[GH-ISSUE #2704] Embedding usage without starting a server #1616

Closed
opened 2026-04-12 11:32:53 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @linonetwo on GitHub (Feb 23, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2704

So we can use it in nodejs worker_thread without starting a server, and I/O with FFI instead!

Originally created by @linonetwo on GitHub (Feb 23, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2704 So we can use it in nodejs worker_thread without starting a server, and I/O with FFI instead!
Author
Owner

@mitar commented on GitHub (Feb 25, 2024):

I am not sure about using it from nodejs, but I am curious if there is an example how to use it from a Go program directly.

<!-- gh-comment-id:1962872761 --> @mitar commented on GitHub (Feb 25, 2024): I am not sure about using it from nodejs, but I am curious if there is an example how to use it from a Go program directly.
Author
Owner

@jmorganca commented on GitHub (Mar 13, 2024):

Hi there, sorry this isn't possible today with Ollama. It's something we're thinking about making possible with the Javascript and Python libraries, but haven't started building that yet. Would it be possible to create an issue on that repo? Thanks so much

<!-- gh-comment-id:1993354477 --> @jmorganca commented on GitHub (Mar 13, 2024): Hi there, sorry this isn't possible today with Ollama. It's something we're thinking about making possible with the [Javascript](https://github.com/ollama/ollama-js) and [Python](https://github.com/ollama/ollama-python) libraries, but haven't started building that yet. Would it be possible to create an issue on that repo? Thanks so much
Author
Owner

@mitar commented on GitHub (Mar 13, 2024):

I would like to do it with Go. So I think this issue here should then be for tracking enabling Go embedding?

I was looking into this a bit and I think it could work with a bit of reorganizing, so that generate is called by Go to generate the .a file which then is should be found by a sub-package's go:embed.

<!-- gh-comment-id:1993684737 --> @mitar commented on GitHub (Mar 13, 2024): I would like to do it with Go. So I think this issue here should then be for tracking enabling Go embedding? I was looking into this a bit and I think it could work with a bit of reorganizing, so that generate is called by Go to generate the .a file which then is should be found by a sub-package's `go:embed`.
Author
Owner

@pushangupta commented on GitHub (Jan 4, 2025):

Hi. Do you know if this is available? If we can use the embedding functions without a server that'd be great.

<!-- gh-comment-id:2571406513 --> @pushangupta commented on GitHub (Jan 4, 2025): Hi. Do you know if this is available? If we can use the embedding functions without a server that'd be great.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#1616