[GH-ISSUE #6944] 怎么样才能将ollama打包成应用程序模块,集成到自己的单机软件中 #30155

Closed
opened 2026-04-22 09:38:59 -05:00 by GiteaMirror · 6 comments
Owner

Originally created by @lymgithub on GitHub (Sep 25, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6944

Originally assigned to: @dhiltgen on GitHub.

在windows中现在安装了ollama,也成功部署了千问大模型,如何将现有的环境打包集成到自己的单机软件中呢

Originally created by @lymgithub on GitHub (Sep 25, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6944 Originally assigned to: @dhiltgen on GitHub. 在windows中现在安装了ollama,也成功部署了千问大模型,如何将现有的环境打包集成到自己的单机软件中呢
GiteaMirror added the questionwindows labels 2026-04-22 09:39:00 -05:00
Author
Owner

@gavinwang668 commented on GitHub (Sep 25, 2024):

为啥要打包呢,直接接口调用不好吗

<!-- gh-comment-id:2373177178 --> @gavinwang668 commented on GitHub (Sep 25, 2024): 为啥要打包呢,直接接口调用不好吗
Author
Owner

@dhiltgen commented on GitHub (Sep 25, 2024):

We publish a zip file ollama-windows-amd64.zip with each release. This includes the ollama binary along with the dependencies. It does not include the tray application, so you will need to manage the lifecycle of the server. See https://github.com/ollama/ollama/blob/main/docs/windows.md#standalone-cli

<!-- gh-comment-id:2375155114 --> @dhiltgen commented on GitHub (Sep 25, 2024): We publish a zip file [ollama-windows-amd64.zip](https://github.com/ollama/ollama/releases/download/v0.3.12/ollama-windows-amd64.zip) with each release. This includes the `ollama` binary along with the dependencies. It does not include the tray application, so you will need to manage the lifecycle of the server. See https://github.com/ollama/ollama/blob/main/docs/windows.md#standalone-cli
Author
Owner

@ajmz commented on GitHub (Sep 26, 2024):

We publish a zip file ollama-windows-amd64.zip with each release. This includes the ollama binary along with the dependencies. It does not include the tray application, so you will need to manage the lifecycle of the server. See https://github.com/ollama/ollama/blob/main/docs/windows.md#standalone-cli

"ollama-windows-amd64.zip zip file is available containing only the Ollama CLI and GPU library dependencies for Nvidia and AMD"
It means "CPU only" is not supported by ollama-windows-amd64.zip?

<!-- gh-comment-id:2377738945 --> @ajmz commented on GitHub (Sep 26, 2024): > We publish a zip file [ollama-windows-amd64.zip](https://github.com/ollama/ollama/releases/download/v0.3.12/ollama-windows-amd64.zip) with each release. This includes the `ollama` binary along with the dependencies. It does not include the tray application, so you will need to manage the lifecycle of the server. See https://github.com/ollama/ollama/blob/main/docs/windows.md#standalone-cli "ollama-windows-amd64.zip zip file is available containing only the Ollama CLI and GPU library dependencies for Nvidia and AMD" It means "CPU only" is not supported by ollama-windows-amd64.zip?
Author
Owner

@dhiltgen commented on GitHub (Sep 26, 2024):

The windows zip file contains the following runners cpu_avx2 cuda_v11 cuda_v12 rocm cpu cpu_avx (3 CPU runners, a v11 and v12 cuda runner, and rocm)

<!-- gh-comment-id:2377822887 --> @dhiltgen commented on GitHub (Sep 26, 2024): The windows zip file contains the following runners `cpu_avx2 cuda_v11 cuda_v12 rocm cpu cpu_avx` (3 CPU runners, a v11 and v12 cuda runner, and rocm)
Author
Owner

@ajmz commented on GitHub (Sep 27, 2024):

The windows zip file contains the following runners cpu_avx2 cuda_v11 cuda_v12 rocm cpu cpu_avx (3 CPU runners, a v11 and v12 cuda runner, and rocm)

My ollama-windows-amd64.zip, starting to the steps in the screenshot, kept flashing the cursor and couldn't continue.
What other system configurations should be done in advance?
Thanks.
2024-09-27_14-58-37

<!-- gh-comment-id:2378546004 --> @ajmz commented on GitHub (Sep 27, 2024): > The windows zip file contains the following runners `cpu_avx2 cuda_v11 cuda_v12 rocm cpu cpu_avx` (3 CPU runners, a v11 and v12 cuda runner, and rocm) My ollama-windows-amd64.zip, starting to the steps in the screenshot, kept flashing the cursor and couldn't continue. What other system configurations should be done in advance? Thanks. ![2024-09-27_14-58-37](https://github.com/user-attachments/assets/6439606e-5fd9-4a45-9de0-8f1398222488)
Author
Owner

@dhiltgen commented on GitHub (Sep 30, 2024):

@ajmz Ollama is a client-server architecture. You're running the server in that window. You can now start a client in another terminal and interact with the server. (for example, ollama run llama3.2 )

<!-- gh-comment-id:2384006186 --> @dhiltgen commented on GitHub (Sep 30, 2024): @ajmz Ollama is a client-server architecture. You're running the server in that window. You can now start a client in another terminal and interact with the server. (for example, `ollama run llama3.2` )
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#30155