[GH-ISSUE #766] Release mac and linux binaries alongside the desktop packages #365

Closed
opened 2026-04-12 10:00:29 -05:00 by GiteaMirror · 5 comments
Owner

Originally created by @Clivern on GitHub (Oct 12, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/766

Maybe ollama is intended to be a desktop app but I believe a lot are using it as an API service.

Honestly i couldn't get it to work as desktop app on Intel Mac but works as API service. Assuming the 500% spike in cpu usage is expected with each prompt and model pulling on a decent mac. I guess i need to give it a try on better machine.

Anyways I gave it a try with goreleaser on a fork ef2d0da969.
It failed to publish to github but maybe because it is a fork! I need to debug but are you interested in such a thing?

Also goreleaser doesn't append to the release, it publish the changelog, binaries ... etc but then desktop packages can be added. it sound they are done manually.

Originally created by @Clivern on GitHub (Oct 12, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/766 Maybe ollama is intended to be a desktop app but I believe a lot are using it as an API service. Honestly i couldn't get it to work as desktop app on Intel Mac but works as API service. Assuming the 500% spike in cpu usage is expected with each prompt and model pulling on a decent mac. I guess i need to give it a try on better machine. Anyways I gave it a try with goreleaser on a fork https://github.com/Clivern/ollama/commit/ef2d0da969343ba1d5fef0b8777f5cca056c1be1. It failed to publish to github but maybe because it is a fork! I need to debug but are you interested in such a thing? Also goreleaser doesn't append to the release, it publish the changelog, binaries ... etc but then desktop packages can be added. it sound they are done manually.
Author
Owner

@BruceMacD commented on GitHub (Oct 12, 2023):

Hi @Clivern thanks for putting together that goreleaser configuration. We definitely want people to be able to use Ollama as an API, a lot of the maintainers have built tools on top of the Ollama API also.

We actually do publish the binaries in our Github releases:
https://github.com/jmorganca/ollama/releases

To get the Mac binary download ollama-darwin and make it executable chmod +x ollama-darwin. Then you can run the binary without the app.

The build process for Ollama is a bit more complicated than I have been able to achieve with goreleaser, specifically the Linux release. The Linux build needs to be done on a machine with CUDA libraries available, and on an old libc version for maximum compatibility.

<!-- gh-comment-id:1759751238 --> @BruceMacD commented on GitHub (Oct 12, 2023): Hi @Clivern thanks for putting together that goreleaser configuration. We definitely want people to be able to use Ollama as an API, a lot of the maintainers have built tools on top of the Ollama API also. We actually do publish the binaries in our Github releases: https://github.com/jmorganca/ollama/releases To get the Mac binary download `ollama-darwin` and make it executable `chmod +x ollama-darwin`. Then you can run the binary without the app. The build process for Ollama is a bit more complicated than I have been able to achieve with goreleaser, specifically the Linux release. The Linux build needs to be done on a machine with CUDA libraries available, and on an old `libc` version for maximum compatibility.
Author
Owner

@Clivern commented on GitHub (Oct 12, 2023):

Hi @Clivern thanks for putting together that goreleaser configuration. We definitely want people to be able to use Ollama as an API, a lot of the maintainers have built tools on top of the Ollama API also.

We actually do publish the binaries in our Github releases: https://github.com/jmorganca/ollama/releases

To get the Mac binary download ollama-darwin and make it executable chmod +x ollama-darwin. Then you can run the binary without the app.

The build process for Ollama is a bit more complicated than I have been able to achieve with goreleaser, specifically the Linux release. The Linux build needs to be done on a machine with CUDA libraries available, and on an old libc version for maximum compatibility.

Thanks @BruceMacD! I can confirm that ollama-darwin works.

That solves my issue!

<!-- gh-comment-id:1759928364 --> @Clivern commented on GitHub (Oct 12, 2023): > Hi @Clivern thanks for putting together that goreleaser configuration. We definitely want people to be able to use Ollama as an API, a lot of the maintainers have built tools on top of the Ollama API also. > > We actually do publish the binaries in our Github releases: https://github.com/jmorganca/ollama/releases > > To get the Mac binary download `ollama-darwin` and make it executable `chmod +x ollama-darwin`. Then you can run the binary without the app. > > The build process for Ollama is a bit more complicated than I have been able to achieve with goreleaser, specifically the Linux release. The Linux build needs to be done on a machine with CUDA libraries available, and on an old `libc` version for maximum compatibility. Thanks @BruceMacD! I can confirm that `ollama-darwin` works. That solves my issue!
Author
Owner
<!-- gh-comment-id:1806583552 --> @arran4 commented on GitHub (Nov 11, 2023): @Clivern You need to add: ``` permissions: contents: write ``` to the workflow yaml Details: * https://docs.github.com/en/actions/using-jobs/assigning-permissions-to-jobs * https://docs.github.com/en/rest/overview/permissions-required-for-github-apps?apiVersion=2022-11-28#repository-permissions-for-contents
Author
Owner

@Clivern commented on GitHub (Nov 11, 2023):

@Clivern You need to add:

permissions:
   contents: write

to the workflow yaml

Details:

Yeah it works with that permission 👍

<!-- gh-comment-id:1806880445 --> @Clivern commented on GitHub (Nov 11, 2023): > @Clivern You need to add: > > ``` > permissions: > contents: write > ``` > > to the workflow yaml > > Details: > > * https://docs.github.com/en/actions/using-jobs/assigning-permissions-to-jobs > * https://docs.github.com/en/rest/overview/permissions-required-for-github-apps?apiVersion=2022-11-28#repository-permissions-for-contents Yeah it works with that permission 👍
Author
Owner

@arran4 commented on GitHub (Nov 11, 2023):

Hopefully we see packages soon. Refuse to install via shell scripts, reminds me of corporate unix from the 00s.

<!-- gh-comment-id:1806937786 --> @arran4 commented on GitHub (Nov 11, 2023): Hopefully we see packages soon. Refuse to install via shell scripts, reminds me of corporate unix from the 00s.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#365