[GH-ISSUE #2053] Request -> Remote server deployment tutorial w/ API access for AI apps #1188

New Issue

GiteaMirror · 2026-04-12T10:58:10-05:00

GiteaMirror commented

2026-04-12 10:58:10 -05:00

Originally created by @squatchydev9000 on GitHub (Jan 18, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2053

Hey Ollama team, thx for all that you guys are doing.

Question/Request: can you please demonstrate how we can deploy Ollama to a remote server -> I have using ssh but I cannot, for the life of me, figure out how to build it into an api I can use with autogen/crewai/superagi/etc...

I bet many are also stuck here. Sure we can get things going locally, but almost no one actually owns an m3 mac to run things locally... so local dev is tough... and for production AI apps we need an API solution for a remote Ollama install...

I believe the world needs Ollama and open sourced options more than ever as the big corporations are pushing us towards the abyss... an API/Deployment tutorial or package would be the keystone in protecting humanity from the big corps...

Originally created by @squatchydev9000 on GitHub (Jan 18, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2053 Hey Ollama team, thx for all that you guys are doing. Question/Request: can you please demonstrate how we can deploy Ollama to a remote server -> I have using ssh but I cannot, for the life of me, figure out how to build it into an api I can use with autogen/crewai/superagi/etc... **I bet many are also stuck here**. Sure we can get things going locally, but almost no one actually owns an m3 mac to run things locally... so local dev is tough... and for production AI apps we need an API solution for a remote Ollama install... I believe the world needs Ollama and open sourced options more than ever as the big corporations are pushing us towards the abyss... an API/Deployment tutorial or package would be the keystone in protecting humanity from the big corps...

GiteaMirror closed this issue

2026-04-12 10:58:10 -05:00

GiteaMirror commented

2026-04-12 10:58:10 -05:00

@easp commented on GitHub (Jan 18, 2024):

but almost no one actually owns an m3 mac to run things locally

You don't need a M3, or a Mac to run things locally. Lots of people run Ollama locally on PCs.

If you want to expose the ollama service beyond localhost you can refer to the FAQ. You should be conscious of the fact that the ollama API doesn't have any authentication or encryption, so you'll either want to run it behind a reverse proxy that implements those things or use a VPN (tail scale is easy to set up).

@easp commented on GitHub (Jan 18, 2024): > but almost no one actually owns an m3 mac to run things locally You don't need a M3, or a Mac to run things locally. Lots of people run Ollama locally on PCs. If you want to expose the ollama service beyond localhost you can [refer to the FAQ](https://github.com/jmorganca/ollama/blob/main/docs/faq.md#how-can-i-expose-ollama-on-my-network). You should be conscious of the fact that the ollama API doesn't have any authentication or encryption, so you'll either want to run it behind a reverse proxy that implements those things or use a VPN (tail scale is easy to set up).

GiteaMirror commented

2026-04-12 10:58:11 -05:00

@mxyng commented on GitHub (Jan 18, 2024):

Here's a concrete example of running Ollama in Kubernetes. There are example configurations for both CPU and GPU inference

@mxyng commented on GitHub (Jan 18, 2024): Here's a concrete [example](https://github.com/jmorganca/ollama/tree/main/examples/kubernetes) of running Ollama in Kubernetes. There are example configurations for both CPU and GPU inference

GiteaMirror commented

2026-04-12 10:58:11 -05:00

@squatchydev9000 commented on GitHub (Jan 18, 2024):

thx guys.. i appreciate it. Also posted to 'Matt's" youtube channel... he replied that this is a good idea so here's to hoping for a tutorial direct from the Ollama team. :)
cheers.

@squatchydev9000 commented on GitHub (Jan 18, 2024): thx guys.. i appreciate it. Also posted to 'Matt's" youtube channel... he replied that this is a good idea so here's to hoping for a tutorial direct from the Ollama team. :) cheers.

GiteaMirror commented

2026-04-12 10:58:11 -05:00

@squatchydev9000 commented on GitHub (Jan 19, 2024):

Need to add for clarity -> I am struggling to access my remote serve linux ubuntu ollama install from anything other than ssh.

Need guidance on connecting to my remote linux/ubuntu server... all I have is a public IP... requests time out no matter what different url string I try...

@squatchydev9000 commented on GitHub (Jan 19, 2024): Need to add for clarity -> I am struggling to access my remote serve linux ubuntu ollama install from anything other than ssh. Need guidance on connecting to my remote linux/ubuntu server... all I have is a public IP... requests time out no matter what different url string I try...

GiteaMirror commented

2026-04-12 10:58:11 -05:00

@squatchydev9000 commented on GitHub (Jan 19, 2024):

I am still unable to find a clear set of instructions or a tutorial to connect to the static public IP of my hosted ubuntu/linux Ollama install with anything other than SSH in my terminal...

Anyone have a way to get past the 'Request Timedout' error... or connection advice?

@squatchydev9000 commented on GitHub (Jan 19, 2024): I am still unable to find a clear set of instructions or a tutorial to connect to the static public IP of my hosted ubuntu/linux Ollama install with anything other than SSH in my terminal... Anyone have a way to get past the 'Request Timedout' error... or connection advice?

GiteaMirror commented

2026-04-12 10:58:12 -05:00

@easp commented on GitHub (Jan 19, 2024):

I'd suggest familiarizing yourself more with firewalls and ssh tunneling / port forwarding. Your hosting provider may have some introductory resources.

You really should NOT be exposing services to the internet at large without some understanding of network and system security. SSH tunneling is probably the simplest way to make a remote Ollama install accessible to something running on your local machine.

@easp commented on GitHub (Jan 19, 2024): I'd suggest familiarizing yourself more with firewalls and ssh tunneling / port forwarding. Your hosting provider may have some introductory resources. You really should NOT be exposing services to the internet at large without some understanding of network and system security. SSH tunneling is probably the simplest way to make a remote Ollama install accessible to something running on your local machine.

GiteaMirror commented

2026-04-12 10:58:12 -05:00

@squatchydev9000 commented on GitHub (Jan 19, 2024):

I followed the binding info from the faq.md file for linux to a 't'....

After a few hours and lots of chat-gpt, lots of editing the environment variables... I still have it binding to 127.0.0.1... when it restarts... (shows :: or 0.0.0.0 when checking status after changes and deomon reload etc...

I simply cannot get it to 0.0.0.0...

Is Ollama not suitable as a production ready LLM runner for my apps? is it strictly a tool for running models locally and/or remotely direct to your machine via SSH tunneling?

@squatchydev9000 commented on GitHub (Jan 19, 2024): I followed the binding info from the faq.md file for linux to a 't'.... After a few hours and lots of chat-gpt, lots of editing the environment variables... I still have it binding to 127.0.0.1... when it restarts... (shows :: or 0.0.0.0 when checking status after changes and deomon reload etc... I simply cannot get it to 0.0.0.0... ***Is Ollama not suitable as a production ready LLM runner for my apps?*** is it strictly a tool for running models locally and/or remotely direct to your machine via SSH tunneling?

GiteaMirror commented

2026-04-12 10:58:12 -05:00

@squatchydev9000 commented on GitHub (Jan 19, 2024):

The people need an alternative to open-ai... the only way I see is Ollama so we can utilize open sourced models for various tasks within our AI apps... but ALL attempts to deploy have been a giant waste of time so far...

Has anyone out there successfully deployed Ollama to a remote server for production scalable apps?

@squatchydev9000 commented on GitHub (Jan 19, 2024): The people need an alternative to open-ai... the only way I see is Ollama so we can utilize open sourced models for various tasks within our AI apps... but ALL attempts to deploy have been a giant waste of time so far... Has anyone out there successfully deployed Ollama to a remote server for production scalable apps?

GiteaMirror commented

2026-04-12 10:58:13 -05:00

@easp commented on GitHub (Jan 19, 2024):

Please share the output of sudo netstat -ltnp This will run netstat as superuser and tell netstat to show listening sockets (l) on tcp (t) using numeric representations of IP and port addresses (n) and list the processes behind those listening sockets (p). You can obfuscate any IP addresses you don't want to be public.

@easp commented on GitHub (Jan 19, 2024): Please share the output of `sudo netstat -ltnp` This will run netstat as superuser and tell netstat to show listening sockets (l) on tcp (t) using numeric representations of IP and port addresses (n) and list the processes behind those listening sockets (p). You can obfuscate any IP addresses you don't want to be public.

GiteaMirror commented

2026-04-12 10:58:13 -05:00

@remy415 commented on GitHub (Jan 31, 2024):

@squatchydev9000 The ollama-python repo has a tutorial for interacting with the API using Python, and there's one for JS on their JS repo:

https://github.com/ollama/ollama-python
https://github.com/ollama/ollama-js

They also have REST API documentation:
https://github.com/ollama/ollama/blob/main/docs/api.md

FAQ section covers exposing the interface to remote machines:
https://github.com/ollama/ollama/blob/main/docs/faq.md

Set env variable to tell Ollama which interface to bind on:

OLLAMA_HOST="0.0.0.0"

Can also update the origins:
OLLAMA_ORIGINS="172.16.4.20"

This should allow you to remotely access ollama serve via API. There are a lot of tutorials out there for deploying apps via Docker, Kubernetes, or through API packages such as Flask, FastAPI, Django, etc. Without knowing your current experience level, it would be difficult to point you to an appropriate tutorial/guide. Feel free to reach out if you need hep with anything.

@remy415 commented on GitHub (Jan 31, 2024): @squatchydev9000 The ollama-python repo has a tutorial for interacting with the API using Python, and there's one for JS on their JS repo: https://github.com/ollama/ollama-python https://github.com/ollama/ollama-js They also have REST API documentation: https://github.com/ollama/ollama/blob/main/docs/api.md FAQ section covers exposing the interface to remote machines: https://github.com/ollama/ollama/blob/main/docs/faq.md Set env variable to tell Ollama which interface to bind on: `OLLAMA_HOST="0.0.0.0"` Can also update the origins: `OLLAMA_ORIGINS="172.16.4.20"` This should allow you to remotely access ollama serve via API. There are a lot of tutorials out there for deploying apps via Docker, Kubernetes, or through API packages such as Flask, FastAPI, Django, etc. Without knowing your current experience level, it would be difficult to point you to an appropriate tutorial/guide. Feel free to reach out if you need hep with anything.

GiteaMirror commented

2026-04-12 10:58:13 -05:00

@pdevine commented on GitHub (Mar 11, 2024):

As @remy415 mentioned, you should be able to start the ollama server with the OLLAMA_HOST=0.0.0.0 environment variable. I think the question has been answered, so I'm going to go ahead and close the issue. Please feel free to reopen or just keep commenting.

@pdevine commented on GitHub (Mar 11, 2024): As @remy415 mentioned, you should be able to start the ollama server with the `OLLAMA_HOST=0.0.0.0` environment variable. I _think_ the question has been answered, so I'm going to go ahead and close the issue. Please feel free to reopen or just keep commenting.

GiteaMirror commented

2026-04-12 10:58:13 -05:00

@danielbisca commented on GitHub (Apr 7, 2024):

Helllo, i also had the same problem. Installed Ollama on a dedicated VM (cpu only) then was struggling with api requests (crewai etc) from the other machines on the internal network.

The solution is pretty simple tho: need to log to the hosted server and once the models are running type:

export OPENAI_API_BASE=http://localhost:11434/v1
i user also SerperDev since no luck with DuckDuckGo and did the same:
export SERPERAPI_KEY=your_serperkey

on the code part i have :

from langchain_openai import ChatOpenAI

from crewai_tools import SerperDevTool
os.environ["SERPER_API_KEY"] = "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxc"

search_tool = SerperDevTool()

gemma2b=ChatOpenAI(
openai_api_base='http://192.168.0.15:11434/v1', # ip of the ollama server
openai_api_key='NA',
model_name='gemma:2b'
)

@danielbisca commented on GitHub (Apr 7, 2024): Helllo, i also had the same problem. Installed Ollama on a dedicated VM (cpu only) then was struggling with api requests (crewai etc) from the other machines on the internal network. The solution is pretty simple tho: need to log to the hosted server and once the models are running type: export OPENAI_API_BASE=http://localhost:11434/v1 i user also SerperDev since no luck with DuckDuckGo and did the same: export SERPERAPI_KEY=your_serperkey on the code part i have : ****************************************************************************************** from langchain_openai import ChatOpenAI from crewai_tools import SerperDevTool os.environ["SERPER_API_KEY"] = "xxxxxxxxxxxxxxxxxxxxxxxxxxxxxc" search_tool = SerperDevTool() gemma2b=ChatOpenAI( openai_api_base='http://192.168.0.15:11434/v1', # ip of the ollama server openai_api_key='NA', model_name='gemma:2b' ) ******************************************************************************

GiteaMirror commented

2026-04-12 10:58:14 -05:00

@scattter commented on GitHub (Apr 9, 2024):

@squatchydev9000 The ollama-python repo has a tutorial for interacting with the API using Python, and there's one for JS on their JS repo:

https://github.com/ollama/ollama-python https://github.com/ollama/ollama-js

They also have REST API documentation: https://github.com/ollama/ollama/blob/main/docs/api.md

FAQ section covers exposing the interface to remote machines: https://github.com/ollama/ollama/blob/main/docs/faq.md

Set env variable to tell Ollama which interface to bind on:

OLLAMA_HOST="0.0.0.0"

Can also update the origins: OLLAMA_ORIGINS="172.16.4.20"

This should allow you to remotely access ollama serve via API. There are a lot of tutorials out there for deploying apps via Docker, Kubernetes, or through API packages such as Flask, FastAPI, Django, etc. Without knowing your current experience level, it would be difficult to point you to an appropriate tutorial/guide. Feel free to reach out if you need hep with anything.

very useful!

@scattter commented on GitHub (Apr 9, 2024): > @squatchydev9000 The ollama-python repo has a tutorial for interacting with the API using Python, and there's one for JS on their JS repo: > > https://github.com/ollama/ollama-python https://github.com/ollama/ollama-js > > They also have REST API documentation: https://github.com/ollama/ollama/blob/main/docs/api.md > > FAQ section covers exposing the interface to remote machines: https://github.com/ollama/ollama/blob/main/docs/faq.md > > Set env variable to tell Ollama which interface to bind on: > > `OLLAMA_HOST="0.0.0.0"` > > Can also update the origins: `OLLAMA_ORIGINS="172.16.4.20"` > > This should allow you to remotely access ollama serve via API. There are a lot of tutorials out there for deploying apps via Docker, Kubernetes, or through API packages such as Flask, FastAPI, Django, etc. Without knowing your current experience level, it would be difficult to point you to an appropriate tutorial/guide. Feel free to reach out if you need hep with anything. very useful!

GiteaMirror commented

2026-04-12 10:58:14 -05:00

@DOMINION-JOHN1 commented on GitHub (May 29, 2024):

Hey Ollama team, thx for all that you guys are doing.

Question/Request: can you please demonstrate how we can deploy Ollama to a remote server -> I have using ssh but I cannot, for the life of me, figure out how to build it into an api I can use with autogen/crewai/superagi/etc...

I bet many are also stuck here. Sure we can get things going locally, but almost no one actually owns an m3 mac to run things locally... so local dev is tough... and for production AI apps we need an API solution for a remote Ollama install...

I believe the world needs Ollama and open sourced options more than ever as the big corporations are pushing us towards the abyss... an API/Deployment tutorial or package would be the keystone in protecting humanity from the big corps...

very true i have same issue here , for any pc to run ollama locally, the system should be atleast to a very extent a bit powerful

@DOMINION-JOHN1 commented on GitHub (May 29, 2024): > Hey Ollama team, thx for all that you guys are doing. > > Question/Request: can you please demonstrate how we can deploy Ollama to a remote server -> I have using ssh but I cannot, for the life of me, figure out how to build it into an api I can use with autogen/crewai/superagi/etc... > > **I bet many are also stuck here**. Sure we can get things going locally, but almost no one actually owns an m3 mac to run things locally... so local dev is tough... and for production AI apps we need an API solution for a remote Ollama install... > > I believe the world needs Ollama and open sourced options more than ever as the big corporations are pushing us towards the abyss... an API/Deployment tutorial or package would be the keystone in protecting humanity from the big corps... very true i have same issue here , for any pc to run ollama locally, the system should be atleast to a very extent a bit powerful

GiteaMirror commented

2026-04-12 10:58:14 -05:00

@DOMINION-JOHN1 commented on GitHub (May 29, 2024):

I love how easy it is to use ollama locally i do wish same can be available for production deployment jus as OpenAi HAS IT BY JUST CALLING THEIR API

@DOMINION-JOHN1 commented on GitHub (May 29, 2024): I love how easy it is to use ollama locally i do wish same can be available for production deployment jus as OpenAi HAS IT BY JUST CALLING THEIR API

GiteaMirror referenced this issue

2026-04-22 02:37:01 -05:00

[GH-ISSUE #1188] Enhancement Request: Network-Distributed Inference(NDI) and Intuitive Resource Sharing #26365

GiteaMirror referenced this issue

2026-04-28 03:17:18 -05:00

[GH-ISSUE #1188] Enhancement Request: Network-Distributed Inference(NDI) and Intuitive Resource Sharing #47116

GiteaMirror referenced this issue

2026-05-03 09:51:25 -05:00

[GH-ISSUE #1188] Enhancement Request: Network-Distributed Inference(NDI) and Intuitive Resource Sharing #62641

Sign in to join this conversation.

Branches Tags

main

hoyyeva/anthropic-local-image-path

dhiltgen/ci

dhiltgen/llama-runner

parth-remove-claude-desktop-launch

hoyyeva/anthropic-reference-images-path

parth-anthropic-reference-images-path

brucemacd/download-before-remove

hoyyeva/editor-config-repair

parth-mlx-decode-checkpoints

parth-launch-codex-app

hoyyeva/fix-codex-model-metadata-warning

hoyyeva/qwen

parth/hide-claude-desktop-till-release

hoyyeva/opencode-image-modality

parth-add-claude-code-autoinstall

release_v0.22.0

pdevine/manifest-list

codex/fix-codex-model-metadata-warning

pdevine/addressable-manifest

brucemacd/launch-fetch-reccomended

jmorganca/llama-compat

launch-copilot-cli

hoyyeva/opencode-thinking

release_v0.20.7

parth-auto-save-backup

parth-test

jmorganca/gemma4-audio-replacements

fix-manifest-digest-on-pull

hoyyeva/vscode-improve

brucemacd/install-server-wait

parth/update-claude-docs

brucemac/start-ap-install

pdevine/mlx-update

pdevine/qwen35_vision

drifkin/api-show-fallback

mintlify/image-generation-1773352582

hoyyeva/server-context-length-local-config

jmorganca/faster-reptition-penalties

jmorganca/convert-nemotron

parth-pi-thinking

pdevine/sampling-penalties

jmorganca/fix-create-quantization-memory

dongchen/resumable_transfer_fix

pdevine/sampling-cache-error

jessegross/mlx-usage

hoyyeva/openclaw-config

hoyyeva/app-html

pdevine/qwen3next

brucemacd/sign-sh-install

brucemacd/tui-update

brucemacd/usage-api

jmorganca/launch-empty

fix-app-dist-embed

mxyng/mlx-compile

mxyng/mlx-quant

mxyng/mlx-glm4.7

mxyng/mlx

brucemacd/simplify-model-picker

jmorganca/qwen3-concurrent

fix-glm-4.7-flash-mla-config

drifkin/qwen3-coder-opening-tag

brucemacd/usage-cli

fix-cuda12-fattn-shmem

ollama-imagegen-docs

parth/fix-multiline-inputs

brucemacd/config-docs

mxyng/model-files

mxyng/simple-execute

fix-imagegen-ollama-models

mxyng/async-upload

jmorganca/lazy-no-dtype-changes

imagegen-auto-detect-create

parth/decrease-concurrent-download-hf

fix-mlx-quantize-init

jmorganca/x-cleanup

usage

imagegen-readme

jmorganca/glm-image

mlx-gpu-cd

jmorganca/imagegen-modelfile

parth/agent-skills

parth/agent-allowlist

parth/signed-in-offline

parth/agents

parth/fix-context-chopping

improve-cloud-flow

parth/add-models-websearch

parth/prompt-renderer-mcp

jmorganca/native-settings

jmorganca/download-stream-hash

jmorganca/client2-rebased

brucemacd/oai-chat-req-multipart

jessegross/multi_chunk_reserve

grace/additional-omit-empty

grace/mistral-3-large

mxyng/tokenizer2

mxyng/tokenizer

jessegross/flash

hoyyeva/windows-nacked-app

mxyng/cleanup-attention

grace/deepseek-parser

hoyyeva/remember-unsent-prompt

parth/add-lfs-pointer-error-conversion

parth/olmo2-test2

hoyyeva/ollama-launchagent-plist

nicole/olmo-model

parth/olmo-test

mxyng/remove-embedded

parth/render-template

jmorganca/intellect-3

parth/remove-prealloc-linter

jmorganca/cmd-eval

nicole/nomic-embed-text-fix

mxyng/lint-2

hoyyeva/add-gemini-3-pro-preview

hoyyeva/load-model-list

mxyng/expand-path

mxyng/environ-2

hoyyeva/deeplink-json-encoding

parth/improve-tool-calling-tests

hoyyeva/conversation

hoyyeva/assistant-edit-response

hoyyeva/thinking

origin/brucemacd/invalid-char-i-err

parth/improve-tool-calling

jmorganca/required-omitempty

grace/qwen3-vl-tests

mxyng/iter-client

parth/docs-readme

nicole/embed-test

pdevine/integration-benchstat

parth/remove-generate-cmd

parth/add-toolcall-id

mxyng/server-tests

jmorganca/glm-4.6

jmorganca/gin-h-compat

drifkin/stable-tool-args

pdevine/qwen3-more-thinking

parth/add-websearch-client

nicole/websearch_local

jmorganca/qwen3-coder-updates

grace/deepseek-v3-migration-tests

mxyng/fix-create

jmorganca/cloud-errors

pdevine/parser-tidy

revert-12233-parth/simplify-entrypoints-runner

parth/enable-so-gpt-oss

brucemacd/qwen3vl

jmorganca/readme-simplify

parth/gpt-oss-structured-outputs

revert-12039-jmorganca/tools-braces

mxyng/embeddings

mxyng/gguf

mxyng/benchmark

mxyng/types-null

parth/move-parsing

mxyng/gemma2

jmorganca/docs

mxyng/16-bit

mxyng/create-stdin

pdevine/authorizedkeys

mxyng/quant

parth/opt-in-error-context-window

brucemacd/cache-models

brucemacd/runner-completion

jmorganca/llama-update-6

brucemacd/benchmark-list

brucemacd/partial-read-caps

parth/deepseek-r1-tools

mxyng/omit-array

parth/tool-prefix-temp

brucemacd/runner-test

jmorganca/qwen25vl

brucemacd/model-forward-test-ext

parth/python-function-parsing

jmorganca/cuda-compression-none

drifkin/num-parallel

drifkin/chat-truncation-fix

jmorganca/sync

parth/python-tools-calling

drifkin/array-head-count

brucemacd/create-no-loop

parth/server-enable-content-stream-with-tools

qwen25omni

mxyng/v3

brucemacd/ropeconfig

jmorganca/silence-tokenizer

parth/sample-so-test

parth/sampling-structured-outputs

brucemacd/doc-go-engine

parth/constrained-sampling-json

jmorganca/mistral-wip

brucemacd/mistral-small-convert

parth/sample-unmarshal-json-for-params

brucemacd/jomorganca/mistral

pdevine/bfloat16

jmorganca/mistral

brucemacd/mistral

pdevine/logging

parth/sample-correctness-fix

parth/sample-fix-sorting

jmorgan/sample-fix-sorting-extras

jmorganca/temp-0-images

brucemacd/parallel-embed-models

brucemacd/shim-grammar

jmorganca/fix-gguf-error

bmizerany/nameswork

jmorganca/faster-releases

bmizerany/validatenames

brucemacd/err-no-vocab

brucemacd/rope-config

brucemacd/err-hint

brucemacd/qwen2_5

brucemacd/logprobs

brucemacd/new_runner_graph_bench

progress-flicker

brucemacd/forward-test

brucemacd/go_qwen2

pdevine/gemma2

jmorganca/add-missing-symlink-eval

mxyng/next-debug

parth/set-context-size-openai

brucemacd/next-bpe-bench

brucemacd/next-bpe-test

brucemacd/new_runner_e2e

brucemacd/new_runner_qwen2

pdevine/convert-cohere2

brucemacd/convert-cli

parth/log-probs

mxyng/next-mlx

mxyng/cmd-history

parth/templating

parth/tokenize-detokenize

brucemacd/check-key-register

bmizerany/grammar

jmorganca/vendor-081b29bd

mxyng/func-checks

jmorganca/fix-null-format

parth/fix-default-to-warn-json

jmorganca/qwen2vl

jmorganca/no-concat

parth/cmd-cleanup-SO

brucemacd/check-key-register-structured-err

parth/openai-stream-usage

parth/fix-referencing-so

stream-tools-stop

jmorganca/degin-1

brucemacd/install-path-clean

brucemacd/push-name-validation

brucemacd/browser-key-register

jmorganca/openai-fix-first-message

jmorganca/fix-proxy

jessegross/sample

parth/disallow-streaming-tools

dhiltgen/remove_submodule

jmorganca/ga

jmorganca/mllama

pdevine/newlines

pdevine/geems-2b

jmorganca/llama-bump

mxyng/modelname-7

mxyng/gin-slog

mxyng/modelname-6

jyan/convert-prog

jyan/quant5

paligemma-support

pdevine/import-docs

jmorganca/openai-context

jyan/paligemma

jyan/p2

jyan/palitest

bmizerany/embedspeedup

jmorganca/llama-vit

brucemacd/allow-ollama

royh/ep-methods

royh/whisper

mxyng/api-models

mxyng/fix-memory

jyan/q4_4/8

jyan/ollama-v

royh/stream-tools

roy-embed-parallel

bmizerany/hrm

revert-5963-revert-5924-mxyng/llama3.1-rope

royh/embed-viz

jyan/local2

jyan/auth

jyan/local

jyan/parse-temp

jmorganca/template-mistral

jyan/reord-g

royh-openai-suffixdocs

royh-imgembed

royh-embed-parallel

jyan/quant4

royh-precision

jyan/progress

pdevine/fix-template

jyan/quant3

pdevine/ggla

mxyng/update-registry-domain

jmorganca/ggml-static

mxyng/create-context

jyan/v0.146

mxyng/layers-from-files

build_dist

bmizerany/noseek

royh-ls

royh-name

timeout

mxyng/server-timestamp

bmizerany/nosillyggufslurps

royh-params

jmorganca/llama-cpp-7c26775

royh-openai-delete

royh-show-rigid

jmorganca/enable-fa

jmorganca/no-error-template

jyan/format

royh-testdelete

bmizerany/fastverify

language_support

pdevine/ps-glitches

brucemacd/tokenize

bruce/iq-quants

bmizerany/filepathwithcoloninhost

mxyng/split-bin

bmizerany/client-registry

jmorganca/if-none-match

native

jmorganca/native

jmorganca/batch-embeddings

jmorganca/initcmake

jmorganca/mm

pdevine/showggmlinfo

modenameenforcealphanum

bmizerany/modenameenforcealphanum

jmorganca/done-reason

jmorganca/llama-cpp-8960fe8

ollama.com

bmizerany/filepathnobuild

bmizerany/types/model/defaultfix

rmdisplaylong

nogogen

bmizerany/x

modelfile-readme

bmizerany/replacecolon

jmorganca/limit

jmorganca/execstack

jmorganca/replace-assets

mxyng/tune-concurrency

jmorganca/testing

whitespace-detection

jmorganca/options

upgrade-all

scratch

cuda-search

mattw/airenamer

mattw/allmodelsonhuggingface

mattw/quantcontext

mattw/whatneedstorun

brucemacd/llama-mem-calc

mattw/faq-context

mattw/communitylinks

mattw/noprune

mattw/python-functioncalling

rename

mxyng/install

pulse

remove-first

editor

mattw/selfqueryingretrieval

cgo

mattw/howtoquant

api

matt/streamingapi

format-config

mxyng/extra-args

shell

update-nous-hermes

cp-model

upload-progress

fix-unknown-model

fix-model-names

delete-fix

insecure-registry

ls

deletemodels

progressbar

readme-updates

license-layers

skip-list

list-models

modelpath

matt/examplemodelfiles

distribution

go-opts

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/ollama#1188