mirror of
https://github.com/ollama/ollama.git
synced 2026-05-06 08:02:14 -05:00
Closed
opened 2026-04-28 05:06:54 -05:00 by GiteaMirror
·
28 comments
No Branch/Tag Specified
main
parth-mlx-decode-checkpoints
dhiltgen/ci
hoyyeva/editor-config-repair
parth-launch-codex-app
hoyyeva/fix-codex-model-metadata-warning
hoyyeva/qwen
hoyyeva/launch-backup-ux
parth/hide-claude-desktop-till-release
hoyyeva/opencode-image-modality
parth-add-claude-code-autoinstall
release_v0.22.0
pdevine/manifest-list
codex/fix-codex-model-metadata-warning
pdevine/addressable-manifest
brucemacd/launch-fetch-reccomended
jmorganca/llama-compat
launch-copilot-cli
hoyyeva/opencode-thinking
release_v0.20.7
parth-auto-save-backup
parth-test
jmorganca/gemma4-audio-replacements
fix-manifest-digest-on-pull
hoyyeva/vscode-improve
brucemacd/install-server-wait
brucemacd/download-before-remove
parth/update-claude-docs
parth-anthropic-reference-images-path
brucemac/start-ap-install
pdevine/mlx-update
pdevine/qwen35_vision
drifkin/api-show-fallback
mintlify/image-generation-1773352582
hoyyeva/server-context-length-local-config
jmorganca/faster-reptition-penalties
jmorganca/convert-nemotron
parth-pi-thinking
pdevine/sampling-penalties
jmorganca/fix-create-quantization-memory
dongchen/resumable_transfer_fix
pdevine/sampling-cache-error
jessegross/mlx-usage
hoyyeva/openclaw-config
hoyyeva/app-html
pdevine/qwen3next
brucemacd/sign-sh-install
brucemacd/tui-update
brucemacd/usage-api
jmorganca/launch-empty
fix-app-dist-embed
mxyng/mlx-compile
mxyng/mlx-quant
mxyng/mlx-glm4.7
mxyng/mlx
brucemacd/simplify-model-picker
jmorganca/qwen3-concurrent
fix-glm-4.7-flash-mla-config
drifkin/qwen3-coder-opening-tag
brucemacd/usage-cli
fix-cuda12-fattn-shmem
ollama-imagegen-docs
parth/fix-multiline-inputs
brucemacd/config-docs
mxyng/model-files
mxyng/simple-execute
fix-imagegen-ollama-models
mxyng/async-upload
jmorganca/lazy-no-dtype-changes
imagegen-auto-detect-create
parth/decrease-concurrent-download-hf
fix-mlx-quantize-init
jmorganca/x-cleanup
usage
imagegen-readme
jmorganca/glm-image
mlx-gpu-cd
jmorganca/imagegen-modelfile
parth/agent-skills
parth/agent-allowlist
parth/signed-in-offline
parth/agents
parth/fix-context-chopping
improve-cloud-flow
parth/add-models-websearch
parth/prompt-renderer-mcp
jmorganca/native-settings
jmorganca/download-stream-hash
jmorganca/client2-rebased
brucemacd/oai-chat-req-multipart
jessegross/multi_chunk_reserve
grace/additional-omit-empty
grace/mistral-3-large
mxyng/tokenizer2
mxyng/tokenizer
jessegross/flash
hoyyeva/windows-nacked-app
mxyng/cleanup-attention
grace/deepseek-parser
hoyyeva/remember-unsent-prompt
parth/add-lfs-pointer-error-conversion
parth/olmo2-test2
hoyyeva/ollama-launchagent-plist
nicole/olmo-model
parth/olmo-test
mxyng/remove-embedded
parth/render-template
jmorganca/intellect-3
parth/remove-prealloc-linter
jmorganca/cmd-eval
nicole/nomic-embed-text-fix
mxyng/lint-2
hoyyeva/add-gemini-3-pro-preview
hoyyeva/load-model-list
mxyng/expand-path
mxyng/environ-2
hoyyeva/deeplink-json-encoding
parth/improve-tool-calling-tests
hoyyeva/conversation
hoyyeva/assistant-edit-response
hoyyeva/thinking
origin/brucemacd/invalid-char-i-err
parth/improve-tool-calling
jmorganca/required-omitempty
grace/qwen3-vl-tests
mxyng/iter-client
parth/docs-readme
nicole/embed-test
pdevine/integration-benchstat
parth/remove-generate-cmd
parth/add-toolcall-id
mxyng/server-tests
jmorganca/glm-4.6
jmorganca/gin-h-compat
drifkin/stable-tool-args
pdevine/qwen3-more-thinking
parth/add-websearch-client
nicole/websearch_local
jmorganca/qwen3-coder-updates
grace/deepseek-v3-migration-tests
mxyng/fix-create
jmorganca/cloud-errors
pdevine/parser-tidy
revert-12233-parth/simplify-entrypoints-runner
parth/enable-so-gpt-oss
brucemacd/qwen3vl
jmorganca/readme-simplify
parth/gpt-oss-structured-outputs
revert-12039-jmorganca/tools-braces
mxyng/embeddings
mxyng/gguf
mxyng/benchmark
mxyng/types-null
parth/move-parsing
mxyng/gemma2
jmorganca/docs
mxyng/16-bit
mxyng/create-stdin
pdevine/authorizedkeys
mxyng/quant
parth/opt-in-error-context-window
brucemacd/cache-models
brucemacd/runner-completion
jmorganca/llama-update-6
brucemacd/benchmark-list
brucemacd/partial-read-caps
parth/deepseek-r1-tools
mxyng/omit-array
parth/tool-prefix-temp
brucemacd/runner-test
jmorganca/qwen25vl
brucemacd/model-forward-test-ext
parth/python-function-parsing
jmorganca/cuda-compression-none
drifkin/num-parallel
drifkin/chat-truncation-fix
jmorganca/sync
parth/python-tools-calling
drifkin/array-head-count
brucemacd/create-no-loop
parth/server-enable-content-stream-with-tools
qwen25omni
mxyng/v3
brucemacd/ropeconfig
jmorganca/silence-tokenizer
parth/sample-so-test
parth/sampling-structured-outputs
brucemacd/doc-go-engine
parth/constrained-sampling-json
jmorganca/mistral-wip
brucemacd/mistral-small-convert
parth/sample-unmarshal-json-for-params
brucemacd/jomorganca/mistral
pdevine/bfloat16
jmorganca/mistral
brucemacd/mistral
pdevine/logging
parth/sample-correctness-fix
parth/sample-fix-sorting
jmorgan/sample-fix-sorting-extras
jmorganca/temp-0-images
brucemacd/parallel-embed-models
brucemacd/shim-grammar
jmorganca/fix-gguf-error
bmizerany/nameswork
jmorganca/faster-releases
bmizerany/validatenames
brucemacd/err-no-vocab
brucemacd/rope-config
brucemacd/err-hint
brucemacd/qwen2_5
brucemacd/logprobs
brucemacd/new_runner_graph_bench
progress-flicker
brucemacd/forward-test
brucemacd/go_qwen2
pdevine/gemma2
jmorganca/add-missing-symlink-eval
mxyng/next-debug
parth/set-context-size-openai
brucemacd/next-bpe-bench
brucemacd/next-bpe-test
brucemacd/new_runner_e2e
brucemacd/new_runner_qwen2
pdevine/convert-cohere2
brucemacd/convert-cli
parth/log-probs
mxyng/next-mlx
mxyng/cmd-history
parth/templating
parth/tokenize-detokenize
brucemacd/check-key-register
bmizerany/grammar
jmorganca/vendor-081b29bd
mxyng/func-checks
jmorganca/fix-null-format
parth/fix-default-to-warn-json
jmorganca/qwen2vl
jmorganca/no-concat
parth/cmd-cleanup-SO
brucemacd/check-key-register-structured-err
parth/openai-stream-usage
parth/fix-referencing-so
stream-tools-stop
jmorganca/degin-1
brucemacd/install-path-clean
brucemacd/push-name-validation
brucemacd/browser-key-register
jmorganca/openai-fix-first-message
jmorganca/fix-proxy
jessegross/sample
parth/disallow-streaming-tools
dhiltgen/remove_submodule
jmorganca/ga
jmorganca/mllama
pdevine/newlines
pdevine/geems-2b
jmorganca/llama-bump
mxyng/modelname-7
mxyng/gin-slog
mxyng/modelname-6
jyan/convert-prog
jyan/quant5
paligemma-support
pdevine/import-docs
jmorganca/openai-context
jyan/paligemma
jyan/p2
jyan/palitest
bmizerany/embedspeedup
jmorganca/llama-vit
brucemacd/allow-ollama
royh/ep-methods
royh/whisper
mxyng/api-models
mxyng/fix-memory
jyan/q4_4/8
jyan/ollama-v
royh/stream-tools
roy-embed-parallel
bmizerany/hrm
revert-5963-revert-5924-mxyng/llama3.1-rope
royh/embed-viz
jyan/local2
jyan/auth
jyan/local
jyan/parse-temp
jmorganca/template-mistral
jyan/reord-g
royh-openai-suffixdocs
royh-imgembed
royh-embed-parallel
jyan/quant4
royh-precision
jyan/progress
pdevine/fix-template
jyan/quant3
pdevine/ggla
mxyng/update-registry-domain
jmorganca/ggml-static
mxyng/create-context
jyan/v0.146
mxyng/layers-from-files
build_dist
bmizerany/noseek
royh-ls
royh-name
timeout
mxyng/server-timestamp
bmizerany/nosillyggufslurps
royh-params
jmorganca/llama-cpp-7c26775
royh-openai-delete
royh-show-rigid
jmorganca/enable-fa
jmorganca/no-error-template
jyan/format
royh-testdelete
bmizerany/fastverify
language_support
pdevine/ps-glitches
brucemacd/tokenize
bruce/iq-quants
bmizerany/filepathwithcoloninhost
mxyng/split-bin
bmizerany/client-registry
jmorganca/if-none-match
native
jmorganca/native
jmorganca/batch-embeddings
jmorganca/initcmake
jmorganca/mm
pdevine/showggmlinfo
modenameenforcealphanum
bmizerany/modenameenforcealphanum
jmorganca/done-reason
jmorganca/llama-cpp-8960fe8
ollama.com
bmizerany/filepathnobuild
bmizerany/types/model/defaultfix
rmdisplaylong
nogogen
bmizerany/x
modelfile-readme
bmizerany/replacecolon
jmorganca/limit
jmorganca/execstack
jmorganca/replace-assets
mxyng/tune-concurrency
jmorganca/testing
whitespace-detection
jmorganca/options
upgrade-all
scratch
cuda-search
mattw/airenamer
mattw/allmodelsonhuggingface
mattw/quantcontext
mattw/whatneedstorun
brucemacd/llama-mem-calc
mattw/faq-context
mattw/communitylinks
mattw/noprune
mattw/python-functioncalling
rename
mxyng/install
pulse
remove-first
editor
mattw/selfqueryingretrieval
cgo
mattw/howtoquant
api
matt/streamingapi
format-config
mxyng/extra-args
shell
update-nous-hermes
cp-model
upload-progress
fix-unknown-model
fix-model-names
delete-fix
insecure-registry
ls
deletemodels
progressbar
readme-updates
license-layers
skip-list
list-models
modelpath
matt/examplemodelfiles
distribution
go-opts
v0.23.1
v0.23.1-rc0
v0.23.0
v0.23.0-rc0
v0.22.1
v0.22.1-rc1
v0.22.1-rc0
v0.22.0
v0.22.0-rc1
v0.21.3-rc0
v0.21.2-rc1
v0.21.2
v0.21.2-rc0
v0.21.1
v0.21.1-rc1
v0.21.1-rc0
v0.21.0
v0.21.0-rc1
v0.21.0-rc0
v0.20.8-rc0
v0.20.7
v0.20.7-rc1
v0.20.7-rc0
v0.20.6
v0.20.6-rc1
v0.20.6-rc0
v0.20.5
v0.20.5-rc2
v0.20.5-rc1
v0.20.5-rc0
v0.20.4
v0.20.4-rc2
v0.20.4-rc1
v0.20.4-rc0
v0.20.3
v0.20.3-rc0
v0.20.2
v0.20.1
v0.20.1-rc2
v0.20.1-rc1
v0.20.1-rc0
v0.20.0
v0.20.0-rc1
v0.20.0-rc0
v0.19.0
v0.19.0-rc2
v0.19.0-rc1
v0.19.0-rc0
v0.18.4-rc1
v0.18.4-rc0
v0.18.3
v0.18.3-rc2
v0.18.3-rc1
v0.18.3-rc0
v0.18.2
v0.18.2-rc1
v0.18.2-rc0
v0.18.1
v0.18.1-rc1
v0.18.1-rc0
v0.18.0
v0.18.0-rc2
v0.18.0-rc1
v0.18.0-rc0
v0.17.8-rc4
v0.17.8-rc3
v0.17.8-rc2
v0.17.8-rc1
v0.17.8-rc0
v0.17.7
v0.17.7-rc2
v0.17.7-rc1
v0.17.7-rc0
v0.17.6
v0.17.5
v0.17.4
v0.17.3
v0.17.2
v0.17.1
v0.17.1-rc2
v0.17.1-rc1
v0.17.1-rc0
v0.17.0
v0.17.0-rc2
v0.17.0-rc1
v0.17.0-rc0
v0.16.3
v0.16.3-rc2
v0.16.3-rc1
v0.16.3-rc0
v0.16.2
v0.16.2-rc0
v0.16.1
v0.16.0
v0.16.0-rc2
v0.16.0-rc0
v0.16.0-rc1
v0.15.6
v0.15.5
v0.15.5-rc5
v0.15.5-rc4
v0.15.5-rc3
v0.15.5-rc2
v0.15.5-rc1
v0.15.5-rc0
v0.15.4
v0.15.3
v0.15.2
v0.15.1
v0.15.1-rc1
v0.15.1-rc0
v0.15.0-rc6
v0.15.0
v0.15.0-rc5
v0.15.0-rc4
v0.15.0-rc3
v0.15.0-rc2
v0.15.0-rc1
v0.15.0-rc0
v0.14.3
v0.14.3-rc3
v0.14.3-rc2
v0.14.3-rc1
v0.14.3-rc0
v0.14.2
v0.14.2-rc1
v0.14.2-rc0
v0.14.1
v0.14.0-rc11
v0.14.0
v0.14.0-rc10
v0.14.0-rc9
v0.14.0-rc8
v0.14.0-rc7
v0.14.0-rc6
v0.14.0-rc5
v0.14.0-rc4
v0.14.0-rc3
v0.14.0-rc2
v0.14.0-rc1
v0.14.0-rc0
v0.13.5
v0.13.5-rc1
v0.13.5-rc0
v0.13.4-rc2
v0.13.4
v0.13.4-rc1
v0.13.4-rc0
v0.13.3
v0.13.3-rc1
v0.13.3-rc0
v0.13.2
v0.13.2-rc2
v0.13.2-rc1
v0.13.2-rc0
v0.13.1
v0.13.1-rc2
v0.13.1-rc1
v0.13.1-rc0
v0.13.0
v0.13.0-rc0
v0.12.11
v0.12.11-rc1
v0.12.11-rc0
v0.12.10
v0.12.10-rc1
v0.12.10-rc0
v0.12.9-rc0
v0.12.9
v0.12.8
v0.12.8-rc0
v0.12.7
v0.12.7-rc1
v0.12.7-rc0
v0.12.7-citest0
v0.12.6
v0.12.6-rc1
v0.12.6-rc0
v0.12.5
v0.12.5-rc0
v0.12.4
v0.12.4-rc7
v0.12.4-rc6
v0.12.4-rc5
v0.12.4-rc4
v0.12.4-rc3
v0.12.4-rc2
v0.12.4-rc1
v0.12.4-rc0
v0.12.3
v0.12.2
v0.12.2-rc0
v0.12.1
v0.12.1-rc1
v0.12.1-rc2
v0.12.1-rc0
v0.12.0
v0.12.0-rc1
v0.12.0-rc0
v0.11.11
v0.11.11-rc3
v0.11.11-rc2
v0.11.11-rc1
v0.11.11-rc0
v0.11.10
v0.11.9
v0.11.9-rc0
v0.11.8
v0.11.8-rc0
v0.11.7-rc1
v0.11.7-rc0
v0.11.7
v0.11.6
v0.11.6-rc0
v0.11.5-rc4
v0.11.5-rc3
v0.11.5
v0.11.5-rc5
v0.11.5-rc2
v0.11.5-rc1
v0.11.5-rc0
v0.11.4
v0.11.4-rc0
v0.11.3
v0.11.3-rc0
v0.11.2
v0.11.1
v0.11.0-rc0
v0.11.0-rc1
v0.11.0-rc2
v0.11.0
v0.10.2-int1
v0.10.1
v0.10.0
v0.10.0-rc4
v0.10.0-rc3
v0.10.0-rc2
v0.10.0-rc1
v0.10.0-rc0
v0.9.7-rc1
v0.9.7-rc0
v0.9.6
v0.9.6-rc0
v0.9.6-ci0
v0.9.5
v0.9.4-rc5
v0.9.4-rc6
v0.9.4
v0.9.4-rc3
v0.9.4-rc4
v0.9.4-rc1
v0.9.4-rc2
v0.9.4-rc0
v0.9.3
v0.9.3-rc5
v0.9.4-citest0
v0.9.3-rc4
v0.9.3-rc3
v0.9.3-rc2
v0.9.3-rc1
v0.9.3-rc0
v0.9.2
v0.9.1
v0.9.1-rc1
v0.9.1-rc0
v0.9.1-ci1
v0.9.1-ci0
v0.9.0
v0.9.0-rc0
v0.8.0
v0.8.0-rc0
v0.7.1-rc2
v0.7.1
v0.7.1-rc1
v0.7.1-rc0
v0.7.0
v0.7.0-rc1
v0.7.0-rc0
v0.6.9-rc0
v0.6.8
v0.6.8-rc0
v0.6.7
v0.6.7-rc2
v0.6.7-rc1
v0.6.7-rc0
v0.6.6
v0.6.6-rc2
v0.6.6-rc1
v0.6.6-rc0
v0.6.5-rc1
v0.6.5
v0.6.5-rc0
v0.6.4-rc0
v0.6.4
v0.6.3-rc1
v0.6.3
v0.6.3-rc0
v0.6.2
v0.6.2-rc0
v0.6.1
v0.6.1-rc0
v0.6.0-rc0
v0.6.0
v0.5.14-rc0
v0.5.13
v0.5.13-rc6
v0.5.13-rc5
v0.5.13-rc4
v0.5.13-rc3
v0.5.13-rc2
v0.5.13-rc1
v0.5.13-rc0
v0.5.12
v0.5.12-rc1
v0.5.12-rc0
v0.5.11
v0.5.10
v0.5.9
v0.5.9-rc0
v0.5.8-rc13
v0.5.8
v0.5.8-rc12
v0.5.8-rc11
v0.5.8-rc10
v0.5.8-rc9
v0.5.8-rc8
v0.5.8-rc7
v0.5.8-rc6
v0.5.8-rc5
v0.5.8-rc4
v0.5.8-rc3
v0.5.8-rc2
v0.5.8-rc1
v0.5.8-rc0
v0.5.7
v0.5.6
v0.5.5
v0.5.5-rc0
v0.5.4
v0.5.3
v0.5.3-rc0
v0.5.2
v0.5.2-rc3
v0.5.2-rc2
v0.5.2-rc1
v0.5.2-rc0
v0.5.1
v0.5.0
v0.5.0-rc1
v0.4.8-rc0
v0.4.7
v0.4.6
v0.4.5
v0.4.4
v0.4.3
v0.4.3-rc0
v0.4.2
v0.4.2-rc1
v0.4.2-rc0
v0.4.1
v0.4.1-rc0
v0.4.0
v0.4.0-rc8
v0.4.0-rc7
v0.4.0-rc6
v0.4.0-rc5
v0.4.0-rc4
v0.4.0-rc3
v0.4.0-rc2
v0.4.0-rc1
v0.4.0-rc0
v0.4.0-ci3
v0.3.14
v0.3.14-rc0
v0.3.13
v0.3.12
v0.3.12-rc5
v0.3.12-rc4
v0.3.12-rc3
v0.3.12-rc2
v0.3.12-rc1
v0.3.11
v0.3.11-rc4
v0.3.11-rc3
v0.3.11-rc2
v0.3.11-rc1
v0.3.10
v0.3.10-rc1
v0.3.9
v0.3.8
v0.3.7
v0.3.7-rc6
v0.3.7-rc5
v0.3.7-rc4
v0.3.7-rc3
v0.3.7-rc2
v0.3.7-rc1
v0.3.6
v0.3.5
v0.3.4
v0.3.3
v0.3.2
v0.3.1
v0.3.0
v0.2.8
v0.2.8-rc2
v0.2.8-rc1
v0.2.7
v0.2.6
v0.2.5
v0.2.4
v0.2.3
v0.2.2
v0.2.2-rc2
v0.2.2-rc1
v0.2.1
v0.2.0
v0.1.49-rc14
v0.1.49-rc13
v0.1.49-rc12
v0.1.49-rc11
v0.1.49-rc10
v0.1.49-rc9
v0.1.49-rc8
v0.1.49-rc7
v0.1.49-rc6
v0.1.49-rc4
v0.1.49-rc5
v0.1.49-rc3
v0.1.49-rc2
v0.1.49-rc1
v0.1.48
v0.1.47
v0.1.46
v0.1.45-rc5
v0.1.45
v0.1.45-rc4
v0.1.45-rc3
v0.1.45-rc2
v0.1.45-rc1
v0.1.44
v0.1.43
v0.1.42
v0.1.41
v0.1.40
v0.1.40-rc1
v0.1.39
v0.1.39-rc2
v0.1.39-rc1
v0.1.38
v0.1.37
v0.1.36
v0.1.35
v0.1.35-rc1
v0.1.34
v0.1.34-rc1
v0.1.33
v0.1.33-rc7
v0.1.33-rc6
v0.1.33-rc5
v0.1.33-rc4
v0.1.33-rc3
v0.1.33-rc2
v0.1.33-rc1
v0.1.32
v0.1.32-rc2
v0.1.32-rc1
v0.1.31
v0.1.30
v0.1.29
v0.1.28
v0.1.27
v0.1.26
v0.1.25
v0.1.24
v0.1.23
v0.1.22
v0.1.21
v0.1.20
v0.1.19
v0.1.18
v0.1.17
v0.1.16
v0.1.15
v0.1.14
v0.1.13
v0.1.12
v0.1.11
v0.1.10
v0.1.9
v0.1.8
v0.1.7
v0.1.6
v0.1.5
v0.1.4
v0.1.3
v0.1.2
v0.1.1
v0.1.0
v0.0.21
v0.0.20
v0.0.19
v0.0.18
v0.0.17
v0.0.16
v0.0.15
v0.0.14
v0.0.13
v0.0.12
v0.0.11
v0.0.10
v0.0.9
v0.0.8
v0.0.7
v0.0.6
v0.0.5
v0.0.4
v0.0.3
v0.0.2
v0.0.1
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
Mirrored from GitHub Pull Request
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/ollama#47730
Reference in New Issue
Block a user
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Originally created by @yliu2702 on GitHub (Jan 22, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2132
Hello, I tried to access 'llama 2' and 'mistral' model to build a local open-source LLM chatbot. However, maybe I access your website too ofter during debugging, I met this error : 'ConnectionError: HTTPConnectionPool(host=‘0.0.0.0’, port=11434): Max retries exceeded with url: /api/chat (Caused by NewConnectionError(‘<urllib3.connection.HTTPConnection object at 0x7fe32765ca30>: Failed to establish a new connection: [Errno 111] Connection refused’))'.
I tried my code through r = requests.post(
"http://0.0.0.0:11434/api/chat",
json={"model": model, "messages": messages, "stream": True, "options": {
"temperature": temp
}},
) and also through langchain, but all failed.
So, how can I solve this problem? So I can use Ollama again? Thanks!
@jmorganca commented on GitHub (Jan 22, 2024):
@yliu2702 sorry you're hitting this error! May I ask if this is on macOS or Linux?
@juancalderonbustillo commented on GitHub (Jan 22, 2024):
In case this helps, I am experiencing the same issue on a Mac, I believe since thursday. For more reference, when run the following commands on bash, I get the following errors:
--> ollama run mistral
Error: could not connect to ollama app, is it running?
--> ollama serve
2024/01/22 11:04:11 images.go:737: total blobs: 84
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x2 addr=0x10 pc=0x10518cd0c]
goroutine 1 [running]:
github.com/jmorganca/ollama/server.deleteUnusedLayers.func1({0x1400007ad90, 0x6c}, {0x10577ae68?, 0x14000466b60?}, {0x1400007ad90?, 0x6c?})
/Users/jmorgan/workspace/ollama/server/images.go:686 +0x41c
path/filepath.walk({0x1400007ad90, 0x6c}, {0x10577ae68, 0x14000466b60}, 0x1400031f930)
/opt/homebrew/Cellar/go/1.21.3/libexec/src/path/filepath/path.go:492 +0xc8
path/filepath.walk({0x14000108d20, 0x52}, {0x10577ae68, 0x14000466a90}, 0x1400031f930)
/opt/homebrew/Cellar/go/1.21.3/libexec/src/path/filepath/path.go:516 +0x1d4
path/filepath.walk({0x14000406a00, 0x3f}, {0x10577ae68, 0x140004669c0}, 0x1400031f930)
/opt/homebrew/Cellar/go/1.21.3/libexec/src/path/filepath/path.go:516 +0x1d4
path/filepath.walk({0x14000406940, 0x37}, {0x10577ae68, 0x140004668f0}, 0x1400031f930)
/opt/homebrew/Cellar/go/1.21.3/libexec/src/path/filepath/path.go:516 +0x1d4
path/filepath.walk({0x14000417dd0, 0x24}, {0x10577ae68, 0x14000466820}, 0x1400031f930)
/opt/homebrew/Cellar/go/1.21.3/libexec/src/path/filepath/path.go:516 +0x1d4
path/filepath.Walk({0x14000417dd0, 0x24}, 0x1400031f930)
/opt/homebrew/Cellar/go/1.21.3/libexec/src/path/filepath/path.go:587 +0x6c
github.com/jmorganca/ollama/server.deleteUnusedLayers(0x0, 0x1400031faa8, 0x0)
/Users/jmorgan/workspace/ollama/server/images.go:690 +0x6c
github.com/jmorganca/ollama/server.PruneLayers()
/Users/jmorgan/workspace/ollama/server/images.go:739 +0x248
github.com/jmorganca/ollama/server.Serve({0x1057785b8, 0x140004455a0})
/Users/jmorgan/workspace/ollama/server/routes.go:875 +0x3c
github.com/jmorganca/ollama/cmd.RunServer(0x1400046c300?, {0x105b984a0?, 0x4?, 0x1051ac07a?})
/Users/jmorgan/workspace/ollama/cmd/cmd.go:1038 +0x178
github.com/spf13/cobra.(*Command).execute(0x1400044d500, {0x105b984a0, 0x0, 0x0})
/Users/jmorgan/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x658
github.com/spf13/cobra.(*Command).ExecuteC(0x1400044c900)
/Users/jmorgan/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x320
github.com/spf13/cobra.(*Command).Execute(...)
/Users/jmorgan/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992
github.com/spf13/cobra.(*Command).ExecuteContext(...)
/Users/jmorgan/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985
main.main()
/Users/jmorgan/workspace/ollama/main.go:11 +0x54
@juancalderonbustillo commented on GitHub (Jan 22, 2024):
My error was solved by just uninstalling and re-installing.... maybe some file got corrupted.
@smanmay commented on GitHub (Jan 22, 2024):
Hi @jmorganca
I have installed OLLAMA using install.sh in my EC2 machine (LINUX).
I am able to access the services inside the EC2 using localhost/127.0.0.1/0.0.0.0:11434.
But when I tried to access it using the private/public IP of the system, its failing saying "Failed to connect to IP port 11434: Connection refused".
I tried to use OLLAMA_ORIGINS using both private and public IP, still the same error is showing.
Basically I want to aces the ollama service from outside of the EC2 machine. I have opened all the ports for the same also in aws.
Not sure how to solve the problem. Could you help.
@mxyng commented on GitHub (Jan 22, 2024):
Connection refusedindicates the service is not exposed/listening on this address/port.Is ollama configured to listen on 0.0.0.0? It only listens on localhost by default so if you want to use it remotely, configuring
OLLAMA_HOSTis a requirement@yliu2702 commented on GitHub (Jan 22, 2024):
on macOS; But I also run it in Linux environment, same issues. I'll try to reinstall Ollama in the environment. Looking forward to your guidance or solutions. Thanks!
@smanmay commented on GitHub (Jan 23, 2024):
Thank you for your help. The updated documentation worked. Following the working configuration for AWS.
[Service]
Environment="OLLAMA_HOST=private_ip"
Environment="OLLAMA_ORIGINS=http://public_ip:11434"
@ganakee commented on GitHub (Jan 24, 2024):
I am having this same issue. After compiling ollama for AMD GPUS, I used the manual install method.
I put the ollama.service file in /etc/systemd/system.
I do
sudo systemctl daemon-reloadandsudo systemctl restart ollama. I have also rebooted several times.I go to
http://192.168.200.71:11434/in the browser and see Ollama is runningHowever, I cannot connect to this server.
Using litellm, I use a simple
This fails with
litellm.exceptions.APIConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))I added to
~/.bashrcIf I try to run
ollama run llama2I getError: Post "http://192.168.200.71:11434/api/chat": EOFI was able, once, to get llama run llama2 to download the llama2 model but nothing since then.
@ganakee commented on GitHub (Jan 25, 2024):
I did several more hours of work on this.
The issue seems to be somehow with copying the custom-compiled file to /usr/bin/local/ollama.gpu . No matter what I do, if I try to use systemd to load the ollama service with the GPU version, it does NOT work. If I do a fresh install of ollama that does work. I checked the permissions and ownership and they are identifcal for ollama. ollama.gpu (my version). I can run my custom-compiled version from a command line and get it to bind to 192.168.200.71 but cannot get it to run via systemd.
@ganakee commented on GitHub (Jan 25, 2024):
OK. If anyone else gets this issue, the problem for me was with the custom-compiled version of ollama and a missing override environment variable in the systemd config file.
I compiled ollama for AMD systems using the AMD RX 6650M card. That card has GPU capacity but is not officially supported by AMD for GPU use. I can, with tweaking, get this to compile anyway.
The issue for me with failed connections was the
/etc/systemd/system/ollama.servicefile needed:Environment="HSA_OVERRIDE_GFX_VERSION=10.3.0"This is necessary for the technically-unsupported AMD GPU to downgrade the gfx instruction set to 1030.
Since this was missing, the ollama service started but
journalctl -n 50 -u ollamashowed that ollama subtly complained that it could not find the gfx1032 instruction file for Tensor files. This is exactly whatEnvironment="HSA_OVERRIDE_GFX_VERSION=10.3.0"fixes.(I have export "HSA_OVERRIDE_GFX_VERSION=10.3.0" in my ~/.bashrc file but, obviously, the systemd service does not "see" this user environment variable.)
Only after careful review of the journalctl did I see the possible source of the error. Note, ollama still reports as running. It just cannot "do" anything apparently due to the reliance on the GPU drivers which were wrong without the HSA-OVERRIDE.
@yliu2702 commented on GitHub (Jan 27, 2024):
Has anyone solved this issue by resetting environment? I still don't know what to do, after re-install Ollama. Need help from the developer. Or does anyone know how to load model from hugging face?
@Z33DD commented on GitHub (Feb 21, 2024):
How I resolved this issue
It looks like the default CORS policy is to allow only localhost, so you need to change it with environment variables.
As root, edit this file:
/etc/systemd/system/ollama.serviceThe only changes were the lines:
After it, you need to reload the daemon and the service:
Also, ensure your firewall is not blocking the port 11434:
@NetRxn commented on GitHub (Mar 1, 2024):
In my case, things were working well originally. I had uninstalled ollama, but had not deleted the models I had used from the previous install.
When I tried to re-install ollama, the above error occurred and continued, and persisted through numerous uninstall/reinstalls.
Once the models from the old install were removed, everything returned to normal. 😂
@mxyng commented on GitHub (Mar 11, 2024):
@yliu2702 you're making a request to 0.0.0.0 port 11434, did you configure ollama to bind to 0.0.0.0:11434? If it's not configured to bind to 0.0.0.0, this failure is expected. See my comment here: https://github.com/ollama/ollama/issues/2132#issuecomment-1904515289
Try making the same request to 127.0.0.1:11434. You'll also likely run into a 404 error if the model doesn't exist on the system. Consider calling
ollama pull modelorPOST /api/pull {'model': model}'before the call to/api/post@applebiter commented on GitHub (Mar 28, 2024):
Same situation here, Linux Mint 21.3 Cinnamon, Linux Kernel 5.15.0-101-lowlatency. Older machine, AMD A10-5800B APU, 31.3 GB RAM, NVidia GTX 1050 Ti (lol). Everything seemed to be working fine. Both my development machine and the machine the ollama system was hosted on are identical, and I've been hacking away at a python app that is supposed to integrate the ollama system. Then I started getting this error and I can't isolate anything on my side causing it. It looks like I've violated some policy by sending malformed requests (I'm developing, so what) and now my dev machine is blacklisted. Maybe that's totally BS and the problem is in my code, but if there is some kind of mechanism in ollama for this, we ought know about it and how to override it.
@RELNO commented on GitHub (Apr 3, 2024):
This appears to be related to this issue https://github.com/ollama/ollama/issues/3476. However I see
Error: Post "http://0.0.0.0:11434/api/chat": EOFonly when running the latest version (0.1.3) and only on vision models (i.e llava). When running docker of older versions, it works well@berchan commented on GitHub (Apr 19, 2024):
launchctl setenv not work in my macos. I add export OLLAMA_HOST="0.0.0.0" in my .bash_profile, then source .bash_profile, it works
@ArslanKAS commented on GitHub (Apr 24, 2024):
Genius. This worked 100%
@narensrini-ds commented on GitHub (Apr 25, 2024):
Thanks for sharing this solution @ArslanKAS !
@deepakyadavdx commented on GitHub (May 12, 2024):
Are you get solution for this?
@pdevine commented on GitHub (May 14, 2024):
Going to close this out since this is all covered in the FAQ
@jmio23 commented on GitHub (Jun 17, 2024):
the solution doesn't work on Ubuntu 24, the file etc/systemd/system/ollama.service is over written and edits removed, unless you put them at the top, where they seem to do nothing at all ... but there is no information about how to format this and I fed up trying... thanks canonical
@ntelo007 commented on GitHub (Aug 27, 2024):
This solution doesn't work if you run ollama from a container. Maybe it works if you modify the desktop application. Any solution for the docker version?
@loglux commented on GitHub (Sep 5, 2024):
I'm joinig the last question. If you try to connect from the docker container using ollama python library, you get An error occurred: [Errno 111] Connection refused
@ntelo007 commented on GitHub (Sep 6, 2024):
I commented out the base_url parameter in LangChain's ChatOllama object, and I added a Host Ollama variable in my docker-compose file and it worked.
@new-Matthew commented on GitHub (Sep 6, 2024):
@danielrsantana-humaitrix commented on GitHub (Oct 2, 2024):
This is how I solved this issue, using Azure Virtual Machine with a FastAPI Docker image.
docker imageinstead of thiscurl -fsSL https://ollama.com/install.sh | sh:network nameand addOLLAMA_HOST=ollamabefore your app start command.How do you know when it will work:
If you enter your network and run the following command, it will succeed:
@SaM-0777 commented on GitHub (Feb 24, 2025):
Make sure ollama is running
ollama serveUse http://127.0.0.1:11434/api/generate instead of http://localhost:11434/api/generate