[GH-ISSUE #7163] Ollama does not run #4546

Closed
opened 2026-04-12 15:28:52 -05:00 by GiteaMirror · 46 comments
Owner

Originally created by @d3tk on GitHub (Oct 10, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/7163

Originally assigned to: @dhiltgen on GitHub.

What is the issue?

The process never completes when I try to do ollama run or ollama list.

OS

Windows

GPU

Nvidia

CPU

Intel

Ollama version

0.3.12

Originally created by @d3tk on GitHub (Oct 10, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/7163 Originally assigned to: @dhiltgen on GitHub. ### What is the issue? The process never completes when I try to do ollama run or ollama list. ### OS Windows ### GPU Nvidia ### CPU Intel ### Ollama version 0.3.12
GiteaMirror added the bugwindows labels 2026-04-12 15:28:52 -05:00
Author
Owner

@rick-github commented on GitHub (Oct 10, 2024):

Server logs will help in debugging.

<!-- gh-comment-id:2405644475 --> @rick-github commented on GitHub (Oct 10, 2024): [Server logs](https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md#how-to-troubleshoot-issues) will help in debugging.
Author
Owner

@d3tk commented on GitHub (Oct 10, 2024):

Server logs will help in debugging.

Server Logs

2024/10/10 14:38:26 routes.go:1153: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:C:\\Users\\dkuts\\.ollama\\models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]" time=2024-10-10T14:38:26.218-04:00 level=INFO source=images.go:753 msg="total blobs: 37" time=2024-10-10T14:38:26.247-04:00 level=INFO source=images.go:760 msg="total unused blobs removed: 0" time=2024-10-10T14:38:26.249-04:00 level=INFO source=routes.go:1200 msg="Listening on 127.0.0.1:11434 (version 0.3.12)" time=2024-10-10T14:38:26.251-04:00 level=INFO source=common.go:49 msg="Dynamic LLM libraries" runners="[cuda_v11 cuda_v12 rocm_v6.1 cpu cpu_avx cpu_avx2]" time=2024-10-10T14:38:26.252-04:00 level=INFO source=gpu.go:199 msg="looking for compatible GPUs" time=2024-10-10T14:38:26.383-04:00 level=INFO source=gpu.go:292 msg="detected OS VRAM overhead" id=GPU-40f13575-6ec5-c1b3-c72e-69caef571bd7 library=cuda compute=8.6 driver=12.6 name="NVIDIA GeForce RTX 3080" overhead="81.5 MiB" time=2024-10-10T14:38:26.384-04:00 level=INFO source=types.go:107 msg="inference compute" id=GPU-40f13575-6ec5-c1b3-c72e-69caef571bd7 library=cuda variant=v12 compute=8.6 driver=12.6 name="NVIDIA GeForce RTX 3080" total="10.0 GiB" available="8.9 GiB" [GIN] 2024/10/10 - 14:39:46 | 200 | 0s | 127.0.0.1 | HEAD "/" [GIN] 2024/10/10 - 14:39:46 | 200 | 26.4183ms | 127.0.0.1 | GET "/api/tags"

<!-- gh-comment-id:2405808498 --> @d3tk commented on GitHub (Oct 10, 2024): > [Server logs](https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md#how-to-troubleshoot-issues) will help in debugging. <details> <summary> Server Logs </summary> <p>2024/10/10 14:38:26 routes.go:1153: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:C:\\Users\\dkuts\\.ollama\\models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]" time=2024-10-10T14:38:26.218-04:00 level=INFO source=images.go:753 msg="total blobs: 37" time=2024-10-10T14:38:26.247-04:00 level=INFO source=images.go:760 msg="total unused blobs removed: 0" time=2024-10-10T14:38:26.249-04:00 level=INFO source=routes.go:1200 msg="Listening on 127.0.0.1:11434 (version 0.3.12)" time=2024-10-10T14:38:26.251-04:00 level=INFO source=common.go:49 msg="Dynamic LLM libraries" runners="[cuda_v11 cuda_v12 rocm_v6.1 cpu cpu_avx cpu_avx2]" time=2024-10-10T14:38:26.252-04:00 level=INFO source=gpu.go:199 msg="looking for compatible GPUs" time=2024-10-10T14:38:26.383-04:00 level=INFO source=gpu.go:292 msg="detected OS VRAM overhead" id=GPU-40f13575-6ec5-c1b3-c72e-69caef571bd7 library=cuda compute=8.6 driver=12.6 name="NVIDIA GeForce RTX 3080" overhead="81.5 MiB" time=2024-10-10T14:38:26.384-04:00 level=INFO source=types.go:107 msg="inference compute" id=GPU-40f13575-6ec5-c1b3-c72e-69caef571bd7 library=cuda variant=v12 compute=8.6 driver=12.6 name="NVIDIA GeForce RTX 3080" total="10.0 GiB" available="8.9 GiB" [GIN] 2024/10/10 - 14:39:46 | 200 | 0s | 127.0.0.1 | HEAD "/" [GIN] 2024/10/10 - 14:39:46 | 200 | 26.4183ms | 127.0.0.1 | GET "/api/tags"</p></details>
Author
Owner

@rick-github commented on GitHub (Oct 10, 2024):

Can you give a demonstration of the problem you are experiencing?

<!-- gh-comment-id:2405826438 --> @rick-github commented on GitHub (Oct 10, 2024): Can you give a demonstration of the problem you are experiencing?
Author
Owner

@d3tk commented on GitHub (Oct 10, 2024):

When I run ollama list that is the server log I get and the list is never printed to console. Here is a gif of it:
problem gif

Is there anything else that could help?

<!-- gh-comment-id:2405851032 --> @d3tk commented on GitHub (Oct 10, 2024): When I run `ollama list` that is the server log I get and the list is never printed to console. Here is a gif of it: ![problem gif](https://media.giphy.com/media/TDUwLgeQbRSUrgaTlI/giphy.gif) Is there anything else that could help?
Author
Owner

@rick-github commented on GitHub (Oct 10, 2024):

Does ollama --version return anything?

<!-- gh-comment-id:2405892092 --> @rick-github commented on GitHub (Oct 10, 2024): Does `ollama --version` return anything?
Author
Owner

@d3tk commented on GitHub (Oct 10, 2024):

Yes that returns 0.3.12

<!-- gh-comment-id:2405902147 --> @d3tk commented on GitHub (Oct 10, 2024): Yes that returns 0.3.12
Author
Owner

@rick-github commented on GitHub (Oct 11, 2024):

ollama --version indicates that the client can talk to the server. So run and list not working implies the server is somehow borked. What does curl http://localhost:11434/api/tags return?

<!-- gh-comment-id:2407939461 --> @rick-github commented on GitHub (Oct 11, 2024): `ollama --version` indicates that the client can talk to the server. So `run` and `list` not working implies the server is somehow borked. What does `curl http://localhost:11434/api/tags` return?
Author
Owner

@d3tk commented on GitHub (Oct 11, 2024):

{"models":[{"name":"qwen2-math:latest","model":"qwen2-math:latest","modified_at":"2024-09-18T15:04:52.6146302-04:00","size":4431400514,"digest":"28cc3a337734d0db9326604d931ccce1c9379f2310b60dee03ef76440b37bb65","details":{"parent_model":"","format":"gguf","family":"qwen2","families":["qwen2"],"parameter_size":"7.6B","quantization_level":"Q4_0"}},{"name":"deepseek-coder-v2:latest","model":"deepseek-coder-v2:latest","modified_at":"2024-08-26T14:25:27.440896-04:00","size":8905125527,"digest":"8577f96d693e51135fb408f915344f4413db45ce31d771be6a6a9b1c7e7a4b40","details":{"parent_model":"","format":"gguf","family":"deepseek2","families":["deepseek2"],"parameter_size":"15.7B","quantization_level":"Q4_0"}},{"name":"llama3.1:latest","model":"llama3.1:latest","modified_at":"2024-08-26T14:22:43.7956121-04:00","size":4661230977,"digest":"91ab477bec9d27086a119e33c471ae7afbd786cc4fbd8f38d8af0a0b949d53aa","details":{"parent_model":"","format":"gguf","family":"llama","families":["llama"],"parameter_size":"8.0B","quantization_level":"Q4_0"}},{"name":"gemma2:27b","model":"gemma2:27b","modified_at":"2024-07-15T18:32:59.5951191-04:00","size":15628387458,"digest":"53261bc9c192c1cb5fcc898dd3aa15da093f5ab6f08e17e48cf838bb1c58abfe","details":{"parent_model":"","format":"gguf","family":"gemma2","families":["gemma2"],"parameter_size":"27.2B","quantization_level":"Q4_0"}},{"name":"gemma2:latest","model":"gemma2:latest","modified_at":"2024-07-15T18:32:16.5725515-04:00","size":5443152417,"digest":"ff02c3702f322b9e075e9568332d96c0a7028002f1a5a056e0a6784320a4db0b","details":{"parent_model":"","format":"gguf","family":"gemma2","families":["gemma2"],"parameter_size":"9.2B","quantization_level":"Q4_0"}},{"name":"llama3:latest","model":"llama3:latest","modified_at":"2024-06-03T20:03:06.414835-04:00","size":4661224676,"digest":"365c0bd3c000a25d28ddbf732fe1c6add414de7275464c4e4d1c3b5fcb5d8ad1","details":{"parent_model":"","format":"gguf","family":"llama","families":["llama"],"parameter_size":"8.0B","quantization_level":"Q4_0"}},{"name":"nomic-embed-text:latest","model":"nomic-embed-text:latest","modified_at":"2024-05-31T17:34:46.1618435-04:00","size":274302450,"digest":"0a109f422b47e3a30ba2b10eca18548e944e8a23073ee3f3e947efcf3c45e59f","details":{"parent_model":"","format":"gguf","family":"nomic-bert","families":["nomic-bert"],"parameter_size":"137M","quantization_level":"F16"}},{"name":"codestral:latest","model":"codestral:latest","modified_at":"2024-05-31T17:33:12.9738307-04:00","size":12569170041,"digest":"fcc0019dcee9947fe4298e23825eae643f4670e391f205f8c55a64c2068e9a22","details":{"parent_model":"","format":"gguf","family":"llama","families":["llama"],"parameter_size":"22.2B","quantization_level":"Q4_0"}}]}

<!-- gh-comment-id:2407946706 --> @d3tk commented on GitHub (Oct 11, 2024): {"models":[{"name":"qwen2-math:latest","model":"qwen2-math:latest","modified_at":"2024-09-18T15:04:52.6146302-04:00","size":4431400514,"digest":"28cc3a337734d0db9326604d931ccce1c9379f2310b60dee03ef76440b37bb65","details":{"parent_model":"","format":"gguf","family":"qwen2","families":["qwen2"],"parameter_size":"7.6B","quantization_level":"Q4_0"}},{"name":"deepseek-coder-v2:latest","model":"deepseek-coder-v2:latest","modified_at":"2024-08-26T14:25:27.440896-04:00","size":8905125527,"digest":"8577f96d693e51135fb408f915344f4413db45ce31d771be6a6a9b1c7e7a4b40","details":{"parent_model":"","format":"gguf","family":"deepseek2","families":["deepseek2"],"parameter_size":"15.7B","quantization_level":"Q4_0"}},{"name":"llama3.1:latest","model":"llama3.1:latest","modified_at":"2024-08-26T14:22:43.7956121-04:00","size":4661230977,"digest":"91ab477bec9d27086a119e33c471ae7afbd786cc4fbd8f38d8af0a0b949d53aa","details":{"parent_model":"","format":"gguf","family":"llama","families":["llama"],"parameter_size":"8.0B","quantization_level":"Q4_0"}},{"name":"gemma2:27b","model":"gemma2:27b","modified_at":"2024-07-15T18:32:59.5951191-04:00","size":15628387458,"digest":"53261bc9c192c1cb5fcc898dd3aa15da093f5ab6f08e17e48cf838bb1c58abfe","details":{"parent_model":"","format":"gguf","family":"gemma2","families":["gemma2"],"parameter_size":"27.2B","quantization_level":"Q4_0"}},{"name":"gemma2:latest","model":"gemma2:latest","modified_at":"2024-07-15T18:32:16.5725515-04:00","size":5443152417,"digest":"ff02c3702f322b9e075e9568332d96c0a7028002f1a5a056e0a6784320a4db0b","details":{"parent_model":"","format":"gguf","family":"gemma2","families":["gemma2"],"parameter_size":"9.2B","quantization_level":"Q4_0"}},{"name":"llama3:latest","model":"llama3:latest","modified_at":"2024-06-03T20:03:06.414835-04:00","size":4661224676,"digest":"365c0bd3c000a25d28ddbf732fe1c6add414de7275464c4e4d1c3b5fcb5d8ad1","details":{"parent_model":"","format":"gguf","family":"llama","families":["llama"],"parameter_size":"8.0B","quantization_level":"Q4_0"}},{"name":"nomic-embed-text:latest","model":"nomic-embed-text:latest","modified_at":"2024-05-31T17:34:46.1618435-04:00","size":274302450,"digest":"0a109f422b47e3a30ba2b10eca18548e944e8a23073ee3f3e947efcf3c45e59f","details":{"parent_model":"","format":"gguf","family":"nomic-bert","families":["nomic-bert"],"parameter_size":"137M","quantization_level":"F16"}},{"name":"codestral:latest","model":"codestral:latest","modified_at":"2024-05-31T17:33:12.9738307-04:00","size":12569170041,"digest":"fcc0019dcee9947fe4298e23825eae643f4670e391f205f8c55a64c2068e9a22","details":{"parent_model":"","format":"gguf","family":"llama","families":["llama"],"parameter_size":"22.2B","quantization_level":"Q4_0"}}]}
Author
Owner

@rick-github commented on GitHub (Oct 11, 2024):

So list works when talking directly to the server. Do you have OLLAMA_HOST set in your environment to something other than localhost:11434? If you run set at the command line, what's the output?

<!-- gh-comment-id:2407951481 --> @rick-github commented on GitHub (Oct 11, 2024): So `list` works when talking directly to the server. Do you have `OLLAMA_HOST` set in your environment to something other than `localhost:11434`? If you run `set` at the command line, what's the output?
Author
Owner

@d3tk commented on GitHub (Oct 11, 2024):

It looks like there isnt an OLLAMA_HOST variable in the output. I've had Ollama working for awhile, I am not sure what I did to break it, if i did.

ALLUSERSPROFILE=C:\ProgramData
APPDATA=C:\Users\dkuts\AppData\Roaming
CommonProgramFiles=C:\Program Files\Common Files
CommonProgramFiles(x86)=C:\Program Files (x86)\Common Files
CommonProgramW6432=C:\Program Files\Common Files
COMPUTERNAME=DESKTOP-Q91IHFM
ComSpec=C:\WINDOWS\system32\cmd.exe
CUDA_PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6
CUDA_PATH_V12_0=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.0
CUDA_PATH_V12_6=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6
DriverData=C:\Windows\System32\Drivers\DriverData
EFC_10812=1
FPS_BROWSER_APP_PROFILE_STRING=Internet Explorer
FPS_BROWSER_USER_PROFILE_STRING=Default
HOMEDRIVE=C:
HOMEPATH=\Users\dkuts
LOCALAPPDATA=C:\Users\dkuts\AppData\Local
LOGONSERVER=\DESKTOP-Q91IHFM
NUMBER_OF_PROCESSORS=20
OneDrive=C:\Users\dkuts\University of Pittsburgh
OneDriveCommercial=C:\Users\dkuts\University of Pittsburgh
OneDriveConsumer=C:\Users\dkuts\OneDrive
OS=Windows_NT
Path=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6\bin;C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6\libnvvp;C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.0\bin;C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.0\libnvvp;C:\Program Files\Common Files\Oracle\Java\javapath;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0;C:\Windows\System32\OpenSSH;C:\Program Files (x86)\dotnet;C:\Program Files\NVIDIA Corporation\NVIDIA NvDLISR;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Program Files\Intel\WiFi\bin;C:\Program Files\Common Files\Intel\WirelessCommon;C:\Program Files\dotnet;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0;C:\WINDOWS\System32\OpenSSH;C:\Program Files\MATLAB\R2023a\bin;Z:\Git\cmd;C:\Program Files\NVIDIA Corporation\Nsight Compute 2024.3.0;C:\Users\dkuts\AppData\Local\Programs\Python\Python312\Scripts;C:\Users\dkuts\AppData\Local\Programs\Python\Python312;C:\Users\dkuts\AppData\Local\Programs\Python\Python311\Scripts;C:\Users\dkuts\AppData\Local\Programs\Python\Python311;C:\Users\dkuts\AppData\Local\Microsoft\WindowsApps;C:\Program Files\Intel\WiFi\bin;C:\Program Files\Common Files\Intel\WirelessCommon;C:\Users\dkuts\AppData\Local\Programs\Microsoft VS Code\bin;C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.0\bin;;C:\Users\dkuts\AppData\Local\Programs\Ollama
PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC
PROCESSOR_ARCHITECTURE=AMD64
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 151 Stepping 2, GenuineIntel
PROCESSOR_LEVEL=6
PROCESSOR_REVISION=9702
ProgramData=C:\ProgramData
ProgramFiles=C:\Program Files
ProgramFiles(x86)=C:\Program Files (x86)
ProgramW6432=C:\Program Files
PROMPT=$P$G
PSModulePath=C:\Program Files\WindowsPowerShell\Modules;C:\WINDOWS\system32\WindowsPowerShell\v1.0\Modules
PUBLIC=C:\Users\Public
SESSIONNAME=Console
SystemDrive=C:
SystemRoot=C:\WINDOWS
TEMP=C:\Users\dkuts\AppData\Local\Temp
TMP=C:\Users\dkuts\AppData\Local\Temp
USERDOMAIN=DESKTOP-Q91IHFM
USERDOMAIN_ROAMINGPROFILE=DESKTOP-Q91IHFM
USERNAME=dkuts
USERPROFILE=C:\Users\dkuts
VBOX_MSI_INSTALL_PATH=C:\Program Files\Oracle\VirtualBox
windir=C:\WINDOWS

<!-- gh-comment-id:2407964911 --> @d3tk commented on GitHub (Oct 11, 2024): It looks like there isnt an OLLAMA_HOST variable in the output. I've had Ollama working for awhile, I am not sure what I did to break it, if i did. ALLUSERSPROFILE=C:\ProgramData APPDATA=C:\Users\dkuts\AppData\Roaming CommonProgramFiles=C:\Program Files\Common Files CommonProgramFiles(x86)=C:\Program Files (x86)\Common Files CommonProgramW6432=C:\Program Files\Common Files COMPUTERNAME=DESKTOP-Q91IHFM ComSpec=C:\WINDOWS\system32\cmd.exe CUDA_PATH=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6 CUDA_PATH_V12_0=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.0 CUDA_PATH_V12_6=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6 DriverData=C:\Windows\System32\Drivers\DriverData EFC_10812=1 FPS_BROWSER_APP_PROFILE_STRING=Internet Explorer FPS_BROWSER_USER_PROFILE_STRING=Default HOMEDRIVE=C: HOMEPATH=\Users\dkuts LOCALAPPDATA=C:\Users\dkuts\AppData\Local LOGONSERVER=\\DESKTOP-Q91IHFM NUMBER_OF_PROCESSORS=20 OneDrive=C:\Users\dkuts\University of Pittsburgh OneDriveCommercial=C:\Users\dkuts\University of Pittsburgh OneDriveConsumer=C:\Users\dkuts\OneDrive OS=Windows_NT Path=C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6\bin;C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.6\libnvvp;C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.0\bin;C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.0\libnvvp;C:\Program Files\Common Files\Oracle\Java\javapath;C:\Program Files (x86)\Common Files\Oracle\Java\javapath;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Windows\System32\OpenSSH\;C:\Program Files (x86)\dotnet\;C:\Program Files\NVIDIA Corporation\NVIDIA NvDLISR;C:\Program Files (x86)\NVIDIA Corporation\PhysX\Common;C:\Program Files\Intel\WiFi\bin\;C:\Program Files\Common Files\Intel\WirelessCommon\;C:\Program Files\dotnet\;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\System32\WindowsPowerShell\v1.0\;C:\WINDOWS\System32\OpenSSH\;C:\Program Files\MATLAB\R2023a\bin;Z:\Git\cmd;C:\Program Files\NVIDIA Corporation\Nsight Compute 2024.3.0\;C:\Users\dkuts\AppData\Local\Programs\Python\Python312\Scripts\;C:\Users\dkuts\AppData\Local\Programs\Python\Python312\;C:\Users\dkuts\AppData\Local\Programs\Python\Python311\Scripts\;C:\Users\dkuts\AppData\Local\Programs\Python\Python311\;C:\Users\dkuts\AppData\Local\Microsoft\WindowsApps;C:\Program Files\Intel\WiFi\bin\;C:\Program Files\Common Files\Intel\WirelessCommon\;C:\Users\dkuts\AppData\Local\Programs\Microsoft VS Code\bin;C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v12.0\bin;;C:\Users\dkuts\AppData\Local\Programs\Ollama PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC PROCESSOR_ARCHITECTURE=AMD64 PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 151 Stepping 2, GenuineIntel PROCESSOR_LEVEL=6 PROCESSOR_REVISION=9702 ProgramData=C:\ProgramData ProgramFiles=C:\Program Files ProgramFiles(x86)=C:\Program Files (x86) ProgramW6432=C:\Program Files PROMPT=$P$G PSModulePath=C:\Program Files\WindowsPowerShell\Modules;C:\WINDOWS\system32\WindowsPowerShell\v1.0\Modules PUBLIC=C:\Users\Public SESSIONNAME=Console SystemDrive=C: SystemRoot=C:\WINDOWS TEMP=C:\Users\dkuts\AppData\Local\Temp TMP=C:\Users\dkuts\AppData\Local\Temp USERDOMAIN=DESKTOP-Q91IHFM USERDOMAIN_ROAMINGPROFILE=DESKTOP-Q91IHFM USERNAME=dkuts USERPROFILE=C:\Users\dkuts VBOX_MSI_INSTALL_PATH=C:\Program Files\Oracle\VirtualBox\ windir=C:\WINDOWS
Author
Owner

@rick-github commented on GitHub (Oct 11, 2024):

It's a head-scratcher. list and --version are just wrappers to the /api/tags and /api/version endpoints, so having the client successfully return the version but hang on the model list, which returns successfully when you curl the endpoint, is strange. Do you have any firewall/anti-virus processes running on the machine? Have you previously tried running ollama in WSL? What's the output of netstat -nq | findstr 11434?

<!-- gh-comment-id:2407988252 --> @rick-github commented on GitHub (Oct 11, 2024): It's a head-scratcher. `list` and `--version` are just wrappers to the `/api/tags` and `/api/version` endpoints, so having the client successfully return the version but hang on the model list, which returns successfully when you `curl` the endpoint, is strange. Do you have any firewall/anti-virus processes running on the machine? Have you previously tried running ollama in WSL? What's the output of `netstat -nq | findstr 11434`?
Author
Owner

@d3tk commented on GitHub (Oct 11, 2024):

TCP 127.0.0.1:11434 0.0.0.0:0 LISTENING

I don't think I have any firewall/anti-virus. If I did it would be Windows Defender but, I haven't changed any settings so not sure why it would be blocked now and wasn't before.

On WSL, ollama list works and ollama pull works but when I try to run a model it says: "Error: llama runner process no longer running: -1"

<!-- gh-comment-id:2407997750 --> @d3tk commented on GitHub (Oct 11, 2024): TCP 127.0.0.1:11434 0.0.0.0:0 LISTENING I don't think I have any firewall/anti-virus. If I did it would be Windows Defender but, I haven't changed any settings so not sure why it would be blocked now and wasn't before. On WSL, ollama list works and ollama pull works but when I try to run a model it says: "Error: llama runner process no longer running: -1"
Author
Owner

@rick-github commented on GitHub (Oct 11, 2024):

Have you installed ollama in both WSL (ie, curl | sh) and Windows (OllamaSetup.exe)? I don't believe that will work reliably (not a Windows guy so I may be mistaken).

<!-- gh-comment-id:2408006368 --> @rick-github commented on GitHub (Oct 11, 2024): Have you installed ollama in both WSL (ie, `curl | sh`) and Windows (OllamaSetup.exe)? I don't believe that will work reliably (not a Windows guy so I may be mistaken).
Author
Owner

@d3tk commented on GitHub (Oct 11, 2024):

I didn't have Ollama installed on WSL, so I did sudo snap install ollama. it said ollama 0.1.32 from Matias Piipari (mz2) installed when it completed.

For windows, I download the exe from the website download section. So I guess they're separate installations.

<!-- gh-comment-id:2408009348 --> @d3tk commented on GitHub (Oct 11, 2024): I didn't have Ollama installed on WSL, so I did `sudo snap install ollama`. it said `ollama 0.1.32 from Matias Piipari (mz2) installed` when it completed. For windows, I download the exe from the website download section. So I guess they're separate installations.
Author
Owner

@rick-github commented on GitHub (Oct 11, 2024):

My experience (https://github.com/ollama/ollama/issues/7023, https://github.com/ollama/ollama/issues/6701) is that installing ollama in both Windows and WSL is problematic. If you installed in WSL just now because I asked about it, uninstall. It's not the cause of the original problem but may be an issue later. If you installed in WSL and Windows prior to submitting this bug report, delete one of the installations.

<!-- gh-comment-id:2408017271 --> @rick-github commented on GitHub (Oct 11, 2024): My experience (https://github.com/ollama/ollama/issues/7023, https://github.com/ollama/ollama/issues/6701) is that installing ollama in both Windows and WSL is problematic. If you installed in WSL just now because I asked about it, uninstall. It's not the cause of the original problem but may be an issue later. If you installed in WSL and Windows prior to submitting this bug report, delete one of the installations.
Author
Owner

@d3tk commented on GitHub (Oct 11, 2024):

I installed it just now, I have uninstalled it. Should I attempt to uninstall ollama from my windows as well?

<!-- gh-comment-id:2408026271 --> @d3tk commented on GitHub (Oct 11, 2024): I installed it just now, I have uninstalled it. Should I attempt to uninstall ollama from my windows as well?
Author
Owner

@rick-github commented on GitHub (Oct 11, 2024):

Yes, it won't reveal the cause of the problem, but uninstalling and reinstalling may resolve the issue.

<!-- gh-comment-id:2408030055 --> @rick-github commented on GitHub (Oct 11, 2024): Yes, it won't reveal the cause of the problem, but uninstalling and reinstalling may resolve the issue.
Author
Owner

@d3tk commented on GitHub (Oct 11, 2024):

I have re-installed Ollama and the issue still persists.
Perhaps there were some files that weren't fully deleted when I uninstalled?

<!-- gh-comment-id:2408036533 --> @d3tk commented on GitHub (Oct 11, 2024): I have re-installed Ollama and the issue still persists. Perhaps there were some files that weren't fully deleted when I uninstalled?
Author
Owner

@rick-github commented on GitHub (Oct 11, 2024):

I'm not familiar with the Windows install, on Linux it's a single binary with a service config file so cleanup is straightforward. Now that you have a fresh install, what's the result of:

curl http://localhost:11434/api/version
curl http://localhost:11434/api/ps
curl http://localhost:11434/api/tags
ollama --version
ollama ps
ollama list

When you've run those, add the results and the server logs.

<!-- gh-comment-id:2408049349 --> @rick-github commented on GitHub (Oct 11, 2024): I'm not familiar with the Windows install, on Linux it's a single binary with a service config file so cleanup is straightforward. Now that you have a fresh install, what's the result of: ``` curl http://localhost:11434/api/version curl http://localhost:11434/api/ps curl http://localhost:11434/api/tags ollama --version ollama ps ollama list ``` When you've run those, add the results and the server logs.
Author
Owner

@d3tk commented on GitHub (Oct 11, 2024):

Results:
Microsoft Windows [Version 10.0.26100.2033]
(c) Microsoft Corporation. All rights reserved.

C:\Users\dkuts>curl http://localhost:11434/api/version
{"version":"0.3.12"}
C:\Users\dkuts>curl http://localhost:11434/api/ps
{"models":[]}
C:\Users\dkuts>curl http://localhost:11434/api/tags
{"models":[]}
C:\Users\dkuts>ollama --version
ollama version is 0.3.12

C:\Users\dkuts>ollama ps
^C
C:\Users\dkuts>ollama list
^C
C:\Users\dkuts>

ps and list didn't return anything. I can run the command and see if they ever return if you think that would help.

Here are the server logs:
2024/10/11 15:50:34 routes.go:1153: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:C:\Users\dkuts\.ollama\models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]"
time=2024-10-11T15:50:34.635-04:00 level=INFO source=images.go:753 msg="total blobs: 0"
time=2024-10-11T15:50:34.635-04:00 level=INFO source=images.go:760 msg="total unused blobs removed: 0"
time=2024-10-11T15:50:34.635-04:00 level=INFO source=routes.go:1200 msg="Listening on 127.0.0.1:11434 (version 0.3.12)"
time=2024-10-11T15:50:34.636-04:00 level=INFO source=common.go:49 msg="Dynamic LLM libraries" runners="[cpu_avx2 cuda_v11 cuda_v12 rocm_v6.1 cpu cpu_avx]"
time=2024-10-11T15:50:34.636-04:00 level=INFO source=gpu.go:199 msg="looking for compatible GPUs"
time=2024-10-11T15:50:34.758-04:00 level=INFO source=types.go:107 msg="inference compute" id=GPU-40f13575-6ec5-c1b3-c72e-69caef571bd7 library=cuda variant=v12 compute=8.6 driver=12.6 name="NVIDIA GeForce RTX 3080" total="10.0 GiB" available="8.9 GiB"
[GIN] 2024/10/11 - 15:50:42 | 200 | 0s | 127.0.0.1 | HEAD "/"
[GIN] 2024/10/11 - 15:50:42 | 200 | 517.3µs | 127.0.0.1 | GET "/api/tags"
[GIN] 2024/10/11 - 16:03:51 | 200 | 866.5µs | 127.0.0.1 | GET "/api/version"
[GIN] 2024/10/11 - 16:03:56 | 200 | 609.6µs | 127.0.0.1 | GET "/api/ps"
[GIN] 2024/10/11 - 16:04:00 | 200 | 0s | 127.0.0.1 | GET "/api/tags"
[GIN] 2024/10/11 - 16:04:06 | 200 | 0s | 127.0.0.1 | GET "/api/version"
[GIN] 2024/10/11 - 16:04:09 | 200 | 0s | 127.0.0.1 | HEAD "/"
[GIN] 2024/10/11 - 16:04:09 | 200 | 0s | 127.0.0.1 | GET "/api/ps"
[GIN] 2024/10/11 - 16:04:16 | 200 | 0s | 127.0.0.1 | HEAD "/"
[GIN] 2024/10/11 - 16:04:16 | 200 | 0s | 127.0.0.1 | GET "/api/tags"

<!-- gh-comment-id:2408054523 --> @d3tk commented on GitHub (Oct 11, 2024): Results: Microsoft Windows [Version 10.0.26100.2033] (c) Microsoft Corporation. All rights reserved. C:\Users\dkuts>curl http://localhost:11434/api/version {"version":"0.3.12"} C:\Users\dkuts>curl http://localhost:11434/api/ps {"models":[]} C:\Users\dkuts>curl http://localhost:11434/api/tags {"models":[]} C:\Users\dkuts>ollama --version ollama version is 0.3.12 C:\Users\dkuts>ollama ps ^C C:\Users\dkuts>ollama list ^C C:\Users\dkuts> ps and list didn't return anything. I can run the command and see if they ever return if you think that would help. Here are the server logs: 2024/10/11 15:50:34 routes.go:1153: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:C:\\Users\\dkuts\\.ollama\\models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]" time=2024-10-11T15:50:34.635-04:00 level=INFO source=images.go:753 msg="total blobs: 0" time=2024-10-11T15:50:34.635-04:00 level=INFO source=images.go:760 msg="total unused blobs removed: 0" time=2024-10-11T15:50:34.635-04:00 level=INFO source=routes.go:1200 msg="Listening on 127.0.0.1:11434 (version 0.3.12)" time=2024-10-11T15:50:34.636-04:00 level=INFO source=common.go:49 msg="Dynamic LLM libraries" runners="[cpu_avx2 cuda_v11 cuda_v12 rocm_v6.1 cpu cpu_avx]" time=2024-10-11T15:50:34.636-04:00 level=INFO source=gpu.go:199 msg="looking for compatible GPUs" time=2024-10-11T15:50:34.758-04:00 level=INFO source=types.go:107 msg="inference compute" id=GPU-40f13575-6ec5-c1b3-c72e-69caef571bd7 library=cuda variant=v12 compute=8.6 driver=12.6 name="NVIDIA GeForce RTX 3080" total="10.0 GiB" available="8.9 GiB" [GIN] 2024/10/11 - 15:50:42 | 200 | 0s | 127.0.0.1 | HEAD "/" [GIN] 2024/10/11 - 15:50:42 | 200 | 517.3µs | 127.0.0.1 | GET "/api/tags" [GIN] 2024/10/11 - 16:03:51 | 200 | 866.5µs | 127.0.0.1 | GET "/api/version" [GIN] 2024/10/11 - 16:03:56 | 200 | 609.6µs | 127.0.0.1 | GET "/api/ps" [GIN] 2024/10/11 - 16:04:00 | 200 | 0s | 127.0.0.1 | GET "/api/tags" [GIN] 2024/10/11 - 16:04:06 | 200 | 0s | 127.0.0.1 | GET "/api/version" [GIN] 2024/10/11 - 16:04:09 | 200 | 0s | 127.0.0.1 | HEAD "/" [GIN] 2024/10/11 - 16:04:09 | 200 | 0s | 127.0.0.1 | GET "/api/ps" [GIN] 2024/10/11 - 16:04:16 | 200 | 0s | 127.0.0.1 | HEAD "/" [GIN] 2024/10/11 - 16:04:16 | 200 | 0s | 127.0.0.1 | GET "/api/tags"
Author
Owner

@rick-github commented on GitHub (Oct 11, 2024):

Well, the server thinks that it successfully completed all 6 commands, 3 curls and 3 ollama client calls. I don't understand why the ps and list commands don't return to the prompt.

Does the same thing happen if you run the commands in a Powershell terminal?

<!-- gh-comment-id:2408065565 --> @rick-github commented on GitHub (Oct 11, 2024): Well, the server thinks that it successfully completed all 6 commands, 3 curls and 3 ollama client calls. I don't understand why the `ps` and `list` commands don't return to the prompt. Does the same thing happen if you run the commands in a Powershell terminal?
Author
Owner

@d3tk commented on GitHub (Oct 11, 2024):

PS C:\Users\dkuts> curl http://localhost:11434/api/version
StatusCode : 200
StatusDescription : OK
Content : {"version":"0.3.12"}
RawContent : HTTP/1.1 200 OK
Content-Length: 20
Content-Type: application/json; charset=utf-8
Date: Fri, 11 Oct 2024 20:16:38 GMT

                {"version":"0.3.12"}

Forms : {}
Headers : {[Content-Length, 20], [Content-Type, application/json; charset=utf-8], [Date, Fri, 11 Oct 2024
20:16:38 GMT]}
Images : {}
InputFields : {}
Links : {}
ParsedHtml : System.__ComObject
RawContentLength : 20
PS C:\Users\dkuts> curl http://localhost:11434/api/ps

StatusCode : 200
StatusDescription : OK
Content : {"models":[]}
RawContent : HTTP/1.1 200 OK
Content-Length: 13
Content-Type: application/json; charset=utf-8
Date: Fri, 11 Oct 2024 20:19:11 GMT

                {"models":[]}

Forms : {}
Headers : {[Content-Length, 13], [Content-Type, application/json; charset=utf-8], [Date, Fri, 11 Oct 2024
20:19:11 GMT]}
Images : {}
InputFields : {}
Links : {}
ParsedHtml : System.__ComObject
RawContentLength : 13
PS C:\Users\dkuts> curl http://localhost:11434/api/tags

StatusCode : 200
StatusDescription : OK
Content : {"models":[]}
RawContent : HTTP/1.1 200 OK
Content-Length: 13
Content-Type: application/json; charset=utf-8
Date: Fri, 11 Oct 2024 20:18:40 GMT

                {"models":[]}

Forms : {}
Headers : {[Content-Length, 13], [Content-Type, application/json; charset=utf-8], [Date, Fri, 11 Oct 2024
20:18:40 GMT]}
Images : {}
InputFields : {}
Links : {}
ParsedHtml : System.__ComObject
RawContentLength : 13

2024/10/11 15:50:34 routes.go:1153: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:C:\Users\dkuts\.ollama\models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]"
time=2024-10-11T15:50:34.635-04:00 level=INFO source=images.go:753 msg="total blobs: 0"
time=2024-10-11T15:50:34.635-04:00 level=INFO source=images.go:760 msg="total unused blobs removed: 0"
time=2024-10-11T15:50:34.635-04:00 level=INFO source=routes.go:1200 msg="Listening on 127.0.0.1:11434 (version 0.3.12)"
time=2024-10-11T15:50:34.636-04:00 level=INFO source=common.go:49 msg="Dynamic LLM libraries" runners="[cpu_avx2 cuda_v11 cuda_v12 rocm_v6.1 cpu cpu_avx]"
time=2024-10-11T15:50:34.636-04:00 level=INFO source=gpu.go:199 msg="looking for compatible GPUs"
time=2024-10-11T15:50:34.758-04:00 level=INFO source=types.go:107 msg="inference compute" id=GPU-40f13575-6ec5-c1b3-c72e-69caef571bd7 library=cuda variant=v12 compute=8.6 driver=12.6 name="NVIDIA GeForce RTX 3080" total="10.0 GiB" available="8.9 GiB"
[GIN] 2024/10/11 - 15:50:42 | 200 | 0s | 127.0.0.1 | HEAD "/"
[GIN] 2024/10/11 - 15:50:42 | 200 | 517.3µs | 127.0.0.1 | GET "/api/tags"
[GIN] 2024/10/11 - 16:03:51 | 200 | 866.5µs | 127.0.0.1 | GET "/api/version"
[GIN] 2024/10/11 - 16:03:56 | 200 | 609.6µs | 127.0.0.1 | GET "/api/ps"
[GIN] 2024/10/11 - 16:04:00 | 200 | 0s | 127.0.0.1 | GET "/api/tags"
[GIN] 2024/10/11 - 16:04:06 | 200 | 0s | 127.0.0.1 | GET "/api/version"
[GIN] 2024/10/11 - 16:04:09 | 200 | 0s | 127.0.0.1 | HEAD "/"
[GIN] 2024/10/11 - 16:04:09 | 200 | 0s | 127.0.0.1 | GET "/api/ps"
[GIN] 2024/10/11 - 16:04:16 | 200 | 0s | 127.0.0.1 | HEAD "/"
[GIN] 2024/10/11 - 16:04:16 | 200 | 0s | 127.0.0.1 | GET "/api/tags"
[GIN] 2024/10/11 - 16:16:38 | 200 | 504.6µs | 127.0.0.1 | GET "/api/version"
[GIN] 2024/10/11 - 16:16:44 | 200 | 0s | 127.0.0.1 | GET "/api/ps"
[GIN] 2024/10/11 - 16:18:40 | 200 | 611.5µs | 127.0.0.1 | GET "/api/tags"
[GIN] 2024/10/11 - 16:18:43 | 200 | 0s | 127.0.0.1 | GET "/api/version"
[GIN] 2024/10/11 - 16:18:46 | 200 | 0s | 127.0.0.1 | HEAD "/"
[GIN] 2024/10/11 - 16:18:46 | 200 | 0s | 127.0.0.1 | GET "/api/ps"
[GIN] 2024/10/11 - 16:18:52 | 200 | 0s | 127.0.0.1 | HEAD "/"
[GIN] 2024/10/11 - 16:18:52 | 200 | 0s | 127.0.0.1 | GET "/api/tags"
[GIN] 2024/10/11 - 16:18:59 | 200 | 0s | 127.0.0.1 | GET "/api/ps"
[GIN] 2024/10/11 - 16:19:11 | 200 | 0s | 127.0.0.1 | GET "/api/ps"
[GIN] 2024/10/11 - 16:19:21 | 200 | 0s | 127.0.0.1 | HEAD "/"
[GIN] 2024/10/11 - 16:19:21 | 200 | 0s | 127.0.0.1 | GET "/api/tags"

powershell didn't print anything from ollama ps or ollama list but ollama version worked.

<!-- gh-comment-id:2408072427 --> @d3tk commented on GitHub (Oct 11, 2024): PS C:\Users\dkuts> curl http://localhost:11434/api/version StatusCode : 200 StatusDescription : OK Content : {"version":"0.3.12"} RawContent : HTTP/1.1 200 OK Content-Length: 20 Content-Type: application/json; charset=utf-8 Date: Fri, 11 Oct 2024 20:16:38 GMT {"version":"0.3.12"} Forms : {} Headers : {[Content-Length, 20], [Content-Type, application/json; charset=utf-8], [Date, Fri, 11 Oct 2024 20:16:38 GMT]} Images : {} InputFields : {} Links : {} ParsedHtml : System.__ComObject RawContentLength : 20 PS C:\Users\dkuts> curl http://localhost:11434/api/ps StatusCode : 200 StatusDescription : OK Content : {"models":[]} RawContent : HTTP/1.1 200 OK Content-Length: 13 Content-Type: application/json; charset=utf-8 Date: Fri, 11 Oct 2024 20:19:11 GMT {"models":[]} Forms : {} Headers : {[Content-Length, 13], [Content-Type, application/json; charset=utf-8], [Date, Fri, 11 Oct 2024 20:19:11 GMT]} Images : {} InputFields : {} Links : {} ParsedHtml : System.__ComObject RawContentLength : 13 PS C:\Users\dkuts> curl http://localhost:11434/api/tags StatusCode : 200 StatusDescription : OK Content : {"models":[]} RawContent : HTTP/1.1 200 OK Content-Length: 13 Content-Type: application/json; charset=utf-8 Date: Fri, 11 Oct 2024 20:18:40 GMT {"models":[]} Forms : {} Headers : {[Content-Length, 13], [Content-Type, application/json; charset=utf-8], [Date, Fri, 11 Oct 2024 20:18:40 GMT]} Images : {} InputFields : {} Links : {} ParsedHtml : System.__ComObject RawContentLength : 13 2024/10/11 15:50:34 routes.go:1153: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:C:\\Users\\dkuts\\.ollama\\models OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES:]" time=2024-10-11T15:50:34.635-04:00 level=INFO source=images.go:753 msg="total blobs: 0" time=2024-10-11T15:50:34.635-04:00 level=INFO source=images.go:760 msg="total unused blobs removed: 0" time=2024-10-11T15:50:34.635-04:00 level=INFO source=routes.go:1200 msg="Listening on 127.0.0.1:11434 (version 0.3.12)" time=2024-10-11T15:50:34.636-04:00 level=INFO source=common.go:49 msg="Dynamic LLM libraries" runners="[cpu_avx2 cuda_v11 cuda_v12 rocm_v6.1 cpu cpu_avx]" time=2024-10-11T15:50:34.636-04:00 level=INFO source=gpu.go:199 msg="looking for compatible GPUs" time=2024-10-11T15:50:34.758-04:00 level=INFO source=types.go:107 msg="inference compute" id=GPU-40f13575-6ec5-c1b3-c72e-69caef571bd7 library=cuda variant=v12 compute=8.6 driver=12.6 name="NVIDIA GeForce RTX 3080" total="10.0 GiB" available="8.9 GiB" [GIN] 2024/10/11 - 15:50:42 | 200 | 0s | 127.0.0.1 | HEAD "/" [GIN] 2024/10/11 - 15:50:42 | 200 | 517.3µs | 127.0.0.1 | GET "/api/tags" [GIN] 2024/10/11 - 16:03:51 | 200 | 866.5µs | 127.0.0.1 | GET "/api/version" [GIN] 2024/10/11 - 16:03:56 | 200 | 609.6µs | 127.0.0.1 | GET "/api/ps" [GIN] 2024/10/11 - 16:04:00 | 200 | 0s | 127.0.0.1 | GET "/api/tags" [GIN] 2024/10/11 - 16:04:06 | 200 | 0s | 127.0.0.1 | GET "/api/version" [GIN] 2024/10/11 - 16:04:09 | 200 | 0s | 127.0.0.1 | HEAD "/" [GIN] 2024/10/11 - 16:04:09 | 200 | 0s | 127.0.0.1 | GET "/api/ps" [GIN] 2024/10/11 - 16:04:16 | 200 | 0s | 127.0.0.1 | HEAD "/" [GIN] 2024/10/11 - 16:04:16 | 200 | 0s | 127.0.0.1 | GET "/api/tags" [GIN] 2024/10/11 - 16:16:38 | 200 | 504.6µs | 127.0.0.1 | GET "/api/version" [GIN] 2024/10/11 - 16:16:44 | 200 | 0s | 127.0.0.1 | GET "/api/ps" [GIN] 2024/10/11 - 16:18:40 | 200 | 611.5µs | 127.0.0.1 | GET "/api/tags" [GIN] 2024/10/11 - 16:18:43 | 200 | 0s | 127.0.0.1 | GET "/api/version" [GIN] 2024/10/11 - 16:18:46 | 200 | 0s | 127.0.0.1 | HEAD "/" [GIN] 2024/10/11 - 16:18:46 | 200 | 0s | 127.0.0.1 | GET "/api/ps" [GIN] 2024/10/11 - 16:18:52 | 200 | 0s | 127.0.0.1 | HEAD "/" [GIN] 2024/10/11 - 16:18:52 | 200 | 0s | 127.0.0.1 | GET "/api/tags" [GIN] 2024/10/11 - 16:18:59 | 200 | 0s | 127.0.0.1 | GET "/api/ps" [GIN] 2024/10/11 - 16:19:11 | 200 | 0s | 127.0.0.1 | GET "/api/ps" [GIN] 2024/10/11 - 16:19:21 | 200 | 0s | 127.0.0.1 | HEAD "/" [GIN] 2024/10/11 - 16:19:21 | 200 | 0s | 127.0.0.1 | GET "/api/tags" powershell didn't print anything from ollama ps or ollama list but ollama version worked.
Author
Owner

@dhiltgen commented on GitHub (Oct 11, 2024):

I'm not sure what's going on here either. It's an unusual failure mode.

When the client commands hang, can you try checking Task Manager to see if something is using a lot of CPU, or is the system ~idle? Some AV products will stop a program while they do investigation to see if it's malicious, but the fact that ollama --version works seems to contract that potential root cause.

Since curl seems to work, it seems more likely to be a client-side problem, so maybe check get-command ollama to see which binary is being used, and maybe try running it under an Admin terminal.

<!-- gh-comment-id:2408239021 --> @dhiltgen commented on GitHub (Oct 11, 2024): I'm not sure what's going on here either. It's an unusual failure mode. When the client commands hang, can you try checking `Task Manager` to see if something is using a lot of CPU, or is the system ~idle? Some AV products will stop a program while they do investigation to see if it's malicious, but the fact that `ollama --version` works seems to contract that potential root cause. Since curl seems to work, it seems more likely to be a client-side problem, so maybe check `get-command ollama` to see which binary is being used, and maybe try running it under an Admin terminal.
Author
Owner

@d3tk commented on GitHub (Oct 15, 2024):

I'm sorry for not getting back to you sooner.

I checked the task manager; nothing was using an excessive amount of CPU, Memory, or GPU. I ran ollama list with an admin terminal, and it did not complete. The binary being used is the only one I have installed currently.

<!-- gh-comment-id:2414658998 --> @d3tk commented on GitHub (Oct 15, 2024): I'm sorry for not getting back to you sooner. I checked the task manager; nothing was using an excessive amount of CPU, Memory, or GPU. I ran `ollama list` with an admin terminal, and it did not complete. The binary being used is the only one I have installed currently.
Author
Owner

@rick-github commented on GitHub (Oct 15, 2024):

At this point I think we are stumped and have no explanation for the program behaviour, so we need more info. On a Linux system I'd use strace to figure out why a process hangs. That's not an option for Windows, but searching for an equivalent turned up procmon. Would it be possible for you to install it and monitor ollama?

<!-- gh-comment-id:2414689195 --> @rick-github commented on GitHub (Oct 15, 2024): At this point I think we are stumped and have no explanation for the program behaviour, so we need more info. On a Linux system I'd use `strace` to figure out why a process hangs. That's not an option for Windows, but searching for an equivalent turned up [`procmon`](https://learn.microsoft.com/en-us/sysinternals/downloads/procmon). Would it be possible for you to install it and monitor ollama?
Author
Owner

@d3tk commented on GitHub (Oct 15, 2024):

I have installed it. Is there anything in particular you'd like me to try?

<!-- gh-comment-id:2414738652 --> @d3tk commented on GitHub (Oct 15, 2024): I have installed it. Is there anything in particular you'd like me to try?
Author
Owner

@rick-github commented on GitHub (Oct 15, 2024):

Start procmon. If it starts with capture on (number of events on bottom of window is increasing), pause by typing Ctrl-E or clicking on the Capture icon (right of the Open and Save icons). In Filter > Filter, turn off all existing filters by clicking on the tick mark to the left of the filters. Then add a new filter for ollama: set Process Name is ollama.exe, click Add then OK. Start capture (Ctrl-E) and run ollama list, Ctrl-C when it hangs. Pause capture and then in File > Save save the captured events as a CSV file. Attach that file to this issue.

I don't know if this will actually give us any useful info, this may be an iterative process.

<!-- gh-comment-id:2414944820 --> @rick-github commented on GitHub (Oct 15, 2024): Start procmon. If it starts with capture on (number of events on bottom of window is increasing), pause by typing Ctrl-E or clicking on the `Capture` icon (right of the `Open` and `Save` icons). In `Filter > Filter`, turn off all existing filters by clicking on the tick mark to the left of the filters. Then add a new filter for ollama: set `Process Name` `is` `ollama.exe`, click `Add` then `OK`. Start capture (Ctrl-E) and run `ollama list`, Ctrl-C when it hangs. Pause capture and then in `File > Save` save the captured events as a CSV file. Attach that file to this issue. I don't know if this will actually give us any useful info, this may be an iterative process.
Author
Owner

@d3tk commented on GitHub (Oct 15, 2024):

Here is the log file obtained
Logfile.CSV

Hopefully its of assistance to you, thank you.

<!-- gh-comment-id:2415122039 --> @d3tk commented on GitHub (Oct 15, 2024): Here is the log file obtained [Logfile.CSV](https://github.com/user-attachments/files/17385017/Logfile.CSV) Hopefully its of assistance to you, thank you.
Author
Owner

@rick-github commented on GitHub (Oct 15, 2024):

Can you do the same again, but this time run ollama -v?

<!-- gh-comment-id:2415195076 --> @rick-github commented on GitHub (Oct 15, 2024): Can you do the same again, but this time run `ollama -v`?
Author
Owner

@d3tk commented on GitHub (Oct 15, 2024):

logfile-ollama-v.CSV

<!-- gh-comment-id:2415201587 --> @d3tk commented on GitHub (Oct 15, 2024): [logfile-ollama-v.CSV](https://github.com/user-attachments/files/17385309/logfile-ollama-v.CSV)
Author
Owner

@LoveFreedomGains commented on GitHub (Oct 18, 2024):

run
'''
netstat -ano | findstr 11434
'''
if your response is
"TCP 127.0.0.1:11434 0.0.0.0:0 LISTENING 27092"
run
taskkill /F /PID 27092 (replace 27092 with what ever your listening on)

i had an old version running in the background after i installed a newer version and it would just crash my ollama instantly until i found this.

i had most of the same issues and results so hopefully this helps you. best of luck!

<!-- gh-comment-id:2421396940 --> @LoveFreedomGains commented on GitHub (Oct 18, 2024): run ''' netstat -ano | findstr 11434 ''' if your response is "TCP 127.0.0.1:11434 0.0.0.0:0 LISTENING 27092" run taskkill /F /PID 27092 (replace 27092 with what ever your listening on) i had an old version running in the background after i installed a newer version and it would just crash my ollama instantly until i found this. i had most of the same issues and results so hopefully this helps you. best of luck!
Author
Owner

@d3tk commented on GitHub (Oct 18, 2024):

Thank you for the suggestion! Unfortunately, this didn't work for me.

<!-- gh-comment-id:2422353661 --> @d3tk commented on GitHub (Oct 18, 2024): Thank you for the suggestion! Unfortunately, this didn't work for me.
Author
Owner

@d3tk commented on GitHub (Oct 22, 2024):

@rick-github any updates on this?

<!-- gh-comment-id:2429115253 --> @d3tk commented on GitHub (Oct 22, 2024): @rick-github any updates on this?
Author
Owner

@rick-github commented on GitHub (Oct 22, 2024):

I've been looking through the logs you supplied and have theories but no solutions.

This is the relevant part of the IP traffic from ollama list on your system:

"4:54:47.0217427 PM","ollama.exe","client","TCP Connect","DESKTOP-Q91IHFM:62381 -> DESKTOP-Q91IHFM:11434","SUCCESS","Length: 0, mss: 65495, sackopt: 1, tsopt: 0, wsopt: 1, rcvwin: 65535, rcvwinscale: 8"
"4:54:47.0217748 PM","ollama.exe","server","TCP Accept","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 0, mss: 65495, sackopt: 1, tsopt: 0, wsopt: 1, rcvwin: 65535, rcvwinscale: 8"
"4:54:47.0218993 PM","ollama.exe","server","TCP TCPCopy","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 155, seqnum: 0, connid: 0"
"4:54:47.0219050 PM","ollama.exe","server","TCP Receive","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 155, seqnum: 0, connid: 0"
"4:54:47.0219202 PM","ollama.exe","client","TCP Send","DESKTOP-Q91IHFM:62381 -> DESKTOP-Q91IHFM:11434","SUCCESS","Length: 155, startime: 1234771, endtime: 1234771, seqnum: 0, connid: 0"       HEAD /
"4:54:47.0220520 PM","ollama.exe","client","TCP TCPCopy","DESKTOP-Q91IHFM:62381 -> DESKTOP-Q91IHFM:11434","SUCCESS","Length: 117, seqnum: 0, connid: 0"
"4:54:47.0220663 PM","ollama.exe","client","TCP Receive","DESKTOP-Q91IHFM:62381 -> DESKTOP-Q91IHFM:11434","SUCCESS","Length: 117, seqnum: 0, connid: 0"
"4:54:47.0220849 PM","ollama.exe","server","TCP Send","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 117, startime: 1234771, endtime: 1234771, seqnum: 0, connid: 0"       HTTP/1.1 200

"4:54:47.0221209 PM","ollama.exe","server","TCP Receive","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 0, seqnum: 0, connid: 0"
"4:54:47.0221658 PM","ollama.exe","server","TCP TCPCopy","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 185, seqnum: 0, connid: 0"
"4:54:47.0221716 PM","ollama.exe","server","TCP Receive","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 185, seqnum: 0, connid: 0"
"4:54:47.0221815 PM","ollama.exe","client","TCP Send","DESKTOP-Q91IHFM:62381 -> DESKTOP-Q91IHFM:11434","SUCCESS","Length: 185, startime: 1234771, endtime: 1234771, seqnum: 0, connid: 0"       GET /api/tags
"4:54:47.0226126 PM","ollama.exe","server","TCP Receive","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 0, seqnum: 0, connid: 0"

"4:55:49.4883427 PM","ollama.exe","server","TCP Receive","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 0, seqnum: 0, connid: 0"
"4:55:49.4883716 PM","ollama.exe","client","TCP Receive","DESKTOP-Q91IHFM:62381 -> DESKTOP-Q91IHFM:11434","SUCCESS","Length: 0, seqnum: 0, connid: 0"
"4:55:49.4883899 PM","ollama.exe","client","TCP Disconnect","DESKTOP-Q91IHFM:62381 -> DESKTOP-Q91IHFM:11434","SUCCESS","Length: 0, seqnum: 0, connid: 0"
"4:55:49.4884778 PM","ollama.exe","server","TCP Disconnect","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 0, seqnum: 0, connid: 0"

I spun up a virtual Windows machine and did ollama list:

"10:13:21.7272536 PM","ollama.exe","client","TCP Connect","DESKTOP-8GDNRT1:50193 -> DESKTOP-8GDNRT1:11434","SUCCESS","Length: 0, mss: 65495, sackopt: 1, tsopt: 0, wsopt: 1, rcvwin: 2619800, rcvwinscale: 8"
"10:13:21.7272893 PM","ollama.exe","server","TCP Accept","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 0, mss: 65495, sackopt: 1, tsopt: 0, wsopt: 1, rcvwin: 2619800, rcvwinscale: 8"
"10:13:21.7275407 PM","ollama.exe","server","TCP Receive","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 154, seqnum: 0, connid: 0"
"10:13:21.7275515 PM","ollama.exe","client","TCP Send","DESKTOP-8GDNRT1:50193 -> DESKTOP-8GDNRT1:11434","SUCCESS","Length: 154, startime: 53746, endtime: 53746, seqnum: 0, connid: 0"            HEAD /
"10:13:21.7336433 PM","ollama.exe","client","TCP Receive","DESKTOP-8GDNRT1:50193 -> DESKTOP-8GDNRT1:11434","SUCCESS","Length: 117, seqnum: 0, connid: 0"
"10:13:21.7336818 PM","ollama.exe","server","TCP Send","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 117, startime: 53746, endtime: 53747, seqnum: 0, connid: 0"            HTTP/1.1 200

"10:13:21.7388229 PM","ollama.exe","server","TCP Receive","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 184, seqnum: 0, connid: 0"
"10:13:21.7388990 PM","ollama.exe","client","TCP Send","DESKTOP-8GDNRT1:50193 -> DESKTOP-8GDNRT1:11434","SUCCESS","Length: 184, startime: 53747, endtime: 53747, seqnum: 0, connid: 0"            GET /api/tags

"10:13:21.9985302 PM","ollama.exe","client","TCP Receive","DESKTOP-8GDNRT1:50193 -> DESKTOP-8GDNRT1:11434","SUCCESS","Length: 790, seqnum: 0, connid: 0"
"10:13:21.9985465 PM","ollama.exe","server","TCP Send","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 790, startime: 53773, endtime: 53773, seqnum: 0, connid: 0"            {}
"10:13:21.9985725 PM","ollama.exe","server","TCP Receive","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 0, seqnum: 0, connid: 0"

"10:13:22.2730638 PM","ollama.exe","server","TCP Receive","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 0, seqnum: 0, connid: 0"
"10:13:22.2730751 PM","ollama.exe","client","TCP Receive","DESKTOP-8GDNRT1:50193 -> DESKTOP-8GDNRT1:11434","SUCCESS","Length: 0, seqnum: 0, connid: 0"
"10:13:22.2730856 PM","ollama.exe","client","TCP Disconnect","DESKTOP-8GDNRT1:50193 -> DESKTOP-8GDNRT1:11434","SUCCESS","Length: 0, seqnum: 0, connid: 0"
"10:13:22.2800457 PM","ollama.exe","server","TCP Disconnect","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 0, seqnum: 0, connid: 0"

Unfortunately Windows networking is not my area of expertise, but two things stand out. You said earlier that you are not running anti-virus (or just Defender). From the log we can see that something is intercepting the traffic (TCPCopy). This is interesting because at 4:54:47.0221209 there's an extra TCP packet on your machine, length 0. If this was a linux machine, I would suspect that that was an RST packet that disrupts the servers 185 byte response to the GET /api/tags request. But it's conjecture. I've been looking online for examples of such behaviour and haven't got any concrete results yet.

All I can suggest at the moment is try to identify whatever is snooping your TCP traffic and trying to disable it.

<!-- gh-comment-id:2429790831 --> @rick-github commented on GitHub (Oct 22, 2024): I've been looking through the logs you supplied and have theories but no solutions. This is the relevant part of the IP traffic from `ollama list` on your system: ``` "4:54:47.0217427 PM","ollama.exe","client","TCP Connect","DESKTOP-Q91IHFM:62381 -> DESKTOP-Q91IHFM:11434","SUCCESS","Length: 0, mss: 65495, sackopt: 1, tsopt: 0, wsopt: 1, rcvwin: 65535, rcvwinscale: 8" "4:54:47.0217748 PM","ollama.exe","server","TCP Accept","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 0, mss: 65495, sackopt: 1, tsopt: 0, wsopt: 1, rcvwin: 65535, rcvwinscale: 8" "4:54:47.0218993 PM","ollama.exe","server","TCP TCPCopy","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 155, seqnum: 0, connid: 0" "4:54:47.0219050 PM","ollama.exe","server","TCP Receive","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 155, seqnum: 0, connid: 0" "4:54:47.0219202 PM","ollama.exe","client","TCP Send","DESKTOP-Q91IHFM:62381 -> DESKTOP-Q91IHFM:11434","SUCCESS","Length: 155, startime: 1234771, endtime: 1234771, seqnum: 0, connid: 0" HEAD / "4:54:47.0220520 PM","ollama.exe","client","TCP TCPCopy","DESKTOP-Q91IHFM:62381 -> DESKTOP-Q91IHFM:11434","SUCCESS","Length: 117, seqnum: 0, connid: 0" "4:54:47.0220663 PM","ollama.exe","client","TCP Receive","DESKTOP-Q91IHFM:62381 -> DESKTOP-Q91IHFM:11434","SUCCESS","Length: 117, seqnum: 0, connid: 0" "4:54:47.0220849 PM","ollama.exe","server","TCP Send","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 117, startime: 1234771, endtime: 1234771, seqnum: 0, connid: 0" HTTP/1.1 200 "4:54:47.0221209 PM","ollama.exe","server","TCP Receive","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 0, seqnum: 0, connid: 0" "4:54:47.0221658 PM","ollama.exe","server","TCP TCPCopy","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 185, seqnum: 0, connid: 0" "4:54:47.0221716 PM","ollama.exe","server","TCP Receive","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 185, seqnum: 0, connid: 0" "4:54:47.0221815 PM","ollama.exe","client","TCP Send","DESKTOP-Q91IHFM:62381 -> DESKTOP-Q91IHFM:11434","SUCCESS","Length: 185, startime: 1234771, endtime: 1234771, seqnum: 0, connid: 0" GET /api/tags "4:54:47.0226126 PM","ollama.exe","server","TCP Receive","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 0, seqnum: 0, connid: 0" "4:55:49.4883427 PM","ollama.exe","server","TCP Receive","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 0, seqnum: 0, connid: 0" "4:55:49.4883716 PM","ollama.exe","client","TCP Receive","DESKTOP-Q91IHFM:62381 -> DESKTOP-Q91IHFM:11434","SUCCESS","Length: 0, seqnum: 0, connid: 0" "4:55:49.4883899 PM","ollama.exe","client","TCP Disconnect","DESKTOP-Q91IHFM:62381 -> DESKTOP-Q91IHFM:11434","SUCCESS","Length: 0, seqnum: 0, connid: 0" "4:55:49.4884778 PM","ollama.exe","server","TCP Disconnect","DESKTOP-Q91IHFM:11434 -> DESKTOP-Q91IHFM:62381","SUCCESS","Length: 0, seqnum: 0, connid: 0" ``` I spun up a virtual Windows machine and did `ollama list`: ``` "10:13:21.7272536 PM","ollama.exe","client","TCP Connect","DESKTOP-8GDNRT1:50193 -> DESKTOP-8GDNRT1:11434","SUCCESS","Length: 0, mss: 65495, sackopt: 1, tsopt: 0, wsopt: 1, rcvwin: 2619800, rcvwinscale: 8" "10:13:21.7272893 PM","ollama.exe","server","TCP Accept","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 0, mss: 65495, sackopt: 1, tsopt: 0, wsopt: 1, rcvwin: 2619800, rcvwinscale: 8" "10:13:21.7275407 PM","ollama.exe","server","TCP Receive","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 154, seqnum: 0, connid: 0" "10:13:21.7275515 PM","ollama.exe","client","TCP Send","DESKTOP-8GDNRT1:50193 -> DESKTOP-8GDNRT1:11434","SUCCESS","Length: 154, startime: 53746, endtime: 53746, seqnum: 0, connid: 0" HEAD / "10:13:21.7336433 PM","ollama.exe","client","TCP Receive","DESKTOP-8GDNRT1:50193 -> DESKTOP-8GDNRT1:11434","SUCCESS","Length: 117, seqnum: 0, connid: 0" "10:13:21.7336818 PM","ollama.exe","server","TCP Send","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 117, startime: 53746, endtime: 53747, seqnum: 0, connid: 0" HTTP/1.1 200 "10:13:21.7388229 PM","ollama.exe","server","TCP Receive","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 184, seqnum: 0, connid: 0" "10:13:21.7388990 PM","ollama.exe","client","TCP Send","DESKTOP-8GDNRT1:50193 -> DESKTOP-8GDNRT1:11434","SUCCESS","Length: 184, startime: 53747, endtime: 53747, seqnum: 0, connid: 0" GET /api/tags "10:13:21.9985302 PM","ollama.exe","client","TCP Receive","DESKTOP-8GDNRT1:50193 -> DESKTOP-8GDNRT1:11434","SUCCESS","Length: 790, seqnum: 0, connid: 0" "10:13:21.9985465 PM","ollama.exe","server","TCP Send","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 790, startime: 53773, endtime: 53773, seqnum: 0, connid: 0" {} "10:13:21.9985725 PM","ollama.exe","server","TCP Receive","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 0, seqnum: 0, connid: 0" "10:13:22.2730638 PM","ollama.exe","server","TCP Receive","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 0, seqnum: 0, connid: 0" "10:13:22.2730751 PM","ollama.exe","client","TCP Receive","DESKTOP-8GDNRT1:50193 -> DESKTOP-8GDNRT1:11434","SUCCESS","Length: 0, seqnum: 0, connid: 0" "10:13:22.2730856 PM","ollama.exe","client","TCP Disconnect","DESKTOP-8GDNRT1:50193 -> DESKTOP-8GDNRT1:11434","SUCCESS","Length: 0, seqnum: 0, connid: 0" "10:13:22.2800457 PM","ollama.exe","server","TCP Disconnect","DESKTOP-8GDNRT1:11434 -> DESKTOP-8GDNRT1:50193","SUCCESS","Length: 0, seqnum: 0, connid: 0" ``` Unfortunately Windows networking is not my area of expertise, but two things stand out. You said earlier that you are not running anti-virus (or just Defender). From the log we can see that something is intercepting the traffic (`TCPCopy`). This is interesting because at `4:54:47.0221209` there's an extra TCP packet on your machine, length 0. If this was a linux machine, I would suspect that that was an RST packet that disrupts the servers 185 byte response to the `GET /api/tags` request. But it's conjecture. I've been looking online for examples of such behaviour and haven't got any concrete results yet. All I can suggest at the moment is try to identify whatever is snooping your TCP traffic and trying to disable it.
Author
Owner

@d3tk commented on GitHub (Oct 22, 2024):

Thank you for the response! I appreciate all your help so far.

I'm not very familiar with Windows networking either, but I understand that you believe something is intercepting/copying the packets sent from Ollama?

I will look into how to find that.

<!-- gh-comment-id:2430050034 --> @d3tk commented on GitHub (Oct 22, 2024): Thank you for the response! I appreciate all your help so far. I'm not very familiar with Windows networking either, but I understand that you believe something is intercepting/copying the packets sent from Ollama? I will look into how to find that.
Author
Owner

@d3tk commented on GitHub (Oct 28, 2024):

@rick-github Do you have any ideas on how I would find which program is doing the TCPCopy?

I found TCPView but, I'm unsure how to configure it to see the program. I tried adding Ollama.exe to my firewall as well as disabling Windows Defender altogether to no avail. I don't see why ollama worked before and has been working (~5 months) and now has recently stopped.

My Jupyter kernels also recently stopped working. Unsure if it's related but those connections time out as well.

<!-- gh-comment-id:2440509302 --> @d3tk commented on GitHub (Oct 28, 2024): @rick-github Do you have any ideas on how I would find which program is doing the TCPCopy? I found [TCPView](https://learn.microsoft.com/en-us/sysinternals/downloads/tcpview) but, I'm unsure how to configure it to see the program. I tried adding Ollama.exe to my firewall as well as disabling Windows Defender altogether to no avail. I don't see why ollama worked before and has been working (~5 months) and now has recently stopped. My Jupyter kernels also recently stopped working. Unsure if it's related but those connections time out as well.
Author
Owner

@rick-github commented on GitHub (Oct 28, 2024):

Because of my hypothesis that something is messing with packets, I'd like to get a packet dump and have a closer look. Install wireshark, start the program, in the "Capture" prompt type "port 11434", click on "Adapter for loopback traffic capture" underneath that, and then on the tool bar click on the blue fin ("Start capturing packets"). Open a command window and run ollama list, then go back to the wireshark window, click on the red square ("Stop capturing packets"), then go to "File > Save" and type "ollama" in the "File name" prompt, click "Save". The packet dump will be in your Documents directory, attach it to this thread and we'll see if there's anything interesting.

<!-- gh-comment-id:2442076351 --> @rick-github commented on GitHub (Oct 28, 2024): Because of my hypothesis that something is messing with packets, I'd like to get a packet dump and have a closer look. Install [wireshark](https://www.wireshark.org/download.html), start the program, in the "Capture" prompt type "port 11434", click on "Adapter for loopback traffic capture" underneath that, and then on the tool bar click on the blue fin ("Start capturing packets"). Open a command window and run `ollama list`, then go back to the wireshark window, click on the red square ("Stop capturing packets"), then go to "File > Save" and type "ollama" in the "File name" prompt, click "Save". The packet dump will be in your Documents directory, attach it to this thread and we'll see if there's anything interesting.
Author
Owner

@rick-github commented on GitHub (Oct 28, 2024):

Probably useful to see what processes are using the network stack too. Start a command prompt in administrator mode, run netstat -abo > ns, and attach ns to this thread.

<!-- gh-comment-id:2442104559 --> @rick-github commented on GitHub (Oct 28, 2024): Probably useful to see what processes are using the network stack too. Start a command prompt in administrator mode, run `netstat -abo > ns`, and attach `ns` to this thread.
Author
Owner

@rick-github commented on GitHub (Oct 28, 2024):

Another late thought: after running ollama list, wait 20 seconds then interrupt the command, then go back to wireshark and save the capture file. The pause will make it clear where the hang occurred.

<!-- gh-comment-id:2442132265 --> @rick-github commented on GitHub (Oct 28, 2024): Another late thought: after running `ollama list`, wait 20 seconds then interrupt the command, then go back to wireshark and save the capture file. The pause will make it clear where the hang occurred.
Author
Owner

@d3tk commented on GitHub (Oct 28, 2024):

ollama-zip.pcapng.gz
i had to zip it to attach it, hopefully, that's ok.

when i run netstat -abo > ns
ns.txt

<!-- gh-comment-id:2442159278 --> @d3tk commented on GitHub (Oct 28, 2024): [ollama-zip.pcapng.gz](https://github.com/user-attachments/files/17546332/ollama-zip.pcapng.gz) i had to zip it to attach it, hopefully, that's ok. when i run netstat -abo > ns [ns.txt](https://github.com/user-attachments/files/17546382/ns.txt)
Author
Owner

@rick-github commented on GitHub (Oct 28, 2024):

From your log:

IP localhost.50220 > localhost.11434: Flags [S], seq 3135272943, win 65535, options [mss 65495,nop,wscale 8,nop,nop,sackOK], length 0
IP localhost.11434 > localhost.50220: Flags [R.], seq 0, ack 3135272944, win 0, length 0
IP localhost.50221 > localhost.11434: Flags [S], seq 2552183209, win 65535, options [mss 65495,nop,wscale 8,nop,nop,sackOK], length 0
IP localhost.11434 > localhost.50221: Flags [R.], seq 0, ack 2552183210, win 0, length 0
IP localhost.50222 > localhost.11434: Flags [S], seq 1890524542, win 65535, options [mss 65495,nop,wscale 8,nop,nop,sackOK], length 0
IP localhost.11434 > localhost.50222: Flags [S.], seq 913857936, ack 1890524543, win 65535, options [mss 65495,nop,wscale 8,nop,nop,sackOK], length 0
IP localhost.50222 > localhost.11434: Flags [.], ack 1, win 255, length 0
IP localhost.50222 > localhost.11434: Flags [P.], seq 1:156, ack 1, win 255, length 155
IP localhost.11434 > localhost.50222: Flags [.], ack 156, win 255, length 0
IP localhost.11434 > localhost.50222: Flags [P.], seq 1:118, ack 156, win 255, length 117
IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, length 0
IP localhost.50222 > localhost.11434: Flags [P.], seq 156:341, ack 118, win 255, length 185
IP localhost.11434 > localhost.50222: Flags [.], ack 341, win 254, length 0
IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1
IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0
IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1
IP localhost.50222 > localhost.11434: Flags [.], seq 340:341, ack 118, win 255, length 1
IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0
IP localhost.11434 > localhost.50222: Flags [.], ack 341, win 254, options [nop,nop,sack 1 {340:341}], length 0
IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1
IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0
IP localhost.50222 > localhost.11434: Flags [.], seq 340:341, ack 118, win 255, length 1
IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1
IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0
IP localhost.11434 > localhost.50222: Flags [.], ack 341, win 254, options [nop,nop,sack 1 {340:341}], length 0
IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1
IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0
IP localhost.50222 > localhost.11434: Flags [.], seq 340:341, ack 118, win 255, length 1
IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1
IP localhost.11434 > localhost.50222: Flags [.], ack 341, win 254, options [nop,nop,sack 1 {340:341}], length 0
IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0
IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1
IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0
IP localhost.50222 > localhost.11434: Flags [.], seq 340:341, ack 118, win 255, length 1
IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1
IP localhost.11434 > localhost.50222: Flags [.], ack 341, win 254, options [nop,nop,sack 1 {340:341}], length 0
IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0
IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1
IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0
IP localhost.50222 > localhost.11434: Flags [.], seq 340:341, ack 118, win 255, length 1
IP localhost.11434 > localhost.50222: Flags [.], ack 341, win 254, options [nop,nop,sack 1 {340:341}], length 0
IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1
IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0
IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1
IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0
IP localhost.50222 > localhost.11434: Flags [.], seq 340:341, ack 118, win 255, length 1
IP localhost.11434 > localhost.50222: Flags [.], ack 341, win 254, options [nop,nop,sack 1 {340:341}], length 0
IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1
IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0
IP localhost.50222 > localhost.11434: Flags [R.], seq 341, ack 118, win 0, length 0

From my virtual machine:

IP localhost.49878 > localhost.11434: Flags [S], seq 2734449753, win 65535, options [mss 65495,nop,wscale 8,nop,nop,sackOK], length 0
IP localhost.11434 > localhost.49878: Flags [S.], seq 3458383066, ack 2734449754, win 65535, options [mss 65495,nop,wscale 8,nop,nop,sackOK], length 0
IP localhost.49878 > localhost.11434: Flags [.], ack 1, win 10233, length 0
IP localhost.49878 > localhost.11434: Flags [P.], seq 1:156, ack 1, win 10233, length 155
IP localhost.11434 > localhost.49878: Flags [.], ack 156, win 10233, length 0
IP localhost.11434 > localhost.49878: Flags [P.], seq 1:118, ack 156, win 10233, length 117
IP localhost.49878 > localhost.11434: Flags [.], ack 118, win 10233, length 0
IP localhost.49878 > localhost.11434: Flags [P.], seq 156:341, ack 118, win 10233, length 185
IP localhost.11434 > localhost.49878: Flags [.], ack 341, win 10232, length 0
IP localhost.11434 > localhost.49878: Flags [P.], seq 118:908, ack 341, win 10232, length 790
IP localhost.49878 > localhost.11434: Flags [.], ack 908, win 10230, length 0
IP localhost.49878 > localhost.11434: Flags [R.], seq 341, ack 908, win 0, length 0

Diffing:

IP localhost.client > localhost.ollama: Flags [S], seq xx, win xx, options [mss xx,nop,wscale 8,nop,nop,sackOK], length 0	IP localhost.client > localhost.ollama: Flags [S], seq xx, win xx, options [mss xx,nop,wscale 8,nop,nop,sackOK], length 0
IP localhost.ollama > localhost.client: Flags [R.], seq xx, ack xx, win xx, length 0					    <
IP localhost.client > localhost.ollama: Flags [S], seq xx, win xx, options [mss xx,nop,wscale 8,nop,nop,sackOK], length 0   <
IP localhost.ollama > localhost.client: Flags [R.], seq xx, ack xx, win xx, length 0					    <
IP localhost.client > localhost.ollama: Flags [S], seq xx, win xx, options [mss xx,nop,wscale 8,nop,nop,sackOK], length 0   <
IP localhost.ollama > localhost.client: Flags [S.], seq xx, ack xx, win xx, options [mss xx,nop,wscale 8,nop,nop,sackOK], 	IP localhost.ollama > localhost.client: Flags [S.], seq xx, ack xx, win xx, options [mss xx,nop,wscale 8,nop,nop,sackOK], 
IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, length 0							IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, length 0
IP localhost.client > localhost.ollama: Flags [P.], seq xx:156, ack xx, win xx, length 155					IP localhost.client > localhost.ollama: Flags [P.], seq xx:156, ack xx, win xx, length 155
IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, length 0							IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, length 0
IP localhost.ollama > localhost.client: Flags [P.], seq xx:118, ack xx, win xx, length 117					IP localhost.ollama > localhost.client: Flags [P.], seq xx:118, ack xx, win xx, length 117
IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, length 0							IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, length 0
IP localhost.client > localhost.ollama: Flags [P.], seq xx:341, ack xx, win xx, length 185					IP localhost.client > localhost.ollama: Flags [P.], seq xx:341, ack xx, win xx, length 185
IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, length 0							IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, length 0
IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1					    |	IP localhost.ollama > localhost.client: Flags [P.], seq xx:908, ack xx, win xx, length 790
IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0	    |	IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, length 0
IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1					    <
IP localhost.client > localhost.ollama: Flags [.], seq xx:341, ack xx, win xx, length 1					    <
IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0	    <
IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, options [nop,nop,sack xx {340:341}], length 0	    <
IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1					    <
IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0	    <
IP localhost.client > localhost.ollama: Flags [.], seq xx:341, ack xx, win xx, length 1					    <
IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1					    <
IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0	    <
IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, options [nop,nop,sack xx {340:341}], length 0	    <
IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1					    <
IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0	    <
IP localhost.client > localhost.ollama: Flags [.], seq xx:341, ack xx, win xx, length 1					    <
IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1					    <
IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, options [nop,nop,sack xx {340:341}], length 0	    <
IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0	    <
IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1					    <
IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0	    <
IP localhost.client > localhost.ollama: Flags [.], seq xx:341, ack xx, win xx, length 1					    <
IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1					    <
IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, options [nop,nop,sack xx {340:341}], length 0	    <
IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0	    <
IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1					    <
IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0	    <
IP localhost.client > localhost.ollama: Flags [.], seq xx:341, ack xx, win xx, length 1					    <
IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, options [nop,nop,sack xx {340:341}], length 0	    <
IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1					    <
IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0	    <
IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1					    <
IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0	    <
IP localhost.client > localhost.ollama: Flags [.], seq xx:341, ack xx, win xx, length 1					    <
IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, options [nop,nop,sack xx {340:341}], length 0	    <
IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1					    <
IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0	    <
IP localhost.client > localhost.ollama: Flags [R.], seq xx, ack xx, win xx, length 0						IP localhost.client > localhost.ollama: Flags [R.], seq xx, ack xx, win xx, length 0

Points of interest:

  1. The server rejects the first two attempts to connect
17:57:22.591328 IP localhost.11434 > localhost.50220: Flags [R.], seq 0, ack 3135272944, win 0, length 0
  1. At the point where the server should respond to the clients request for the model list, it instead retransmits the last byte:
17:57:38.101237 IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1

The client has already ACKd up to byte 118, and the byte being retransmitted is not the same as the one in the original payload. Then the client retransmits the last byte from it's last message (except it's not the same), and the two ping-pong single byte messages until you terminate the client.

The connection resets and the retransmissions smack of packet intercept, but it's not clear where, who or why.

The only interesting process listed in ns.txt is PnkBstrA.exe. A Google search doesn't indicate that it actively interferes with network traffic.

<!-- gh-comment-id:2442633844 --> @rick-github commented on GitHub (Oct 28, 2024): From your log: ``` IP localhost.50220 > localhost.11434: Flags [S], seq 3135272943, win 65535, options [mss 65495,nop,wscale 8,nop,nop,sackOK], length 0 IP localhost.11434 > localhost.50220: Flags [R.], seq 0, ack 3135272944, win 0, length 0 IP localhost.50221 > localhost.11434: Flags [S], seq 2552183209, win 65535, options [mss 65495,nop,wscale 8,nop,nop,sackOK], length 0 IP localhost.11434 > localhost.50221: Flags [R.], seq 0, ack 2552183210, win 0, length 0 IP localhost.50222 > localhost.11434: Flags [S], seq 1890524542, win 65535, options [mss 65495,nop,wscale 8,nop,nop,sackOK], length 0 IP localhost.11434 > localhost.50222: Flags [S.], seq 913857936, ack 1890524543, win 65535, options [mss 65495,nop,wscale 8,nop,nop,sackOK], length 0 IP localhost.50222 > localhost.11434: Flags [.], ack 1, win 255, length 0 IP localhost.50222 > localhost.11434: Flags [P.], seq 1:156, ack 1, win 255, length 155 IP localhost.11434 > localhost.50222: Flags [.], ack 156, win 255, length 0 IP localhost.11434 > localhost.50222: Flags [P.], seq 1:118, ack 156, win 255, length 117 IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, length 0 IP localhost.50222 > localhost.11434: Flags [P.], seq 156:341, ack 118, win 255, length 185 IP localhost.11434 > localhost.50222: Flags [.], ack 341, win 254, length 0 IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1 IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0 IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1 IP localhost.50222 > localhost.11434: Flags [.], seq 340:341, ack 118, win 255, length 1 IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0 IP localhost.11434 > localhost.50222: Flags [.], ack 341, win 254, options [nop,nop,sack 1 {340:341}], length 0 IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1 IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0 IP localhost.50222 > localhost.11434: Flags [.], seq 340:341, ack 118, win 255, length 1 IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1 IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0 IP localhost.11434 > localhost.50222: Flags [.], ack 341, win 254, options [nop,nop,sack 1 {340:341}], length 0 IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1 IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0 IP localhost.50222 > localhost.11434: Flags [.], seq 340:341, ack 118, win 255, length 1 IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1 IP localhost.11434 > localhost.50222: Flags [.], ack 341, win 254, options [nop,nop,sack 1 {340:341}], length 0 IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0 IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1 IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0 IP localhost.50222 > localhost.11434: Flags [.], seq 340:341, ack 118, win 255, length 1 IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1 IP localhost.11434 > localhost.50222: Flags [.], ack 341, win 254, options [nop,nop,sack 1 {340:341}], length 0 IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0 IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1 IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0 IP localhost.50222 > localhost.11434: Flags [.], seq 340:341, ack 118, win 255, length 1 IP localhost.11434 > localhost.50222: Flags [.], ack 341, win 254, options [nop,nop,sack 1 {340:341}], length 0 IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1 IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0 IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1 IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0 IP localhost.50222 > localhost.11434: Flags [.], seq 340:341, ack 118, win 255, length 1 IP localhost.11434 > localhost.50222: Flags [.], ack 341, win 254, options [nop,nop,sack 1 {340:341}], length 0 IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1 IP localhost.50222 > localhost.11434: Flags [.], ack 118, win 255, options [nop,nop,sack 1 {117:118}], length 0 IP localhost.50222 > localhost.11434: Flags [R.], seq 341, ack 118, win 0, length 0 ``` From my virtual machine: ``` IP localhost.49878 > localhost.11434: Flags [S], seq 2734449753, win 65535, options [mss 65495,nop,wscale 8,nop,nop,sackOK], length 0 IP localhost.11434 > localhost.49878: Flags [S.], seq 3458383066, ack 2734449754, win 65535, options [mss 65495,nop,wscale 8,nop,nop,sackOK], length 0 IP localhost.49878 > localhost.11434: Flags [.], ack 1, win 10233, length 0 IP localhost.49878 > localhost.11434: Flags [P.], seq 1:156, ack 1, win 10233, length 155 IP localhost.11434 > localhost.49878: Flags [.], ack 156, win 10233, length 0 IP localhost.11434 > localhost.49878: Flags [P.], seq 1:118, ack 156, win 10233, length 117 IP localhost.49878 > localhost.11434: Flags [.], ack 118, win 10233, length 0 IP localhost.49878 > localhost.11434: Flags [P.], seq 156:341, ack 118, win 10233, length 185 IP localhost.11434 > localhost.49878: Flags [.], ack 341, win 10232, length 0 IP localhost.11434 > localhost.49878: Flags [P.], seq 118:908, ack 341, win 10232, length 790 IP localhost.49878 > localhost.11434: Flags [.], ack 908, win 10230, length 0 IP localhost.49878 > localhost.11434: Flags [R.], seq 341, ack 908, win 0, length 0 ``` Diffing: ```diff IP localhost.client > localhost.ollama: Flags [S], seq xx, win xx, options [mss xx,nop,wscale 8,nop,nop,sackOK], length 0 IP localhost.client > localhost.ollama: Flags [S], seq xx, win xx, options [mss xx,nop,wscale 8,nop,nop,sackOK], length 0 IP localhost.ollama > localhost.client: Flags [R.], seq xx, ack xx, win xx, length 0 < IP localhost.client > localhost.ollama: Flags [S], seq xx, win xx, options [mss xx,nop,wscale 8,nop,nop,sackOK], length 0 < IP localhost.ollama > localhost.client: Flags [R.], seq xx, ack xx, win xx, length 0 < IP localhost.client > localhost.ollama: Flags [S], seq xx, win xx, options [mss xx,nop,wscale 8,nop,nop,sackOK], length 0 < IP localhost.ollama > localhost.client: Flags [S.], seq xx, ack xx, win xx, options [mss xx,nop,wscale 8,nop,nop,sackOK], IP localhost.ollama > localhost.client: Flags [S.], seq xx, ack xx, win xx, options [mss xx,nop,wscale 8,nop,nop,sackOK], IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, length 0 IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, length 0 IP localhost.client > localhost.ollama: Flags [P.], seq xx:156, ack xx, win xx, length 155 IP localhost.client > localhost.ollama: Flags [P.], seq xx:156, ack xx, win xx, length 155 IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, length 0 IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, length 0 IP localhost.ollama > localhost.client: Flags [P.], seq xx:118, ack xx, win xx, length 117 IP localhost.ollama > localhost.client: Flags [P.], seq xx:118, ack xx, win xx, length 117 IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, length 0 IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, length 0 IP localhost.client > localhost.ollama: Flags [P.], seq xx:341, ack xx, win xx, length 185 IP localhost.client > localhost.ollama: Flags [P.], seq xx:341, ack xx, win xx, length 185 IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, length 0 IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, length 0 IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1 | IP localhost.ollama > localhost.client: Flags [P.], seq xx:908, ack xx, win xx, length 790 IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0 | IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, length 0 IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1 < IP localhost.client > localhost.ollama: Flags [.], seq xx:341, ack xx, win xx, length 1 < IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0 < IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, options [nop,nop,sack xx {340:341}], length 0 < IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1 < IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0 < IP localhost.client > localhost.ollama: Flags [.], seq xx:341, ack xx, win xx, length 1 < IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1 < IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0 < IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, options [nop,nop,sack xx {340:341}], length 0 < IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1 < IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0 < IP localhost.client > localhost.ollama: Flags [.], seq xx:341, ack xx, win xx, length 1 < IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1 < IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, options [nop,nop,sack xx {340:341}], length 0 < IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0 < IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1 < IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0 < IP localhost.client > localhost.ollama: Flags [.], seq xx:341, ack xx, win xx, length 1 < IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1 < IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, options [nop,nop,sack xx {340:341}], length 0 < IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0 < IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1 < IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0 < IP localhost.client > localhost.ollama: Flags [.], seq xx:341, ack xx, win xx, length 1 < IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, options [nop,nop,sack xx {340:341}], length 0 < IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1 < IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0 < IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1 < IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0 < IP localhost.client > localhost.ollama: Flags [.], seq xx:341, ack xx, win xx, length 1 < IP localhost.ollama > localhost.client: Flags [.], ack xx, win xx, options [nop,nop,sack xx {340:341}], length 0 < IP localhost.ollama > localhost.client: Flags [.], seq xx:118, ack xx, win xx, length 1 < IP localhost.client > localhost.ollama: Flags [.], ack xx, win xx, options [nop,nop,sack xx {117:118}], length 0 < IP localhost.client > localhost.ollama: Flags [R.], seq xx, ack xx, win xx, length 0 IP localhost.client > localhost.ollama: Flags [R.], seq xx, ack xx, win xx, length 0 ``` Points of interest: 1. The server rejects the first two attempts to connect ``` 17:57:22.591328 IP localhost.11434 > localhost.50220: Flags [R.], seq 0, ack 3135272944, win 0, length 0 ``` 2. At the point where the server should respond to the clients request for the model list, it instead retransmits the last byte: ``` 17:57:38.101237 IP localhost.11434 > localhost.50222: Flags [.], seq 117:118, ack 341, win 254, length 1 ``` The client has already ACKd up to byte 118, and the byte being retransmitted is not the same as the one in the original payload. Then the client retransmits the last byte from it's last message (except it's not the same), and the two ping-pong single byte messages until you terminate the client. The connection resets and the retransmissions smack of packet intercept, but it's not clear where, who or why. The only interesting process listed in ns.txt is PnkBstrA.exe. A Google search doesn't indicate that it actively interferes with network traffic.
Author
Owner

@d3tk commented on GitHub (Oct 29, 2024):

I believe PnkBstrA.exe is an anti cheat. I removed it; however, my issue with Jupyter was recently closed as a "setup issue": https://github.com/microsoft/vscode-jupyter/issues/16115#issuecomment-2442958730.

So I can assume it's the same for this Ollama issue as well. I will attempt to resolve this although, I'm unsure where to start.

<!-- gh-comment-id:2444085868 --> @d3tk commented on GitHub (Oct 29, 2024): I believe PnkBstrA.exe is an anti cheat. I removed it; however, my issue with Jupyter was recently closed as a "setup issue": https://github.com/microsoft/vscode-jupyter/issues/16115#issuecomment-2442958730. So I can assume it's the same for this Ollama issue as well. I will attempt to resolve this although, I'm unsure where to start.
Author
Owner

@rick-github commented on GitHub (Oct 29, 2024):

It's a puzzle, I still don't have any idea what's happening. It's certainly something related to your setup or environment, I just don't know what. If you don't mind sharing the details of what processes your machine is running, could you open a PowerShell window in Administrator mode and run these two commands:

get-process > process.txt
show-netfirewallrule > firewall.txt

and then attach the process.txt and firewall.txt files to this thread.

<!-- gh-comment-id:2444518483 --> @rick-github commented on GitHub (Oct 29, 2024): It's a puzzle, I still don't have any idea what's happening. It's certainly something related to your setup or environment, I just don't know what. If you don't mind sharing the details of what processes your machine is running, could you open a PowerShell window in Administrator mode and run these two commands: ``` get-process > process.txt show-netfirewallrule > firewall.txt ``` and then attach the process.txt and firewall.txt files to this thread.
Author
Owner

@d3tk commented on GitHub (Oct 29, 2024):

Here are those files.
process.txt
firewall.txt

Thank you for continuing to assist me even though it's not directly a problem with Ollama. I appreciate it.

<!-- gh-comment-id:2444682788 --> @d3tk commented on GitHub (Oct 29, 2024): Here are those files. [process.txt](https://github.com/user-attachments/files/17559653/process.txt) [firewall.txt](https://github.com/user-attachments/files/17559659/firewall.txt) Thank you for continuing to assist me even though it's not directly a problem with Ollama. I appreciate it.
Author
Owner

@d3tk commented on GitHub (Nov 5, 2024):

I factory reset my PC and the issue was resolved although obviously not the ideal solution. Thank you for your help @rick-github

<!-- gh-comment-id:2458051956 --> @d3tk commented on GitHub (Nov 5, 2024): I factory reset my PC and the issue was resolved although obviously not the ideal solution. Thank you for your help @rick-github
Author
Owner

@Amarjit commented on GitHub (Jun 17, 2025):

I had this very issue but none of the steps helped. However, I was running it in GIT Bash and switchover to Windows CMD - everything now works as is.

<!-- gh-comment-id:2979934146 --> @Amarjit commented on GitHub (Jun 17, 2025): I had this very issue but none of the steps helped. However, I was running it in GIT Bash and switchover to Windows CMD - everything now works as is.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#4546