[GH-ISSUE #9192] Ollama freezes after running for about 30 minutes #68047

New Issue

GiteaMirror · 2026-05-04T12:22:51-05:00

GiteaMirror commented

2026-05-04 12:22:51 -05:00

Originally created by @someone132s on GitHub (Feb 18, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9192

What is the issue?

My ollama would freeze running when i continuous requesting the apis. I use lightrag to warp up my files, and the lightrag it self is continous accesing the api. I goes well in the beginning, but it stucks in the middle, without any erros. I tried to curl the server and it respond:"ollama is running", but no more api request log appears.
This bug happens both when i run on a single 2080ti, or i ran it with 22080ti + 12070s

Relevant log output

######## i have to remove some logs due to it exceeds the limit of github
llama_new_context_with_model: KV self size  =  192.00 MiB, K (f16):   96.00 MiB, V (f16):   96.00 MiB
llama_new_context_with_model:  CUDA_Host  output buffer size =     0.00 MiB
llama_new_context_with_model: pipeline parallelism enabled (n_copies=4)
llama_new_context_with_model:      CUDA0 compute buffer size =    44.05 MiB
llama_new_context_with_model:      CUDA1 compute buffer size =    36.00 MiB
llama_new_context_with_model:      CUDA2 compute buffer size =    36.01 MiB
llama_new_context_with_model:  CUDA_Host compute buffer size =     8.02 MiB
llama_new_context_with_model: graph nodes  = 849
llama_new_context_with_model: graph splits = 6 (with bs=512), 4 (with bs=1)
time=2025-02-18T11:47:54.387Z level=INFO source=server.go:596 msg="llama runner started in 3.78 seconds"
[GIN] 2025/02/18 - 11:47:54 | 200 |  6.991810122s |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:47:57 | 200 |   2.99960913s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:47:58 | 200 |   87.444843ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:48:14 | 200 | 15.827811858s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:48:14 | 200 |  156.818011ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:48:22 | 200 |  7.733732731s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:48:22 | 200 |   94.040815ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:48:34 | 200 | 12.396726806s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:48:35 | 200 |   81.625914ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:48:49 | 200 | 13.968301396s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:48:49 | 200 |   96.175323ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:48:58 | 200 |  9.236436077s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:48:59 | 200 |   93.136679ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:49:09 | 200 |  10.55765395s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:49:09 | 200 |   97.928473ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:49:21 | 200 | 11.638764515s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:49:21 | 200 |    92.24764ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:49:35 | 200 | 13.797225903s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:49:35 | 200 |   55.231598ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:49:47 | 200 | 11.130778013s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:49:47 | 200 |   73.678462ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:49:59 | 200 | 11.990563187s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:49:59 | 200 |  131.000807ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:50:18 | 200 | 18.461387046s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:50:18 | 200 |  102.737971ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:50:36 | 200 | 17.872230359s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:50:36 | 200 |  124.024723ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:50:56 | 200 | 19.313041913s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:50:56 | 200 |  167.517494ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:51:08 | 200 | 12.077054682s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:51:09 | 200 |  181.015887ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:51:26 | 200 | 17.456845767s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:51:26 | 200 |    76.82471ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:51:33 | 200 |  6.912768271s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:51:34 | 200 |   92.830663ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:52:02 | 200 | 28.033651907s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:52:02 | 200 |  108.908826ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:52:17 | 200 |  15.16052027s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:52:17 | 200 |   75.976801ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:52:34 | 200 | 16.862529305s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:52:35 | 200 |  109.406592ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:52:50 | 200 | 15.035679025s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:52:50 | 200 |   67.400053ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:53:05 | 200 | 15.408265938s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:53:06 | 200 |  111.145324ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:53:21 | 200 | 14.870725323s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:53:21 | 200 |   99.185904ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:53:30 | 200 |   9.28962787s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:53:31 | 200 |  115.420645ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:53:43 | 200 | 12.183088435s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:53:43 | 200 |   93.583619ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:53:58 | 200 | 15.249658602s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:53:59 | 200 |   126.20557ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:54:14 | 200 | 15.265152354s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:54:14 | 200 |   96.574386ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:54:26 | 200 | 11.999946035s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:54:27 | 200 |   77.903923ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:54:48 | 200 | 21.518267634s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:54:48 | 200 |   96.630736ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:54:57 | 200 |  8.932644921s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:54:58 | 200 |   66.030942ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:55:07 | 200 |  9.406115054s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:55:07 | 200 |  127.067794ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:55:16 | 200 |  8.405475338s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:55:16 | 200 |   92.259028ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:55:25 | 200 |  8.657938964s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:55:25 | 200 |   68.405776ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:55:32 | 200 |  7.307305889s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:55:33 | 200 |  163.463103ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:55:46 | 200 | 12.770598013s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:55:46 | 200 |  152.346571ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:56:04 | 200 | 17.870624304s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:56:04 | 200 |  116.821285ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:56:22 | 200 | 17.799633537s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:56:22 | 200 |   125.96027ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:56:32 | 200 |  9.685478414s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:56:32 | 200 |   70.918549ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:56:43 | 200 | 10.202180119s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:56:43 | 200 |  156.573267ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:56:51 | 200 |  8.518470567s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:56:52 | 200 |  117.712609ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:57:02 | 200 |  9.791925971s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:57:02 | 200 |   99.492881ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:57:16 | 200 | 13.967740654s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:57:16 | 200 |  105.349307ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:57:28 | 200 | 12.181205601s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:57:29 | 200 |  126.527454ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:57:57 | 200 | 28.805205255s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:57:58 | 200 |  123.459954ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:58:11 | 200 | 13.318964916s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:58:11 | 200 |   100.04507ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:58:26 | 200 | 14.071201471s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:58:26 | 200 |  100.287265ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:58:42 | 200 | 15.868777815s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:58:42 | 200 |  121.475685ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:58:55 | 200 | 12.443102232s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:58:55 | 200 |   96.635155ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:59:09 | 200 | 14.146508533s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:59:09 | 200 |   73.568171ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:59:23 | 200 | 13.730254615s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:59:23 | 200 |   68.629926ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:59:36 | 200 | 12.738095612s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:59:36 | 200 |  122.967567ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 11:59:53 | 200 | 16.369554429s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 11:59:53 | 200 |   62.796854ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:00:05 | 200 | 11.704645878s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:00:05 | 200 |  104.375158ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:00:14 | 200 |  9.082057318s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:00:14 | 200 |  116.923779ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:00:26 | 200 | 11.707495992s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:00:27 | 200 |  155.172508ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:00:43 | 200 | 15.932321826s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:00:43 | 200 |  101.939819ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:00:57 | 200 |  13.77822027s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:00:57 | 200 |  101.187094ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:01:17 | 200 | 20.359287528s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:01:18 | 200 |  113.730353ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:01:31 | 200 | 12.947596775s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:01:31 | 200 |  111.962461ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:01:47 | 200 | 15.465666474s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:01:47 | 200 |  133.138536ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:02:06 | 200 | 19.173972525s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:02:06 | 200 |  129.876264ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:02:19 | 200 | 12.340948398s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:02:19 | 200 |   59.804225ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:02:31 | 200 | 11.616769165s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:02:31 | 200 |   88.947215ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:02:51 | 200 | 20.374255753s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:02:52 | 200 |   90.995855ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:03:09 | 200 | 17.599653318s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:03:10 | 200 |  147.808667ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:03:25 | 200 | 14.897392151s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:03:25 | 200 |  110.638814ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:03:32 | 200 |  7.349226743s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:03:32 | 200 |   67.434844ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:03:52 | 200 |  19.34004411s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:03:52 | 200 |   93.269417ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:04:05 | 200 | 13.189722987s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:04:06 | 200 |   81.706983ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:04:17 | 200 | 11.528415386s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:04:17 | 200 |   151.84016ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:04:36 | 200 | 18.302724024s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:04:36 | 200 |   140.68582ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:04:52 | 200 | 15.855435131s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:04:52 | 200 |  109.184937ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:05:10 | 200 | 18.083868648s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:05:11 | 200 |  123.135534ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:05:24 | 200 | 12.780803858s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:05:24 | 200 |  107.870586ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:05:39 | 200 |  14.57802471s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:05:39 | 200 |  118.236932ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:05:50 | 200 | 11.441389135s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:05:51 | 200 |  106.734744ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:06:03 | 200 | 12.605194015s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:06:03 | 200 |   76.888896ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:06:21 | 200 | 17.283483683s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:06:21 | 200 |  101.729499ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:06:33 | 200 | 11.920233466s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:06:33 | 200 |   40.445532ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:06:56 | 200 | 21.877395058s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:06:56 | 200 |     65.6509ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:07:04 | 200 |   7.79148264s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:07:04 | 200 |   45.952271ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:07:17 | 200 | 13.094722945s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:07:17 | 200 |   34.837498ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:07:32 | 200 | 13.897071605s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:07:32 | 200 |   54.057416ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:07:48 | 200 | 16.037934144s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:07:48 | 200 |    55.52058ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:08:06 | 200 | 17.379275243s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:08:06 | 200 |   65.873962ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:08:23 | 200 | 16.293139019s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:08:23 | 200 |   63.527748ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:08:39 | 200 | 15.409180214s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:08:39 | 200 |   61.346405ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:08:52 | 200 | 12.478841245s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:08:52 | 200 |   35.667818ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:08:57 | 200 |     119.879µs |      172.18.0.4 | GET      "/api/version"
[GIN] 2025/02/18 - 12:09:06 | 200 | 13.982067943s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:09:06 | 200 |   40.458865ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:09:16 | 200 |  9.966110062s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:09:16 | 200 |   34.777288ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:09:30 | 200 | 13.020979591s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:09:30 | 200 |   35.903507ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:09:45 | 200 | 14.675168807s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:09:45 | 200 |    41.26276ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:09:58 | 200 | 13.292693464s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:09:59 | 200 |   36.717776ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:10:12 | 200 | 12.813768294s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:10:12 | 200 |   34.789926ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:10:23 | 200 | 11.297644698s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:10:24 | 200 |   36.833891ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:10:43 | 200 | 19.009689616s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:10:43 | 200 |    55.23222ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:10:57 | 200 | 13.491980926s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:10:57 | 200 |   36.794464ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:11:07 | 200 | 10.128035358s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:11:07 | 200 |   34.211841ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:11:18 | 200 | 10.399057033s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:11:18 | 200 |   31.340228ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:11:29 | 200 | 10.155373892s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:11:29 | 200 |   31.584076ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:11:29 | 200 |   86.101386ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:11:41 | 200 | 12.221585501s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:11:41 | 200 |   34.472963ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:11:55 | 200 | 13.188158826s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:11:55 | 200 |   46.569093ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:12:06 | 200 | 10.953766383s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:12:06 | 200 |   39.362444ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:12:07 | 200 |  118.643023ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:12:15 | 200 |  8.486126192s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:12:16 | 200 |   32.957399ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:12:16 | 200 |   55.436483ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:12:24 | 200 |  8.471614393s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:12:25 | 200 |   38.295057ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:12:34 | 200 |  9.558316073s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:12:34 | 200 |   52.848549ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:12:52 | 200 | 17.152761796s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:12:52 | 200 |   55.636313ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:13:09 | 200 | 16.640497666s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:13:09 | 200 |   57.288826ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:13:28 | 200 |  18.34016111s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:13:28 | 200 |   69.957034ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:13:42 | 200 | 14.168628322s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:13:43 | 200 |   44.608226ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:13:43 | 200 |   66.050842ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:13:58 | 200 | 15.260324543s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:13:58 | 200 |   52.598381ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:13:59 | 200 |   97.786259ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:14:15 | 200 | 16.216780827s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:14:15 | 200 |   57.231622ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:14:16 | 200 |   78.531275ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:14:29 | 200 | 13.088362566s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:14:29 | 200 |   35.924717ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:14:29 | 200 |  112.684084ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:14:43 | 200 | 14.090612103s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:14:44 | 200 |   37.904779ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:14:44 | 200 |  105.793901ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:14:44 | 200 |  107.836115ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:14:54 | 200 |  9.360440639s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:14:54 | 200 |   48.659543ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:14:54 | 200 |  110.037573ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:15:07 | 200 | 13.282833587s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:15:08 | 200 |   47.992696ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:15:21 | 200 | 13.131459278s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:15:21 | 200 |   56.047899ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:15:22 | 200 |   86.108017ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:15:22 | 200 |   95.797719ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:15:31 | 200 |  9.265294341s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:15:31 | 200 |   39.152304ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:15:47 | 200 | 15.933449633s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:15:48 | 200 |   87.551098ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:16:01 | 200 | 13.258156291s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:16:01 | 200 |   86.232846ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:16:09 | 200 |   7.58781595s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:16:09 | 200 |   47.686869ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:16:16 | 200 |  6.411131337s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:16:16 | 200 |   41.737058ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:16:31 | 200 | 14.773528148s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:16:31 | 200 |   56.571984ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:16:41 | 200 |   77.009372ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:16:46 | 200 |  4.121336426s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:17:57 | 200 |         1m11s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:18:20 | 200 | 23.675476544s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:22:46 | 200 |         4m25s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:22:55 | 200 |  110.478457ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:23:45 | 200 | 49.741107821s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:24:46 | 200 |  183.367498ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:48 | 200 |  125.058939ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   81.793764ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   72.718627ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   35.538136ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   38.535779ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   50.531758ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   49.422229ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   58.815483ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   65.669451ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   36.047721ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   49.197432ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   40.232723ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   55.482724ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   34.962061ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   50.318221ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   35.847043ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   45.147328ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   37.465368ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:49 | 200 |   38.112062ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:50 | 200 |   47.902634ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:50 | 200 |  208.951943ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:50 | 200 |   37.283051ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:50 | 200 |   36.697765ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:50 | 200 |   37.251279ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:50 | 200 |   42.573931ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:55 | 200 |   158.82803ms |  10.248.155.225 | POST     "/api/embeddings"
[GIN] 2025/02/18 - 12:24:58 | 200 |  2.458931806s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:24:59 | 200 |  3.184130972s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:02 | 200 |  6.460281743s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:05 | 200 |  9.095924918s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:06 | 200 | 10.200337843s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:07 | 200 |  11.24102892s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:08 | 200 | 12.144235082s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:09 | 200 | 13.558786579s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:10 | 200 | 14.688847624s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:12 | 200 | 15.768576279s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:13 | 200 | 17.630091603s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:16 | 200 | 19.887408238s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:17 | 200 | 21.704978834s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:19 | 200 | 23.641673287s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:20 | 200 | 24.556206975s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:21 | 200 | 25.471211428s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:24 | 200 | 27.814557179s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:26 | 200 | 30.463379797s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:27 | 200 |  31.55678356s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:28 | 200 | 32.678623061s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:30 | 200 | 33.800896168s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:33 | 200 | 37.497692842s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:35 | 200 | 39.530468826s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:47 | 200 | 45.064181681s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:52 | 200 |  4.670538769s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:54 | 200 |  1.091034209s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:56 | 200 |  1.622430695s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:25:58 | 200 |  1.837206477s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:26:00 | 200 |  1.923796829s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:26:02 | 200 |  1.803793467s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:26:03 | 200 |  1.400159666s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:26:05 | 200 |  1.451028766s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:26:07 | 200 |  1.522554267s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:26:10 | 200 |  2.973402146s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:26:12 | 200 |  1.402188178s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:26:14 | 200 |  1.766171756s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:26:33 | 200 | 19.047165484s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:26:37 | 200 |  3.605876072s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:26:39 | 200 |  1.794334876s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:26:53 | 200 | 14.505359655s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:12 | 200 | 18.237957401s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:14 | 200 |  1.381599466s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:16 | 200 |  2.437525331s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:18 | 200 |  1.572519703s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:22 | 200 |  3.783956424s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:26 | 200 |  3.447986505s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:28 | 200 |  2.152106162s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:30 | 200 |  2.058221448s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:32 | 200 |  1.864975055s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:45 | 200 | 12.605522364s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:48 | 200 |  2.353966687s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:50 | 200 |  1.706299363s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:52 | 200 |  1.631209239s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:54 | 200 |  1.603601722s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:55 | 200 |  1.301305717s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:57 | 200 |  1.459390508s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:27:59 | 200 |  1.998766268s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:28:14 | 200 | 14.316765002s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:28:21 | 200 |  7.592090466s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:28:27 | 200 |  4.823105549s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:28:28 | 200 |  1.665032453s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:28:32 | 200 |  3.089487108s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:28:36 | 200 |  3.846079805s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:28:38 | 200 |  2.446554392s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:28:40 | 200 |  1.520332877s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:28:52 | 200 | 11.170230973s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:28:54 | 200 |  1.858797707s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:28:56 | 200 |  1.877182153s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:28:58 | 200 |  1.928485184s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:29:12 | 200 | 13.702858533s |  10.248.155.225 | POST     "/api/chat"
[GIN] 2025/02/18 - 12:29:15 | 200 |  2.580146238s |  10.248.155.225 | POST     "/api/chat"
time=2025-02-18T12:55:01.141Z level=WARN source=sched.go:646 msg="gpu VRAM usage didn't recover within timeout" seconds=5.340303658 model=/root/.ollama/models/blobs/sha256-daec91ffb5dd0c27411bd71f29932917c49cf529a641d0168496c3a501e3062c
time=2025-02-18T12:55:01.760Z level=WARN source=sched.go:646 msg="gpu VRAM usage didn't recover within timeout" seconds=5.959220854 model=/root/.ollama/models/blobs/sha256-daec91ffb5dd0c27411bd71f29932917c49cf529a641d0168496c3a501e3062c
time=2025-02-18T12:55:02.486Z level=WARN source=sched.go:646 msg="gpu VRAM usage didn't recover within timeout" seconds=6.685155794 model=/root/.ollama/models/blobs/sha256-daec91ffb5dd0c27411bd71f29932917c49cf529a641d0168496c3a501e3062c

OS

Linux

GPU

Nvidia

CPU

AMD

Ollama version

0.5.11

Originally created by @someone132s on GitHub (Feb 18, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9192 ### What is the issue? My ollama would freeze running when i continuous requesting the apis. I use lightrag to warp up my files, and the lightrag it self is continous accesing the api. I goes well in the beginning, but it stucks in the middle, without any erros. I tried to curl the server and it respond:"ollama is running", but no more api request log appears. This bug happens both when i run on a single 2080ti, or i ran it with 2*2080ti + 1*2070s ### Relevant log output ```shell ######## i have to remove some logs due to it exceeds the limit of github llama_new_context_with_model: KV self size = 192.00 MiB, K (f16): 96.00 MiB, V (f16): 96.00 MiB llama_new_context_with_model: CUDA_Host output buffer size = 0.00 MiB llama_new_context_with_model: pipeline parallelism enabled (n_copies=4) llama_new_context_with_model: CUDA0 compute buffer size = 44.05 MiB llama_new_context_with_model: CUDA1 compute buffer size = 36.00 MiB llama_new_context_with_model: CUDA2 compute buffer size = 36.01 MiB llama_new_context_with_model: CUDA_Host compute buffer size = 8.02 MiB llama_new_context_with_model: graph nodes = 849 llama_new_context_with_model: graph splits = 6 (with bs=512), 4 (with bs=1) time=2025-02-18T11:47:54.387Z level=INFO source=server.go:596 msg="llama runner started in 3.78 seconds" [GIN] 2025/02/18 - 11:47:54 | 200 | 6.991810122s | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:47:57 | 200 | 2.99960913s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:47:58 | 200 | 87.444843ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:48:14 | 200 | 15.827811858s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:48:14 | 200 | 156.818011ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:48:22 | 200 | 7.733732731s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:48:22 | 200 | 94.040815ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:48:34 | 200 | 12.396726806s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:48:35 | 200 | 81.625914ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:48:49 | 200 | 13.968301396s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:48:49 | 200 | 96.175323ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:48:58 | 200 | 9.236436077s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:48:59 | 200 | 93.136679ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:49:09 | 200 | 10.55765395s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:49:09 | 200 | 97.928473ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:49:21 | 200 | 11.638764515s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:49:21 | 200 | 92.24764ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:49:35 | 200 | 13.797225903s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:49:35 | 200 | 55.231598ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:49:47 | 200 | 11.130778013s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:49:47 | 200 | 73.678462ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:49:59 | 200 | 11.990563187s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:49:59 | 200 | 131.000807ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:50:18 | 200 | 18.461387046s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:50:18 | 200 | 102.737971ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:50:36 | 200 | 17.872230359s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:50:36 | 200 | 124.024723ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:50:56 | 200 | 19.313041913s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:50:56 | 200 | 167.517494ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:51:08 | 200 | 12.077054682s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:51:09 | 200 | 181.015887ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:51:26 | 200 | 17.456845767s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:51:26 | 200 | 76.82471ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:51:33 | 200 | 6.912768271s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:51:34 | 200 | 92.830663ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:52:02 | 200 | 28.033651907s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:52:02 | 200 | 108.908826ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:52:17 | 200 | 15.16052027s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:52:17 | 200 | 75.976801ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:52:34 | 200 | 16.862529305s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:52:35 | 200 | 109.406592ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:52:50 | 200 | 15.035679025s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:52:50 | 200 | 67.400053ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:53:05 | 200 | 15.408265938s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:53:06 | 200 | 111.145324ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:53:21 | 200 | 14.870725323s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:53:21 | 200 | 99.185904ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:53:30 | 200 | 9.28962787s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:53:31 | 200 | 115.420645ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:53:43 | 200 | 12.183088435s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:53:43 | 200 | 93.583619ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:53:58 | 200 | 15.249658602s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:53:59 | 200 | 126.20557ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:54:14 | 200 | 15.265152354s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:54:14 | 200 | 96.574386ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:54:26 | 200 | 11.999946035s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:54:27 | 200 | 77.903923ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:54:48 | 200 | 21.518267634s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:54:48 | 200 | 96.630736ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:54:57 | 200 | 8.932644921s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:54:58 | 200 | 66.030942ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:55:07 | 200 | 9.406115054s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:55:07 | 200 | 127.067794ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:55:16 | 200 | 8.405475338s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:55:16 | 200 | 92.259028ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:55:25 | 200 | 8.657938964s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:55:25 | 200 | 68.405776ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:55:32 | 200 | 7.307305889s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:55:33 | 200 | 163.463103ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:55:46 | 200 | 12.770598013s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:55:46 | 200 | 152.346571ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:56:04 | 200 | 17.870624304s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:56:04 | 200 | 116.821285ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:56:22 | 200 | 17.799633537s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:56:22 | 200 | 125.96027ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:56:32 | 200 | 9.685478414s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:56:32 | 200 | 70.918549ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:56:43 | 200 | 10.202180119s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:56:43 | 200 | 156.573267ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:56:51 | 200 | 8.518470567s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:56:52 | 200 | 117.712609ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:57:02 | 200 | 9.791925971s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:57:02 | 200 | 99.492881ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:57:16 | 200 | 13.967740654s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:57:16 | 200 | 105.349307ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:57:28 | 200 | 12.181205601s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:57:29 | 200 | 126.527454ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:57:57 | 200 | 28.805205255s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:57:58 | 200 | 123.459954ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:58:11 | 200 | 13.318964916s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:58:11 | 200 | 100.04507ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:58:26 | 200 | 14.071201471s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:58:26 | 200 | 100.287265ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:58:42 | 200 | 15.868777815s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:58:42 | 200 | 121.475685ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:58:55 | 200 | 12.443102232s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:58:55 | 200 | 96.635155ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:59:09 | 200 | 14.146508533s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:59:09 | 200 | 73.568171ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:59:23 | 200 | 13.730254615s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:59:23 | 200 | 68.629926ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:59:36 | 200 | 12.738095612s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:59:36 | 200 | 122.967567ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 11:59:53 | 200 | 16.369554429s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 11:59:53 | 200 | 62.796854ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:00:05 | 200 | 11.704645878s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:00:05 | 200 | 104.375158ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:00:14 | 200 | 9.082057318s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:00:14 | 200 | 116.923779ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:00:26 | 200 | 11.707495992s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:00:27 | 200 | 155.172508ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:00:43 | 200 | 15.932321826s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:00:43 | 200 | 101.939819ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:00:57 | 200 | 13.77822027s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:00:57 | 200 | 101.187094ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:01:17 | 200 | 20.359287528s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:01:18 | 200 | 113.730353ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:01:31 | 200 | 12.947596775s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:01:31 | 200 | 111.962461ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:01:47 | 200 | 15.465666474s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:01:47 | 200 | 133.138536ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:02:06 | 200 | 19.173972525s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:02:06 | 200 | 129.876264ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:02:19 | 200 | 12.340948398s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:02:19 | 200 | 59.804225ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:02:31 | 200 | 11.616769165s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:02:31 | 200 | 88.947215ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:02:51 | 200 | 20.374255753s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:02:52 | 200 | 90.995855ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:03:09 | 200 | 17.599653318s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:03:10 | 200 | 147.808667ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:03:25 | 200 | 14.897392151s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:03:25 | 200 | 110.638814ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:03:32 | 200 | 7.349226743s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:03:32 | 200 | 67.434844ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:03:52 | 200 | 19.34004411s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:03:52 | 200 | 93.269417ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:04:05 | 200 | 13.189722987s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:04:06 | 200 | 81.706983ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:04:17 | 200 | 11.528415386s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:04:17 | 200 | 151.84016ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:04:36 | 200 | 18.302724024s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:04:36 | 200 | 140.68582ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:04:52 | 200 | 15.855435131s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:04:52 | 200 | 109.184937ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:05:10 | 200 | 18.083868648s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:05:11 | 200 | 123.135534ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:05:24 | 200 | 12.780803858s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:05:24 | 200 | 107.870586ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:05:39 | 200 | 14.57802471s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:05:39 | 200 | 118.236932ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:05:50 | 200 | 11.441389135s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:05:51 | 200 | 106.734744ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:06:03 | 200 | 12.605194015s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:06:03 | 200 | 76.888896ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:06:21 | 200 | 17.283483683s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:06:21 | 200 | 101.729499ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:06:33 | 200 | 11.920233466s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:06:33 | 200 | 40.445532ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:06:56 | 200 | 21.877395058s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:06:56 | 200 | 65.6509ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:07:04 | 200 | 7.79148264s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:07:04 | 200 | 45.952271ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:07:17 | 200 | 13.094722945s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:07:17 | 200 | 34.837498ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:07:32 | 200 | 13.897071605s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:07:32 | 200 | 54.057416ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:07:48 | 200 | 16.037934144s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:07:48 | 200 | 55.52058ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:08:06 | 200 | 17.379275243s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:08:06 | 200 | 65.873962ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:08:23 | 200 | 16.293139019s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:08:23 | 200 | 63.527748ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:08:39 | 200 | 15.409180214s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:08:39 | 200 | 61.346405ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:08:52 | 200 | 12.478841245s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:08:52 | 200 | 35.667818ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:08:57 | 200 | 119.879µs | 172.18.0.4 | GET "/api/version" [GIN] 2025/02/18 - 12:09:06 | 200 | 13.982067943s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:09:06 | 200 | 40.458865ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:09:16 | 200 | 9.966110062s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:09:16 | 200 | 34.777288ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:09:30 | 200 | 13.020979591s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:09:30 | 200 | 35.903507ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:09:45 | 200 | 14.675168807s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:09:45 | 200 | 41.26276ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:09:58 | 200 | 13.292693464s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:09:59 | 200 | 36.717776ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:10:12 | 200 | 12.813768294s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:10:12 | 200 | 34.789926ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:10:23 | 200 | 11.297644698s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:10:24 | 200 | 36.833891ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:10:43 | 200 | 19.009689616s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:10:43 | 200 | 55.23222ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:10:57 | 200 | 13.491980926s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:10:57 | 200 | 36.794464ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:11:07 | 200 | 10.128035358s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:11:07 | 200 | 34.211841ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:11:18 | 200 | 10.399057033s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:11:18 | 200 | 31.340228ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:11:29 | 200 | 10.155373892s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:11:29 | 200 | 31.584076ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:11:29 | 200 | 86.101386ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:11:41 | 200 | 12.221585501s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:11:41 | 200 | 34.472963ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:11:55 | 200 | 13.188158826s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:11:55 | 200 | 46.569093ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:12:06 | 200 | 10.953766383s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:12:06 | 200 | 39.362444ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:12:07 | 200 | 118.643023ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:12:15 | 200 | 8.486126192s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:12:16 | 200 | 32.957399ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:12:16 | 200 | 55.436483ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:12:24 | 200 | 8.471614393s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:12:25 | 200 | 38.295057ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:12:34 | 200 | 9.558316073s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:12:34 | 200 | 52.848549ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:12:52 | 200 | 17.152761796s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:12:52 | 200 | 55.636313ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:13:09 | 200 | 16.640497666s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:13:09 | 200 | 57.288826ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:13:28 | 200 | 18.34016111s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:13:28 | 200 | 69.957034ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:13:42 | 200 | 14.168628322s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:13:43 | 200 | 44.608226ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:13:43 | 200 | 66.050842ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:13:58 | 200 | 15.260324543s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:13:58 | 200 | 52.598381ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:13:59 | 200 | 97.786259ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:14:15 | 200 | 16.216780827s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:14:15 | 200 | 57.231622ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:14:16 | 200 | 78.531275ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:14:29 | 200 | 13.088362566s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:14:29 | 200 | 35.924717ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:14:29 | 200 | 112.684084ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:14:43 | 200 | 14.090612103s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:14:44 | 200 | 37.904779ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:14:44 | 200 | 105.793901ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:14:44 | 200 | 107.836115ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:14:54 | 200 | 9.360440639s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:14:54 | 200 | 48.659543ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:14:54 | 200 | 110.037573ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:15:07 | 200 | 13.282833587s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:15:08 | 200 | 47.992696ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:15:21 | 200 | 13.131459278s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:15:21 | 200 | 56.047899ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:15:22 | 200 | 86.108017ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:15:22 | 200 | 95.797719ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:15:31 | 200 | 9.265294341s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:15:31 | 200 | 39.152304ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:15:47 | 200 | 15.933449633s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:15:48 | 200 | 87.551098ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:16:01 | 200 | 13.258156291s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:16:01 | 200 | 86.232846ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:16:09 | 200 | 7.58781595s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:16:09 | 200 | 47.686869ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:16:16 | 200 | 6.411131337s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:16:16 | 200 | 41.737058ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:16:31 | 200 | 14.773528148s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:16:31 | 200 | 56.571984ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:16:41 | 200 | 77.009372ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:16:46 | 200 | 4.121336426s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:17:57 | 200 | 1m11s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:18:20 | 200 | 23.675476544s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:22:46 | 200 | 4m25s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:22:55 | 200 | 110.478457ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:23:45 | 200 | 49.741107821s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:24:46 | 200 | 183.367498ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:48 | 200 | 125.058939ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 81.793764ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 72.718627ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 35.538136ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 38.535779ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 50.531758ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 49.422229ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 58.815483ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 65.669451ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 36.047721ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 49.197432ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 40.232723ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 55.482724ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 34.962061ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 50.318221ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 35.847043ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 45.147328ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 37.465368ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:49 | 200 | 38.112062ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:50 | 200 | 47.902634ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:50 | 200 | 208.951943ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:50 | 200 | 37.283051ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:50 | 200 | 36.697765ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:50 | 200 | 37.251279ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:50 | 200 | 42.573931ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:55 | 200 | 158.82803ms | 10.248.155.225 | POST "/api/embeddings" [GIN] 2025/02/18 - 12:24:58 | 200 | 2.458931806s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:24:59 | 200 | 3.184130972s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:02 | 200 | 6.460281743s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:05 | 200 | 9.095924918s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:06 | 200 | 10.200337843s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:07 | 200 | 11.24102892s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:08 | 200 | 12.144235082s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:09 | 200 | 13.558786579s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:10 | 200 | 14.688847624s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:12 | 200 | 15.768576279s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:13 | 200 | 17.630091603s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:16 | 200 | 19.887408238s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:17 | 200 | 21.704978834s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:19 | 200 | 23.641673287s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:20 | 200 | 24.556206975s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:21 | 200 | 25.471211428s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:24 | 200 | 27.814557179s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:26 | 200 | 30.463379797s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:27 | 200 | 31.55678356s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:28 | 200 | 32.678623061s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:30 | 200 | 33.800896168s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:33 | 200 | 37.497692842s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:35 | 200 | 39.530468826s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:47 | 200 | 45.064181681s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:52 | 200 | 4.670538769s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:54 | 200 | 1.091034209s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:56 | 200 | 1.622430695s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:25:58 | 200 | 1.837206477s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:26:00 | 200 | 1.923796829s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:26:02 | 200 | 1.803793467s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:26:03 | 200 | 1.400159666s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:26:05 | 200 | 1.451028766s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:26:07 | 200 | 1.522554267s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:26:10 | 200 | 2.973402146s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:26:12 | 200 | 1.402188178s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:26:14 | 200 | 1.766171756s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:26:33 | 200 | 19.047165484s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:26:37 | 200 | 3.605876072s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:26:39 | 200 | 1.794334876s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:26:53 | 200 | 14.505359655s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:12 | 200 | 18.237957401s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:14 | 200 | 1.381599466s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:16 | 200 | 2.437525331s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:18 | 200 | 1.572519703s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:22 | 200 | 3.783956424s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:26 | 200 | 3.447986505s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:28 | 200 | 2.152106162s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:30 | 200 | 2.058221448s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:32 | 200 | 1.864975055s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:45 | 200 | 12.605522364s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:48 | 200 | 2.353966687s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:50 | 200 | 1.706299363s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:52 | 200 | 1.631209239s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:54 | 200 | 1.603601722s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:55 | 200 | 1.301305717s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:57 | 200 | 1.459390508s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:27:59 | 200 | 1.998766268s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:28:14 | 200 | 14.316765002s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:28:21 | 200 | 7.592090466s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:28:27 | 200 | 4.823105549s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:28:28 | 200 | 1.665032453s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:28:32 | 200 | 3.089487108s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:28:36 | 200 | 3.846079805s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:28:38 | 200 | 2.446554392s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:28:40 | 200 | 1.520332877s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:28:52 | 200 | 11.170230973s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:28:54 | 200 | 1.858797707s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:28:56 | 200 | 1.877182153s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:28:58 | 200 | 1.928485184s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:29:12 | 200 | 13.702858533s | 10.248.155.225 | POST "/api/chat" [GIN] 2025/02/18 - 12:29:15 | 200 | 2.580146238s | 10.248.155.225 | POST "/api/chat" time=2025-02-18T12:55:01.141Z level=WARN source=sched.go:646 msg="gpu VRAM usage didn't recover within timeout" seconds=5.340303658 model=/root/.ollama/models/blobs/sha256-daec91ffb5dd0c27411bd71f29932917c49cf529a641d0168496c3a501e3062c time=2025-02-18T12:55:01.760Z level=WARN source=sched.go:646 msg="gpu VRAM usage didn't recover within timeout" seconds=5.959220854 model=/root/.ollama/models/blobs/sha256-daec91ffb5dd0c27411bd71f29932917c49cf529a641d0168496c3a501e3062c time=2025-02-18T12:55:02.486Z level=WARN source=sched.go:646 msg="gpu VRAM usage didn't recover within timeout" seconds=6.685155794 model=/root/.ollama/models/blobs/sha256-daec91ffb5dd0c27411bd71f29932917c49cf529a641d0168496c3a501e3062c ``` ### OS Linux ### GPU Nvidia ### CPU AMD ### Ollama version 0.5.11

GiteaMirror added the bug needs more info labels 2026-05-04 12:22:52 -05:00

GiteaMirror closed this issue

2026-05-04 12:22:53 -05:00

GiteaMirror commented

2026-05-04 12:22:55 -05:00

@rick-github commented on GitHub (Feb 18, 2025):

Enable debugging by setting OLLAMA_DEBUG=1 in the server environment, then attach the full log as a file.

@rick-github commented on GitHub (Feb 18, 2025): Enable debugging by setting `OLLAMA_DEBUG=1` in the server environment, then attach the full log as a file.

GiteaMirror commented

2026-05-04 12:22:56 -05:00

@mansibm6 commented on GitHub (Feb 19, 2025):

I'm facing the same issue with a Windows, NVIDIA P40, and Intel Xeon system. After making calls to the API for some time, it stops responding.

@mansibm6 commented on GitHub (Feb 19, 2025): I'm facing the same issue with a Windows, NVIDIA P40, and Intel Xeon system. After making calls to the API for some time, it stops responding.

GiteaMirror commented

2026-05-04 12:22:56 -05:00

@rick-github commented on GitHub (Feb 19, 2025):

Enable debugging by setting OLLAMA_DEBUG=1 in the server environment, then attach the full log as a file.

@rick-github commented on GitHub (Feb 19, 2025): Enable debugging by setting OLLAMA_DEBUG=1 in the server environment, then attach the full log as a file.

GiteaMirror commented

2026-05-04 12:22:57 -05:00

@mansibm6 commented on GitHub (Feb 19, 2025):

Error: requires at least 1 arg(s), only received 0 - from the log file

@mansibm6 commented on GitHub (Feb 19, 2025): Error: requires at least 1 arg(s), only received 0 - from the log file

GiteaMirror commented

2026-05-04 12:22:58 -05:00

@rick-github commented on GitHub (Feb 19, 2025):

Attach the full log as a file.

@rick-github commented on GitHub (Feb 19, 2025): Attach the full log as a file.

GiteaMirror commented

2026-05-04 12:22:59 -05:00

@mansibm6 commented on GitHub (Feb 19, 2025):

ollama_log.txt

@mansibm6 commented on GitHub (Feb 19, 2025): [ollama_log.txt](https://github.com/user-attachments/files/18874997/ollama_log.txt)

GiteaMirror commented

2026-05-04 12:23:00 -05:00

@rick-github commented on GitHub (Feb 19, 2025):

See here for instructions in getting logs.

@rick-github commented on GitHub (Feb 19, 2025): See [here](https://github.com/ollama/ollama/blob/main/docs/troubleshooting.md#how-to-troubleshoot-issues) for instructions in getting logs.

Sign in to join this conversation.

Branches Tags

main

dhiltgen/ci

dhiltgen/llama-runner

hoyyeva/anthropic-local-image-path

hoyyeva/anthropic-reference-images-path

parth-anthropic-reference-images-path

brucemacd/download-before-remove

hoyyeva/editor-config-repair

parth-mlx-decode-checkpoints

parth-launch-codex-app

hoyyeva/fix-codex-model-metadata-warning

hoyyeva/qwen

parth/hide-claude-desktop-till-release

hoyyeva/opencode-image-modality

parth-add-claude-code-autoinstall

release_v0.22.0

pdevine/manifest-list

codex/fix-codex-model-metadata-warning

pdevine/addressable-manifest

brucemacd/launch-fetch-reccomended

jmorganca/llama-compat

launch-copilot-cli

hoyyeva/opencode-thinking

release_v0.20.7

parth-auto-save-backup

parth-test

jmorganca/gemma4-audio-replacements

fix-manifest-digest-on-pull

hoyyeva/vscode-improve

brucemacd/install-server-wait

parth/update-claude-docs

brucemac/start-ap-install

pdevine/mlx-update

pdevine/qwen35_vision

drifkin/api-show-fallback

mintlify/image-generation-1773352582

hoyyeva/server-context-length-local-config

jmorganca/faster-reptition-penalties

jmorganca/convert-nemotron

parth-pi-thinking

pdevine/sampling-penalties

jmorganca/fix-create-quantization-memory

dongchen/resumable_transfer_fix

pdevine/sampling-cache-error

jessegross/mlx-usage

hoyyeva/openclaw-config

hoyyeva/app-html

pdevine/qwen3next

brucemacd/sign-sh-install

brucemacd/tui-update

brucemacd/usage-api

jmorganca/launch-empty

fix-app-dist-embed

mxyng/mlx-compile

mxyng/mlx-quant

mxyng/mlx-glm4.7

mxyng/mlx

brucemacd/simplify-model-picker

jmorganca/qwen3-concurrent

fix-glm-4.7-flash-mla-config

drifkin/qwen3-coder-opening-tag

brucemacd/usage-cli

fix-cuda12-fattn-shmem

ollama-imagegen-docs

parth/fix-multiline-inputs

brucemacd/config-docs

mxyng/model-files

mxyng/simple-execute

fix-imagegen-ollama-models

mxyng/async-upload

jmorganca/lazy-no-dtype-changes

imagegen-auto-detect-create

parth/decrease-concurrent-download-hf

fix-mlx-quantize-init

jmorganca/x-cleanup

usage

imagegen-readme

jmorganca/glm-image

mlx-gpu-cd

jmorganca/imagegen-modelfile

parth/agent-skills

parth/agent-allowlist

parth/signed-in-offline

parth/agents

parth/fix-context-chopping

improve-cloud-flow

parth/add-models-websearch

parth/prompt-renderer-mcp

jmorganca/native-settings

jmorganca/download-stream-hash

jmorganca/client2-rebased

brucemacd/oai-chat-req-multipart

jessegross/multi_chunk_reserve

grace/additional-omit-empty

grace/mistral-3-large

mxyng/tokenizer2

mxyng/tokenizer

jessegross/flash

hoyyeva/windows-nacked-app

mxyng/cleanup-attention

grace/deepseek-parser

hoyyeva/remember-unsent-prompt

parth/add-lfs-pointer-error-conversion

parth/olmo2-test2

hoyyeva/ollama-launchagent-plist

nicole/olmo-model

parth/olmo-test

mxyng/remove-embedded

parth/render-template

jmorganca/intellect-3

parth/remove-prealloc-linter

jmorganca/cmd-eval

nicole/nomic-embed-text-fix

mxyng/lint-2

hoyyeva/add-gemini-3-pro-preview

hoyyeva/load-model-list

mxyng/expand-path

mxyng/environ-2

hoyyeva/deeplink-json-encoding

parth/improve-tool-calling-tests

hoyyeva/conversation

hoyyeva/assistant-edit-response

hoyyeva/thinking

origin/brucemacd/invalid-char-i-err

parth/improve-tool-calling

jmorganca/required-omitempty

grace/qwen3-vl-tests

mxyng/iter-client

parth/docs-readme

nicole/embed-test

pdevine/integration-benchstat

parth/remove-generate-cmd

parth/add-toolcall-id

mxyng/server-tests

jmorganca/glm-4.6

jmorganca/gin-h-compat

drifkin/stable-tool-args

pdevine/qwen3-more-thinking

parth/add-websearch-client

nicole/websearch_local

jmorganca/qwen3-coder-updates

grace/deepseek-v3-migration-tests

mxyng/fix-create

jmorganca/cloud-errors

pdevine/parser-tidy

revert-12233-parth/simplify-entrypoints-runner

parth/enable-so-gpt-oss

brucemacd/qwen3vl

jmorganca/readme-simplify

parth/gpt-oss-structured-outputs

revert-12039-jmorganca/tools-braces

mxyng/embeddings

mxyng/gguf

mxyng/benchmark

mxyng/types-null

parth/move-parsing

mxyng/gemma2

jmorganca/docs

mxyng/16-bit

mxyng/create-stdin

pdevine/authorizedkeys

mxyng/quant

parth/opt-in-error-context-window

brucemacd/cache-models

brucemacd/runner-completion

jmorganca/llama-update-6

brucemacd/benchmark-list

brucemacd/partial-read-caps

parth/deepseek-r1-tools

mxyng/omit-array

parth/tool-prefix-temp

brucemacd/runner-test

jmorganca/qwen25vl

brucemacd/model-forward-test-ext

parth/python-function-parsing

jmorganca/cuda-compression-none

drifkin/num-parallel

drifkin/chat-truncation-fix

jmorganca/sync

parth/python-tools-calling

drifkin/array-head-count

brucemacd/create-no-loop

parth/server-enable-content-stream-with-tools

qwen25omni

mxyng/v3

brucemacd/ropeconfig

jmorganca/silence-tokenizer

parth/sample-so-test

parth/sampling-structured-outputs

brucemacd/doc-go-engine

parth/constrained-sampling-json

jmorganca/mistral-wip

brucemacd/mistral-small-convert

parth/sample-unmarshal-json-for-params

brucemacd/jomorganca/mistral

pdevine/bfloat16

jmorganca/mistral

brucemacd/mistral

pdevine/logging

parth/sample-correctness-fix

parth/sample-fix-sorting

jmorgan/sample-fix-sorting-extras

jmorganca/temp-0-images

brucemacd/parallel-embed-models

brucemacd/shim-grammar

jmorganca/fix-gguf-error

bmizerany/nameswork

jmorganca/faster-releases

bmizerany/validatenames

brucemacd/err-no-vocab

brucemacd/rope-config

brucemacd/err-hint

brucemacd/qwen2_5

brucemacd/logprobs

brucemacd/new_runner_graph_bench

progress-flicker

brucemacd/forward-test

brucemacd/go_qwen2

pdevine/gemma2

jmorganca/add-missing-symlink-eval

mxyng/next-debug

parth/set-context-size-openai

brucemacd/next-bpe-bench

brucemacd/next-bpe-test

brucemacd/new_runner_e2e

brucemacd/new_runner_qwen2

pdevine/convert-cohere2

brucemacd/convert-cli

parth/log-probs

mxyng/next-mlx

mxyng/cmd-history

parth/templating

parth/tokenize-detokenize

brucemacd/check-key-register

bmizerany/grammar

jmorganca/vendor-081b29bd

mxyng/func-checks

jmorganca/fix-null-format

parth/fix-default-to-warn-json

jmorganca/qwen2vl

jmorganca/no-concat

parth/cmd-cleanup-SO

brucemacd/check-key-register-structured-err

parth/openai-stream-usage

parth/fix-referencing-so

stream-tools-stop

jmorganca/degin-1

brucemacd/install-path-clean

brucemacd/push-name-validation

brucemacd/browser-key-register

jmorganca/openai-fix-first-message

jmorganca/fix-proxy

jessegross/sample

parth/disallow-streaming-tools

dhiltgen/remove_submodule

jmorganca/ga

jmorganca/mllama

pdevine/newlines

pdevine/geems-2b

jmorganca/llama-bump

mxyng/modelname-7

mxyng/gin-slog

mxyng/modelname-6

jyan/convert-prog

jyan/quant5

paligemma-support

pdevine/import-docs

jmorganca/openai-context

jyan/paligemma

jyan/p2

jyan/palitest

bmizerany/embedspeedup

jmorganca/llama-vit

brucemacd/allow-ollama

royh/ep-methods

royh/whisper

mxyng/api-models

mxyng/fix-memory

jyan/q4_4/8

jyan/ollama-v

royh/stream-tools

roy-embed-parallel

bmizerany/hrm

revert-5963-revert-5924-mxyng/llama3.1-rope

royh/embed-viz

jyan/local2

jyan/auth

jyan/local

jyan/parse-temp

jmorganca/template-mistral

jyan/reord-g

royh-openai-suffixdocs

royh-imgembed

royh-embed-parallel

jyan/quant4

royh-precision

jyan/progress

pdevine/fix-template

jyan/quant3

pdevine/ggla

mxyng/update-registry-domain

jmorganca/ggml-static

mxyng/create-context

jyan/v0.146

mxyng/layers-from-files

build_dist

bmizerany/noseek

royh-ls

royh-name

timeout

mxyng/server-timestamp

bmizerany/nosillyggufslurps

royh-params

jmorganca/llama-cpp-7c26775

royh-openai-delete

royh-show-rigid

jmorganca/enable-fa

jmorganca/no-error-template

jyan/format

royh-testdelete

bmizerany/fastverify

language_support

pdevine/ps-glitches

brucemacd/tokenize

bruce/iq-quants

bmizerany/filepathwithcoloninhost

mxyng/split-bin

bmizerany/client-registry

jmorganca/if-none-match

native

jmorganca/native

jmorganca/batch-embeddings

jmorganca/initcmake

jmorganca/mm

pdevine/showggmlinfo

modenameenforcealphanum

bmizerany/modenameenforcealphanum

jmorganca/done-reason

jmorganca/llama-cpp-8960fe8

ollama.com

bmizerany/filepathnobuild

bmizerany/types/model/defaultfix

rmdisplaylong

nogogen

bmizerany/x

modelfile-readme

bmizerany/replacecolon

jmorganca/limit

jmorganca/execstack

jmorganca/replace-assets

mxyng/tune-concurrency

jmorganca/testing

whitespace-detection

jmorganca/options

upgrade-all

scratch

cuda-search

mattw/airenamer

mattw/allmodelsonhuggingface

mattw/quantcontext

mattw/whatneedstorun

brucemacd/llama-mem-calc

mattw/faq-context

mattw/communitylinks

mattw/noprune

mattw/python-functioncalling

rename

mxyng/install

pulse

remove-first

editor

mattw/selfqueryingretrieval

cgo

mattw/howtoquant

api

matt/streamingapi

format-config

mxyng/extra-args

shell

update-nous-hermes

cp-model

upload-progress

fix-unknown-model

fix-model-names

delete-fix

insecure-registry

ls

deletemodels

progressbar

readme-updates

license-layers

skip-list

list-models

modelpath

matt/examplemodelfiles

distribution

go-opts

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/ollama#68047