github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-21 05:01:48 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #11196] Allow multiple instances of Same Model #85061

New Issue
Closed
opened 2026-05-09 22:26:28 -05:00 by GiteaMirror · 14 comments
GiteaMirror commented 2026-05-09 22:26:28 -05:00
Owner
Copy Link

Originally created by @jeepshop on GitHub (Jun 25, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/11196

I know that Ollama will batch queries to a Model, but all that really seems to do is make users wait in a queue. Ollama seems to have no problems loading and running simultaneous models, but only if they are different. What I'd really like to see is to allow Ollama to load multiple instances of the same model to service requests.

For example, I have 2x V100s and run the Devstral model for code completion. And even though I have 2x cards, and multiple users using code completion, they all get stuck on one GPU in a queue while the other GPU is empty and idle. I've tried all combinations of settings, but only 1 user ever gets serviced at a time unless I make some users use a different model.

Originally created by @jeepshop on GitHub (Jun 25, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/11196 I know that Ollama will batch queries to a Model, but all that really seems to do is make users wait in a queue. Ollama seems to have no problems loading and running simultaneous models, but **only** if they are different. What I'd really like to see is to allow Ollama to load multiple instances of the same model to service requests. For example, I have 2x V100s and run the Devstral model for code completion. And even though I have 2x cards, and multiple users using code completion, they all get stuck on one GPU in a queue while the other GPU is empty and idle. I've tried all combinations of settings, but only 1 user ever gets serviced at a time unless I make some users use a different model.
GiteaMirror added the feature request label 2026-05-09 22:26:28 -05:00
GiteaMirror commented 2026-05-09 22:26:34 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jun 25, 2025):

Ollama doesn't support loading the same model more than once (#3902). To run simultaneous parallel queries, set OLLAMA_NUM_PARALLEL.

<!-- gh-comment-id:3005194003 --> @rick-github commented on GitHub (Jun 25, 2025): Ollama doesn't support loading the same model more than once (#3902). To run simultaneous parallel queries, set [`OLLAMA_NUM_PARALLEL`](https://github.com/ollama/ollama/blob/main/docs/faq.md#how-does-ollama-handle-concurrent-requests).
GiteaMirror commented 2026-05-09 22:26:34 -05:00
Author
Owner
Copy Link

@jeepshop commented on GitHub (Jun 25, 2025):

Thanks for pointing out the other ticket, I searched for a while and
couldn't find a similar one.

Yes I know about OLLAMA_NUM_PARALLEL, and no it doesn't work. I can set it
to 1, 2, 4 and it still only uses one GPU and only answers 1 query at a
time.

On Wed, Jun 25, 2025 at 11:24 AM frob @.***> wrote:

rick-github left a comment (ollama/ollama#11196)
https://github.com/ollama/ollama/issues/11196#issuecomment-3005194003

Ollama doesn't support loading the same model more than once (#3902
https://github.com/ollama/ollama/issues/3902). To run simultaneous
parallel queries, set OLLAMA_NUM_PARALLEL
https://github.com/ollama/ollama/blob/main/docs/faq.md#how-does-ollama-handle-concurrent-requests
.

—
Reply to this email directly, view it on GitHub
https://github.com/ollama/ollama/issues/11196#issuecomment-3005194003,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AF6EMS2U5W3FNV3NEI2WI6L3FK5MRAVCNFSM6AAAAACADT54SWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTAMBVGE4TIMBQGM
.
You are receiving this because you authored the thread.Message ID:
@.***>

<!-- gh-comment-id:3005691892 --> @jeepshop commented on GitHub (Jun 25, 2025): Thanks for pointing out the other ticket, I searched for a while and couldn't find a similar one. Yes I know about OLLAMA_NUM_PARALLEL, and no it doesn't work. I can set it to 1, 2, 4 and it still only uses one GPU and only answers 1 query at a time. On Wed, Jun 25, 2025 at 11:24 AM frob ***@***.***> wrote: > *rick-github* left a comment (ollama/ollama#11196) > <https://github.com/ollama/ollama/issues/11196#issuecomment-3005194003> > > Ollama doesn't support loading the same model more than once (#3902 > <https://github.com/ollama/ollama/issues/3902>). To run simultaneous > parallel queries, set OLLAMA_NUM_PARALLEL > <https://github.com/ollama/ollama/blob/main/docs/faq.md#how-does-ollama-handle-concurrent-requests> > . > > — > Reply to this email directly, view it on GitHub > <https://github.com/ollama/ollama/issues/11196#issuecomment-3005194003>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AF6EMS2U5W3FNV3NEI2WI6L3FK5MRAVCNFSM6AAAAACADT54SWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTAMBVGE4TIMBQGM> > . > You are receiving this because you authored the thread.Message ID: > ***@***.***> >
GiteaMirror commented 2026-05-09 22:26:35 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jun 25, 2025):

How well it work depends on your hardware. For example, on a 4070:

Image

If your hardware doesn't parallelize very well, you can try running a model per GPU and using a reverse proxy server to distribute queries similar to what's described here

<!-- gh-comment-id:3005722882 --> @rick-github commented on GitHub (Jun 25, 2025): How well it work depends on your hardware. For example, on a 4070: ![Image](https://github.com/user-attachments/assets/c0b37621-19ba-4034-9f4d-04f3eb2c081b) If your hardware doesn't parallelize very well, you can try running a model per GPU and using a reverse proxy server to distribute queries similar to what's described [here](https://github.com/ollama/ollama/issues/9607#issuecomment-2708764862)
GiteaMirror commented 2026-05-09 22:26:35 -05:00
Author
Owner
Copy Link

@jeepshop commented on GitHub (Jun 25, 2025):

Is there documentation somewhere that lists which features of Ollama works
on what cards?

Seems the V100 just doesn't handle parallel (yes it's old) but it also has
32GB VRAM which makes it better at running larger models than a 4070. And a
$6000 A100 isn't in the cards right now :(

I did look into the proxy concept, but then I lost the ability to run
certain models that require both cards. And I can't just reconfigure the
computer every time an employee's needs shift a bit.

Having Ollama be able to spin up an identical model just makes sense to me,
and many others. Is it that much of a code change since it already can spin
up several 'different' models to let it spin up several 'identical' models?

On Wed, Jun 25, 2025 at 2:18 PM frob @.***> wrote:

rick-github left a comment (ollama/ollama#11196)
https://github.com/ollama/ollama/issues/11196#issuecomment-3005722882

How well it work depends on your hardware. For example, on a 4070:

image.png (view on web)
https://github.com/user-attachments/assets/c0b37621-19ba-4034-9f4d-04f3eb2c081b

If your hardware doesn't parallelize very well, you can try running a
model per GPU and using a reverse proxy server to distribute queries
similar to what's described here
https://github.com/ollama/ollama/issues/9607#issuecomment-2708764862

—
Reply to this email directly, view it on GitHub
https://github.com/ollama/ollama/issues/11196#issuecomment-3005722882,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AF6EMS2HNW5M2AJEOC4NDTT3FLRWVAVCNFSM6AAAAACADT54SWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTAMBVG4ZDEOBYGI
.
You are receiving this because you authored the thread.Message ID:
@.***>

<!-- gh-comment-id:3005752543 --> @jeepshop commented on GitHub (Jun 25, 2025): Is there documentation somewhere that lists which features of Ollama works on what cards? Seems the V100 just doesn't handle parallel (yes it's old) but it also has 32GB VRAM which makes it better at running larger models than a 4070. And a $6000 A100 isn't in the cards right now :( I did look into the proxy concept, but then I lost the ability to run certain models that require both cards. And I can't just reconfigure the computer every time an employee's needs shift a bit. Having Ollama be able to spin up an identical model just makes sense to me, and many others. Is it that much of a code change since it already can spin up several 'different' models to let it spin up several 'identical' models? On Wed, Jun 25, 2025 at 2:18 PM frob ***@***.***> wrote: > *rick-github* left a comment (ollama/ollama#11196) > <https://github.com/ollama/ollama/issues/11196#issuecomment-3005722882> > > How well it work depends on your hardware. For example, on a 4070: > > image.png (view on web) > <https://github.com/user-attachments/assets/c0b37621-19ba-4034-9f4d-04f3eb2c081b> > > If your hardware doesn't parallelize very well, you can try running a > model per GPU and using a reverse proxy server to distribute queries > similar to what's described here > <https://github.com/ollama/ollama/issues/9607#issuecomment-2708764862> > > — > Reply to this email directly, view it on GitHub > <https://github.com/ollama/ollama/issues/11196#issuecomment-3005722882>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AF6EMS2HNW5M2AJEOC4NDTT3FLRWVAVCNFSM6AAAAACADT54SWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTAMBVG4ZDEOBYGI> > . > You are receiving this because you authored the thread.Message ID: > ***@***.***> >
GiteaMirror commented 2026-05-09 22:26:36 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jun 25, 2025):

And a $6000 A100 isn't in the cards right now :(

In my experience the A100 has the same problem with parallelization.

I lost the ability to run certain models that require both cards.

It's not a requirement to bind a GPU to an ollama server. If two servers have access to both cards, then one is free to take the combined VRAM for loading a larger model, although the other server would have to be told to evict any running models. That function could be handled by the proxy.

<!-- gh-comment-id:3005832996 --> @rick-github commented on GitHub (Jun 25, 2025): > And a $6000 A100 isn't in the cards right now :( In my experience the A100 has the same problem with parallelization. > I lost the ability to run certain models that require both cards. It's not a requirement to bind a GPU to an ollama server. If two servers have access to both cards, then one is free to take the combined VRAM for loading a larger model, although the other server would have to be told to evict any running models. That function could be handled by the proxy.
GiteaMirror commented 2026-05-09 22:26:36 -05:00
Author
Owner
Copy Link

@jeepshop commented on GitHub (Jun 26, 2025):

Yes and we've discussed the issues with doing so above; Namely that I lose
the ability to run models on both cards without reconfiguring a bunch of
instances throughout the day as users need's change.

On Thu, Jun 26, 2025 at 4:38 PM sammyvoncheese @.***>
wrote:

sammyvoncheese left a comment (ollama/ollama#11196)
https://github.com/ollama/ollama/issues/11196#issuecomment-3009922722

You could run another instance of the server on another port.

—
Reply to this email directly, view it on GitHub
https://github.com/ollama/ollama/issues/11196#issuecomment-3009922722,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AF6EMS4WAEM6N6DKCTWVUV33FRK5PAVCNFSM6AAAAACADT54SWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTAMBZHEZDENZSGI
.
You are receiving this because you authored the thread.Message ID:
@.***>

<!-- gh-comment-id:3009936474 --> @jeepshop commented on GitHub (Jun 26, 2025): Yes and we've discussed the issues with doing so above; Namely that I lose the ability to run models on both cards without reconfiguring a bunch of instances throughout the day as users need's change. On Thu, Jun 26, 2025 at 4:38 PM sammyvoncheese ***@***.***> wrote: > *sammyvoncheese* left a comment (ollama/ollama#11196) > <https://github.com/ollama/ollama/issues/11196#issuecomment-3009922722> > > You could run another instance of the server on another port. > > — > Reply to this email directly, view it on GitHub > <https://github.com/ollama/ollama/issues/11196#issuecomment-3009922722>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AF6EMS4WAEM6N6DKCTWVUV33FRK5PAVCNFSM6AAAAACADT54SWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTAMBZHEZDENZSGI> > . > You are receiving this because you authored the thread.Message ID: > ***@***.***> >
GiteaMirror commented 2026-05-09 22:26:37 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jun 27, 2025):

It turns out I was a bit unfair to the A100. It does scale, just not as well as the 4070:

Image

If you share logs with OLLAMA_DEBUG=1 there might be some information logged about the V100s which could identify the bottleneck.

<!-- gh-comment-id:3010977849 --> @rick-github commented on GitHub (Jun 27, 2025): It turns out I was a bit unfair to the A100. It does scale, just not as well as the 4070: ![Image](https://github.com/user-attachments/assets/90a81498-12ad-4e05-9f4f-0032a2653d58) If you share logs with `OLLAMA_DEBUG=1` there might be some information logged about the V100s which could identify the bottleneck.
GiteaMirror commented 2026-05-09 22:26:37 -05:00
Author
Owner
Copy Link

@jeepshop commented on GitHub (Jun 30, 2025):

Here is a log after a fresh restart of Ollama, and loading Devstral. I don't know what I'm looking for, but it seems as if --parallel is set to 2.

Do I have a fundamental misunderstanding of how parallel works? I assumed it meant how many parallel queries (api services) it could run at the same time, directly relating to how many users could run, but is that really true? Or does something like AnythingLLM use multiple simultanious queries somehow negating the benifit to multiple users?

For example, in your attached Graph of an 2x A100 - Can it really serve 4-10 users simultaneously???

Jun 30 09:14:23 Darkstar ollama[1651980]: time=2025-06-30T09:14:23.973-04:00 level=WARN source=types.go:572 msg="invalid option provided" option=use_mlock
Jun 30 09:14:24 Darkstar ollama[1651980]: time=2025-06-30T09:14:24.575-04:00 level=INFO source=sched.go:788 msg="new model will fit in available VRAM in single GPU, loading" model=/usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 gpu=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 parallel=2 available=33754841088 required="23.0 GiB"
Jun 30 09:14:24 Darkstar ollama[1651980]: time=2025-06-30T09:14:24.805-04:00 level=INFO source=server.go:135 msg="system memory" total="62.9 GiB" free="54.4 GiB" free_swap="92.0 KiB"
Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.024-04:00 level=INFO source=server.go:168 msg=offload library=cuda layers.requested=-1 layers.model=41 layers.offload=41 layers.split="" memory.available="[31.4 GiB]" memory.gpu_overhead="0 B" memory.required.full="23.0 GiB" memory.required.partial="23.0 GiB" memory.required.kv="5.0 GiB" memory.required.allocations="[23.0 GiB]" memory.weights.total="13.0 GiB" memory.weights.repeating="12.5 GiB" memory.weights.nonrepeating="525.0 MiB" memory.graph.full="4.2 GiB" memory.graph.partial="4.5 GiB"
Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.024-04:00 level=INFO source=server.go:211 msg="enabling flash attention"
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: loaded meta data with 41 key-value pairs and 363 tensors from /usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 (version GGUF V3 (latest))
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   0:                       general.architecture str              = llama
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   1:                  general.base_model.0.name str              = Devstrall Small 2505
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   2:          general.base_model.0.organization str              = Mistralai
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   3:              general.base_model.0.repo_url str              = https://huggingface.co/mistralai/Devs...
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   4:               general.base_model.0.version str              = 2505
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   5:                   general.base_model.count u32              = 1
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   6:                           general.basename str              = Devstral
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   7:                          general.file_type u32              = 15
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   8:                          general.languages arr[str,24]      = ["en", "fr", "de", "es", "pt", "it", ...
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   9:                            general.license str              = apache-2.0
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  10:                               general.name str              = Devstral Small 2505
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  11:                    general.parameter_count u64              = 23572403200
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  12:               general.quantization_version u32              = 2
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  13:                         general.size_label str              = Small
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  14:                               general.tags arr[str,1]       = ["text2text-generation"]
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  15:                               general.type str              = model
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  16:                            general.version str              = 2505
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  17:                 llama.attention.head_count u32              = 32
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  18:              llama.attention.head_count_kv u32              = 8
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  19:                 llama.attention.key_length u32              = 128
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  20:     llama.attention.layer_norm_rms_epsilon f32              = 0.000010
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  21:               llama.attention.value_length u32              = 128
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  22:                          llama.block_count u32              = 40
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  23:                       llama.context_length u32              = 131072
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  24:                     llama.embedding_length u32              = 5120
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  25:                  llama.feed_forward_length u32              = 32768
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  26:                 llama.rope.dimension_count u32              = 128
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  27:                       llama.rope.freq_base f32              = 1000000000.000000
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  28:                           llama.vocab_size u32              = 131072
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  29:                    tokenizer.chat_template str              = {%- set today = strftime_now("%Y-%m-%...
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  30:               tokenizer.ggml.add_bos_token bool             = true
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  31:               tokenizer.ggml.add_eos_token bool             = false
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  32:            tokenizer.ggml.add_space_prefix bool             = false
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  33:                tokenizer.ggml.bos_token_id u32              = 1
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  34:                tokenizer.ggml.eos_token_id u32              = 2
Jun 30 09:14:25 Darkstar ollama[1651980]: [132B blob data]
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  36:                       tokenizer.ggml.model str              = gpt2
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  37:                         tokenizer.ggml.pre str              = tekken
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  38:                  tokenizer.ggml.token_type arr[i32,131072]  = [3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, ...
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  39:                      tokenizer.ggml.tokens arr[str,131072]  = ["<unk>", "<s>", "</s>", "[INST]", "[...
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  40:            tokenizer.ggml.unknown_token_id u32              = 0
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - type  f32:   81 tensors
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - type q4_K:  241 tensors
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - type q6_K:   41 tensors
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: file format = GGUF V3 (latest)
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: file type   = Q4_K - Medium
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: file size   = 13.34 GiB (4.86 BPW)
Jun 30 09:14:25 Darkstar ollama[1651980]: load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect
Jun 30 09:14:25 Darkstar ollama[1651980]: load: special tokens cache size = 1000
Jun 30 09:14:25 Darkstar ollama[1651980]: load: token to piece cache size = 0.8498 MB
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: arch             = llama
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: vocab_only       = 1
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: model type       = ?B
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: model params     = 23.57 B
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: general.name     = Devstral Small 2505
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: vocab type       = BPE
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_vocab          = 131072
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_merges         = 269443
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: BOS token        = 1 '<s>'
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: EOS token        = 2 '</s>'
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: UNK token        = 0 '<unk>'
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: LF token         = 1010 ''
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: EOG token        = 2 '</s>'
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: max token length = 150
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_load: vocab only - skipping tensors
Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.321-04:00 level=INFO source=server.go:431 msg="starting llama server" cmd="/usr/local/bin/ollama runner --model /usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 --ctx-size 65368 --batch-size 512 --n-gpu-layers 41 --threads 32 --flash-attn --kv-cache-type q8_0 --parallel 2 --port 46209"
Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.322-04:00 level=INFO source=sched.go:483 msg="loaded runners" count=1
Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.322-04:00 level=INFO source=server.go:591 msg="waiting for llama runner to start responding"
Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.322-04:00 level=INFO source=server.go:625 msg="waiting for server to become available" status="llm server not responding"
Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.343-04:00 level=INFO source=runner.go:815 msg="starting go runner"
Jun 30 09:14:25 Darkstar ollama[1651980]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-skylakex.so
Jun 30 09:14:25 Darkstar ollama[1651980]: ggml_cuda_init: GGML_CUDA_FORCE_MMQ:    no
Jun 30 09:14:25 Darkstar ollama[1651980]: ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
Jun 30 09:14:25 Darkstar ollama[1651980]: ggml_cuda_init: found 1 CUDA devices:
Jun 30 09:14:25 Darkstar ollama[1651980]:   Device 0: Tesla V100-PCIE-32GB, compute capability 7.0, VMM: yes
Jun 30 09:14:25 Darkstar ollama[1651980]: load_backend: loaded CUDA backend from /usr/local/lib/ollama/cuda_v12/libggml-cuda.so
Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.413-04:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.AVX512=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc)
Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.414-04:00 level=INFO source=runner.go:874 msg="Server listening on 127.0.0.1:46209"
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_load_from_file_impl: using device CUDA0 (Tesla V100-PCIE-32GB) - 32191 MiB free
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: loaded meta data with 41 key-value pairs and 363 tensors from /usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 (version GGUF V3 (latest))
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   0:                       general.architecture str              = llama
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   1:                  general.base_model.0.name str              = Devstrall Small 2505
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   2:          general.base_model.0.organization str              = Mistralai
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   3:              general.base_model.0.repo_url str              = https://huggingface.co/mistralai/Devs...
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   4:               general.base_model.0.version str              = 2505
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   5:                   general.base_model.count u32              = 1
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   6:                           general.basename str              = Devstral
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   7:                          general.file_type u32              = 15
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   8:                          general.languages arr[str,24]      = ["en", "fr", "de", "es", "pt", "it", ...
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv   9:                            general.license str              = apache-2.0
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  10:                               general.name str              = Devstral Small 2505
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  11:                    general.parameter_count u64              = 23572403200
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  12:               general.quantization_version u32              = 2
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  13:                         general.size_label str              = Small
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  14:                               general.tags arr[str,1]       = ["text2text-generation"]
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  15:                               general.type str              = model
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  16:                            general.version str              = 2505
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  17:                 llama.attention.head_count u32              = 32
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  18:              llama.attention.head_count_kv u32              = 8
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  19:                 llama.attention.key_length u32              = 128
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  20:     llama.attention.layer_norm_rms_epsilon f32              = 0.000010
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  21:               llama.attention.value_length u32              = 128
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  22:                          llama.block_count u32              = 40
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  23:                       llama.context_length u32              = 131072
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  24:                     llama.embedding_length u32              = 5120
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  25:                  llama.feed_forward_length u32              = 32768
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  26:                 llama.rope.dimension_count u32              = 128
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  27:                       llama.rope.freq_base f32              = 1000000000.000000
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  28:                           llama.vocab_size u32              = 131072
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  29:                    tokenizer.chat_template str              = {%- set today = strftime_now("%Y-%m-%...
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  30:               tokenizer.ggml.add_bos_token bool             = true
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  31:               tokenizer.ggml.add_eos_token bool             = false
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  32:            tokenizer.ggml.add_space_prefix bool             = false
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  33:                tokenizer.ggml.bos_token_id u32              = 1
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  34:                tokenizer.ggml.eos_token_id u32              = 2
Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.574-04:00 level=INFO source=server.go:625 msg="waiting for server to become available" status="llm server loading model"
Jun 30 09:14:25 Darkstar ollama[1651980]: [132B blob data]
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  36:                       tokenizer.ggml.model str              = gpt2
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  37:                         tokenizer.ggml.pre str              = tekken
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  38:                  tokenizer.ggml.token_type arr[i32,131072]  = [3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, ...
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  39:                      tokenizer.ggml.tokens arr[str,131072]  = ["<unk>", "<s>", "</s>", "[INST]", "[...
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv  40:            tokenizer.ggml.unknown_token_id u32              = 0
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - type  f32:   81 tensors
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - type q4_K:  241 tensors
Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - type q6_K:   41 tensors
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: file format = GGUF V3 (latest)
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: file type   = Q4_K - Medium
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: file size   = 13.34 GiB (4.86 BPW)
Jun 30 09:14:25 Darkstar ollama[1651980]: load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect
Jun 30 09:14:25 Darkstar ollama[1651980]: load: special tokens cache size = 1000
Jun 30 09:14:25 Darkstar ollama[1651980]: load: token to piece cache size = 0.8498 MB
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: arch             = llama
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: vocab_only       = 0
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_ctx_train      = 131072
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_embd           = 5120
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_layer          = 40
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_head           = 32
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_head_kv        = 8
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_rot            = 128
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_swa            = 0
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_swa_pattern    = 1
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_embd_head_k    = 128
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_embd_head_v    = 128
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_gqa            = 4
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_embd_k_gqa     = 1024
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_embd_v_gqa     = 1024
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: f_norm_eps       = 0.0e+00
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: f_norm_rms_eps   = 1.0e-05
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: f_clamp_kqv      = 0.0e+00
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: f_max_alibi_bias = 0.0e+00
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: f_logit_scale    = 0.0e+00
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: f_attn_scale     = 0.0e+00
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_ff             = 32768
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_expert         = 0
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_expert_used    = 0
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: causal attn      = 1
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: pooling type     = 0
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: rope type        = 0
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: rope scaling     = linear
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: freq_base_train  = 1000000000.0
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: freq_scale_train = 1
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_ctx_orig_yarn  = 131072
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: rope_finetuned   = unknown
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: ssm_d_conv       = 0
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: ssm_d_inner      = 0
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: ssm_d_state      = 0
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: ssm_dt_rank      = 0
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: ssm_dt_b_c_rms   = 0
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: model type       = 13B
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: model params     = 23.57 B
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: general.name     = Devstral Small 2505
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: vocab type       = BPE
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_vocab          = 131072
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_merges         = 269443
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: BOS token        = 1 '<s>'
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: EOS token        = 2 '</s>'
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: UNK token        = 0 '<unk>'
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: LF token         = 1010 ''
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: EOG token        = 2 '</s>'
Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: max token length = 150
Jun 30 09:14:25 Darkstar ollama[1651980]: load_tensors: loading model tensors, this can take a while... (mmap = true)
Jun 30 09:14:26 Darkstar ollama[1651980]: load_tensors: offloading 40 repeating layers to GPU
Jun 30 09:14:26 Darkstar ollama[1651980]: load_tensors: offloading output layer to GPU
Jun 30 09:14:26 Darkstar ollama[1651980]: load_tensors: offloaded 41/41 layers to GPU
Jun 30 09:14:26 Darkstar ollama[1651980]: load_tensors:        CUDA0 model buffer size = 13302.36 MiB
Jun 30 09:14:26 Darkstar ollama[1651980]: load_tensors:   CPU_Mapped model buffer size =   360.00 MiB
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: constructing llama_context
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: n_seq_max     = 2
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: n_ctx         = 65368
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: n_ctx_per_seq = 32684
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: n_batch       = 1024
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: n_ubatch      = 512
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: causal_attn   = 1
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: flash_attn    = 1
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: freq_base     = 1000000000.0
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: freq_scale    = 1
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: n_ctx_per_seq (32684) < n_ctx_train (131072) -- the full capacity of the model will not be utilized
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context:  CUDA_Host  output buffer size =     1.04 MiB
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_kv_cache_unified: kv_size = 65536, type_k = 'q8_0', type_v = 'q8_0', n_layer = 40, can_shift = 1, padding = 256
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_kv_cache_unified:      CUDA0 KV buffer size =  5440.00 MiB
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_kv_cache_unified: KV self size  = 5440.00 MiB, K (q8_0): 2720.00 MiB, V (q8_0): 2720.00 MiB
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context:      CUDA0 compute buffer size =   266.00 MiB
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context:  CUDA_Host compute buffer size =   138.01 MiB
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: graph nodes  = 1207
Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: graph splits = 2
Jun 30 09:14:30 Darkstar ollama[1651980]: time=2025-06-30T09:14:30.854-04:00 level=INFO source=server.go:630 msg="llama runner started in 5.53 seconds"
Jun 30 09:14:31 Darkstar ollama[1651980]: [GIN] 2025/06/30 - 09:14:31 | 200 |  7.338534446s |       127.0.0.1 | POST     "/api/chat"
Jun 30 09:14:51 Darkstar ollama[1651980]: [GIN] 2025/06/30 - 09:14:51 | 200 |       132.8�s |       127.0.0.1 | GET      "/api/version"
Jun 30 09:17:24 Darkstar systemd[1]: Stopping ollama.service - Ollama Service...
Jun 30 09:17:25 Darkstar systemd[1]: ollama.service: Deactivated successfully.
Jun 30 09:17:25 Darkstar systemd[1]: Stopped ollama.service - Ollama Service.
Jun 30 09:17:25 Darkstar systemd[1]: ollama.service: Consumed 23h 21min 22.642s CPU time.
Jun 30 09:17:25 Darkstar systemd[1]: Started ollama.service - Ollama Service.
Jun 30 09:17:25 Darkstar ollama[2860928]: time=2025-06-30T09:17:25.215-04:00 level=INFO source=routes.go:1235 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:true OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE:q8_0 OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/usr/share/ollama/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
Jun 30 09:17:25 Darkstar ollama[2860928]: time=2025-06-30T09:17:25.222-04:00 level=INFO source=images.go:476 msg="total blobs: 71"
Jun 30 09:17:25 Darkstar ollama[2860928]: time=2025-06-30T09:17:25.224-04:00 level=INFO source=images.go:483 msg="total unused blobs removed: 0"
Jun 30 09:17:25 Darkstar ollama[2860928]: time=2025-06-30T09:17:25.224-04:00 level=INFO source=routes.go:1288 msg="Listening on [::]:11434 (version 0.9.3)"
Jun 30 09:17:25 Darkstar ollama[2860928]: time=2025-06-30T09:17:25.225-04:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs"
Jun 30 09:17:25 Darkstar ollama[2860928]: time=2025-06-30T09:17:25.564-04:00 level=INFO source=types.go:130 msg="inference compute" id=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 library=cuda variant=v12 compute=7.0 driver=12.2 name="Tesla V100-PCIE-32GB" total="31.7 GiB" available="31.4 GiB"
Jun 30 09:17:25 Darkstar ollama[2860928]: time=2025-06-30T09:17:25.565-04:00 level=INFO source=types.go:130 msg="inference compute" id=GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822 library=cuda variant=v12 compute=7.0 driver=12.2 name="Tesla V100-PCIE-32GB" total="31.7 GiB" available="31.4 GiB"
Jun 30 09:21:52 Darkstar systemd[1]: Stopping ollama.service - Ollama Service...
Jun 30 09:21:52 Darkstar systemd[1]: ollama.service: Deactivated successfully.
Jun 30 09:21:52 Darkstar systemd[1]: Stopped ollama.service - Ollama Service.
Jun 30 09:21:52 Darkstar systemd[1]: Started ollama.service - Ollama Service.
Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.141-04:00 level=INFO source=routes.go:1235 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:DEBUG OLLAMA_FLASH_ATTENTION:true OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE:q8_0 OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/usr/share/ollama/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.149-04:00 level=INFO source=images.go:476 msg="total blobs: 71"
Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.152-04:00 level=INFO source=images.go:483 msg="total unused blobs removed: 0"
Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.154-04:00 level=INFO source=routes.go:1288 msg="Listening on [::]:11434 (version 0.9.3)"
Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.154-04:00 level=DEBUG source=sched.go:108 msg="starting llm scheduler"
Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.154-04:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs"
Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.158-04:00 level=DEBUG source=gpu.go:98 msg="searching for GPU discovery libraries for NVIDIA"
Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.158-04:00 level=DEBUG source=gpu.go:501 msg="Searching for GPU library" name=libcuda.so*
Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.158-04:00 level=DEBUG source=gpu.go:525 msg="gpu library search" globs="[/usr/local/lib/ollama/libcuda.so* /libcuda.so* /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.162-04:00 level=DEBUG source=gpu.go:558 msg="discovered GPU libraries" paths=[/usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.535.216.01]
Jun 30 09:21:52 Darkstar ollama[2861272]: initializing /usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.535.216.01
Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuInit - 0x7f8429cc24b0
Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuDriverGetVersion - 0x7f8429cc24d0
Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuDeviceGetCount - 0x7f8429cc2510
Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuDeviceGet - 0x7f8429cc24f0
Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuDeviceGetAttribute - 0x7f8429cc25f0
Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuDeviceGetUuid - 0x7f8429cc2550
Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuDeviceGetName - 0x7f8429cc2530
Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuCtxCreate_v3 - 0x7f8429cca1b0
Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuMemGetInfo_v2 - 0x7f8429cd5680
Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuCtxDestroy - 0x7f8429d24680
Jun 30 09:21:52 Darkstar ollama[2861272]: calling cuInit
Jun 30 09:21:52 Darkstar ollama[2861272]: calling cuDriverGetVersion
Jun 30 09:21:52 Darkstar ollama[2861272]: raw version 0x2ef4
Jun 30 09:21:52 Darkstar ollama[2861272]: CUDA driver version: 12.2
Jun 30 09:21:52 Darkstar ollama[2861272]: calling cuDeviceGetCount
Jun 30 09:21:52 Darkstar ollama[2861272]: device count 2
Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.203-04:00 level=DEBUG source=gpu.go:125 msg="detected GPUs" count=2 library=/usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.535.216.01
Jun 30 09:21:52 Darkstar ollama[2861272]: [GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4] CUDA totalMem 32501mb
Jun 30 09:21:52 Darkstar ollama[2861272]: [GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4] CUDA freeMem 32191mb
Jun 30 09:21:52 Darkstar ollama[2861272]: [GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4] Compute Capability 7.0
Jun 30 09:21:52 Darkstar ollama[2861272]: [GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822] CUDA totalMem 32501mb
Jun 30 09:21:52 Darkstar ollama[2861272]: [GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822] CUDA freeMem 32191mb
Jun 30 09:21:52 Darkstar ollama[2861272]: [GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822] Compute Capability 7.0
Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.497-04:00 level=DEBUG source=amd_linux.go:419 msg="amdgpu driver not detected /sys/module/amdgpu"
Jun 30 09:21:52 Darkstar ollama[2861272]: releasing cuda driver library
Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.497-04:00 level=INFO source=types.go:130 msg="inference compute" id=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 library=cuda variant=v12 compute=7.0 driver=12.2 name="Tesla V100-PCIE-32GB" total="31.7 GiB" available="31.4 GiB"
Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.497-04:00 level=INFO source=types.go:130 msg="inference compute" id=GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822 library=cuda variant=v12 compute=7.0 driver=12.2 name="Tesla V100-PCIE-32GB" total="31.7 GiB" available="31.4 GiB"
Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.495-04:00 level=WARN source=types.go:572 msg="invalid option provided" option=use_mlock
Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.495-04:00 level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.9 GiB" before.free="56.9 GiB" before.free_swap="386.0 MiB" now.total="62.9 GiB" now.free="56.9 GiB" now.free_swap="386.0 MiB"
Jun 30 09:22:08 Darkstar ollama[2861272]: initializing /usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.535.216.01
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuInit - 0x7f8429cc24b0
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDriverGetVersion - 0x7f8429cc24d0
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetCount - 0x7f8429cc2510
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGet - 0x7f8429cc24f0
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetAttribute - 0x7f8429cc25f0
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetUuid - 0x7f8429cc2550
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetName - 0x7f8429cc2530
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuCtxCreate_v3 - 0x7f8429cca1b0
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuMemGetInfo_v2 - 0x7f8429cd5680
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuCtxDestroy - 0x7f8429d24680
Jun 30 09:22:08 Darkstar ollama[2861272]: calling cuInit
Jun 30 09:22:08 Darkstar ollama[2861272]: calling cuDriverGetVersion
Jun 30 09:22:08 Darkstar ollama[2861272]: raw version 0x2ef4
Jun 30 09:22:08 Darkstar ollama[2861272]: CUDA driver version: 12.2
Jun 30 09:22:08 Darkstar ollama[2861272]: calling cuDeviceGetCount
Jun 30 09:22:08 Darkstar ollama[2861272]: device count 2
Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.660-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB"
Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.809-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB"
Jun 30 09:22:08 Darkstar ollama[2861272]: releasing cuda driver library
Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.809-04:00 level=DEBUG source=sched.go:185 msg="updating default concurrency" OLLAMA_MAX_LOADED_MODELS=6 gpu_count=2
Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.827-04:00 level=DEBUG source=ggml.go:206 msg="key with type not found" key=general.alignment default=32
Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.879-04:00 level=DEBUG source=sched.go:228 msg="loading first model" model=/usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01
Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.879-04:00 level=DEBUG source=memory.go:111 msg=evaluating library=cuda gpu_count=1 available="[31.4 GiB]"
Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.879-04:00 level=DEBUG source=ggml.go:206 msg="key with type not found" key=llama.vision.block_count default=0
Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.879-04:00 level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.9 GiB" before.free="56.9 GiB" before.free_swap="386.0 MiB" now.total="62.9 GiB" now.free="56.8 GiB" now.free_swap="386.0 MiB"
Jun 30 09:22:08 Darkstar ollama[2861272]: initializing /usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.535.216.01
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuInit - 0x7f8429cc24b0
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDriverGetVersion - 0x7f8429cc24d0
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetCount - 0x7f8429cc2510
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGet - 0x7f8429cc24f0
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetAttribute - 0x7f8429cc25f0
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetUuid - 0x7f8429cc2550
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetName - 0x7f8429cc2530
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuCtxCreate_v3 - 0x7f8429cca1b0
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuMemGetInfo_v2 - 0x7f8429cd5680
Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuCtxDestroy - 0x7f8429d24680
Jun 30 09:22:08 Darkstar ollama[2861272]: calling cuInit
Jun 30 09:22:08 Darkstar ollama[2861272]: calling cuDriverGetVersion
Jun 30 09:22:08 Darkstar ollama[2861272]: raw version 0x2ef4
Jun 30 09:22:08 Darkstar ollama[2861272]: CUDA driver version: 12.2
Jun 30 09:22:08 Darkstar ollama[2861272]: calling cuDeviceGetCount
Jun 30 09:22:08 Darkstar ollama[2861272]: device count 2
Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.991-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB"
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.101-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB"
Jun 30 09:22:09 Darkstar ollama[2861272]: releasing cuda driver library
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.102-04:00 level=INFO source=sched.go:788 msg="new model will fit in available VRAM in single GPU, loading" model=/usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 gpu=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 parallel=2 available=33754841088 required="23.0 GiB"
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.102-04:00 level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.9 GiB" before.free="56.8 GiB" before.free_swap="386.0 MiB" now.total="62.9 GiB" now.free="56.8 GiB" now.free_swap="386.0 MiB"
Jun 30 09:22:09 Darkstar ollama[2861272]: initializing /usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.535.216.01
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuInit - 0x7f8429cc24b0
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDriverGetVersion - 0x7f8429cc24d0
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetCount - 0x7f8429cc2510
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGet - 0x7f8429cc24f0
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetAttribute - 0x7f8429cc25f0
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetUuid - 0x7f8429cc2550
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetName - 0x7f8429cc2530
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuCtxCreate_v3 - 0x7f8429cca1b0
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuMemGetInfo_v2 - 0x7f8429cd5680
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuCtxDestroy - 0x7f8429d24680
Jun 30 09:22:09 Darkstar ollama[2861272]: calling cuInit
Jun 30 09:22:09 Darkstar ollama[2861272]: calling cuDriverGetVersion
Jun 30 09:22:09 Darkstar ollama[2861272]: raw version 0x2ef4
Jun 30 09:22:09 Darkstar ollama[2861272]: CUDA driver version: 12.2
Jun 30 09:22:09 Darkstar ollama[2861272]: calling cuDeviceGetCount
Jun 30 09:22:09 Darkstar ollama[2861272]: device count 2
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.210-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB"
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.317-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB"
Jun 30 09:22:09 Darkstar ollama[2861272]: releasing cuda driver library
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.318-04:00 level=INFO source=server.go:135 msg="system memory" total="62.9 GiB" free="56.8 GiB" free_swap="386.0 MiB"
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.318-04:00 level=DEBUG source=memory.go:111 msg=evaluating library=cuda gpu_count=1 available="[31.4 GiB]"
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.318-04:00 level=DEBUG source=ggml.go:206 msg="key with type not found" key=llama.vision.block_count default=0
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.318-04:00 level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.9 GiB" before.free="56.8 GiB" before.free_swap="386.0 MiB" now.total="62.9 GiB" now.free="56.8 GiB" now.free_swap="386.0 MiB"
Jun 30 09:22:09 Darkstar ollama[2861272]: initializing /usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.535.216.01
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuInit - 0x7f8429cc24b0
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDriverGetVersion - 0x7f8429cc24d0
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetCount - 0x7f8429cc2510
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGet - 0x7f8429cc24f0
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetAttribute - 0x7f8429cc25f0
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetUuid - 0x7f8429cc2550
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetName - 0x7f8429cc2530
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuCtxCreate_v3 - 0x7f8429cca1b0
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuMemGetInfo_v2 - 0x7f8429cd5680
Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuCtxDestroy - 0x7f8429d24680
Jun 30 09:22:09 Darkstar ollama[2861272]: calling cuInit
Jun 30 09:22:09 Darkstar ollama[2861272]: calling cuDriverGetVersion
Jun 30 09:22:09 Darkstar ollama[2861272]: raw version 0x2ef4
Jun 30 09:22:09 Darkstar ollama[2861272]: CUDA driver version: 12.2
Jun 30 09:22:09 Darkstar ollama[2861272]: calling cuDeviceGetCount
Jun 30 09:22:09 Darkstar ollama[2861272]: device count 2
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.425-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB"
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.537-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB"
Jun 30 09:22:09 Darkstar ollama[2861272]: releasing cuda driver library
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.537-04:00 level=INFO source=server.go:175 msg=offload library=cuda layers.requested=-1 layers.model=41 layers.offload=41 layers.split="" memory.available="[31.4 GiB]" memory.gpu_overhead="0 B" memory.required.full="23.0 GiB" memory.required.partial="23.0 GiB" memory.required.kv="5.0 GiB" memory.required.allocations="[23.0 GiB]" memory.weights.total="13.0 GiB" memory.weights.repeating="12.5 GiB" memory.weights.nonrepeating="525.0 MiB" memory.graph.full="4.2 GiB" memory.graph.partial="4.5 GiB"
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.537-04:00 level=INFO source=server.go:218 msg="enabling flash attention"
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.537-04:00 level=DEBUG source=server.go:291 msg="compatible gpu libraries" compatible=[]
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: loaded meta data with 41 key-value pairs and 363 tensors from /usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 (version GGUF V3 (latest))
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv   0:                       general.architecture str              = llama
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv   1:                  general.base_model.0.name str              = Devstrall Small 2505
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv   2:          general.base_model.0.organization str              = Mistralai
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv   3:              general.base_model.0.repo_url str              = https://huggingface.co/mistralai/Devs...
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv   4:               general.base_model.0.version str              = 2505
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv   5:                   general.base_model.count u32              = 1
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv   6:                           general.basename str              = Devstral
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv   7:                          general.file_type u32              = 15
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv   8:                          general.languages arr[str,24]      = ["en", "fr", "de", "es", "pt", "it", ...
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv   9:                            general.license str              = apache-2.0
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  10:                               general.name str              = Devstral Small 2505
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  11:                    general.parameter_count u64              = 23572403200
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  12:               general.quantization_version u32              = 2
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  13:                         general.size_label str              = Small
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  14:                               general.tags arr[str,1]       = ["text2text-generation"]
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  15:                               general.type str              = model
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  16:                            general.version str              = 2505
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  17:                 llama.attention.head_count u32              = 32
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  18:              llama.attention.head_count_kv u32              = 8
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  19:                 llama.attention.key_length u32              = 128
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  20:     llama.attention.layer_norm_rms_epsilon f32              = 0.000010
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  21:               llama.attention.value_length u32              = 128
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  22:                          llama.block_count u32              = 40
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  23:                       llama.context_length u32              = 131072
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  24:                     llama.embedding_length u32              = 5120
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  25:                  llama.feed_forward_length u32              = 32768
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  26:                 llama.rope.dimension_count u32              = 128
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  27:                       llama.rope.freq_base f32              = 1000000000.000000
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  28:                           llama.vocab_size u32              = 131072
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  29:                    tokenizer.chat_template str              = {%- set today = strftime_now("%Y-%m-%...
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  30:               tokenizer.ggml.add_bos_token bool             = true
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  31:               tokenizer.ggml.add_eos_token bool             = false
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  32:            tokenizer.ggml.add_space_prefix bool             = false
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  33:                tokenizer.ggml.bos_token_id u32              = 1
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  34:                tokenizer.ggml.eos_token_id u32              = 2
Jun 30 09:22:09 Darkstar ollama[2861272]: [132B blob data]
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  36:                       tokenizer.ggml.model str              = gpt2
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  37:                         tokenizer.ggml.pre str              = tekken
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  38:                  tokenizer.ggml.token_type arr[i32,131072]  = [3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, ...
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  39:                      tokenizer.ggml.tokens arr[str,131072]  = ["<unk>", "<s>", "</s>", "[INST]", "[...
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv  40:            tokenizer.ggml.unknown_token_id u32              = 0
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - type  f32:   81 tensors
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - type q4_K:  241 tensors
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - type q6_K:   41 tensors
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: file format = GGUF V3 (latest)
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: file type   = Q4_K - Medium
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: file size   = 13.34 GiB (4.86 BPW)
Jun 30 09:22:09 Darkstar ollama[2861272]: init_tokenizer: initializing tokenizer for type 2
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    216 '<SPECIAL_216>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    408 '<SPECIAL_408>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    845 '<SPECIAL_845>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    555 '<SPECIAL_555>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    257 '<SPECIAL_257>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    474 '<SPECIAL_474>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    241 '<SPECIAL_241>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    646 '<SPECIAL_646>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    601 '<SPECIAL_601>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    905 '<SPECIAL_905>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    168 '<SPECIAL_168>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     37 '<SPECIAL_37>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    125 '<SPECIAL_125>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     95 '<SPECIAL_95>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    304 '<SPECIAL_304>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    706 '<SPECIAL_706>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    423 '<SPECIAL_423>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:      6 '[/AVAILABLE_TOOLS]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    592 '<SPECIAL_592>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    409 '<SPECIAL_409>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    231 '<SPECIAL_231>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    607 '<SPECIAL_607>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:      7 '[TOOL_RESULTS]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    138 '<SPECIAL_138>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    455 '<SPECIAL_455>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    801 '<SPECIAL_801>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    288 '<SPECIAL_288>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    619 '<SPECIAL_619>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    133 '<SPECIAL_133>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    827 '<SPECIAL_827>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    771 '<SPECIAL_771>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    723 '<SPECIAL_723>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    494 '<SPECIAL_494>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    444 '<SPECIAL_444>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    422 '<SPECIAL_422>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    441 '<SPECIAL_441>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    372 '<SPECIAL_372>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    874 '<SPECIAL_874>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    137 '<SPECIAL_137>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    250 '<SPECIAL_250>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    840 '<SPECIAL_840>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    846 '<SPECIAL_846>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    465 '<SPECIAL_465>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    425 '<SPECIAL_425>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    984 '<SPECIAL_984>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    328 '<SPECIAL_328>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    186 '<SPECIAL_186>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    973 '<SPECIAL_973>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    394 '<SPECIAL_394>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    522 '<SPECIAL_522>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    385 '<SPECIAL_385>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    496 '<SPECIAL_496>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    498 '<SPECIAL_498>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    489 '<SPECIAL_489>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    767 '<SPECIAL_767>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    916 '<SPECIAL_916>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    818 '<SPECIAL_818>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    894 '<SPECIAL_894>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    668 '<SPECIAL_668>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    566 '<SPECIAL_566>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    898 '<SPECIAL_898>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    490 '<SPECIAL_490>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    977 '<SPECIAL_977>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    900 '<SPECIAL_900>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    541 '<SPECIAL_541>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     21 '<SPECIAL_21>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    787 '<SPECIAL_787>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    722 '<SPECIAL_722>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    803 '<SPECIAL_803>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    210 '<SPECIAL_210>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    205 '<SPECIAL_205>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    485 '<SPECIAL_485>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     40 '<SPECIAL_40>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     57 '<SPECIAL_57>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    115 '<SPECIAL_115>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    798 '<SPECIAL_798>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    700 '<SPECIAL_700>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    961 '<SPECIAL_961>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    101 '<SPECIAL_101>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    279 '<SPECIAL_279>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    139 '<SPECIAL_139>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    903 '<SPECIAL_903>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    625 '<SPECIAL_625>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    147 '<SPECIAL_147>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    837 '<SPECIAL_837>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    438 '<SPECIAL_438>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    500 '<SPECIAL_500>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    371 '<SPECIAL_371>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     31 '<SPECIAL_31>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     27 '<SPECIAL_27>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    948 '<SPECIAL_948>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     72 '<SPECIAL_72>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     53 '<SPECIAL_53>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     70 '<SPECIAL_70>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    737 '<SPECIAL_737>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    864 '<SPECIAL_864>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    623 '<SPECIAL_623>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    421 '<SPECIAL_421>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    431 '<SPECIAL_431>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    589 '<SPECIAL_589>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    926 '<SPECIAL_926>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    743 '<SPECIAL_743>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    484 '<SPECIAL_484>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    721 '<SPECIAL_721>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    940 '<SPECIAL_940>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    971 '<SPECIAL_971>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    136 '<SPECIAL_136>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    445 '<SPECIAL_445>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    142 '<SPECIAL_142>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    934 '<SPECIAL_934>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    316 '<SPECIAL_316>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    690 '<SPECIAL_690>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    887 '<SPECIAL_887>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    531 '<SPECIAL_531>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    482 '<SPECIAL_482>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    560 '<SPECIAL_560>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    333 '<SPECIAL_333>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    574 '<SPECIAL_574>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    734 '<SPECIAL_734>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    491 '<SPECIAL_491>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    199 '<SPECIAL_199>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    449 '<SPECIAL_449>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    704 '<SPECIAL_704>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    618 '<SPECIAL_618>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    516 '<SPECIAL_516>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    661 '<SPECIAL_661>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    459 '<SPECIAL_459>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    134 '<SPECIAL_134>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    708 '<SPECIAL_708>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    426 '<SPECIAL_426>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    727 '<SPECIAL_727>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    506 '<SPECIAL_506>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    265 '<SPECIAL_265>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    861 '<SPECIAL_861>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    988 '<SPECIAL_988>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    189 '<SPECIAL_189>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    367 '<SPECIAL_367>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    118 '<SPECIAL_118>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    526 '<SPECIAL_526>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    527 '<SPECIAL_527>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    448 '<SPECIAL_448>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     86 '<SPECIAL_86>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    554 '<SPECIAL_554>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    895 '<SPECIAL_895>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    608 '<SPECIAL_608>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    681 '<SPECIAL_681>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     11 '<pad>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    403 '<SPECIAL_403>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    503 '<SPECIAL_503>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     20 '<SPECIAL_20>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    797 '<SPECIAL_797>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    476 '<SPECIAL_476>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    359 '<SPECIAL_359>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    909 '<SPECIAL_909>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    323 '<SPECIAL_323>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    435 '<SPECIAL_435>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     43 '<SPECIAL_43>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    970 '<SPECIAL_970>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    175 '<SPECIAL_175>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    300 '<SPECIAL_300>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    505 '<SPECIAL_505>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    158 '<SPECIAL_158>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    890 '<SPECIAL_890>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    855 '<SPECIAL_855>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    182 '<SPECIAL_182>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    312 '<SPECIAL_312>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    688 '<SPECIAL_688>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    795 '<SPECIAL_795>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    883 '<SPECIAL_883>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    817 '<SPECIAL_817>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    886 '<SPECIAL_886>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     50 '<SPECIAL_50>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    314 '<SPECIAL_314>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    519 '<SPECIAL_519>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    989 '<SPECIAL_989>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    653 '<SPECIAL_653>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    779 '<SPECIAL_779>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    377 '<SPECIAL_377>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    473 '<SPECIAL_473>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     61 '<SPECIAL_61>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    165 '<SPECIAL_165>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    745 '<SPECIAL_745>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    963 '<SPECIAL_963>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    775 '<SPECIAL_775>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    450 '<SPECIAL_450>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    396 '<SPECIAL_396>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    587 '<SPECIAL_587>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    418 '<SPECIAL_418>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    414 '<SPECIAL_414>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    859 '<SPECIAL_859>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    218 '<SPECIAL_218>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    252 '<SPECIAL_252>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     55 '<SPECIAL_55>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    802 '<SPECIAL_802>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    249 '<SPECIAL_249>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    130 '<SPECIAL_130>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     34 '<SPECIAL_34>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    834 '<SPECIAL_834>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    660 '<SPECIAL_660>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    638 '<SPECIAL_638>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    380 '<SPECIAL_380>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    411 '<SPECIAL_411>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     62 '<SPECIAL_62>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    719 '<SPECIAL_719>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    340 '<SPECIAL_340>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    939 '<SPECIAL_939>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    891 '<SPECIAL_891>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    184 '<SPECIAL_184>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    714 '<SPECIAL_714>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    794 '<SPECIAL_794>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    736 '<SPECIAL_736>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    509 '<SPECIAL_509>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    983 '<SPECIAL_983>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    862 '<SPECIAL_862>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    829 '<SPECIAL_829>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    925 '<SPECIAL_925>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    698 '<SPECIAL_698>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    451 '<SPECIAL_451>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    570 '<SPECIAL_570>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    214 '<SPECIAL_214>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    144 '<SPECIAL_144>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    561 '<SPECIAL_561>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    582 '<SPECIAL_582>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    523 '<SPECIAL_523>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     65 '<SPECIAL_65>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    311 '<SPECIAL_311>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    693 '<SPECIAL_693>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    857 '<SPECIAL_857>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    513 '<SPECIAL_513>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    271 '<SPECIAL_271>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    919 '<SPECIAL_919>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    720 '<SPECIAL_720>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    542 '<SPECIAL_542>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    594 '<SPECIAL_594>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    338 '<SPECIAL_338>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     32 '<SPECIAL_32>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    955 '<SPECIAL_955>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    969 '<SPECIAL_969>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    460 '<SPECIAL_460>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    518 '<SPECIAL_518>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    588 '<SPECIAL_588>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    701 '<SPECIAL_701>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    319 '<SPECIAL_319>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    320 '<SPECIAL_320>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    233 '<SPECIAL_233>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    277 '<SPECIAL_277>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    585 '<SPECIAL_585>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    213 '<SPECIAL_213>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    599 '<SPECIAL_599>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    291 '<SPECIAL_291>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    583 '<SPECIAL_583>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    160 '<SPECIAL_160>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    109 '<SPECIAL_109>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    164 '<SPECIAL_164>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    436 '<SPECIAL_436>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    461 '<SPECIAL_461>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    982 '<SPECIAL_982>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    621 '<SPECIAL_621>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    303 '<SPECIAL_303>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    207 '<SPECIAL_207>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    654 '<SPECIAL_654>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    868 '<SPECIAL_868>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    437 '<SPECIAL_437>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    641 '<SPECIAL_641>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    200 '<SPECIAL_200>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    741 '<SPECIAL_741>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     18 '[/SYSTEM_PROMPT]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    738 '<SPECIAL_738>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    786 '<SPECIAL_786>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     82 '<SPECIAL_82>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    234 '<SPECIAL_234>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    563 '<SPECIAL_563>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    358 '<SPECIAL_358>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    497 '<SPECIAL_497>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    296 '<SPECIAL_296>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    652 '<SPECIAL_652>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    756 '<SPECIAL_756>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    170 '<SPECIAL_170>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    495 '<SPECIAL_495>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    176 '<SPECIAL_176>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     89 '<SPECIAL_89>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    724 '<SPECIAL_724>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    251 '<SPECIAL_251>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    238 '<SPECIAL_238>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    913 '<SPECIAL_913>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    766 '<SPECIAL_766>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    826 '<SPECIAL_826>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    547 '<SPECIAL_547>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    374 '<SPECIAL_374>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    514 '<SPECIAL_514>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    950 '<SPECIAL_950>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    598 '<SPECIAL_598>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    850 '<SPECIAL_850>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    908 '<SPECIAL_908>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    517 '<SPECIAL_517>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    679 '<SPECIAL_679>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    578 '<SPECIAL_578>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     75 '<SPECIAL_75>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    462 '<SPECIAL_462>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    456 '<SPECIAL_456>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    979 '<SPECIAL_979>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    446 '<SPECIAL_446>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    917 '<SPECIAL_917>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    549 '<SPECIAL_549>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    183 '<SPECIAL_183>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    424 '<SPECIAL_424>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    419 '<SPECIAL_419>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    413 '<SPECIAL_413>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    478 '<SPECIAL_478>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    398 '<SPECIAL_398>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    386 '<SPECIAL_386>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    440 '<SPECIAL_440>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    202 '<SPECIAL_202>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    747 '<SPECIAL_747>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    825 '<SPECIAL_825>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    997 '<SPECIAL_997>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    369 '<SPECIAL_369>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    696 '<SPECIAL_696>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    512 '<SPECIAL_512>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    349 '<SPECIAL_349>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    985 '<SPECIAL_985>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    337 '<SPECIAL_337>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    135 '<SPECIAL_135>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    283 '<SPECIAL_283>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    776 '<SPECIAL_776>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    327 '<SPECIAL_327>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    610 '<SPECIAL_610>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    752 '<SPECIAL_752>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    510 '<SPECIAL_510>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     92 '<SPECIAL_92>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     69 '<SPECIAL_69>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    703 '<SPECIAL_703>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    284 '<SPECIAL_284>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    325 '<SPECIAL_325>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    228 '<SPECIAL_228>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    355 '<SPECIAL_355>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    389 '<SPECIAL_389>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    458 '<SPECIAL_458>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    264 '<SPECIAL_264>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    335 '<SPECIAL_335>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    181 '<SPECIAL_181>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    263 '<SPECIAL_263>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    671 '<SPECIAL_671>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     63 '<SPECIAL_63>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    261 '<SPECIAL_261>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    122 '<SPECIAL_122>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     90 '<SPECIAL_90>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    944 '<SPECIAL_944>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    760 '<SPECIAL_760>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    956 '<SPECIAL_956>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    692 '<SPECIAL_692>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    400 '<SPECIAL_400>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     83 '<SPECIAL_83>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    537 '<SPECIAL_537>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    959 '<SPECIAL_959>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    910 '<SPECIAL_910>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    119 '<SPECIAL_119>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     66 '<SPECIAL_66>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     10 '[IMG]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    285 '<SPECIAL_285>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    524 '<SPECIAL_524>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    565 '<SPECIAL_565>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    744 '<SPECIAL_744>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    255 '<SPECIAL_255>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    866 '<SPECIAL_866>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    538 '<SPECIAL_538>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    280 '<SPECIAL_280>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    815 '<SPECIAL_815>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    204 '<SPECIAL_204>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    276 '<SPECIAL_276>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    757 '<SPECIAL_757>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    475 '<SPECIAL_475>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    480 '<SPECIAL_480>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    166 '<SPECIAL_166>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     45 '<SPECIAL_45>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    262 '<SPECIAL_262>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    301 '<SPECIAL_301>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:      2 '</s>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    580 '<SPECIAL_580>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    432 '<SPECIAL_432>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    454 '<SPECIAL_454>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    107 '<SPECIAL_107>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     46 '<SPECIAL_46>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    140 '<SPECIAL_140>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     14 '[PREFIX]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    246 '<SPECIAL_246>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     52 '<SPECIAL_52>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    295 '<SPECIAL_295>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    994 '<SPECIAL_994>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    370 '<SPECIAL_370>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    831 '<SPECIAL_831>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    488 '<SPECIAL_488>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    557 '<SPECIAL_557>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    124 '<SPECIAL_124>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    644 '<SPECIAL_644>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    357 '<SPECIAL_357>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    492 '<SPECIAL_492>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    209 '<SPECIAL_209>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     71 '<SPECIAL_71>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     19 '[TOOL_CONTENT]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    562 '<SPECIAL_562>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     47 '<SPECIAL_47>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    471 '<SPECIAL_471>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    486 '<SPECIAL_486>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    244 '<SPECIAL_244>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     79 '<SPECIAL_79>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    171 '<SPECIAL_171>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    564 '<SPECIAL_564>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    439 '<SPECIAL_439>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    120 '<SPECIAL_120>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    399 '<SPECIAL_399>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     13 '[IMG_END]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     49 '<SPECIAL_49>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    938 '<SPECIAL_938>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    499 '<SPECIAL_499>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    382 '<SPECIAL_382>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    824 '<SPECIAL_824>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    393 '<SPECIAL_393>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    584 '<SPECIAL_584>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    275 '<SPECIAL_275>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    915 '<SPECIAL_915>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    699 '<SPECIAL_699>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    838 '<SPECIAL_838>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    352 '<SPECIAL_352>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    871 '<SPECIAL_871>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    470 '<SPECIAL_470>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    807 '<SPECIAL_807>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     68 '<SPECIAL_68>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    678 '<SPECIAL_678>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    511 '<SPECIAL_511>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    892 '<SPECIAL_892>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    749 '<SPECIAL_749>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    206 '<SPECIAL_206>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    710 '<SPECIAL_710>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    732 '<SPECIAL_732>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    155 '<SPECIAL_155>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    247 '<SPECIAL_247>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    208 '<SPECIAL_208>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    365 '<SPECIAL_365>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    321 '<SPECIAL_321>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    217 '<SPECIAL_217>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    777 '<SPECIAL_777>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    640 '<SPECIAL_640>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    515 '<SPECIAL_515>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    194 '<SPECIAL_194>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    378 '<SPECIAL_378>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    104 '<SPECIAL_104>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    770 '<SPECIAL_770>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    479 '<SPECIAL_479>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    145 '<SPECIAL_145>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    151 '<SPECIAL_151>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    854 '<SPECIAL_854>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    929 '<SPECIAL_929>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    156 '<SPECIAL_156>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    302 '<SPECIAL_302>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     88 '<SPECIAL_88>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    305 '<SPECIAL_305>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    590 '<SPECIAL_590>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    763 '<SPECIAL_763>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    178 '<SPECIAL_178>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    609 '<SPECIAL_609>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    353 '<SPECIAL_353>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    379 '<SPECIAL_379>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    931 '<SPECIAL_931>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    222 '<SPECIAL_222>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    870 '<SPECIAL_870>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    501 '<SPECIAL_501>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    682 '<SPECIAL_682>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    126 '<SPECIAL_126>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    341 '<SPECIAL_341>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    597 '<SPECIAL_597>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    705 '<SPECIAL_705>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    774 '<SPECIAL_774>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    121 '<SPECIAL_121>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    230 '<SPECIAL_230>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     17 '[SYSTEM_PROMPT]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    848 '<SPECIAL_848>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    240 '<SPECIAL_240>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    336 '<SPECIAL_336>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    274 '<SPECIAL_274>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    937 '<SPECIAL_937>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    350 '<SPECIAL_350>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    535 '<SPECIAL_535>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    504 '<SPECIAL_504>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    662 '<SPECIAL_662>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    141 '<SPECIAL_141>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    193 '<SPECIAL_193>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     77 '<SPECIAL_77>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    999 '<SPECIAL_999>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    157 '<SPECIAL_157>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    568 '<SPECIAL_568>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     39 '<SPECIAL_39>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    579 '<SPECIAL_579>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    581 '<SPECIAL_581>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    324 '<SPECIAL_324>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    586 '<SPECIAL_586>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    595 '<SPECIAL_595>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    602 '<SPECIAL_602>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    972 '<SPECIAL_972>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    632 '<SPECIAL_632>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    634 '<SPECIAL_634>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    615 '<SPECIAL_615>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    117 '<SPECIAL_117>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    221 '<SPECIAL_221>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    811 '<SPECIAL_811>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    197 '<SPECIAL_197>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    457 '<SPECIAL_457>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    617 '<SPECIAL_617>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    712 '<SPECIAL_712>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    839 '<SPECIAL_839>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    643 '<SPECIAL_643>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    902 '<SPECIAL_902>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    553 '<SPECIAL_553>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    656 '<SPECIAL_656>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    672 '<SPECIAL_672>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    773 '<SPECIAL_773>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    675 '<SPECIAL_675>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    361 '<SPECIAL_361>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    683 '<SPECIAL_683>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    673 '<SPECIAL_673>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    800 '<SPECIAL_800>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    691 '<SPECIAL_691>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    694 '<SPECIAL_694>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    604 '<SPECIAL_604>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    717 '<SPECIAL_717>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    442 '<SPECIAL_442>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     93 '<SPECIAL_93>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    129 '<SPECIAL_129>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    315 '<SPECIAL_315>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    406 '<SPECIAL_406>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    987 '<SPECIAL_987>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    828 '<SPECIAL_828>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    368 '<SPECIAL_368>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    904 '<SPECIAL_904>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    930 '<SPECIAL_930>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    317 '<SPECIAL_317>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    792 '<SPECIAL_792>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     91 '<SPECIAL_91>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    814 '<SPECIAL_814>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    796 '<SPECIAL_796>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    799 '<SPECIAL_799>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    664 '<SPECIAL_664>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    951 '<SPECIAL_951>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    888 '<SPECIAL_888>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    806 '<SPECIAL_806>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    809 '<SPECIAL_809>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    810 '<SPECIAL_810>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    819 '<SPECIAL_819>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    628 '<SPECIAL_628>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     58 '<SPECIAL_58>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    392 '<SPECIAL_392>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    899 '<SPECIAL_899>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    896 '<SPECIAL_896>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    612 '<SPECIAL_612>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    154 '<SPECIAL_154>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    630 '<SPECIAL_630>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    856 '<SPECIAL_856>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    666 '<SPECIAL_666>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    860 '<SPECIAL_860>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    863 '<SPECIAL_863>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    788 '<SPECIAL_788>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    865 '<SPECIAL_865>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    872 '<SPECIAL_872>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    974 '<SPECIAL_974>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    873 '<SPECIAL_873>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    543 '<SPECIAL_543>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:      9 '[TOOL_CALLS]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    665 '<SPECIAL_665>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    354 '<SPECIAL_354>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    243 '<SPECIAL_243>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    637 '<SPECIAL_637>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    735 '<SPECIAL_735>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    901 '<SPECIAL_901>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    363 '<SPECIAL_363>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    821 '<SPECIAL_821>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     41 '<SPECIAL_41>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    920 '<SPECIAL_920>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    928 '<SPECIAL_928>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    220 '<SPECIAL_220>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    942 '<SPECIAL_942>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    947 '<SPECIAL_947>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    556 '<SPECIAL_556>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    962 '<SPECIAL_962>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    889 '<SPECIAL_889>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    235 '<SPECIAL_235>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    927 '<SPECIAL_927>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    967 '<SPECIAL_967>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    968 '<SPECIAL_968>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     78 '<SPECIAL_78>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    980 '<SPECIAL_980>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    223 '<SPECIAL_223>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    360 '<SPECIAL_360>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    822 '<SPECIAL_822>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    342 '<SPECIAL_342>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    294 '<SPECIAL_294>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    715 '<SPECIAL_715>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    187 '<SPECIAL_187>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    248 '<SPECIAL_248>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    481 '<SPECIAL_481>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    548 '<SPECIAL_548>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    110 '<SPECIAL_110>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    687 '<SPECIAL_687>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    593 '<SPECIAL_593>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    259 '<SPECIAL_259>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    686 '<SPECIAL_686>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    188 '<SPECIAL_188>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    229 '<SPECIAL_229>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     24 '<SPECIAL_24>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    131 '<SPECIAL_131>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    253 '<SPECIAL_253>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    318 '<SPECIAL_318>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    633 '<SPECIAL_633>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    716 '<SPECIAL_716>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    685 '<SPECIAL_685>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    224 '<SPECIAL_224>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    180 '<SPECIAL_180>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    572 '<SPECIAL_572>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    463 '<SPECIAL_463>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    689 '<SPECIAL_689>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:      0 '<unk>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    758 '<SPECIAL_758>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    674 '<SPECIAL_674>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    329 '<SPECIAL_329>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    525 '<SPECIAL_525>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     25 '<SPECIAL_25>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    573 '<SPECIAL_573>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    833 '<SPECIAL_833>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    847 '<SPECIAL_847>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    334 '<SPECIAL_334>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    289 '<SPECIAL_289>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    923 '<SPECIAL_923>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     64 '<SPECIAL_64>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    784 '<SPECIAL_784>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    791 '<SPECIAL_791>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    404 '<SPECIAL_404>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    952 '<SPECIAL_952>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:      8 '[/TOOL_RESULTS]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    880 '<SPECIAL_880>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    981 '<SPECIAL_981>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    551 '<SPECIAL_551>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    343 '<SPECIAL_343>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    726 '<SPECIAL_726>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    620 '<SPECIAL_620>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    832 '<SPECIAL_832>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    405 '<SPECIAL_405>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    534 '<SPECIAL_534>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    467 '<SPECIAL_467>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    391 '<SPECIAL_391>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    540 '<SPECIAL_540>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    911 '<SPECIAL_911>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    626 '<SPECIAL_626>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    782 '<SPECIAL_782>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    232 '<SPECIAL_232>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    362 '<SPECIAL_362>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    835 '<SPECIAL_835>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    867 '<SPECIAL_867>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    100 '<SPECIAL_100>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    417 '<SPECIAL_417>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    267 '<SPECIAL_267>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    918 '<SPECIAL_918>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     98 '<SPECIAL_98>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     22 '<SPECIAL_22>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    306 '<SPECIAL_306>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    366 '<SPECIAL_366>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    290 '<SPECIAL_290>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    844 '<SPECIAL_844>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    769 '<SPECIAL_769>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    885 '<SPECIAL_885>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    711 '<SPECIAL_711>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    709 '<SPECIAL_709>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    663 '<SPECIAL_663>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     15 '[MIDDLE]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     60 '<SPECIAL_60>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    869 '<SPECIAL_869>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    298 '<SPECIAL_298>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    635 '<SPECIAL_635>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    729 '<SPECIAL_729>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    245 '<SPECIAL_245>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    933 '<SPECIAL_933>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    627 '<SPECIAL_627>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    215 '<SPECIAL_215>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    820 '<SPECIAL_820>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    881 '<SPECIAL_881>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    308 '<SPECIAL_308>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     94 '<SPECIAL_94>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    219 '<SPECIAL_219>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     51 '<SPECIAL_51>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    177 '<SPECIAL_177>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    348 '<SPECIAL_348>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    239 '<SPECIAL_239>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    772 '<SPECIAL_772>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    173 '<SPECIAL_173>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    373 '<SPECIAL_373>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    174 '<SPECIAL_174>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    852 '<SPECIAL_852>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    150 '<SPECIAL_150>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    559 '<SPECIAL_559>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    169 '<SPECIAL_169>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    539 '<SPECIAL_539>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    383 '<SPECIAL_383>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    614 '<SPECIAL_614>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    943 '<SPECIAL_943>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    395 '<SPECIAL_395>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    953 '<SPECIAL_953>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    843 '<SPECIAL_843>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    986 '<SPECIAL_986>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     36 '<SPECIAL_36>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    762 '<SPECIAL_762>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    530 '<SPECIAL_530>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    464 '<SPECIAL_464>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    879 '<SPECIAL_879>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    401 '<SPECIAL_401>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     73 '<SPECIAL_73>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    992 '<SPECIAL_992>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    447 '<SPECIAL_447>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    402 '<SPECIAL_402>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    849 '<SPECIAL_849>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    307 '<SPECIAL_307>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    179 '<SPECIAL_179>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    781 '<SPECIAL_781>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    991 '<SPECIAL_991>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    356 '<SPECIAL_356>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    273 '<SPECIAL_273>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     85 '<SPECIAL_85>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    407 '<SPECIAL_407>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    493 '<SPECIAL_493>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    487 '<SPECIAL_487>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    332 '<SPECIAL_332>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    364 '<SPECIAL_364>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    976 '<SPECIAL_976>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    427 '<SPECIAL_427>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    751 '<SPECIAL_751>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    415 '<SPECIAL_415>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    966 '<SPECIAL_966>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    203 '<SPECIAL_203>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    949 '<SPECIAL_949>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     59 '<SPECIAL_59>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     81 '<SPECIAL_81>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    805 '<SPECIAL_805>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    430 '<SPECIAL_430>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    477 '<SPECIAL_477>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    922 '<SPECIAL_922>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    148 '<SPECIAL_148>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    452 '<SPECIAL_452>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    748 '<SPECIAL_748>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    272 '<SPECIAL_272>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    201 '<SPECIAL_201>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    924 '<SPECIAL_924>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    412 '<SPECIAL_412>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    921 '<SPECIAL_921>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     16 '[SUFFIX]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    529 '<SPECIAL_529>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    761 '<SPECIAL_761>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    941 '<SPECIAL_941>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    281 '<SPECIAL_281>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    344 '<SPECIAL_344>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    577 '<SPECIAL_577>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    936 '<SPECIAL_936>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    642 '<SPECIAL_642>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    433 '<SPECIAL_433>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    227 '<SPECIAL_227>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    269 '<SPECIAL_269>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    242 '<SPECIAL_242>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    841 '<SPECIAL_841>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    381 '<SPECIAL_381>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    468 '<SPECIAL_468>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    649 '<SPECIAL_649>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    884 '<SPECIAL_884>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    964 '<SPECIAL_964>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    739 '<SPECIAL_739>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    945 '<SPECIAL_945>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    428 '<SPECIAL_428>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    755 '<SPECIAL_755>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    878 '<SPECIAL_878>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    651 '<SPECIAL_651>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    346 '<SPECIAL_346>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     48 '<SPECIAL_48>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    804 '<SPECIAL_804>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    309 '<SPECIAL_309>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    127 '<SPECIAL_127>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    957 '<SPECIAL_957>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    387 '<SPECIAL_387>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    785 '<SPECIAL_785>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     30 '<SPECIAL_30>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    185 '<SPECIAL_185>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    611 '<SPECIAL_611>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    434 '<SPECIAL_434>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    546 '<SPECIAL_546>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    897 '<SPECIAL_897>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    946 '<SPECIAL_946>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    746 '<SPECIAL_746>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    552 '<SPECIAL_552>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    750 '<SPECIAL_750>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    677 '<SPECIAL_677>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    605 '<SPECIAL_605>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    159 '<SPECIAL_159>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    631 '<SPECIAL_631>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    906 '<SPECIAL_906>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     96 '<SPECIAL_96>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     35 '<SPECIAL_35>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    161 '<SPECIAL_161>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     42 '<SPECIAL_42>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    958 '<SPECIAL_958>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     80 '<SPECIAL_80>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    429 '<SPECIAL_429>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    684 '<SPECIAL_684>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    707 '<SPECIAL_707>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    993 '<SPECIAL_993>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    645 '<SPECIAL_645>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    330 '<SPECIAL_330>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    420 '<SPECIAL_420>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    613 '<SPECIAL_613>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    105 '<SPECIAL_105>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    842 '<SPECIAL_842>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    816 '<SPECIAL_816>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    397 '<SPECIAL_397>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    616 '<SPECIAL_616>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    236 '<SPECIAL_236>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    823 '<SPECIAL_823>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    954 '<SPECIAL_954>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    650 '<SPECIAL_650>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    960 '<SPECIAL_960>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    695 '<SPECIAL_695>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    375 '<SPECIAL_375>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:      1 '<s>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    146 '<SPECIAL_146>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    914 '<SPECIAL_914>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     38 '<SPECIAL_38>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    990 '<SPECIAL_990>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    753 '<SPECIAL_753>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    907 '<SPECIAL_907>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    211 '<SPECIAL_211>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     29 '<SPECIAL_29>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    622 '<SPECIAL_622>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     87 '<SPECIAL_87>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    172 '<SPECIAL_172>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    191 '<SPECIAL_191>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    778 '<SPECIAL_778>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    713 '<SPECIAL_713>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    647 '<SPECIAL_647>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    347 '<SPECIAL_347>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    237 '<SPECIAL_237>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    190 '<SPECIAL_190>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    536 '<SPECIAL_536>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:      4 '[/INST]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    893 '<SPECIAL_893>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    569 '<SPECIAL_569>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     54 '<SPECIAL_54>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    790 '<SPECIAL_790>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    667 '<SPECIAL_667>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    123 '<SPECIAL_123>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    975 '<SPECIAL_975>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    808 '<SPECIAL_808>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    600 '<SPECIAL_600>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    912 '<SPECIAL_912>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    520 '<SPECIAL_520>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    740 '<SPECIAL_740>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    132 '<SPECIAL_132>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    659 '<SPECIAL_659>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    508 '<SPECIAL_508>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    658 '<SPECIAL_658>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    780 '<SPECIAL_780>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    260 '<SPECIAL_260>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    567 '<SPECIAL_567>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    195 '<SPECIAL_195>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    282 '<SPECIAL_282>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    278 '<SPECIAL_278>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    453 '<SPECIAL_453>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    532 '<SPECIAL_532>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     28 '<SPECIAL_28>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    697 '<SPECIAL_697>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    502 '<SPECIAL_502>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    226 '<SPECIAL_226>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    858 '<SPECIAL_858>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    836 '<SPECIAL_836>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    636 '<SPECIAL_636>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    116 '<SPECIAL_116>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    676 '<SPECIAL_676>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    466 '<SPECIAL_466>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    521 '<SPECIAL_521>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    483 '<SPECIAL_483>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    718 '<SPECIAL_718>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    764 '<SPECIAL_764>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    978 '<SPECIAL_978>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    624 '<SPECIAL_624>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    388 '<SPECIAL_388>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    266 '<SPECIAL_266>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    670 '<SPECIAL_670>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    875 '<SPECIAL_875>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     12 '[IMG_BREAK]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    550 '<SPECIAL_550>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    384 '<SPECIAL_384>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    759 '<SPECIAL_759>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    254 '<SPECIAL_254>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    443 '<SPECIAL_443>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    655 '<SPECIAL_655>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    996 '<SPECIAL_996>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    558 '<SPECIAL_558>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    339 '<SPECIAL_339>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    830 '<SPECIAL_830>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    528 '<SPECIAL_528>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    768 '<SPECIAL_768>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    591 '<SPECIAL_591>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    876 '<SPECIAL_876>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    730 '<SPECIAL_730>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    571 '<SPECIAL_571>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    629 '<SPECIAL_629>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    270 '<SPECIAL_270>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    742 '<SPECIAL_742>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    783 '<SPECIAL_783>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    258 '<SPECIAL_258>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     67 '<SPECIAL_67>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    575 '<SPECIAL_575>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    212 '<SPECIAL_212>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:      3 '[INST]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    813 '<SPECIAL_813>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    143 '<SPECIAL_143>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    149 '<SPECIAL_149>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    192 '<SPECIAL_192>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    669 '<SPECIAL_669>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    648 '<SPECIAL_648>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    932 '<SPECIAL_932>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    765 '<SPECIAL_765>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    113 '<SPECIAL_113>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     33 '<SPECIAL_33>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    533 '<SPECIAL_533>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    103 '<SPECIAL_103>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    544 '<SPECIAL_544>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    112 '<SPECIAL_112>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     56 '<SPECIAL_56>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    114 '<SPECIAL_114>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    163 '<SPECIAL_163>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    108 '<SPECIAL_108>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    310 '<SPECIAL_310>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    606 '<SPECIAL_606>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    410 '<SPECIAL_410>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    297 '<SPECIAL_297>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    256 '<SPECIAL_256>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    851 '<SPECIAL_851>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    812 '<SPECIAL_812>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    754 '<SPECIAL_754>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    225 '<SPECIAL_225>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    416 '<SPECIAL_416>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     23 '<SPECIAL_23>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    733 '<SPECIAL_733>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    268 '<SPECIAL_268>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    576 '<SPECIAL_576>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    596 '<SPECIAL_596>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    326 '<SPECIAL_326>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    128 '<SPECIAL_128>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    507 '<SPECIAL_507>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    293 '<SPECIAL_293>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    728 '<SPECIAL_728>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    292 '<SPECIAL_292>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    472 '<SPECIAL_472>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     84 '<SPECIAL_84>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     99 '<SPECIAL_99>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    390 '<SPECIAL_390>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     26 '<SPECIAL_26>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     74 '<SPECIAL_74>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    995 '<SPECIAL_995>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    162 '<SPECIAL_162>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    877 '<SPECIAL_877>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    603 '<SPECIAL_603>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    198 '<SPECIAL_198>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    657 '<SPECIAL_657>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    167 '<SPECIAL_167>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    998 '<SPECIAL_998>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    789 '<SPECIAL_789>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     97 '<SPECIAL_97>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    152 '<SPECIAL_152>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    725 '<SPECIAL_725>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    545 '<SPECIAL_545>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    351 '<SPECIAL_351>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    345 '<SPECIAL_345>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    111 '<SPECIAL_111>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    286 '<SPECIAL_286>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    331 '<SPECIAL_331>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    376 '<SPECIAL_376>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    731 '<SPECIAL_731>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    935 '<SPECIAL_935>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    196 '<SPECIAL_196>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    965 '<SPECIAL_965>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    469 '<SPECIAL_469>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    882 '<SPECIAL_882>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    106 '<SPECIAL_106>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    322 '<SPECIAL_322>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    639 '<SPECIAL_639>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    287 '<SPECIAL_287>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    853 '<SPECIAL_853>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    153 '<SPECIAL_153>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:      5 '[AVAILABLE_TOOLS]' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     44 '<SPECIAL_44>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    313 '<SPECIAL_313>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    680 '<SPECIAL_680>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    793 '<SPECIAL_793>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    702 '<SPECIAL_702>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    102 '<SPECIAL_102>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:    299 '<SPECIAL_299>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token:     76 '<SPECIAL_76>' is not marked as EOG
Jun 30 09:22:09 Darkstar ollama[2861272]: load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect
Jun 30 09:22:09 Darkstar ollama[2861272]: load: special tokens cache size = 1000
Jun 30 09:22:09 Darkstar ollama[2861272]: load: token to piece cache size = 0.8498 MB
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: arch             = llama
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: vocab_only       = 1
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: model type       = ?B
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: model params     = 23.57 B
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: general.name     = Devstral Small 2505
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: vocab type       = BPE
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: n_vocab          = 131072
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: n_merges         = 269443
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: BOS token        = 1 '<s>'
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: EOS token        = 2 '</s>'
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: UNK token        = 0 '<unk>'
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: LF token         = 1010 ''
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: EOG token        = 2 '</s>'
Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: max token length = 150
Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_load: vocab only - skipping tensors
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.861-04:00 level=INFO source=server.go:438 msg="starting llama server" cmd="/usr/local/bin/ollama runner --model /usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 --ctx-size 65368 --batch-size 512 --n-gpu-layers 41 --threads 32 --flash-attn --kv-cache-type q8_0 --parallel 2 --port 44989"
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.861-04:00 level=DEBUG source=server.go:439 msg=subprocess PATH=/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games OLLAMA_HOST=0.0.0.0:11434 OLLAMA_FLASH_ATTENTION=1 OLLAMA_KV_CACHE_TYPE=q8_0 OLLAMA_DEBUG=1 OLLAMA_MAX_LOADED_MODELS=6 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama CUDA_VISIBLE_DEVICES=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.862-04:00 level=INFO source=sched.go:483 msg="loaded runners" count=1
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.862-04:00 level=INFO source=server.go:598 msg="waiting for llama runner to start responding"
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.863-04:00 level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server not responding"
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.885-04:00 level=INFO source=runner.go:815 msg="starting go runner"
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.885-04:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama
Jun 30 09:22:09 Darkstar ollama[2861272]: ggml_cuda_init: GGML_CUDA_FORCE_MMQ:    no
Jun 30 09:22:09 Darkstar ollama[2861272]: ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no
Jun 30 09:22:09 Darkstar ollama[2861272]: ggml_cuda_init: found 1 CUDA devices:
Jun 30 09:22:09 Darkstar ollama[2861272]:   Device 0: Tesla V100-PCIE-32GB, compute capability 7.0, VMM: yes
Jun 30 09:22:09 Darkstar ollama[2861272]: load_backend: loaded CUDA backend from /usr/local/lib/ollama/libggml-cuda.so
Jun 30 09:22:09 Darkstar ollama[2861272]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-skylakex.so
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.962-04:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.AVX512=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc)
Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.963-04:00 level=INFO source=runner.go:874 msg="Server listening on 127.0.0.1:44989"
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_load_from_file_impl: using device CUDA0 (Tesla V100-PCIE-32GB) - 32191 MiB free
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: loaded meta data with 41 key-value pairs and 363 tensors from /usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 (version GGUF V3 (latest))
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv   0:                       general.architecture str              = llama
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv   1:                  general.base_model.0.name str              = Devstrall Small 2505
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv   2:          general.base_model.0.organization str              = Mistralai
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv   3:              general.base_model.0.repo_url str              = https://huggingface.co/mistralai/Devs...
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv   4:               general.base_model.0.version str              = 2505
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv   5:                   general.base_model.count u32              = 1
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv   6:                           general.basename str              = Devstral
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv   7:                          general.file_type u32              = 15
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv   8:                          general.languages arr[str,24]      = ["en", "fr", "de", "es", "pt", "it", ...
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv   9:                            general.license str              = apache-2.0
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  10:                               general.name str              = Devstral Small 2505
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  11:                    general.parameter_count u64              = 23572403200
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  12:               general.quantization_version u32              = 2
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  13:                         general.size_label str              = Small
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  14:                               general.tags arr[str,1]       = ["text2text-generation"]
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  15:                               general.type str              = model
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  16:                            general.version str              = 2505
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  17:                 llama.attention.head_count u32              = 32
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  18:              llama.attention.head_count_kv u32              = 8
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  19:                 llama.attention.key_length u32              = 128
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  20:     llama.attention.layer_norm_rms_epsilon f32              = 0.000010
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  21:               llama.attention.value_length u32              = 128
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  22:                          llama.block_count u32              = 40
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  23:                       llama.context_length u32              = 131072
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  24:                     llama.embedding_length u32              = 5120
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  25:                  llama.feed_forward_length u32              = 32768
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  26:                 llama.rope.dimension_count u32              = 128
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  27:                       llama.rope.freq_base f32              = 1000000000.000000
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  28:                           llama.vocab_size u32              = 131072
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  29:                    tokenizer.chat_template str              = {%- set today = strftime_now("%Y-%m-%...
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  30:               tokenizer.ggml.add_bos_token bool             = true
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  31:               tokenizer.ggml.add_eos_token bool             = false
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  32:            tokenizer.ggml.add_space_prefix bool             = false
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  33:                tokenizer.ggml.bos_token_id u32              = 1
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  34:                tokenizer.ggml.eos_token_id u32              = 2
Jun 30 09:22:10 Darkstar ollama[2861272]: time=2025-06-30T09:22:10.116-04:00 level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server loading model"
Jun 30 09:22:10 Darkstar ollama[2861272]: [132B blob data]
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  36:                       tokenizer.ggml.model str              = gpt2
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  37:                         tokenizer.ggml.pre str              = tekken
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  38:                  tokenizer.ggml.token_type arr[i32,131072]  = [3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, ...
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  39:                      tokenizer.ggml.tokens arr[str,131072]  = ["<unk>", "<s>", "</s>", "[INST]", "[...
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv  40:            tokenizer.ggml.unknown_token_id u32              = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - type  f32:   81 tensors
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - type q4_K:  241 tensors
Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - type q6_K:   41 tensors
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: file format = GGUF V3 (latest)
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: file type   = Q4_K - Medium
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: file size   = 13.34 GiB (4.86 BPW)
Jun 30 09:22:10 Darkstar ollama[2861272]: init_tokenizer: initializing tokenizer for type 2
<!-- gh-comment-id:3019200497 --> @jeepshop commented on GitHub (Jun 30, 2025): Here is a log after a fresh restart of Ollama, and loading Devstral. I don't know what I'm looking for, but it seems as if --parallel is set to 2. Do I have a fundamental misunderstanding of how parallel works? I *assumed* it meant how many parallel queries (api services) it could run at the same time, directly relating to how many users could run, but is that really true? Or does something like AnythingLLM use multiple simultanious queries somehow negating the benifit to multiple users? For example, in your attached Graph of an 2x A100 - Can it really serve 4-10 users simultaneously??? ```log Jun 30 09:14:23 Darkstar ollama[1651980]: time=2025-06-30T09:14:23.973-04:00 level=WARN source=types.go:572 msg="invalid option provided" option=use_mlock Jun 30 09:14:24 Darkstar ollama[1651980]: time=2025-06-30T09:14:24.575-04:00 level=INFO source=sched.go:788 msg="new model will fit in available VRAM in single GPU, loading" model=/usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 gpu=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 parallel=2 available=33754841088 required="23.0 GiB" Jun 30 09:14:24 Darkstar ollama[1651980]: time=2025-06-30T09:14:24.805-04:00 level=INFO source=server.go:135 msg="system memory" total="62.9 GiB" free="54.4 GiB" free_swap="92.0 KiB" Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.024-04:00 level=INFO source=server.go:168 msg=offload library=cuda layers.requested=-1 layers.model=41 layers.offload=41 layers.split="" memory.available="[31.4 GiB]" memory.gpu_overhead="0 B" memory.required.full="23.0 GiB" memory.required.partial="23.0 GiB" memory.required.kv="5.0 GiB" memory.required.allocations="[23.0 GiB]" memory.weights.total="13.0 GiB" memory.weights.repeating="12.5 GiB" memory.weights.nonrepeating="525.0 MiB" memory.graph.full="4.2 GiB" memory.graph.partial="4.5 GiB" Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.024-04:00 level=INFO source=server.go:211 msg="enabling flash attention" Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: loaded meta data with 41 key-value pairs and 363 tensors from /usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 (version GGUF V3 (latest)) Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output. Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 0: general.architecture str = llama Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 1: general.base_model.0.name str = Devstrall Small 2505 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 2: general.base_model.0.organization str = Mistralai Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 3: general.base_model.0.repo_url str = https://huggingface.co/mistralai/Devs... Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 4: general.base_model.0.version str = 2505 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 5: general.base_model.count u32 = 1 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 6: general.basename str = Devstral Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 7: general.file_type u32 = 15 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 8: general.languages arr[str,24] = ["en", "fr", "de", "es", "pt", "it", ... Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 9: general.license str = apache-2.0 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 10: general.name str = Devstral Small 2505 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 11: general.parameter_count u64 = 23572403200 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 12: general.quantization_version u32 = 2 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 13: general.size_label str = Small Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 14: general.tags arr[str,1] = ["text2text-generation"] Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 15: general.type str = model Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 16: general.version str = 2505 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 17: llama.attention.head_count u32 = 32 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 18: llama.attention.head_count_kv u32 = 8 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 19: llama.attention.key_length u32 = 128 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 20: llama.attention.layer_norm_rms_epsilon f32 = 0.000010 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 21: llama.attention.value_length u32 = 128 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 22: llama.block_count u32 = 40 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 23: llama.context_length u32 = 131072 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 24: llama.embedding_length u32 = 5120 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 25: llama.feed_forward_length u32 = 32768 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 26: llama.rope.dimension_count u32 = 128 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 27: llama.rope.freq_base f32 = 1000000000.000000 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 28: llama.vocab_size u32 = 131072 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 29: tokenizer.chat_template str = {%- set today = strftime_now("%Y-%m-%... Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 30: tokenizer.ggml.add_bos_token bool = true Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 31: tokenizer.ggml.add_eos_token bool = false Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 32: tokenizer.ggml.add_space_prefix bool = false Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 33: tokenizer.ggml.bos_token_id u32 = 1 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 34: tokenizer.ggml.eos_token_id u32 = 2 Jun 30 09:14:25 Darkstar ollama[1651980]: [132B blob data] Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 36: tokenizer.ggml.model str = gpt2 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 37: tokenizer.ggml.pre str = tekken Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 38: tokenizer.ggml.token_type arr[i32,131072] = [3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, ... Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 39: tokenizer.ggml.tokens arr[str,131072] = ["<unk>", "<s>", "</s>", "[INST]", "[... Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 40: tokenizer.ggml.unknown_token_id u32 = 0 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - type f32: 81 tensors Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - type q4_K: 241 tensors Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - type q6_K: 41 tensors Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: file format = GGUF V3 (latest) Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: file type = Q4_K - Medium Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: file size = 13.34 GiB (4.86 BPW) Jun 30 09:14:25 Darkstar ollama[1651980]: load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect Jun 30 09:14:25 Darkstar ollama[1651980]: load: special tokens cache size = 1000 Jun 30 09:14:25 Darkstar ollama[1651980]: load: token to piece cache size = 0.8498 MB Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: arch = llama Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: vocab_only = 1 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: model type = ?B Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: model params = 23.57 B Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: general.name = Devstral Small 2505 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: vocab type = BPE Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_vocab = 131072 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_merges = 269443 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: BOS token = 1 '<s>' Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: EOS token = 2 '</s>' Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: UNK token = 0 '<unk>' Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: LF token = 1010 '' Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: EOG token = 2 '</s>' Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: max token length = 150 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_load: vocab only - skipping tensors Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.321-04:00 level=INFO source=server.go:431 msg="starting llama server" cmd="/usr/local/bin/ollama runner --model /usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 --ctx-size 65368 --batch-size 512 --n-gpu-layers 41 --threads 32 --flash-attn --kv-cache-type q8_0 --parallel 2 --port 46209" Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.322-04:00 level=INFO source=sched.go:483 msg="loaded runners" count=1 Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.322-04:00 level=INFO source=server.go:591 msg="waiting for llama runner to start responding" Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.322-04:00 level=INFO source=server.go:625 msg="waiting for server to become available" status="llm server not responding" Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.343-04:00 level=INFO source=runner.go:815 msg="starting go runner" Jun 30 09:14:25 Darkstar ollama[1651980]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-skylakex.so Jun 30 09:14:25 Darkstar ollama[1651980]: ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no Jun 30 09:14:25 Darkstar ollama[1651980]: ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no Jun 30 09:14:25 Darkstar ollama[1651980]: ggml_cuda_init: found 1 CUDA devices: Jun 30 09:14:25 Darkstar ollama[1651980]: Device 0: Tesla V100-PCIE-32GB, compute capability 7.0, VMM: yes Jun 30 09:14:25 Darkstar ollama[1651980]: load_backend: loaded CUDA backend from /usr/local/lib/ollama/cuda_v12/libggml-cuda.so Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.413-04:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.AVX512=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc) Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.414-04:00 level=INFO source=runner.go:874 msg="Server listening on 127.0.0.1:46209" Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_load_from_file_impl: using device CUDA0 (Tesla V100-PCIE-32GB) - 32191 MiB free Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: loaded meta data with 41 key-value pairs and 363 tensors from /usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 (version GGUF V3 (latest)) Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output. Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 0: general.architecture str = llama Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 1: general.base_model.0.name str = Devstrall Small 2505 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 2: general.base_model.0.organization str = Mistralai Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 3: general.base_model.0.repo_url str = https://huggingface.co/mistralai/Devs... Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 4: general.base_model.0.version str = 2505 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 5: general.base_model.count u32 = 1 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 6: general.basename str = Devstral Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 7: general.file_type u32 = 15 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 8: general.languages arr[str,24] = ["en", "fr", "de", "es", "pt", "it", ... Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 9: general.license str = apache-2.0 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 10: general.name str = Devstral Small 2505 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 11: general.parameter_count u64 = 23572403200 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 12: general.quantization_version u32 = 2 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 13: general.size_label str = Small Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 14: general.tags arr[str,1] = ["text2text-generation"] Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 15: general.type str = model Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 16: general.version str = 2505 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 17: llama.attention.head_count u32 = 32 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 18: llama.attention.head_count_kv u32 = 8 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 19: llama.attention.key_length u32 = 128 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 20: llama.attention.layer_norm_rms_epsilon f32 = 0.000010 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 21: llama.attention.value_length u32 = 128 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 22: llama.block_count u32 = 40 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 23: llama.context_length u32 = 131072 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 24: llama.embedding_length u32 = 5120 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 25: llama.feed_forward_length u32 = 32768 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 26: llama.rope.dimension_count u32 = 128 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 27: llama.rope.freq_base f32 = 1000000000.000000 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 28: llama.vocab_size u32 = 131072 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 29: tokenizer.chat_template str = {%- set today = strftime_now("%Y-%m-%... Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 30: tokenizer.ggml.add_bos_token bool = true Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 31: tokenizer.ggml.add_eos_token bool = false Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 32: tokenizer.ggml.add_space_prefix bool = false Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 33: tokenizer.ggml.bos_token_id u32 = 1 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 34: tokenizer.ggml.eos_token_id u32 = 2 Jun 30 09:14:25 Darkstar ollama[1651980]: time=2025-06-30T09:14:25.574-04:00 level=INFO source=server.go:625 msg="waiting for server to become available" status="llm server loading model" Jun 30 09:14:25 Darkstar ollama[1651980]: [132B blob data] Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 36: tokenizer.ggml.model str = gpt2 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 37: tokenizer.ggml.pre str = tekken Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 38: tokenizer.ggml.token_type arr[i32,131072] = [3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, ... Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 39: tokenizer.ggml.tokens arr[str,131072] = ["<unk>", "<s>", "</s>", "[INST]", "[... Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - kv 40: tokenizer.ggml.unknown_token_id u32 = 0 Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - type f32: 81 tensors Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - type q4_K: 241 tensors Jun 30 09:14:25 Darkstar ollama[1651980]: llama_model_loader: - type q6_K: 41 tensors Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: file format = GGUF V3 (latest) Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: file type = Q4_K - Medium Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: file size = 13.34 GiB (4.86 BPW) Jun 30 09:14:25 Darkstar ollama[1651980]: load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect Jun 30 09:14:25 Darkstar ollama[1651980]: load: special tokens cache size = 1000 Jun 30 09:14:25 Darkstar ollama[1651980]: load: token to piece cache size = 0.8498 MB Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: arch = llama Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: vocab_only = 0 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_ctx_train = 131072 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_embd = 5120 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_layer = 40 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_head = 32 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_head_kv = 8 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_rot = 128 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_swa = 0 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_swa_pattern = 1 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_embd_head_k = 128 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_embd_head_v = 128 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_gqa = 4 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_embd_k_gqa = 1024 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_embd_v_gqa = 1024 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: f_norm_eps = 0.0e+00 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: f_norm_rms_eps = 1.0e-05 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: f_clamp_kqv = 0.0e+00 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: f_max_alibi_bias = 0.0e+00 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: f_logit_scale = 0.0e+00 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: f_attn_scale = 0.0e+00 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_ff = 32768 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_expert = 0 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_expert_used = 0 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: causal attn = 1 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: pooling type = 0 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: rope type = 0 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: rope scaling = linear Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: freq_base_train = 1000000000.0 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: freq_scale_train = 1 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_ctx_orig_yarn = 131072 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: rope_finetuned = unknown Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: ssm_d_conv = 0 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: ssm_d_inner = 0 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: ssm_d_state = 0 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: ssm_dt_rank = 0 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: ssm_dt_b_c_rms = 0 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: model type = 13B Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: model params = 23.57 B Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: general.name = Devstral Small 2505 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: vocab type = BPE Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_vocab = 131072 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: n_merges = 269443 Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: BOS token = 1 '<s>' Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: EOS token = 2 '</s>' Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: UNK token = 0 '<unk>' Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: LF token = 1010 '' Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: EOG token = 2 '</s>' Jun 30 09:14:25 Darkstar ollama[1651980]: print_info: max token length = 150 Jun 30 09:14:25 Darkstar ollama[1651980]: load_tensors: loading model tensors, this can take a while... (mmap = true) Jun 30 09:14:26 Darkstar ollama[1651980]: load_tensors: offloading 40 repeating layers to GPU Jun 30 09:14:26 Darkstar ollama[1651980]: load_tensors: offloading output layer to GPU Jun 30 09:14:26 Darkstar ollama[1651980]: load_tensors: offloaded 41/41 layers to GPU Jun 30 09:14:26 Darkstar ollama[1651980]: load_tensors: CUDA0 model buffer size = 13302.36 MiB Jun 30 09:14:26 Darkstar ollama[1651980]: load_tensors: CPU_Mapped model buffer size = 360.00 MiB Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: constructing llama_context Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: n_seq_max = 2 Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: n_ctx = 65368 Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: n_ctx_per_seq = 32684 Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: n_batch = 1024 Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: n_ubatch = 512 Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: causal_attn = 1 Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: flash_attn = 1 Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: freq_base = 1000000000.0 Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: freq_scale = 1 Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: n_ctx_per_seq (32684) < n_ctx_train (131072) -- the full capacity of the model will not be utilized Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: CUDA_Host output buffer size = 1.04 MiB Jun 30 09:14:30 Darkstar ollama[1651980]: llama_kv_cache_unified: kv_size = 65536, type_k = 'q8_0', type_v = 'q8_0', n_layer = 40, can_shift = 1, padding = 256 Jun 30 09:14:30 Darkstar ollama[1651980]: llama_kv_cache_unified: CUDA0 KV buffer size = 5440.00 MiB Jun 30 09:14:30 Darkstar ollama[1651980]: llama_kv_cache_unified: KV self size = 5440.00 MiB, K (q8_0): 2720.00 MiB, V (q8_0): 2720.00 MiB Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: CUDA0 compute buffer size = 266.00 MiB Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: CUDA_Host compute buffer size = 138.01 MiB Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: graph nodes = 1207 Jun 30 09:14:30 Darkstar ollama[1651980]: llama_context: graph splits = 2 Jun 30 09:14:30 Darkstar ollama[1651980]: time=2025-06-30T09:14:30.854-04:00 level=INFO source=server.go:630 msg="llama runner started in 5.53 seconds" Jun 30 09:14:31 Darkstar ollama[1651980]: [GIN] 2025/06/30 - 09:14:31 | 200 | 7.338534446s | 127.0.0.1 | POST "/api/chat" Jun 30 09:14:51 Darkstar ollama[1651980]: [GIN] 2025/06/30 - 09:14:51 | 200 | 132.8�s | 127.0.0.1 | GET "/api/version" Jun 30 09:17:24 Darkstar systemd[1]: Stopping ollama.service - Ollama Service... Jun 30 09:17:25 Darkstar systemd[1]: ollama.service: Deactivated successfully. Jun 30 09:17:25 Darkstar systemd[1]: Stopped ollama.service - Ollama Service. Jun 30 09:17:25 Darkstar systemd[1]: ollama.service: Consumed 23h 21min 22.642s CPU time. Jun 30 09:17:25 Darkstar systemd[1]: Started ollama.service - Ollama Service. Jun 30 09:17:25 Darkstar ollama[2860928]: time=2025-06-30T09:17:25.215-04:00 level=INFO source=routes.go:1235 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:true OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE:q8_0 OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/usr/share/ollama/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]" Jun 30 09:17:25 Darkstar ollama[2860928]: time=2025-06-30T09:17:25.222-04:00 level=INFO source=images.go:476 msg="total blobs: 71" Jun 30 09:17:25 Darkstar ollama[2860928]: time=2025-06-30T09:17:25.224-04:00 level=INFO source=images.go:483 msg="total unused blobs removed: 0" Jun 30 09:17:25 Darkstar ollama[2860928]: time=2025-06-30T09:17:25.224-04:00 level=INFO source=routes.go:1288 msg="Listening on [::]:11434 (version 0.9.3)" Jun 30 09:17:25 Darkstar ollama[2860928]: time=2025-06-30T09:17:25.225-04:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs" Jun 30 09:17:25 Darkstar ollama[2860928]: time=2025-06-30T09:17:25.564-04:00 level=INFO source=types.go:130 msg="inference compute" id=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 library=cuda variant=v12 compute=7.0 driver=12.2 name="Tesla V100-PCIE-32GB" total="31.7 GiB" available="31.4 GiB" Jun 30 09:17:25 Darkstar ollama[2860928]: time=2025-06-30T09:17:25.565-04:00 level=INFO source=types.go:130 msg="inference compute" id=GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822 library=cuda variant=v12 compute=7.0 driver=12.2 name="Tesla V100-PCIE-32GB" total="31.7 GiB" available="31.4 GiB" Jun 30 09:21:52 Darkstar systemd[1]: Stopping ollama.service - Ollama Service... Jun 30 09:21:52 Darkstar systemd[1]: ollama.service: Deactivated successfully. Jun 30 09:21:52 Darkstar systemd[1]: Stopped ollama.service - Ollama Service. Jun 30 09:21:52 Darkstar systemd[1]: Started ollama.service - Ollama Service. Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.141-04:00 level=INFO source=routes.go:1235 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:DEBUG OLLAMA_FLASH_ATTENTION:true OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE:q8_0 OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/usr/share/ollama/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]" Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.149-04:00 level=INFO source=images.go:476 msg="total blobs: 71" Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.152-04:00 level=INFO source=images.go:483 msg="total unused blobs removed: 0" Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.154-04:00 level=INFO source=routes.go:1288 msg="Listening on [::]:11434 (version 0.9.3)" Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.154-04:00 level=DEBUG source=sched.go:108 msg="starting llm scheduler" Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.154-04:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs" Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.158-04:00 level=DEBUG source=gpu.go:98 msg="searching for GPU discovery libraries for NVIDIA" Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.158-04:00 level=DEBUG source=gpu.go:501 msg="Searching for GPU library" name=libcuda.so* Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.158-04:00 level=DEBUG source=gpu.go:525 msg="gpu library search" globs="[/usr/local/lib/ollama/libcuda.so* /libcuda.so* /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]" Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.162-04:00 level=DEBUG source=gpu.go:558 msg="discovered GPU libraries" paths=[/usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.535.216.01] Jun 30 09:21:52 Darkstar ollama[2861272]: initializing /usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.535.216.01 Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuInit - 0x7f8429cc24b0 Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuDriverGetVersion - 0x7f8429cc24d0 Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuDeviceGetCount - 0x7f8429cc2510 Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuDeviceGet - 0x7f8429cc24f0 Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuDeviceGetAttribute - 0x7f8429cc25f0 Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuDeviceGetUuid - 0x7f8429cc2550 Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuDeviceGetName - 0x7f8429cc2530 Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuCtxCreate_v3 - 0x7f8429cca1b0 Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuMemGetInfo_v2 - 0x7f8429cd5680 Jun 30 09:21:52 Darkstar ollama[2861272]: dlsym: cuCtxDestroy - 0x7f8429d24680 Jun 30 09:21:52 Darkstar ollama[2861272]: calling cuInit Jun 30 09:21:52 Darkstar ollama[2861272]: calling cuDriverGetVersion Jun 30 09:21:52 Darkstar ollama[2861272]: raw version 0x2ef4 Jun 30 09:21:52 Darkstar ollama[2861272]: CUDA driver version: 12.2 Jun 30 09:21:52 Darkstar ollama[2861272]: calling cuDeviceGetCount Jun 30 09:21:52 Darkstar ollama[2861272]: device count 2 Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.203-04:00 level=DEBUG source=gpu.go:125 msg="detected GPUs" count=2 library=/usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.535.216.01 Jun 30 09:21:52 Darkstar ollama[2861272]: [GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4] CUDA totalMem 32501mb Jun 30 09:21:52 Darkstar ollama[2861272]: [GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4] CUDA freeMem 32191mb Jun 30 09:21:52 Darkstar ollama[2861272]: [GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4] Compute Capability 7.0 Jun 30 09:21:52 Darkstar ollama[2861272]: [GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822] CUDA totalMem 32501mb Jun 30 09:21:52 Darkstar ollama[2861272]: [GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822] CUDA freeMem 32191mb Jun 30 09:21:52 Darkstar ollama[2861272]: [GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822] Compute Capability 7.0 Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.497-04:00 level=DEBUG source=amd_linux.go:419 msg="amdgpu driver not detected /sys/module/amdgpu" Jun 30 09:21:52 Darkstar ollama[2861272]: releasing cuda driver library Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.497-04:00 level=INFO source=types.go:130 msg="inference compute" id=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 library=cuda variant=v12 compute=7.0 driver=12.2 name="Tesla V100-PCIE-32GB" total="31.7 GiB" available="31.4 GiB" Jun 30 09:21:52 Darkstar ollama[2861272]: time=2025-06-30T09:21:52.497-04:00 level=INFO source=types.go:130 msg="inference compute" id=GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822 library=cuda variant=v12 compute=7.0 driver=12.2 name="Tesla V100-PCIE-32GB" total="31.7 GiB" available="31.4 GiB" Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.495-04:00 level=WARN source=types.go:572 msg="invalid option provided" option=use_mlock Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.495-04:00 level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.9 GiB" before.free="56.9 GiB" before.free_swap="386.0 MiB" now.total="62.9 GiB" now.free="56.9 GiB" now.free_swap="386.0 MiB" Jun 30 09:22:08 Darkstar ollama[2861272]: initializing /usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.535.216.01 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuInit - 0x7f8429cc24b0 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDriverGetVersion - 0x7f8429cc24d0 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetCount - 0x7f8429cc2510 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGet - 0x7f8429cc24f0 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetAttribute - 0x7f8429cc25f0 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetUuid - 0x7f8429cc2550 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetName - 0x7f8429cc2530 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuCtxCreate_v3 - 0x7f8429cca1b0 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuMemGetInfo_v2 - 0x7f8429cd5680 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuCtxDestroy - 0x7f8429d24680 Jun 30 09:22:08 Darkstar ollama[2861272]: calling cuInit Jun 30 09:22:08 Darkstar ollama[2861272]: calling cuDriverGetVersion Jun 30 09:22:08 Darkstar ollama[2861272]: raw version 0x2ef4 Jun 30 09:22:08 Darkstar ollama[2861272]: CUDA driver version: 12.2 Jun 30 09:22:08 Darkstar ollama[2861272]: calling cuDeviceGetCount Jun 30 09:22:08 Darkstar ollama[2861272]: device count 2 Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.660-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB" Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.809-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB" Jun 30 09:22:08 Darkstar ollama[2861272]: releasing cuda driver library Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.809-04:00 level=DEBUG source=sched.go:185 msg="updating default concurrency" OLLAMA_MAX_LOADED_MODELS=6 gpu_count=2 Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.827-04:00 level=DEBUG source=ggml.go:206 msg="key with type not found" key=general.alignment default=32 Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.879-04:00 level=DEBUG source=sched.go:228 msg="loading first model" model=/usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.879-04:00 level=DEBUG source=memory.go:111 msg=evaluating library=cuda gpu_count=1 available="[31.4 GiB]" Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.879-04:00 level=DEBUG source=ggml.go:206 msg="key with type not found" key=llama.vision.block_count default=0 Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.879-04:00 level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.9 GiB" before.free="56.9 GiB" before.free_swap="386.0 MiB" now.total="62.9 GiB" now.free="56.8 GiB" now.free_swap="386.0 MiB" Jun 30 09:22:08 Darkstar ollama[2861272]: initializing /usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.535.216.01 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuInit - 0x7f8429cc24b0 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDriverGetVersion - 0x7f8429cc24d0 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetCount - 0x7f8429cc2510 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGet - 0x7f8429cc24f0 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetAttribute - 0x7f8429cc25f0 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetUuid - 0x7f8429cc2550 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuDeviceGetName - 0x7f8429cc2530 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuCtxCreate_v3 - 0x7f8429cca1b0 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuMemGetInfo_v2 - 0x7f8429cd5680 Jun 30 09:22:08 Darkstar ollama[2861272]: dlsym: cuCtxDestroy - 0x7f8429d24680 Jun 30 09:22:08 Darkstar ollama[2861272]: calling cuInit Jun 30 09:22:08 Darkstar ollama[2861272]: calling cuDriverGetVersion Jun 30 09:22:08 Darkstar ollama[2861272]: raw version 0x2ef4 Jun 30 09:22:08 Darkstar ollama[2861272]: CUDA driver version: 12.2 Jun 30 09:22:08 Darkstar ollama[2861272]: calling cuDeviceGetCount Jun 30 09:22:08 Darkstar ollama[2861272]: device count 2 Jun 30 09:22:08 Darkstar ollama[2861272]: time=2025-06-30T09:22:08.991-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB" Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.101-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB" Jun 30 09:22:09 Darkstar ollama[2861272]: releasing cuda driver library Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.102-04:00 level=INFO source=sched.go:788 msg="new model will fit in available VRAM in single GPU, loading" model=/usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 gpu=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 parallel=2 available=33754841088 required="23.0 GiB" Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.102-04:00 level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.9 GiB" before.free="56.8 GiB" before.free_swap="386.0 MiB" now.total="62.9 GiB" now.free="56.8 GiB" now.free_swap="386.0 MiB" Jun 30 09:22:09 Darkstar ollama[2861272]: initializing /usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.535.216.01 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuInit - 0x7f8429cc24b0 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDriverGetVersion - 0x7f8429cc24d0 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetCount - 0x7f8429cc2510 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGet - 0x7f8429cc24f0 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetAttribute - 0x7f8429cc25f0 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetUuid - 0x7f8429cc2550 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetName - 0x7f8429cc2530 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuCtxCreate_v3 - 0x7f8429cca1b0 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuMemGetInfo_v2 - 0x7f8429cd5680 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuCtxDestroy - 0x7f8429d24680 Jun 30 09:22:09 Darkstar ollama[2861272]: calling cuInit Jun 30 09:22:09 Darkstar ollama[2861272]: calling cuDriverGetVersion Jun 30 09:22:09 Darkstar ollama[2861272]: raw version 0x2ef4 Jun 30 09:22:09 Darkstar ollama[2861272]: CUDA driver version: 12.2 Jun 30 09:22:09 Darkstar ollama[2861272]: calling cuDeviceGetCount Jun 30 09:22:09 Darkstar ollama[2861272]: device count 2 Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.210-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB" Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.317-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB" Jun 30 09:22:09 Darkstar ollama[2861272]: releasing cuda driver library Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.318-04:00 level=INFO source=server.go:135 msg="system memory" total="62.9 GiB" free="56.8 GiB" free_swap="386.0 MiB" Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.318-04:00 level=DEBUG source=memory.go:111 msg=evaluating library=cuda gpu_count=1 available="[31.4 GiB]" Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.318-04:00 level=DEBUG source=ggml.go:206 msg="key with type not found" key=llama.vision.block_count default=0 Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.318-04:00 level=DEBUG source=gpu.go:391 msg="updating system memory data" before.total="62.9 GiB" before.free="56.8 GiB" before.free_swap="386.0 MiB" now.total="62.9 GiB" now.free="56.8 GiB" now.free_swap="386.0 MiB" Jun 30 09:22:09 Darkstar ollama[2861272]: initializing /usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.535.216.01 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuInit - 0x7f8429cc24b0 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDriverGetVersion - 0x7f8429cc24d0 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetCount - 0x7f8429cc2510 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGet - 0x7f8429cc24f0 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetAttribute - 0x7f8429cc25f0 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetUuid - 0x7f8429cc2550 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuDeviceGetName - 0x7f8429cc2530 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuCtxCreate_v3 - 0x7f8429cca1b0 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuMemGetInfo_v2 - 0x7f8429cd5680 Jun 30 09:22:09 Darkstar ollama[2861272]: dlsym: cuCtxDestroy - 0x7f8429d24680 Jun 30 09:22:09 Darkstar ollama[2861272]: calling cuInit Jun 30 09:22:09 Darkstar ollama[2861272]: calling cuDriverGetVersion Jun 30 09:22:09 Darkstar ollama[2861272]: raw version 0x2ef4 Jun 30 09:22:09 Darkstar ollama[2861272]: CUDA driver version: 12.2 Jun 30 09:22:09 Darkstar ollama[2861272]: calling cuDeviceGetCount Jun 30 09:22:09 Darkstar ollama[2861272]: device count 2 Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.425-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB" Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.537-04:00 level=DEBUG source=gpu.go:441 msg="updating cuda memory data" gpu=GPU-43922f04-c7c4-ec73-6f4e-51687b1fd822 name="Tesla V100-PCIE-32GB" overhead="0 B" before.total="31.7 GiB" before.free="31.4 GiB" now.total="31.7 GiB" now.free="31.4 GiB" now.used="310.0 MiB" Jun 30 09:22:09 Darkstar ollama[2861272]: releasing cuda driver library Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.537-04:00 level=INFO source=server.go:175 msg=offload library=cuda layers.requested=-1 layers.model=41 layers.offload=41 layers.split="" memory.available="[31.4 GiB]" memory.gpu_overhead="0 B" memory.required.full="23.0 GiB" memory.required.partial="23.0 GiB" memory.required.kv="5.0 GiB" memory.required.allocations="[23.0 GiB]" memory.weights.total="13.0 GiB" memory.weights.repeating="12.5 GiB" memory.weights.nonrepeating="525.0 MiB" memory.graph.full="4.2 GiB" memory.graph.partial="4.5 GiB" Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.537-04:00 level=INFO source=server.go:218 msg="enabling flash attention" Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.537-04:00 level=DEBUG source=server.go:291 msg="compatible gpu libraries" compatible=[] Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: loaded meta data with 41 key-value pairs and 363 tensors from /usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 (version GGUF V3 (latest)) Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output. Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 0: general.architecture str = llama Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 1: general.base_model.0.name str = Devstrall Small 2505 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 2: general.base_model.0.organization str = Mistralai Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 3: general.base_model.0.repo_url str = https://huggingface.co/mistralai/Devs... Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 4: general.base_model.0.version str = 2505 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 5: general.base_model.count u32 = 1 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 6: general.basename str = Devstral Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 7: general.file_type u32 = 15 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 8: general.languages arr[str,24] = ["en", "fr", "de", "es", "pt", "it", ... Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 9: general.license str = apache-2.0 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 10: general.name str = Devstral Small 2505 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 11: general.parameter_count u64 = 23572403200 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 12: general.quantization_version u32 = 2 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 13: general.size_label str = Small Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 14: general.tags arr[str,1] = ["text2text-generation"] Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 15: general.type str = model Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 16: general.version str = 2505 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 17: llama.attention.head_count u32 = 32 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 18: llama.attention.head_count_kv u32 = 8 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 19: llama.attention.key_length u32 = 128 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 20: llama.attention.layer_norm_rms_epsilon f32 = 0.000010 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 21: llama.attention.value_length u32 = 128 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 22: llama.block_count u32 = 40 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 23: llama.context_length u32 = 131072 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 24: llama.embedding_length u32 = 5120 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 25: llama.feed_forward_length u32 = 32768 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 26: llama.rope.dimension_count u32 = 128 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 27: llama.rope.freq_base f32 = 1000000000.000000 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 28: llama.vocab_size u32 = 131072 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 29: tokenizer.chat_template str = {%- set today = strftime_now("%Y-%m-%... Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 30: tokenizer.ggml.add_bos_token bool = true Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 31: tokenizer.ggml.add_eos_token bool = false Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 32: tokenizer.ggml.add_space_prefix bool = false Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 33: tokenizer.ggml.bos_token_id u32 = 1 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 34: tokenizer.ggml.eos_token_id u32 = 2 Jun 30 09:22:09 Darkstar ollama[2861272]: [132B blob data] Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 36: tokenizer.ggml.model str = gpt2 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 37: tokenizer.ggml.pre str = tekken Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 38: tokenizer.ggml.token_type arr[i32,131072] = [3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, ... Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 39: tokenizer.ggml.tokens arr[str,131072] = ["<unk>", "<s>", "</s>", "[INST]", "[... Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - kv 40: tokenizer.ggml.unknown_token_id u32 = 0 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - type f32: 81 tensors Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - type q4_K: 241 tensors Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_loader: - type q6_K: 41 tensors Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: file format = GGUF V3 (latest) Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: file type = Q4_K - Medium Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: file size = 13.34 GiB (4.86 BPW) Jun 30 09:22:09 Darkstar ollama[2861272]: init_tokenizer: initializing tokenizer for type 2 Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 216 '<SPECIAL_216>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 408 '<SPECIAL_408>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 845 '<SPECIAL_845>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 555 '<SPECIAL_555>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 257 '<SPECIAL_257>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 474 '<SPECIAL_474>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 241 '<SPECIAL_241>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 646 '<SPECIAL_646>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 601 '<SPECIAL_601>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 905 '<SPECIAL_905>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 168 '<SPECIAL_168>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 37 '<SPECIAL_37>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 125 '<SPECIAL_125>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 95 '<SPECIAL_95>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 304 '<SPECIAL_304>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 706 '<SPECIAL_706>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 423 '<SPECIAL_423>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 6 '[/AVAILABLE_TOOLS]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 592 '<SPECIAL_592>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 409 '<SPECIAL_409>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 231 '<SPECIAL_231>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 607 '<SPECIAL_607>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 7 '[TOOL_RESULTS]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 138 '<SPECIAL_138>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 455 '<SPECIAL_455>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 801 '<SPECIAL_801>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 288 '<SPECIAL_288>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 619 '<SPECIAL_619>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 133 '<SPECIAL_133>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 827 '<SPECIAL_827>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 771 '<SPECIAL_771>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 723 '<SPECIAL_723>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 494 '<SPECIAL_494>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 444 '<SPECIAL_444>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 422 '<SPECIAL_422>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 441 '<SPECIAL_441>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 372 '<SPECIAL_372>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 874 '<SPECIAL_874>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 137 '<SPECIAL_137>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 250 '<SPECIAL_250>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 840 '<SPECIAL_840>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 846 '<SPECIAL_846>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 465 '<SPECIAL_465>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 425 '<SPECIAL_425>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 984 '<SPECIAL_984>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 328 '<SPECIAL_328>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 186 '<SPECIAL_186>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 973 '<SPECIAL_973>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 394 '<SPECIAL_394>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 522 '<SPECIAL_522>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 385 '<SPECIAL_385>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 496 '<SPECIAL_496>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 498 '<SPECIAL_498>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 489 '<SPECIAL_489>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 767 '<SPECIAL_767>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 916 '<SPECIAL_916>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 818 '<SPECIAL_818>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 894 '<SPECIAL_894>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 668 '<SPECIAL_668>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 566 '<SPECIAL_566>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 898 '<SPECIAL_898>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 490 '<SPECIAL_490>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 977 '<SPECIAL_977>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 900 '<SPECIAL_900>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 541 '<SPECIAL_541>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 21 '<SPECIAL_21>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 787 '<SPECIAL_787>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 722 '<SPECIAL_722>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 803 '<SPECIAL_803>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 210 '<SPECIAL_210>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 205 '<SPECIAL_205>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 485 '<SPECIAL_485>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 40 '<SPECIAL_40>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 57 '<SPECIAL_57>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 115 '<SPECIAL_115>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 798 '<SPECIAL_798>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 700 '<SPECIAL_700>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 961 '<SPECIAL_961>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 101 '<SPECIAL_101>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 279 '<SPECIAL_279>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 139 '<SPECIAL_139>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 903 '<SPECIAL_903>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 625 '<SPECIAL_625>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 147 '<SPECIAL_147>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 837 '<SPECIAL_837>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 438 '<SPECIAL_438>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 500 '<SPECIAL_500>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 371 '<SPECIAL_371>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 31 '<SPECIAL_31>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 27 '<SPECIAL_27>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 948 '<SPECIAL_948>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 72 '<SPECIAL_72>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 53 '<SPECIAL_53>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 70 '<SPECIAL_70>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 737 '<SPECIAL_737>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 864 '<SPECIAL_864>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 623 '<SPECIAL_623>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 421 '<SPECIAL_421>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 431 '<SPECIAL_431>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 589 '<SPECIAL_589>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 926 '<SPECIAL_926>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 743 '<SPECIAL_743>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 484 '<SPECIAL_484>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 721 '<SPECIAL_721>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 940 '<SPECIAL_940>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 971 '<SPECIAL_971>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 136 '<SPECIAL_136>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 445 '<SPECIAL_445>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 142 '<SPECIAL_142>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 934 '<SPECIAL_934>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 316 '<SPECIAL_316>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 690 '<SPECIAL_690>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 887 '<SPECIAL_887>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 531 '<SPECIAL_531>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 482 '<SPECIAL_482>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 560 '<SPECIAL_560>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 333 '<SPECIAL_333>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 574 '<SPECIAL_574>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 734 '<SPECIAL_734>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 491 '<SPECIAL_491>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 199 '<SPECIAL_199>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 449 '<SPECIAL_449>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 704 '<SPECIAL_704>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 618 '<SPECIAL_618>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 516 '<SPECIAL_516>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 661 '<SPECIAL_661>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 459 '<SPECIAL_459>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 134 '<SPECIAL_134>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 708 '<SPECIAL_708>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 426 '<SPECIAL_426>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 727 '<SPECIAL_727>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 506 '<SPECIAL_506>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 265 '<SPECIAL_265>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 861 '<SPECIAL_861>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 988 '<SPECIAL_988>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 189 '<SPECIAL_189>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 367 '<SPECIAL_367>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 118 '<SPECIAL_118>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 526 '<SPECIAL_526>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 527 '<SPECIAL_527>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 448 '<SPECIAL_448>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 86 '<SPECIAL_86>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 554 '<SPECIAL_554>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 895 '<SPECIAL_895>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 608 '<SPECIAL_608>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 681 '<SPECIAL_681>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 11 '<pad>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 403 '<SPECIAL_403>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 503 '<SPECIAL_503>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 20 '<SPECIAL_20>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 797 '<SPECIAL_797>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 476 '<SPECIAL_476>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 359 '<SPECIAL_359>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 909 '<SPECIAL_909>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 323 '<SPECIAL_323>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 435 '<SPECIAL_435>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 43 '<SPECIAL_43>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 970 '<SPECIAL_970>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 175 '<SPECIAL_175>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 300 '<SPECIAL_300>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 505 '<SPECIAL_505>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 158 '<SPECIAL_158>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 890 '<SPECIAL_890>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 855 '<SPECIAL_855>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 182 '<SPECIAL_182>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 312 '<SPECIAL_312>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 688 '<SPECIAL_688>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 795 '<SPECIAL_795>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 883 '<SPECIAL_883>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 817 '<SPECIAL_817>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 886 '<SPECIAL_886>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 50 '<SPECIAL_50>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 314 '<SPECIAL_314>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 519 '<SPECIAL_519>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 989 '<SPECIAL_989>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 653 '<SPECIAL_653>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 779 '<SPECIAL_779>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 377 '<SPECIAL_377>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 473 '<SPECIAL_473>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 61 '<SPECIAL_61>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 165 '<SPECIAL_165>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 745 '<SPECIAL_745>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 963 '<SPECIAL_963>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 775 '<SPECIAL_775>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 450 '<SPECIAL_450>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 396 '<SPECIAL_396>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 587 '<SPECIAL_587>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 418 '<SPECIAL_418>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 414 '<SPECIAL_414>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 859 '<SPECIAL_859>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 218 '<SPECIAL_218>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 252 '<SPECIAL_252>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 55 '<SPECIAL_55>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 802 '<SPECIAL_802>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 249 '<SPECIAL_249>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 130 '<SPECIAL_130>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 34 '<SPECIAL_34>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 834 '<SPECIAL_834>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 660 '<SPECIAL_660>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 638 '<SPECIAL_638>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 380 '<SPECIAL_380>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 411 '<SPECIAL_411>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 62 '<SPECIAL_62>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 719 '<SPECIAL_719>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 340 '<SPECIAL_340>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 939 '<SPECIAL_939>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 891 '<SPECIAL_891>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 184 '<SPECIAL_184>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 714 '<SPECIAL_714>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 794 '<SPECIAL_794>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 736 '<SPECIAL_736>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 509 '<SPECIAL_509>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 983 '<SPECIAL_983>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 862 '<SPECIAL_862>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 829 '<SPECIAL_829>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 925 '<SPECIAL_925>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 698 '<SPECIAL_698>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 451 '<SPECIAL_451>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 570 '<SPECIAL_570>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 214 '<SPECIAL_214>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 144 '<SPECIAL_144>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 561 '<SPECIAL_561>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 582 '<SPECIAL_582>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 523 '<SPECIAL_523>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 65 '<SPECIAL_65>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 311 '<SPECIAL_311>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 693 '<SPECIAL_693>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 857 '<SPECIAL_857>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 513 '<SPECIAL_513>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 271 '<SPECIAL_271>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 919 '<SPECIAL_919>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 720 '<SPECIAL_720>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 542 '<SPECIAL_542>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 594 '<SPECIAL_594>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 338 '<SPECIAL_338>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 32 '<SPECIAL_32>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 955 '<SPECIAL_955>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 969 '<SPECIAL_969>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 460 '<SPECIAL_460>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 518 '<SPECIAL_518>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 588 '<SPECIAL_588>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 701 '<SPECIAL_701>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 319 '<SPECIAL_319>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 320 '<SPECIAL_320>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 233 '<SPECIAL_233>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 277 '<SPECIAL_277>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 585 '<SPECIAL_585>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 213 '<SPECIAL_213>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 599 '<SPECIAL_599>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 291 '<SPECIAL_291>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 583 '<SPECIAL_583>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 160 '<SPECIAL_160>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 109 '<SPECIAL_109>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 164 '<SPECIAL_164>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 436 '<SPECIAL_436>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 461 '<SPECIAL_461>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 982 '<SPECIAL_982>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 621 '<SPECIAL_621>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 303 '<SPECIAL_303>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 207 '<SPECIAL_207>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 654 '<SPECIAL_654>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 868 '<SPECIAL_868>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 437 '<SPECIAL_437>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 641 '<SPECIAL_641>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 200 '<SPECIAL_200>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 741 '<SPECIAL_741>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 18 '[/SYSTEM_PROMPT]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 738 '<SPECIAL_738>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 786 '<SPECIAL_786>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 82 '<SPECIAL_82>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 234 '<SPECIAL_234>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 563 '<SPECIAL_563>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 358 '<SPECIAL_358>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 497 '<SPECIAL_497>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 296 '<SPECIAL_296>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 652 '<SPECIAL_652>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 756 '<SPECIAL_756>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 170 '<SPECIAL_170>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 495 '<SPECIAL_495>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 176 '<SPECIAL_176>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 89 '<SPECIAL_89>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 724 '<SPECIAL_724>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 251 '<SPECIAL_251>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 238 '<SPECIAL_238>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 913 '<SPECIAL_913>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 766 '<SPECIAL_766>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 826 '<SPECIAL_826>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 547 '<SPECIAL_547>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 374 '<SPECIAL_374>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 514 '<SPECIAL_514>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 950 '<SPECIAL_950>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 598 '<SPECIAL_598>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 850 '<SPECIAL_850>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 908 '<SPECIAL_908>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 517 '<SPECIAL_517>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 679 '<SPECIAL_679>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 578 '<SPECIAL_578>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 75 '<SPECIAL_75>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 462 '<SPECIAL_462>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 456 '<SPECIAL_456>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 979 '<SPECIAL_979>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 446 '<SPECIAL_446>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 917 '<SPECIAL_917>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 549 '<SPECIAL_549>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 183 '<SPECIAL_183>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 424 '<SPECIAL_424>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 419 '<SPECIAL_419>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 413 '<SPECIAL_413>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 478 '<SPECIAL_478>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 398 '<SPECIAL_398>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 386 '<SPECIAL_386>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 440 '<SPECIAL_440>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 202 '<SPECIAL_202>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 747 '<SPECIAL_747>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 825 '<SPECIAL_825>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 997 '<SPECIAL_997>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 369 '<SPECIAL_369>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 696 '<SPECIAL_696>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 512 '<SPECIAL_512>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 349 '<SPECIAL_349>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 985 '<SPECIAL_985>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 337 '<SPECIAL_337>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 135 '<SPECIAL_135>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 283 '<SPECIAL_283>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 776 '<SPECIAL_776>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 327 '<SPECIAL_327>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 610 '<SPECIAL_610>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 752 '<SPECIAL_752>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 510 '<SPECIAL_510>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 92 '<SPECIAL_92>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 69 '<SPECIAL_69>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 703 '<SPECIAL_703>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 284 '<SPECIAL_284>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 325 '<SPECIAL_325>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 228 '<SPECIAL_228>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 355 '<SPECIAL_355>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 389 '<SPECIAL_389>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 458 '<SPECIAL_458>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 264 '<SPECIAL_264>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 335 '<SPECIAL_335>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 181 '<SPECIAL_181>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 263 '<SPECIAL_263>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 671 '<SPECIAL_671>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 63 '<SPECIAL_63>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 261 '<SPECIAL_261>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 122 '<SPECIAL_122>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 90 '<SPECIAL_90>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 944 '<SPECIAL_944>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 760 '<SPECIAL_760>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 956 '<SPECIAL_956>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 692 '<SPECIAL_692>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 400 '<SPECIAL_400>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 83 '<SPECIAL_83>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 537 '<SPECIAL_537>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 959 '<SPECIAL_959>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 910 '<SPECIAL_910>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 119 '<SPECIAL_119>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 66 '<SPECIAL_66>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 10 '[IMG]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 285 '<SPECIAL_285>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 524 '<SPECIAL_524>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 565 '<SPECIAL_565>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 744 '<SPECIAL_744>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 255 '<SPECIAL_255>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 866 '<SPECIAL_866>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 538 '<SPECIAL_538>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 280 '<SPECIAL_280>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 815 '<SPECIAL_815>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 204 '<SPECIAL_204>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 276 '<SPECIAL_276>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 757 '<SPECIAL_757>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 475 '<SPECIAL_475>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 480 '<SPECIAL_480>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 166 '<SPECIAL_166>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 45 '<SPECIAL_45>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 262 '<SPECIAL_262>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 301 '<SPECIAL_301>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 2 '</s>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 580 '<SPECIAL_580>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 432 '<SPECIAL_432>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 454 '<SPECIAL_454>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 107 '<SPECIAL_107>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 46 '<SPECIAL_46>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 140 '<SPECIAL_140>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 14 '[PREFIX]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 246 '<SPECIAL_246>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 52 '<SPECIAL_52>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 295 '<SPECIAL_295>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 994 '<SPECIAL_994>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 370 '<SPECIAL_370>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 831 '<SPECIAL_831>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 488 '<SPECIAL_488>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 557 '<SPECIAL_557>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 124 '<SPECIAL_124>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 644 '<SPECIAL_644>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 357 '<SPECIAL_357>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 492 '<SPECIAL_492>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 209 '<SPECIAL_209>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 71 '<SPECIAL_71>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 19 '[TOOL_CONTENT]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 562 '<SPECIAL_562>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 47 '<SPECIAL_47>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 471 '<SPECIAL_471>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 486 '<SPECIAL_486>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 244 '<SPECIAL_244>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 79 '<SPECIAL_79>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 171 '<SPECIAL_171>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 564 '<SPECIAL_564>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 439 '<SPECIAL_439>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 120 '<SPECIAL_120>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 399 '<SPECIAL_399>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 13 '[IMG_END]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 49 '<SPECIAL_49>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 938 '<SPECIAL_938>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 499 '<SPECIAL_499>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 382 '<SPECIAL_382>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 824 '<SPECIAL_824>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 393 '<SPECIAL_393>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 584 '<SPECIAL_584>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 275 '<SPECIAL_275>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 915 '<SPECIAL_915>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 699 '<SPECIAL_699>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 838 '<SPECIAL_838>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 352 '<SPECIAL_352>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 871 '<SPECIAL_871>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 470 '<SPECIAL_470>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 807 '<SPECIAL_807>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 68 '<SPECIAL_68>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 678 '<SPECIAL_678>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 511 '<SPECIAL_511>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 892 '<SPECIAL_892>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 749 '<SPECIAL_749>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 206 '<SPECIAL_206>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 710 '<SPECIAL_710>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 732 '<SPECIAL_732>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 155 '<SPECIAL_155>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 247 '<SPECIAL_247>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 208 '<SPECIAL_208>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 365 '<SPECIAL_365>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 321 '<SPECIAL_321>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 217 '<SPECIAL_217>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 777 '<SPECIAL_777>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 640 '<SPECIAL_640>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 515 '<SPECIAL_515>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 194 '<SPECIAL_194>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 378 '<SPECIAL_378>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 104 '<SPECIAL_104>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 770 '<SPECIAL_770>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 479 '<SPECIAL_479>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 145 '<SPECIAL_145>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 151 '<SPECIAL_151>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 854 '<SPECIAL_854>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 929 '<SPECIAL_929>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 156 '<SPECIAL_156>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 302 '<SPECIAL_302>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 88 '<SPECIAL_88>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 305 '<SPECIAL_305>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 590 '<SPECIAL_590>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 763 '<SPECIAL_763>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 178 '<SPECIAL_178>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 609 '<SPECIAL_609>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 353 '<SPECIAL_353>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 379 '<SPECIAL_379>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 931 '<SPECIAL_931>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 222 '<SPECIAL_222>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 870 '<SPECIAL_870>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 501 '<SPECIAL_501>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 682 '<SPECIAL_682>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 126 '<SPECIAL_126>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 341 '<SPECIAL_341>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 597 '<SPECIAL_597>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 705 '<SPECIAL_705>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 774 '<SPECIAL_774>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 121 '<SPECIAL_121>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 230 '<SPECIAL_230>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 17 '[SYSTEM_PROMPT]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 848 '<SPECIAL_848>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 240 '<SPECIAL_240>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 336 '<SPECIAL_336>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 274 '<SPECIAL_274>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 937 '<SPECIAL_937>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 350 '<SPECIAL_350>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 535 '<SPECIAL_535>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 504 '<SPECIAL_504>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 662 '<SPECIAL_662>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 141 '<SPECIAL_141>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 193 '<SPECIAL_193>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 77 '<SPECIAL_77>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 999 '<SPECIAL_999>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 157 '<SPECIAL_157>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 568 '<SPECIAL_568>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 39 '<SPECIAL_39>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 579 '<SPECIAL_579>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 581 '<SPECIAL_581>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 324 '<SPECIAL_324>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 586 '<SPECIAL_586>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 595 '<SPECIAL_595>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 602 '<SPECIAL_602>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 972 '<SPECIAL_972>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 632 '<SPECIAL_632>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 634 '<SPECIAL_634>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 615 '<SPECIAL_615>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 117 '<SPECIAL_117>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 221 '<SPECIAL_221>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 811 '<SPECIAL_811>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 197 '<SPECIAL_197>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 457 '<SPECIAL_457>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 617 '<SPECIAL_617>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 712 '<SPECIAL_712>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 839 '<SPECIAL_839>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 643 '<SPECIAL_643>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 902 '<SPECIAL_902>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 553 '<SPECIAL_553>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 656 '<SPECIAL_656>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 672 '<SPECIAL_672>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 773 '<SPECIAL_773>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 675 '<SPECIAL_675>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 361 '<SPECIAL_361>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 683 '<SPECIAL_683>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 673 '<SPECIAL_673>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 800 '<SPECIAL_800>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 691 '<SPECIAL_691>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 694 '<SPECIAL_694>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 604 '<SPECIAL_604>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 717 '<SPECIAL_717>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 442 '<SPECIAL_442>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 93 '<SPECIAL_93>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 129 '<SPECIAL_129>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 315 '<SPECIAL_315>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 406 '<SPECIAL_406>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 987 '<SPECIAL_987>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 828 '<SPECIAL_828>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 368 '<SPECIAL_368>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 904 '<SPECIAL_904>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 930 '<SPECIAL_930>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 317 '<SPECIAL_317>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 792 '<SPECIAL_792>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 91 '<SPECIAL_91>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 814 '<SPECIAL_814>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 796 '<SPECIAL_796>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 799 '<SPECIAL_799>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 664 '<SPECIAL_664>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 951 '<SPECIAL_951>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 888 '<SPECIAL_888>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 806 '<SPECIAL_806>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 809 '<SPECIAL_809>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 810 '<SPECIAL_810>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 819 '<SPECIAL_819>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 628 '<SPECIAL_628>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 58 '<SPECIAL_58>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 392 '<SPECIAL_392>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 899 '<SPECIAL_899>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 896 '<SPECIAL_896>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 612 '<SPECIAL_612>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 154 '<SPECIAL_154>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 630 '<SPECIAL_630>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 856 '<SPECIAL_856>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 666 '<SPECIAL_666>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 860 '<SPECIAL_860>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 863 '<SPECIAL_863>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 788 '<SPECIAL_788>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 865 '<SPECIAL_865>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 872 '<SPECIAL_872>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 974 '<SPECIAL_974>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 873 '<SPECIAL_873>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 543 '<SPECIAL_543>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 9 '[TOOL_CALLS]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 665 '<SPECIAL_665>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 354 '<SPECIAL_354>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 243 '<SPECIAL_243>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 637 '<SPECIAL_637>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 735 '<SPECIAL_735>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 901 '<SPECIAL_901>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 363 '<SPECIAL_363>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 821 '<SPECIAL_821>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 41 '<SPECIAL_41>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 920 '<SPECIAL_920>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 928 '<SPECIAL_928>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 220 '<SPECIAL_220>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 942 '<SPECIAL_942>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 947 '<SPECIAL_947>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 556 '<SPECIAL_556>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 962 '<SPECIAL_962>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 889 '<SPECIAL_889>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 235 '<SPECIAL_235>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 927 '<SPECIAL_927>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 967 '<SPECIAL_967>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 968 '<SPECIAL_968>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 78 '<SPECIAL_78>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 980 '<SPECIAL_980>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 223 '<SPECIAL_223>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 360 '<SPECIAL_360>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 822 '<SPECIAL_822>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 342 '<SPECIAL_342>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 294 '<SPECIAL_294>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 715 '<SPECIAL_715>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 187 '<SPECIAL_187>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 248 '<SPECIAL_248>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 481 '<SPECIAL_481>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 548 '<SPECIAL_548>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 110 '<SPECIAL_110>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 687 '<SPECIAL_687>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 593 '<SPECIAL_593>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 259 '<SPECIAL_259>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 686 '<SPECIAL_686>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 188 '<SPECIAL_188>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 229 '<SPECIAL_229>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 24 '<SPECIAL_24>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 131 '<SPECIAL_131>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 253 '<SPECIAL_253>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 318 '<SPECIAL_318>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 633 '<SPECIAL_633>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 716 '<SPECIAL_716>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 685 '<SPECIAL_685>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 224 '<SPECIAL_224>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 180 '<SPECIAL_180>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 572 '<SPECIAL_572>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 463 '<SPECIAL_463>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 689 '<SPECIAL_689>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 0 '<unk>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 758 '<SPECIAL_758>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 674 '<SPECIAL_674>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 329 '<SPECIAL_329>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 525 '<SPECIAL_525>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 25 '<SPECIAL_25>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 573 '<SPECIAL_573>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 833 '<SPECIAL_833>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 847 '<SPECIAL_847>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 334 '<SPECIAL_334>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 289 '<SPECIAL_289>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 923 '<SPECIAL_923>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 64 '<SPECIAL_64>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 784 '<SPECIAL_784>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 791 '<SPECIAL_791>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 404 '<SPECIAL_404>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 952 '<SPECIAL_952>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 8 '[/TOOL_RESULTS]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 880 '<SPECIAL_880>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 981 '<SPECIAL_981>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 551 '<SPECIAL_551>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 343 '<SPECIAL_343>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 726 '<SPECIAL_726>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 620 '<SPECIAL_620>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 832 '<SPECIAL_832>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 405 '<SPECIAL_405>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 534 '<SPECIAL_534>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 467 '<SPECIAL_467>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 391 '<SPECIAL_391>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 540 '<SPECIAL_540>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 911 '<SPECIAL_911>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 626 '<SPECIAL_626>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 782 '<SPECIAL_782>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 232 '<SPECIAL_232>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 362 '<SPECIAL_362>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 835 '<SPECIAL_835>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 867 '<SPECIAL_867>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 100 '<SPECIAL_100>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 417 '<SPECIAL_417>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 267 '<SPECIAL_267>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 918 '<SPECIAL_918>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 98 '<SPECIAL_98>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 22 '<SPECIAL_22>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 306 '<SPECIAL_306>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 366 '<SPECIAL_366>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 290 '<SPECIAL_290>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 844 '<SPECIAL_844>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 769 '<SPECIAL_769>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 885 '<SPECIAL_885>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 711 '<SPECIAL_711>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 709 '<SPECIAL_709>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 663 '<SPECIAL_663>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 15 '[MIDDLE]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 60 '<SPECIAL_60>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 869 '<SPECIAL_869>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 298 '<SPECIAL_298>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 635 '<SPECIAL_635>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 729 '<SPECIAL_729>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 245 '<SPECIAL_245>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 933 '<SPECIAL_933>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 627 '<SPECIAL_627>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 215 '<SPECIAL_215>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 820 '<SPECIAL_820>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 881 '<SPECIAL_881>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 308 '<SPECIAL_308>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 94 '<SPECIAL_94>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 219 '<SPECIAL_219>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 51 '<SPECIAL_51>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 177 '<SPECIAL_177>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 348 '<SPECIAL_348>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 239 '<SPECIAL_239>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 772 '<SPECIAL_772>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 173 '<SPECIAL_173>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 373 '<SPECIAL_373>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 174 '<SPECIAL_174>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 852 '<SPECIAL_852>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 150 '<SPECIAL_150>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 559 '<SPECIAL_559>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 169 '<SPECIAL_169>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 539 '<SPECIAL_539>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 383 '<SPECIAL_383>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 614 '<SPECIAL_614>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 943 '<SPECIAL_943>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 395 '<SPECIAL_395>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 953 '<SPECIAL_953>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 843 '<SPECIAL_843>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 986 '<SPECIAL_986>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 36 '<SPECIAL_36>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 762 '<SPECIAL_762>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 530 '<SPECIAL_530>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 464 '<SPECIAL_464>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 879 '<SPECIAL_879>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 401 '<SPECIAL_401>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 73 '<SPECIAL_73>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 992 '<SPECIAL_992>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 447 '<SPECIAL_447>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 402 '<SPECIAL_402>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 849 '<SPECIAL_849>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 307 '<SPECIAL_307>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 179 '<SPECIAL_179>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 781 '<SPECIAL_781>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 991 '<SPECIAL_991>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 356 '<SPECIAL_356>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 273 '<SPECIAL_273>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 85 '<SPECIAL_85>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 407 '<SPECIAL_407>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 493 '<SPECIAL_493>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 487 '<SPECIAL_487>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 332 '<SPECIAL_332>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 364 '<SPECIAL_364>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 976 '<SPECIAL_976>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 427 '<SPECIAL_427>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 751 '<SPECIAL_751>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 415 '<SPECIAL_415>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 966 '<SPECIAL_966>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 203 '<SPECIAL_203>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 949 '<SPECIAL_949>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 59 '<SPECIAL_59>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 81 '<SPECIAL_81>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 805 '<SPECIAL_805>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 430 '<SPECIAL_430>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 477 '<SPECIAL_477>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 922 '<SPECIAL_922>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 148 '<SPECIAL_148>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 452 '<SPECIAL_452>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 748 '<SPECIAL_748>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 272 '<SPECIAL_272>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 201 '<SPECIAL_201>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 924 '<SPECIAL_924>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 412 '<SPECIAL_412>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 921 '<SPECIAL_921>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 16 '[SUFFIX]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 529 '<SPECIAL_529>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 761 '<SPECIAL_761>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 941 '<SPECIAL_941>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 281 '<SPECIAL_281>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 344 '<SPECIAL_344>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 577 '<SPECIAL_577>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 936 '<SPECIAL_936>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 642 '<SPECIAL_642>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 433 '<SPECIAL_433>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 227 '<SPECIAL_227>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 269 '<SPECIAL_269>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 242 '<SPECIAL_242>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 841 '<SPECIAL_841>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 381 '<SPECIAL_381>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 468 '<SPECIAL_468>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 649 '<SPECIAL_649>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 884 '<SPECIAL_884>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 964 '<SPECIAL_964>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 739 '<SPECIAL_739>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 945 '<SPECIAL_945>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 428 '<SPECIAL_428>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 755 '<SPECIAL_755>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 878 '<SPECIAL_878>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 651 '<SPECIAL_651>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 346 '<SPECIAL_346>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 48 '<SPECIAL_48>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 804 '<SPECIAL_804>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 309 '<SPECIAL_309>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 127 '<SPECIAL_127>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 957 '<SPECIAL_957>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 387 '<SPECIAL_387>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 785 '<SPECIAL_785>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 30 '<SPECIAL_30>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 185 '<SPECIAL_185>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 611 '<SPECIAL_611>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 434 '<SPECIAL_434>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 546 '<SPECIAL_546>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 897 '<SPECIAL_897>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 946 '<SPECIAL_946>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 746 '<SPECIAL_746>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 552 '<SPECIAL_552>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 750 '<SPECIAL_750>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 677 '<SPECIAL_677>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 605 '<SPECIAL_605>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 159 '<SPECIAL_159>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 631 '<SPECIAL_631>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 906 '<SPECIAL_906>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 96 '<SPECIAL_96>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 35 '<SPECIAL_35>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 161 '<SPECIAL_161>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 42 '<SPECIAL_42>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 958 '<SPECIAL_958>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 80 '<SPECIAL_80>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 429 '<SPECIAL_429>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 684 '<SPECIAL_684>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 707 '<SPECIAL_707>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 993 '<SPECIAL_993>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 645 '<SPECIAL_645>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 330 '<SPECIAL_330>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 420 '<SPECIAL_420>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 613 '<SPECIAL_613>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 105 '<SPECIAL_105>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 842 '<SPECIAL_842>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 816 '<SPECIAL_816>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 397 '<SPECIAL_397>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 616 '<SPECIAL_616>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 236 '<SPECIAL_236>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 823 '<SPECIAL_823>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 954 '<SPECIAL_954>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 650 '<SPECIAL_650>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 960 '<SPECIAL_960>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 695 '<SPECIAL_695>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 375 '<SPECIAL_375>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 1 '<s>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 146 '<SPECIAL_146>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 914 '<SPECIAL_914>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 38 '<SPECIAL_38>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 990 '<SPECIAL_990>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 753 '<SPECIAL_753>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 907 '<SPECIAL_907>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 211 '<SPECIAL_211>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 29 '<SPECIAL_29>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 622 '<SPECIAL_622>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 87 '<SPECIAL_87>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 172 '<SPECIAL_172>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 191 '<SPECIAL_191>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 778 '<SPECIAL_778>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 713 '<SPECIAL_713>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 647 '<SPECIAL_647>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 347 '<SPECIAL_347>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 237 '<SPECIAL_237>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 190 '<SPECIAL_190>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 536 '<SPECIAL_536>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 4 '[/INST]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 893 '<SPECIAL_893>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 569 '<SPECIAL_569>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 54 '<SPECIAL_54>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 790 '<SPECIAL_790>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 667 '<SPECIAL_667>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 123 '<SPECIAL_123>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 975 '<SPECIAL_975>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 808 '<SPECIAL_808>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 600 '<SPECIAL_600>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 912 '<SPECIAL_912>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 520 '<SPECIAL_520>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 740 '<SPECIAL_740>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 132 '<SPECIAL_132>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 659 '<SPECIAL_659>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 508 '<SPECIAL_508>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 658 '<SPECIAL_658>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 780 '<SPECIAL_780>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 260 '<SPECIAL_260>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 567 '<SPECIAL_567>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 195 '<SPECIAL_195>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 282 '<SPECIAL_282>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 278 '<SPECIAL_278>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 453 '<SPECIAL_453>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 532 '<SPECIAL_532>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 28 '<SPECIAL_28>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 697 '<SPECIAL_697>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 502 '<SPECIAL_502>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 226 '<SPECIAL_226>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 858 '<SPECIAL_858>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 836 '<SPECIAL_836>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 636 '<SPECIAL_636>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 116 '<SPECIAL_116>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 676 '<SPECIAL_676>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 466 '<SPECIAL_466>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 521 '<SPECIAL_521>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 483 '<SPECIAL_483>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 718 '<SPECIAL_718>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 764 '<SPECIAL_764>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 978 '<SPECIAL_978>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 624 '<SPECIAL_624>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 388 '<SPECIAL_388>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 266 '<SPECIAL_266>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 670 '<SPECIAL_670>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 875 '<SPECIAL_875>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 12 '[IMG_BREAK]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 550 '<SPECIAL_550>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 384 '<SPECIAL_384>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 759 '<SPECIAL_759>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 254 '<SPECIAL_254>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 443 '<SPECIAL_443>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 655 '<SPECIAL_655>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 996 '<SPECIAL_996>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 558 '<SPECIAL_558>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 339 '<SPECIAL_339>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 830 '<SPECIAL_830>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 528 '<SPECIAL_528>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 768 '<SPECIAL_768>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 591 '<SPECIAL_591>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 876 '<SPECIAL_876>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 730 '<SPECIAL_730>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 571 '<SPECIAL_571>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 629 '<SPECIAL_629>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 270 '<SPECIAL_270>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 742 '<SPECIAL_742>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 783 '<SPECIAL_783>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 258 '<SPECIAL_258>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 67 '<SPECIAL_67>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 575 '<SPECIAL_575>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 212 '<SPECIAL_212>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 3 '[INST]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 813 '<SPECIAL_813>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 143 '<SPECIAL_143>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 149 '<SPECIAL_149>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 192 '<SPECIAL_192>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 669 '<SPECIAL_669>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 648 '<SPECIAL_648>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 932 '<SPECIAL_932>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 765 '<SPECIAL_765>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 113 '<SPECIAL_113>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 33 '<SPECIAL_33>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 533 '<SPECIAL_533>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 103 '<SPECIAL_103>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 544 '<SPECIAL_544>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 112 '<SPECIAL_112>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 56 '<SPECIAL_56>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 114 '<SPECIAL_114>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 163 '<SPECIAL_163>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 108 '<SPECIAL_108>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 310 '<SPECIAL_310>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 606 '<SPECIAL_606>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 410 '<SPECIAL_410>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 297 '<SPECIAL_297>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 256 '<SPECIAL_256>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 851 '<SPECIAL_851>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 812 '<SPECIAL_812>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 754 '<SPECIAL_754>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 225 '<SPECIAL_225>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 416 '<SPECIAL_416>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 23 '<SPECIAL_23>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 733 '<SPECIAL_733>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 268 '<SPECIAL_268>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 576 '<SPECIAL_576>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 596 '<SPECIAL_596>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 326 '<SPECIAL_326>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 128 '<SPECIAL_128>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 507 '<SPECIAL_507>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 293 '<SPECIAL_293>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 728 '<SPECIAL_728>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 292 '<SPECIAL_292>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 472 '<SPECIAL_472>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 84 '<SPECIAL_84>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 99 '<SPECIAL_99>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 390 '<SPECIAL_390>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 26 '<SPECIAL_26>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 74 '<SPECIAL_74>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 995 '<SPECIAL_995>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 162 '<SPECIAL_162>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 877 '<SPECIAL_877>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 603 '<SPECIAL_603>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 198 '<SPECIAL_198>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 657 '<SPECIAL_657>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 167 '<SPECIAL_167>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 998 '<SPECIAL_998>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 789 '<SPECIAL_789>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 97 '<SPECIAL_97>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 152 '<SPECIAL_152>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 725 '<SPECIAL_725>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 545 '<SPECIAL_545>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 351 '<SPECIAL_351>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 345 '<SPECIAL_345>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 111 '<SPECIAL_111>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 286 '<SPECIAL_286>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 331 '<SPECIAL_331>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 376 '<SPECIAL_376>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 731 '<SPECIAL_731>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 935 '<SPECIAL_935>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 196 '<SPECIAL_196>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 965 '<SPECIAL_965>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 469 '<SPECIAL_469>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 882 '<SPECIAL_882>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 106 '<SPECIAL_106>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 322 '<SPECIAL_322>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 639 '<SPECIAL_639>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 287 '<SPECIAL_287>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 853 '<SPECIAL_853>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 153 '<SPECIAL_153>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 5 '[AVAILABLE_TOOLS]' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 44 '<SPECIAL_44>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 313 '<SPECIAL_313>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 680 '<SPECIAL_680>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 793 '<SPECIAL_793>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 702 '<SPECIAL_702>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 102 '<SPECIAL_102>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 299 '<SPECIAL_299>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: control token: 76 '<SPECIAL_76>' is not marked as EOG Jun 30 09:22:09 Darkstar ollama[2861272]: load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect Jun 30 09:22:09 Darkstar ollama[2861272]: load: special tokens cache size = 1000 Jun 30 09:22:09 Darkstar ollama[2861272]: load: token to piece cache size = 0.8498 MB Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: arch = llama Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: vocab_only = 1 Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: model type = ?B Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: model params = 23.57 B Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: general.name = Devstral Small 2505 Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: vocab type = BPE Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: n_vocab = 131072 Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: n_merges = 269443 Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: BOS token = 1 '<s>' Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: EOS token = 2 '</s>' Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: UNK token = 0 '<unk>' Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: LF token = 1010 '' Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: EOG token = 2 '</s>' Jun 30 09:22:09 Darkstar ollama[2861272]: print_info: max token length = 150 Jun 30 09:22:09 Darkstar ollama[2861272]: llama_model_load: vocab only - skipping tensors Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.861-04:00 level=INFO source=server.go:438 msg="starting llama server" cmd="/usr/local/bin/ollama runner --model /usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 --ctx-size 65368 --batch-size 512 --n-gpu-layers 41 --threads 32 --flash-attn --kv-cache-type q8_0 --parallel 2 --port 44989" Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.861-04:00 level=DEBUG source=server.go:439 msg=subprocess PATH=/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games OLLAMA_HOST=0.0.0.0:11434 OLLAMA_FLASH_ATTENTION=1 OLLAMA_KV_CACHE_TYPE=q8_0 OLLAMA_DEBUG=1 OLLAMA_MAX_LOADED_MODELS=6 OLLAMA_LIBRARY_PATH=/usr/local/lib/ollama LD_LIBRARY_PATH=/usr/local/lib/ollama:/usr/local/lib/ollama CUDA_VISIBLE_DEVICES=GPU-2229ba74-dbe4-5c32-e086-3ca1f0ab65b4 Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.862-04:00 level=INFO source=sched.go:483 msg="loaded runners" count=1 Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.862-04:00 level=INFO source=server.go:598 msg="waiting for llama runner to start responding" Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.863-04:00 level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server not responding" Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.885-04:00 level=INFO source=runner.go:815 msg="starting go runner" Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.885-04:00 level=DEBUG source=ggml.go:94 msg="ggml backend load all from path" path=/usr/local/lib/ollama Jun 30 09:22:09 Darkstar ollama[2861272]: ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no Jun 30 09:22:09 Darkstar ollama[2861272]: ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no Jun 30 09:22:09 Darkstar ollama[2861272]: ggml_cuda_init: found 1 CUDA devices: Jun 30 09:22:09 Darkstar ollama[2861272]: Device 0: Tesla V100-PCIE-32GB, compute capability 7.0, VMM: yes Jun 30 09:22:09 Darkstar ollama[2861272]: load_backend: loaded CUDA backend from /usr/local/lib/ollama/libggml-cuda.so Jun 30 09:22:09 Darkstar ollama[2861272]: load_backend: loaded CPU backend from /usr/local/lib/ollama/libggml-cpu-skylakex.so Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.962-04:00 level=INFO source=ggml.go:104 msg=system CPU.0.SSE3=1 CPU.0.SSSE3=1 CPU.0.AVX=1 CPU.0.AVX2=1 CPU.0.F16C=1 CPU.0.FMA=1 CPU.0.BMI2=1 CPU.0.AVX512=1 CPU.0.LLAMAFILE=1 CPU.1.LLAMAFILE=1 CUDA.0.ARCHS=500,600,610,700,750,800,860,870,890,900,1200 CUDA.0.USE_GRAPHS=1 CUDA.0.PEER_MAX_BATCH_SIZE=128 compiler=cgo(gcc) Jun 30 09:22:09 Darkstar ollama[2861272]: time=2025-06-30T09:22:09.963-04:00 level=INFO source=runner.go:874 msg="Server listening on 127.0.0.1:44989" Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_load_from_file_impl: using device CUDA0 (Tesla V100-PCIE-32GB) - 32191 MiB free Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: loaded meta data with 41 key-value pairs and 363 tensors from /usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 (version GGUF V3 (latest)) Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output. Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 0: general.architecture str = llama Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 1: general.base_model.0.name str = Devstrall Small 2505 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 2: general.base_model.0.organization str = Mistralai Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 3: general.base_model.0.repo_url str = https://huggingface.co/mistralai/Devs... Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 4: general.base_model.0.version str = 2505 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 5: general.base_model.count u32 = 1 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 6: general.basename str = Devstral Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 7: general.file_type u32 = 15 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 8: general.languages arr[str,24] = ["en", "fr", "de", "es", "pt", "it", ... Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 9: general.license str = apache-2.0 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 10: general.name str = Devstral Small 2505 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 11: general.parameter_count u64 = 23572403200 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 12: general.quantization_version u32 = 2 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 13: general.size_label str = Small Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 14: general.tags arr[str,1] = ["text2text-generation"] Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 15: general.type str = model Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 16: general.version str = 2505 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 17: llama.attention.head_count u32 = 32 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 18: llama.attention.head_count_kv u32 = 8 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 19: llama.attention.key_length u32 = 128 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 20: llama.attention.layer_norm_rms_epsilon f32 = 0.000010 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 21: llama.attention.value_length u32 = 128 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 22: llama.block_count u32 = 40 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 23: llama.context_length u32 = 131072 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 24: llama.embedding_length u32 = 5120 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 25: llama.feed_forward_length u32 = 32768 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 26: llama.rope.dimension_count u32 = 128 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 27: llama.rope.freq_base f32 = 1000000000.000000 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 28: llama.vocab_size u32 = 131072 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 29: tokenizer.chat_template str = {%- set today = strftime_now("%Y-%m-%... Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 30: tokenizer.ggml.add_bos_token bool = true Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 31: tokenizer.ggml.add_eos_token bool = false Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 32: tokenizer.ggml.add_space_prefix bool = false Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 33: tokenizer.ggml.bos_token_id u32 = 1 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 34: tokenizer.ggml.eos_token_id u32 = 2 Jun 30 09:22:10 Darkstar ollama[2861272]: time=2025-06-30T09:22:10.116-04:00 level=INFO source=server.go:632 msg="waiting for server to become available" status="llm server loading model" Jun 30 09:22:10 Darkstar ollama[2861272]: [132B blob data] Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 36: tokenizer.ggml.model str = gpt2 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 37: tokenizer.ggml.pre str = tekken Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 38: tokenizer.ggml.token_type arr[i32,131072] = [3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, 3, ... Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 39: tokenizer.ggml.tokens arr[str,131072] = ["<unk>", "<s>", "</s>", "[INST]", "[... Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - kv 40: tokenizer.ggml.unknown_token_id u32 = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - type f32: 81 tensors Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - type q4_K: 241 tensors Jun 30 09:22:10 Darkstar ollama[2861272]: llama_model_loader: - type q6_K: 41 tensors Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: file format = GGUF V3 (latest) Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: file type = Q4_K - Medium Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: file size = 13.34 GiB (4.86 BPW) Jun 30 09:22:10 Darkstar ollama[2861272]: init_tokenizer: initializing tokenizer for type 2 ```
GiteaMirror commented 2026-05-09 22:26:38 -05:00
Author
Owner
Copy Link

@jeepshop commented on GitHub (Jun 30, 2025):

Couldn't fit the whole log into one comment, here is the 2nd half:

Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    216 '<SPECIAL_216>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    408 '<SPECIAL_408>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    845 '<SPECIAL_845>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    555 '<SPECIAL_555>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    257 '<SPECIAL_257>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    474 '<SPECIAL_474>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    241 '<SPECIAL_241>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    646 '<SPECIAL_646>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    601 '<SPECIAL_601>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    905 '<SPECIAL_905>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    168 '<SPECIAL_168>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     37 '<SPECIAL_37>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    125 '<SPECIAL_125>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     95 '<SPECIAL_95>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    304 '<SPECIAL_304>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    706 '<SPECIAL_706>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    423 '<SPECIAL_423>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:      6 '[/AVAILABLE_TOOLS]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    592 '<SPECIAL_592>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    409 '<SPECIAL_409>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    231 '<SPECIAL_231>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    607 '<SPECIAL_607>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:      7 '[TOOL_RESULTS]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    138 '<SPECIAL_138>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    455 '<SPECIAL_455>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    801 '<SPECIAL_801>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    288 '<SPECIAL_288>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    619 '<SPECIAL_619>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    133 '<SPECIAL_133>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    827 '<SPECIAL_827>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    771 '<SPECIAL_771>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    723 '<SPECIAL_723>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    494 '<SPECIAL_494>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    444 '<SPECIAL_444>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    422 '<SPECIAL_422>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    441 '<SPECIAL_441>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    372 '<SPECIAL_372>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    874 '<SPECIAL_874>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    137 '<SPECIAL_137>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    250 '<SPECIAL_250>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    840 '<SPECIAL_840>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    846 '<SPECIAL_846>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    465 '<SPECIAL_465>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    425 '<SPECIAL_425>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    984 '<SPECIAL_984>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    328 '<SPECIAL_328>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    186 '<SPECIAL_186>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    973 '<SPECIAL_973>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    394 '<SPECIAL_394>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    522 '<SPECIAL_522>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    385 '<SPECIAL_385>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    496 '<SPECIAL_496>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    498 '<SPECIAL_498>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    489 '<SPECIAL_489>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    767 '<SPECIAL_767>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    916 '<SPECIAL_916>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    818 '<SPECIAL_818>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    894 '<SPECIAL_894>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    668 '<SPECIAL_668>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    566 '<SPECIAL_566>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    898 '<SPECIAL_898>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    490 '<SPECIAL_490>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    977 '<SPECIAL_977>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    900 '<SPECIAL_900>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    541 '<SPECIAL_541>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     21 '<SPECIAL_21>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    787 '<SPECIAL_787>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    722 '<SPECIAL_722>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    803 '<SPECIAL_803>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    210 '<SPECIAL_210>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    205 '<SPECIAL_205>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    485 '<SPECIAL_485>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     40 '<SPECIAL_40>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     57 '<SPECIAL_57>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    115 '<SPECIAL_115>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    798 '<SPECIAL_798>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    700 '<SPECIAL_700>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    961 '<SPECIAL_961>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    101 '<SPECIAL_101>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    279 '<SPECIAL_279>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    139 '<SPECIAL_139>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    903 '<SPECIAL_903>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    625 '<SPECIAL_625>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    147 '<SPECIAL_147>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    837 '<SPECIAL_837>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    438 '<SPECIAL_438>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    500 '<SPECIAL_500>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    371 '<SPECIAL_371>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     31 '<SPECIAL_31>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     27 '<SPECIAL_27>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    948 '<SPECIAL_948>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     72 '<SPECIAL_72>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     53 '<SPECIAL_53>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     70 '<SPECIAL_70>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    737 '<SPECIAL_737>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    864 '<SPECIAL_864>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    623 '<SPECIAL_623>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    421 '<SPECIAL_421>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    431 '<SPECIAL_431>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    589 '<SPECIAL_589>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    926 '<SPECIAL_926>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    743 '<SPECIAL_743>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    484 '<SPECIAL_484>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    721 '<SPECIAL_721>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    940 '<SPECIAL_940>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    971 '<SPECIAL_971>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    136 '<SPECIAL_136>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    445 '<SPECIAL_445>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    142 '<SPECIAL_142>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    934 '<SPECIAL_934>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    316 '<SPECIAL_316>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    690 '<SPECIAL_690>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    887 '<SPECIAL_887>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    531 '<SPECIAL_531>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    482 '<SPECIAL_482>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    560 '<SPECIAL_560>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    333 '<SPECIAL_333>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    574 '<SPECIAL_574>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    734 '<SPECIAL_734>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    491 '<SPECIAL_491>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    199 '<SPECIAL_199>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    449 '<SPECIAL_449>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    704 '<SPECIAL_704>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    618 '<SPECIAL_618>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    516 '<SPECIAL_516>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    661 '<SPECIAL_661>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    459 '<SPECIAL_459>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    134 '<SPECIAL_134>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    708 '<SPECIAL_708>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    426 '<SPECIAL_426>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    727 '<SPECIAL_727>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    506 '<SPECIAL_506>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    265 '<SPECIAL_265>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    861 '<SPECIAL_861>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    988 '<SPECIAL_988>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    189 '<SPECIAL_189>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    367 '<SPECIAL_367>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    118 '<SPECIAL_118>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    526 '<SPECIAL_526>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    527 '<SPECIAL_527>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    448 '<SPECIAL_448>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     86 '<SPECIAL_86>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    554 '<SPECIAL_554>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    895 '<SPECIAL_895>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    608 '<SPECIAL_608>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    681 '<SPECIAL_681>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     11 '<pad>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    403 '<SPECIAL_403>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    503 '<SPECIAL_503>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     20 '<SPECIAL_20>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    797 '<SPECIAL_797>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    476 '<SPECIAL_476>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    359 '<SPECIAL_359>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    909 '<SPECIAL_909>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    323 '<SPECIAL_323>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    435 '<SPECIAL_435>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     43 '<SPECIAL_43>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    970 '<SPECIAL_970>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    175 '<SPECIAL_175>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    300 '<SPECIAL_300>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    505 '<SPECIAL_505>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    158 '<SPECIAL_158>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    890 '<SPECIAL_890>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    855 '<SPECIAL_855>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    182 '<SPECIAL_182>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    312 '<SPECIAL_312>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    688 '<SPECIAL_688>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    795 '<SPECIAL_795>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    883 '<SPECIAL_883>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    817 '<SPECIAL_817>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    886 '<SPECIAL_886>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     50 '<SPECIAL_50>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    314 '<SPECIAL_314>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    519 '<SPECIAL_519>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    989 '<SPECIAL_989>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    653 '<SPECIAL_653>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    779 '<SPECIAL_779>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    377 '<SPECIAL_377>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    473 '<SPECIAL_473>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     61 '<SPECIAL_61>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    165 '<SPECIAL_165>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    745 '<SPECIAL_745>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    963 '<SPECIAL_963>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    775 '<SPECIAL_775>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    450 '<SPECIAL_450>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    396 '<SPECIAL_396>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    587 '<SPECIAL_587>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    418 '<SPECIAL_418>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    414 '<SPECIAL_414>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    859 '<SPECIAL_859>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    218 '<SPECIAL_218>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    252 '<SPECIAL_252>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     55 '<SPECIAL_55>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    802 '<SPECIAL_802>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    249 '<SPECIAL_249>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    130 '<SPECIAL_130>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     34 '<SPECIAL_34>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    834 '<SPECIAL_834>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    660 '<SPECIAL_660>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    638 '<SPECIAL_638>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    380 '<SPECIAL_380>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    411 '<SPECIAL_411>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     62 '<SPECIAL_62>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    719 '<SPECIAL_719>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    340 '<SPECIAL_340>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    939 '<SPECIAL_939>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    891 '<SPECIAL_891>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    184 '<SPECIAL_184>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    714 '<SPECIAL_714>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    794 '<SPECIAL_794>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    736 '<SPECIAL_736>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    509 '<SPECIAL_509>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    983 '<SPECIAL_983>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    862 '<SPECIAL_862>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    829 '<SPECIAL_829>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    925 '<SPECIAL_925>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    698 '<SPECIAL_698>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    451 '<SPECIAL_451>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    570 '<SPECIAL_570>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    214 '<SPECIAL_214>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    144 '<SPECIAL_144>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    561 '<SPECIAL_561>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    582 '<SPECIAL_582>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    523 '<SPECIAL_523>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     65 '<SPECIAL_65>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    311 '<SPECIAL_311>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    693 '<SPECIAL_693>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    857 '<SPECIAL_857>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    513 '<SPECIAL_513>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    271 '<SPECIAL_271>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    919 '<SPECIAL_919>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    720 '<SPECIAL_720>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    542 '<SPECIAL_542>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    594 '<SPECIAL_594>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    338 '<SPECIAL_338>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     32 '<SPECIAL_32>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    955 '<SPECIAL_955>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    969 '<SPECIAL_969>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    460 '<SPECIAL_460>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    518 '<SPECIAL_518>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    588 '<SPECIAL_588>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    701 '<SPECIAL_701>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    319 '<SPECIAL_319>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    320 '<SPECIAL_320>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    233 '<SPECIAL_233>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    277 '<SPECIAL_277>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    585 '<SPECIAL_585>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    213 '<SPECIAL_213>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    599 '<SPECIAL_599>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    291 '<SPECIAL_291>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    583 '<SPECIAL_583>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    160 '<SPECIAL_160>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    109 '<SPECIAL_109>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    164 '<SPECIAL_164>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    436 '<SPECIAL_436>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    461 '<SPECIAL_461>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    982 '<SPECIAL_982>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    621 '<SPECIAL_621>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    303 '<SPECIAL_303>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    207 '<SPECIAL_207>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    654 '<SPECIAL_654>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    868 '<SPECIAL_868>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    437 '<SPECIAL_437>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    641 '<SPECIAL_641>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    200 '<SPECIAL_200>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    741 '<SPECIAL_741>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     18 '[/SYSTEM_PROMPT]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    738 '<SPECIAL_738>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    786 '<SPECIAL_786>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     82 '<SPECIAL_82>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    234 '<SPECIAL_234>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    563 '<SPECIAL_563>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    358 '<SPECIAL_358>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    497 '<SPECIAL_497>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    296 '<SPECIAL_296>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    652 '<SPECIAL_652>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    756 '<SPECIAL_756>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    170 '<SPECIAL_170>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    495 '<SPECIAL_495>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    176 '<SPECIAL_176>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     89 '<SPECIAL_89>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    724 '<SPECIAL_724>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    251 '<SPECIAL_251>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    238 '<SPECIAL_238>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    913 '<SPECIAL_913>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    766 '<SPECIAL_766>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    826 '<SPECIAL_826>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    547 '<SPECIAL_547>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    374 '<SPECIAL_374>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    514 '<SPECIAL_514>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    950 '<SPECIAL_950>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    598 '<SPECIAL_598>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    850 '<SPECIAL_850>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    908 '<SPECIAL_908>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    517 '<SPECIAL_517>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    679 '<SPECIAL_679>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    578 '<SPECIAL_578>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     75 '<SPECIAL_75>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    462 '<SPECIAL_462>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    456 '<SPECIAL_456>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    979 '<SPECIAL_979>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    446 '<SPECIAL_446>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    917 '<SPECIAL_917>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    549 '<SPECIAL_549>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    183 '<SPECIAL_183>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    424 '<SPECIAL_424>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    419 '<SPECIAL_419>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    413 '<SPECIAL_413>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    478 '<SPECIAL_478>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    398 '<SPECIAL_398>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    386 '<SPECIAL_386>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    440 '<SPECIAL_440>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    202 '<SPECIAL_202>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    747 '<SPECIAL_747>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    825 '<SPECIAL_825>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    997 '<SPECIAL_997>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    369 '<SPECIAL_369>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    696 '<SPECIAL_696>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    512 '<SPECIAL_512>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    349 '<SPECIAL_349>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    985 '<SPECIAL_985>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    337 '<SPECIAL_337>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    135 '<SPECIAL_135>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    283 '<SPECIAL_283>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    776 '<SPECIAL_776>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    327 '<SPECIAL_327>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    610 '<SPECIAL_610>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    752 '<SPECIAL_752>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    510 '<SPECIAL_510>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     92 '<SPECIAL_92>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     69 '<SPECIAL_69>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    703 '<SPECIAL_703>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    284 '<SPECIAL_284>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    325 '<SPECIAL_325>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    228 '<SPECIAL_228>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    355 '<SPECIAL_355>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    389 '<SPECIAL_389>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    458 '<SPECIAL_458>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    264 '<SPECIAL_264>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    335 '<SPECIAL_335>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    181 '<SPECIAL_181>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    263 '<SPECIAL_263>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    671 '<SPECIAL_671>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     63 '<SPECIAL_63>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    261 '<SPECIAL_261>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    122 '<SPECIAL_122>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     90 '<SPECIAL_90>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    944 '<SPECIAL_944>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    760 '<SPECIAL_760>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    956 '<SPECIAL_956>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    692 '<SPECIAL_692>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    400 '<SPECIAL_400>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     83 '<SPECIAL_83>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    537 '<SPECIAL_537>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    959 '<SPECIAL_959>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    910 '<SPECIAL_910>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    119 '<SPECIAL_119>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     66 '<SPECIAL_66>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     10 '[IMG]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    285 '<SPECIAL_285>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    524 '<SPECIAL_524>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    565 '<SPECIAL_565>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    744 '<SPECIAL_744>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    255 '<SPECIAL_255>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    866 '<SPECIAL_866>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    538 '<SPECIAL_538>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    280 '<SPECIAL_280>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    815 '<SPECIAL_815>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    204 '<SPECIAL_204>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    276 '<SPECIAL_276>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    757 '<SPECIAL_757>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    475 '<SPECIAL_475>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    480 '<SPECIAL_480>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    166 '<SPECIAL_166>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     45 '<SPECIAL_45>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    262 '<SPECIAL_262>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    301 '<SPECIAL_301>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:      2 '</s>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    580 '<SPECIAL_580>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    432 '<SPECIAL_432>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    454 '<SPECIAL_454>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    107 '<SPECIAL_107>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     46 '<SPECIAL_46>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    140 '<SPECIAL_140>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     14 '[PREFIX]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    246 '<SPECIAL_246>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     52 '<SPECIAL_52>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    295 '<SPECIAL_295>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    994 '<SPECIAL_994>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    370 '<SPECIAL_370>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    831 '<SPECIAL_831>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    488 '<SPECIAL_488>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    557 '<SPECIAL_557>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    124 '<SPECIAL_124>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    644 '<SPECIAL_644>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    357 '<SPECIAL_357>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    492 '<SPECIAL_492>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    209 '<SPECIAL_209>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     71 '<SPECIAL_71>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     19 '[TOOL_CONTENT]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    562 '<SPECIAL_562>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     47 '<SPECIAL_47>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    471 '<SPECIAL_471>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    486 '<SPECIAL_486>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    244 '<SPECIAL_244>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     79 '<SPECIAL_79>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    171 '<SPECIAL_171>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    564 '<SPECIAL_564>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    439 '<SPECIAL_439>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    120 '<SPECIAL_120>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    399 '<SPECIAL_399>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     13 '[IMG_END]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     49 '<SPECIAL_49>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    938 '<SPECIAL_938>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    499 '<SPECIAL_499>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    382 '<SPECIAL_382>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    824 '<SPECIAL_824>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    393 '<SPECIAL_393>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    584 '<SPECIAL_584>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    275 '<SPECIAL_275>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    915 '<SPECIAL_915>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    699 '<SPECIAL_699>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    838 '<SPECIAL_838>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    352 '<SPECIAL_352>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    871 '<SPECIAL_871>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    470 '<SPECIAL_470>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    807 '<SPECIAL_807>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     68 '<SPECIAL_68>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    678 '<SPECIAL_678>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    511 '<SPECIAL_511>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    892 '<SPECIAL_892>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    749 '<SPECIAL_749>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    206 '<SPECIAL_206>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    710 '<SPECIAL_710>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    732 '<SPECIAL_732>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    155 '<SPECIAL_155>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    247 '<SPECIAL_247>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    208 '<SPECIAL_208>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    365 '<SPECIAL_365>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    321 '<SPECIAL_321>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    217 '<SPECIAL_217>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    777 '<SPECIAL_777>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    640 '<SPECIAL_640>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    515 '<SPECIAL_515>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    194 '<SPECIAL_194>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    378 '<SPECIAL_378>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    104 '<SPECIAL_104>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    770 '<SPECIAL_770>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    479 '<SPECIAL_479>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    145 '<SPECIAL_145>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    151 '<SPECIAL_151>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    854 '<SPECIAL_854>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    929 '<SPECIAL_929>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    156 '<SPECIAL_156>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    302 '<SPECIAL_302>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     88 '<SPECIAL_88>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    305 '<SPECIAL_305>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    590 '<SPECIAL_590>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    763 '<SPECIAL_763>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    178 '<SPECIAL_178>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    609 '<SPECIAL_609>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    353 '<SPECIAL_353>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    379 '<SPECIAL_379>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    931 '<SPECIAL_931>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    222 '<SPECIAL_222>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    870 '<SPECIAL_870>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    501 '<SPECIAL_501>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    682 '<SPECIAL_682>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    126 '<SPECIAL_126>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    341 '<SPECIAL_341>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    597 '<SPECIAL_597>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    705 '<SPECIAL_705>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    774 '<SPECIAL_774>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    121 '<SPECIAL_121>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    230 '<SPECIAL_230>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     17 '[SYSTEM_PROMPT]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    848 '<SPECIAL_848>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    240 '<SPECIAL_240>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    336 '<SPECIAL_336>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    274 '<SPECIAL_274>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    937 '<SPECIAL_937>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    350 '<SPECIAL_350>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    535 '<SPECIAL_535>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    504 '<SPECIAL_504>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    662 '<SPECIAL_662>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    141 '<SPECIAL_141>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    193 '<SPECIAL_193>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     77 '<SPECIAL_77>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    999 '<SPECIAL_999>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    157 '<SPECIAL_157>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    568 '<SPECIAL_568>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     39 '<SPECIAL_39>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    579 '<SPECIAL_579>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    581 '<SPECIAL_581>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    324 '<SPECIAL_324>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    586 '<SPECIAL_586>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    595 '<SPECIAL_595>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    602 '<SPECIAL_602>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    972 '<SPECIAL_972>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    632 '<SPECIAL_632>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    634 '<SPECIAL_634>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    615 '<SPECIAL_615>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    117 '<SPECIAL_117>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    221 '<SPECIAL_221>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    811 '<SPECIAL_811>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    197 '<SPECIAL_197>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    457 '<SPECIAL_457>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    617 '<SPECIAL_617>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    712 '<SPECIAL_712>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    839 '<SPECIAL_839>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    643 '<SPECIAL_643>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    902 '<SPECIAL_902>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    553 '<SPECIAL_553>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    656 '<SPECIAL_656>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    672 '<SPECIAL_672>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    773 '<SPECIAL_773>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    675 '<SPECIAL_675>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    361 '<SPECIAL_361>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    683 '<SPECIAL_683>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    673 '<SPECIAL_673>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    800 '<SPECIAL_800>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    691 '<SPECIAL_691>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    694 '<SPECIAL_694>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    604 '<SPECIAL_604>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    717 '<SPECIAL_717>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    442 '<SPECIAL_442>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     93 '<SPECIAL_93>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    129 '<SPECIAL_129>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    315 '<SPECIAL_315>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    406 '<SPECIAL_406>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    987 '<SPECIAL_987>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    828 '<SPECIAL_828>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    368 '<SPECIAL_368>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    904 '<SPECIAL_904>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    930 '<SPECIAL_930>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    317 '<SPECIAL_317>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    792 '<SPECIAL_792>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     91 '<SPECIAL_91>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    814 '<SPECIAL_814>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    796 '<SPECIAL_796>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    799 '<SPECIAL_799>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    664 '<SPECIAL_664>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    951 '<SPECIAL_951>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    888 '<SPECIAL_888>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    806 '<SPECIAL_806>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    809 '<SPECIAL_809>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    810 '<SPECIAL_810>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    819 '<SPECIAL_819>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    628 '<SPECIAL_628>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     58 '<SPECIAL_58>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    392 '<SPECIAL_392>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    899 '<SPECIAL_899>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    896 '<SPECIAL_896>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    612 '<SPECIAL_612>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    154 '<SPECIAL_154>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    630 '<SPECIAL_630>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    856 '<SPECIAL_856>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    666 '<SPECIAL_666>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    860 '<SPECIAL_860>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    863 '<SPECIAL_863>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    788 '<SPECIAL_788>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    865 '<SPECIAL_865>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    872 '<SPECIAL_872>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    974 '<SPECIAL_974>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    873 '<SPECIAL_873>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    543 '<SPECIAL_543>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:      9 '[TOOL_CALLS]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    665 '<SPECIAL_665>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    354 '<SPECIAL_354>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    243 '<SPECIAL_243>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    637 '<SPECIAL_637>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    735 '<SPECIAL_735>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    901 '<SPECIAL_901>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    363 '<SPECIAL_363>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    821 '<SPECIAL_821>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     41 '<SPECIAL_41>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    920 '<SPECIAL_920>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    928 '<SPECIAL_928>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    220 '<SPECIAL_220>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    942 '<SPECIAL_942>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    947 '<SPECIAL_947>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    556 '<SPECIAL_556>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    962 '<SPECIAL_962>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    889 '<SPECIAL_889>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    235 '<SPECIAL_235>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    927 '<SPECIAL_927>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    967 '<SPECIAL_967>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    968 '<SPECIAL_968>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     78 '<SPECIAL_78>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    980 '<SPECIAL_980>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    223 '<SPECIAL_223>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    360 '<SPECIAL_360>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    822 '<SPECIAL_822>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    342 '<SPECIAL_342>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    294 '<SPECIAL_294>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    715 '<SPECIAL_715>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    187 '<SPECIAL_187>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    248 '<SPECIAL_248>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    481 '<SPECIAL_481>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    548 '<SPECIAL_548>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    110 '<SPECIAL_110>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    687 '<SPECIAL_687>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    593 '<SPECIAL_593>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    259 '<SPECIAL_259>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    686 '<SPECIAL_686>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    188 '<SPECIAL_188>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    229 '<SPECIAL_229>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     24 '<SPECIAL_24>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    131 '<SPECIAL_131>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    253 '<SPECIAL_253>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    318 '<SPECIAL_318>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    633 '<SPECIAL_633>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    716 '<SPECIAL_716>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    685 '<SPECIAL_685>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    224 '<SPECIAL_224>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    180 '<SPECIAL_180>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    572 '<SPECIAL_572>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    463 '<SPECIAL_463>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    689 '<SPECIAL_689>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:      0 '<unk>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    758 '<SPECIAL_758>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    674 '<SPECIAL_674>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    329 '<SPECIAL_329>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    525 '<SPECIAL_525>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     25 '<SPECIAL_25>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    573 '<SPECIAL_573>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    833 '<SPECIAL_833>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    847 '<SPECIAL_847>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    334 '<SPECIAL_334>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    289 '<SPECIAL_289>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    923 '<SPECIAL_923>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     64 '<SPECIAL_64>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    784 '<SPECIAL_784>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    791 '<SPECIAL_791>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    404 '<SPECIAL_404>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    952 '<SPECIAL_952>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:      8 '[/TOOL_RESULTS]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    880 '<SPECIAL_880>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    981 '<SPECIAL_981>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    551 '<SPECIAL_551>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    343 '<SPECIAL_343>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    726 '<SPECIAL_726>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    620 '<SPECIAL_620>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    832 '<SPECIAL_832>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    405 '<SPECIAL_405>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    534 '<SPECIAL_534>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    467 '<SPECIAL_467>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    391 '<SPECIAL_391>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    540 '<SPECIAL_540>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    911 '<SPECIAL_911>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    626 '<SPECIAL_626>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    782 '<SPECIAL_782>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    232 '<SPECIAL_232>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    362 '<SPECIAL_362>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    835 '<SPECIAL_835>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    867 '<SPECIAL_867>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    100 '<SPECIAL_100>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    417 '<SPECIAL_417>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    267 '<SPECIAL_267>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    918 '<SPECIAL_918>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     98 '<SPECIAL_98>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     22 '<SPECIAL_22>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    306 '<SPECIAL_306>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    366 '<SPECIAL_366>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    290 '<SPECIAL_290>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    844 '<SPECIAL_844>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    769 '<SPECIAL_769>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    885 '<SPECIAL_885>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    711 '<SPECIAL_711>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    709 '<SPECIAL_709>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    663 '<SPECIAL_663>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     15 '[MIDDLE]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     60 '<SPECIAL_60>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    869 '<SPECIAL_869>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    298 '<SPECIAL_298>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    635 '<SPECIAL_635>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    729 '<SPECIAL_729>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    245 '<SPECIAL_245>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    933 '<SPECIAL_933>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    627 '<SPECIAL_627>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    215 '<SPECIAL_215>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    820 '<SPECIAL_820>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    881 '<SPECIAL_881>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    308 '<SPECIAL_308>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     94 '<SPECIAL_94>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    219 '<SPECIAL_219>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     51 '<SPECIAL_51>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    177 '<SPECIAL_177>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    348 '<SPECIAL_348>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    239 '<SPECIAL_239>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    772 '<SPECIAL_772>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    173 '<SPECIAL_173>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    373 '<SPECIAL_373>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    174 '<SPECIAL_174>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    852 '<SPECIAL_852>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    150 '<SPECIAL_150>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    559 '<SPECIAL_559>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    169 '<SPECIAL_169>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    539 '<SPECIAL_539>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    383 '<SPECIAL_383>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    614 '<SPECIAL_614>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    943 '<SPECIAL_943>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    395 '<SPECIAL_395>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    953 '<SPECIAL_953>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    843 '<SPECIAL_843>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    986 '<SPECIAL_986>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     36 '<SPECIAL_36>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    762 '<SPECIAL_762>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    530 '<SPECIAL_530>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    464 '<SPECIAL_464>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    879 '<SPECIAL_879>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    401 '<SPECIAL_401>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     73 '<SPECIAL_73>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    992 '<SPECIAL_992>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    447 '<SPECIAL_447>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    402 '<SPECIAL_402>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    849 '<SPECIAL_849>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    307 '<SPECIAL_307>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    179 '<SPECIAL_179>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    781 '<SPECIAL_781>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    991 '<SPECIAL_991>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    356 '<SPECIAL_356>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    273 '<SPECIAL_273>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     85 '<SPECIAL_85>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    407 '<SPECIAL_407>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    493 '<SPECIAL_493>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    487 '<SPECIAL_487>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    332 '<SPECIAL_332>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    364 '<SPECIAL_364>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    976 '<SPECIAL_976>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    427 '<SPECIAL_427>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    751 '<SPECIAL_751>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    415 '<SPECIAL_415>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    966 '<SPECIAL_966>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    203 '<SPECIAL_203>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    949 '<SPECIAL_949>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     59 '<SPECIAL_59>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     81 '<SPECIAL_81>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    805 '<SPECIAL_805>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    430 '<SPECIAL_430>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    477 '<SPECIAL_477>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    922 '<SPECIAL_922>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    148 '<SPECIAL_148>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    452 '<SPECIAL_452>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    748 '<SPECIAL_748>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    272 '<SPECIAL_272>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    201 '<SPECIAL_201>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    924 '<SPECIAL_924>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    412 '<SPECIAL_412>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    921 '<SPECIAL_921>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     16 '[SUFFIX]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    529 '<SPECIAL_529>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    761 '<SPECIAL_761>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    941 '<SPECIAL_941>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    281 '<SPECIAL_281>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    344 '<SPECIAL_344>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    577 '<SPECIAL_577>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    936 '<SPECIAL_936>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    642 '<SPECIAL_642>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    433 '<SPECIAL_433>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    227 '<SPECIAL_227>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    269 '<SPECIAL_269>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    242 '<SPECIAL_242>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    841 '<SPECIAL_841>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    381 '<SPECIAL_381>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    468 '<SPECIAL_468>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    649 '<SPECIAL_649>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    884 '<SPECIAL_884>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    964 '<SPECIAL_964>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    739 '<SPECIAL_739>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    945 '<SPECIAL_945>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    428 '<SPECIAL_428>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    755 '<SPECIAL_755>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    878 '<SPECIAL_878>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    651 '<SPECIAL_651>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    346 '<SPECIAL_346>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     48 '<SPECIAL_48>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    804 '<SPECIAL_804>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    309 '<SPECIAL_309>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    127 '<SPECIAL_127>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    957 '<SPECIAL_957>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    387 '<SPECIAL_387>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    785 '<SPECIAL_785>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     30 '<SPECIAL_30>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    185 '<SPECIAL_185>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    611 '<SPECIAL_611>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    434 '<SPECIAL_434>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    546 '<SPECIAL_546>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    897 '<SPECIAL_897>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    946 '<SPECIAL_946>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    746 '<SPECIAL_746>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    552 '<SPECIAL_552>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    750 '<SPECIAL_750>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    677 '<SPECIAL_677>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    605 '<SPECIAL_605>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    159 '<SPECIAL_159>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    631 '<SPECIAL_631>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    906 '<SPECIAL_906>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     96 '<SPECIAL_96>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     35 '<SPECIAL_35>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    161 '<SPECIAL_161>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     42 '<SPECIAL_42>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    958 '<SPECIAL_958>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     80 '<SPECIAL_80>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    429 '<SPECIAL_429>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    684 '<SPECIAL_684>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    707 '<SPECIAL_707>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    993 '<SPECIAL_993>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    645 '<SPECIAL_645>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    330 '<SPECIAL_330>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    420 '<SPECIAL_420>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    613 '<SPECIAL_613>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    105 '<SPECIAL_105>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    842 '<SPECIAL_842>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    816 '<SPECIAL_816>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    397 '<SPECIAL_397>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    616 '<SPECIAL_616>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    236 '<SPECIAL_236>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    823 '<SPECIAL_823>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    954 '<SPECIAL_954>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    650 '<SPECIAL_650>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    960 '<SPECIAL_960>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    695 '<SPECIAL_695>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    375 '<SPECIAL_375>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:      1 '<s>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    146 '<SPECIAL_146>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    914 '<SPECIAL_914>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     38 '<SPECIAL_38>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    990 '<SPECIAL_990>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    753 '<SPECIAL_753>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    907 '<SPECIAL_907>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    211 '<SPECIAL_211>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     29 '<SPECIAL_29>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    622 '<SPECIAL_622>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     87 '<SPECIAL_87>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    172 '<SPECIAL_172>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    191 '<SPECIAL_191>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    778 '<SPECIAL_778>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    713 '<SPECIAL_713>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    647 '<SPECIAL_647>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    347 '<SPECIAL_347>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    237 '<SPECIAL_237>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    190 '<SPECIAL_190>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    536 '<SPECIAL_536>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:      4 '[/INST]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    893 '<SPECIAL_893>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    569 '<SPECIAL_569>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     54 '<SPECIAL_54>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    790 '<SPECIAL_790>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    667 '<SPECIAL_667>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    123 '<SPECIAL_123>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    975 '<SPECIAL_975>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    808 '<SPECIAL_808>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    600 '<SPECIAL_600>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    912 '<SPECIAL_912>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    520 '<SPECIAL_520>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    740 '<SPECIAL_740>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    132 '<SPECIAL_132>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    659 '<SPECIAL_659>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    508 '<SPECIAL_508>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    658 '<SPECIAL_658>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    780 '<SPECIAL_780>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    260 '<SPECIAL_260>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    567 '<SPECIAL_567>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    195 '<SPECIAL_195>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    282 '<SPECIAL_282>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    278 '<SPECIAL_278>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    453 '<SPECIAL_453>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    532 '<SPECIAL_532>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     28 '<SPECIAL_28>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    697 '<SPECIAL_697>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    502 '<SPECIAL_502>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    226 '<SPECIAL_226>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    858 '<SPECIAL_858>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    836 '<SPECIAL_836>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    636 '<SPECIAL_636>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    116 '<SPECIAL_116>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    676 '<SPECIAL_676>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    466 '<SPECIAL_466>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    521 '<SPECIAL_521>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    483 '<SPECIAL_483>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    718 '<SPECIAL_718>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    764 '<SPECIAL_764>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    978 '<SPECIAL_978>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    624 '<SPECIAL_624>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    388 '<SPECIAL_388>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    266 '<SPECIAL_266>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    670 '<SPECIAL_670>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    875 '<SPECIAL_875>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     12 '[IMG_BREAK]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    550 '<SPECIAL_550>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    384 '<SPECIAL_384>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    759 '<SPECIAL_759>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    254 '<SPECIAL_254>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    443 '<SPECIAL_443>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    655 '<SPECIAL_655>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    996 '<SPECIAL_996>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    558 '<SPECIAL_558>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    339 '<SPECIAL_339>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    830 '<SPECIAL_830>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    528 '<SPECIAL_528>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    768 '<SPECIAL_768>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    591 '<SPECIAL_591>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    876 '<SPECIAL_876>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    730 '<SPECIAL_730>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    571 '<SPECIAL_571>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    629 '<SPECIAL_629>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    270 '<SPECIAL_270>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    742 '<SPECIAL_742>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    783 '<SPECIAL_783>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    258 '<SPECIAL_258>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     67 '<SPECIAL_67>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    575 '<SPECIAL_575>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    212 '<SPECIAL_212>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:      3 '[INST]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    813 '<SPECIAL_813>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    143 '<SPECIAL_143>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    149 '<SPECIAL_149>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    192 '<SPECIAL_192>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    669 '<SPECIAL_669>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    648 '<SPECIAL_648>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    932 '<SPECIAL_932>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    765 '<SPECIAL_765>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    113 '<SPECIAL_113>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     33 '<SPECIAL_33>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    533 '<SPECIAL_533>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    103 '<SPECIAL_103>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    544 '<SPECIAL_544>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    112 '<SPECIAL_112>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     56 '<SPECIAL_56>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    114 '<SPECIAL_114>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    163 '<SPECIAL_163>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    108 '<SPECIAL_108>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    310 '<SPECIAL_310>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    606 '<SPECIAL_606>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    410 '<SPECIAL_410>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    297 '<SPECIAL_297>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    256 '<SPECIAL_256>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    851 '<SPECIAL_851>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    812 '<SPECIAL_812>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    754 '<SPECIAL_754>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    225 '<SPECIAL_225>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    416 '<SPECIAL_416>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     23 '<SPECIAL_23>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    733 '<SPECIAL_733>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    268 '<SPECIAL_268>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    576 '<SPECIAL_576>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    596 '<SPECIAL_596>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    326 '<SPECIAL_326>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    128 '<SPECIAL_128>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    507 '<SPECIAL_507>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    293 '<SPECIAL_293>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    728 '<SPECIAL_728>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    292 '<SPECIAL_292>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    472 '<SPECIAL_472>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     84 '<SPECIAL_84>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     99 '<SPECIAL_99>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    390 '<SPECIAL_390>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     26 '<SPECIAL_26>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     74 '<SPECIAL_74>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    995 '<SPECIAL_995>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    162 '<SPECIAL_162>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    877 '<SPECIAL_877>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    603 '<SPECIAL_603>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    198 '<SPECIAL_198>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    657 '<SPECIAL_657>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    167 '<SPECIAL_167>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    998 '<SPECIAL_998>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    789 '<SPECIAL_789>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     97 '<SPECIAL_97>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    152 '<SPECIAL_152>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    725 '<SPECIAL_725>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    545 '<SPECIAL_545>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    351 '<SPECIAL_351>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    345 '<SPECIAL_345>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    111 '<SPECIAL_111>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    286 '<SPECIAL_286>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    331 '<SPECIAL_331>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    376 '<SPECIAL_376>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    731 '<SPECIAL_731>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    935 '<SPECIAL_935>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    196 '<SPECIAL_196>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    965 '<SPECIAL_965>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    469 '<SPECIAL_469>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    882 '<SPECIAL_882>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    106 '<SPECIAL_106>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    322 '<SPECIAL_322>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    639 '<SPECIAL_639>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    287 '<SPECIAL_287>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    853 '<SPECIAL_853>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    153 '<SPECIAL_153>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:      5 '[AVAILABLE_TOOLS]' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     44 '<SPECIAL_44>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    313 '<SPECIAL_313>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    680 '<SPECIAL_680>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    793 '<SPECIAL_793>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    702 '<SPECIAL_702>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    102 '<SPECIAL_102>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:    299 '<SPECIAL_299>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token:     76 '<SPECIAL_76>' is not marked as EOG
Jun 30 09:22:10 Darkstar ollama[2861272]: load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect
Jun 30 09:22:10 Darkstar ollama[2861272]: load: special tokens cache size = 1000
Jun 30 09:22:10 Darkstar ollama[2861272]: load: token to piece cache size = 0.8498 MB
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: arch             = llama
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: vocab_only       = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_ctx_train      = 131072
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_embd           = 5120
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_layer          = 40
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_head           = 32
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_head_kv        = 8
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_rot            = 128
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_swa            = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_swa_pattern    = 1
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_embd_head_k    = 128
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_embd_head_v    = 128
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_gqa            = 4
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_embd_k_gqa     = 1024
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_embd_v_gqa     = 1024
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: f_norm_eps       = 0.0e+00
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: f_norm_rms_eps   = 1.0e-05
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: f_clamp_kqv      = 0.0e+00
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: f_max_alibi_bias = 0.0e+00
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: f_logit_scale    = 0.0e+00
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: f_attn_scale     = 0.0e+00
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_ff             = 32768
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_expert         = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_expert_used    = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: causal attn      = 1
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: pooling type     = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: rope type        = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: rope scaling     = linear
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: freq_base_train  = 1000000000.0
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: freq_scale_train = 1
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_ctx_orig_yarn  = 131072
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: rope_finetuned   = unknown
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: ssm_d_conv       = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: ssm_d_inner      = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: ssm_d_state      = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: ssm_dt_rank      = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: ssm_dt_b_c_rms   = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: model type       = 13B
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: model params     = 23.57 B
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: general.name     = Devstral Small 2505
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: vocab type       = BPE
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_vocab          = 131072
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_merges         = 269443
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: BOS token        = 1 '<s>'
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: EOS token        = 2 '</s>'
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: UNK token        = 0 '<unk>'
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: LF token         = 1010 ''
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: EOG token        = 2 '</s>'
Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: max token length = 150
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: loading model tensors, this can take a while... (mmap = true)
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer   0 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer   1 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer   2 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer   3 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer   4 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer   5 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer   6 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer   7 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer   8 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer   9 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  10 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  11 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  12 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  13 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  14 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  15 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  16 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  17 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  18 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  19 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  20 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  21 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  22 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  23 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  24 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  25 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  26 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  27 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  28 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  29 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  30 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  31 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  32 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  33 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  34 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  35 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  36 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  37 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  38 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  39 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer  40 assigned to device CUDA0, is_swa = 0
Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: tensor 'token_embd.weight' (q4_K) (and 0 others) cannot be used with preferred buffer type CUDA_Host, using CPU instead
Jun 30 09:22:11 Darkstar ollama[2861272]: load_tensors: offloading 40 repeating layers to GPU
Jun 30 09:22:11 Darkstar ollama[2861272]: load_tensors: offloading output layer to GPU
Jun 30 09:22:11 Darkstar ollama[2861272]: load_tensors: offloaded 41/41 layers to GPU
Jun 30 09:22:11 Darkstar ollama[2861272]: load_tensors:        CUDA0 model buffer size = 13302.36 MiB
Jun 30 09:22:11 Darkstar ollama[2861272]: load_tensors:   CPU_Mapped model buffer size =   360.00 MiB
Jun 30 09:22:11 Darkstar ollama[2861272]: time=2025-06-30T09:22:11.373-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.00"
Jun 30 09:22:11 Darkstar ollama[2861272]: time=2025-06-30T09:22:11.625-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.12"
Jun 30 09:22:11 Darkstar ollama[2861272]: time=2025-06-30T09:22:11.876-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.19"
Jun 30 09:22:12 Darkstar ollama[2861272]: time=2025-06-30T09:22:12.127-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.27"
Jun 30 09:22:12 Darkstar ollama[2861272]: time=2025-06-30T09:22:12.379-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.35"
Jun 30 09:22:12 Darkstar ollama[2861272]: time=2025-06-30T09:22:12.630-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.43"
Jun 30 09:22:12 Darkstar ollama[2861272]: time=2025-06-30T09:22:12.882-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.51"
Jun 30 09:22:13 Darkstar ollama[2861272]: time=2025-06-30T09:22:13.133-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.58"
Jun 30 09:22:13 Darkstar ollama[2861272]: time=2025-06-30T09:22:13.384-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.66"
Jun 30 09:22:13 Darkstar ollama[2861272]: time=2025-06-30T09:22:13.636-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.73"
Jun 30 09:22:13 Darkstar ollama[2861272]: time=2025-06-30T09:22:13.887-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.80"
Jun 30 09:22:14 Darkstar ollama[2861272]: time=2025-06-30T09:22:14.139-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.88"
Jun 30 09:22:14 Darkstar ollama[2861272]: time=2025-06-30T09:22:14.390-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.96"
Jun 30 09:22:14 Darkstar ollama[2861272]: time=2025-06-30T09:22:14.642-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.97"
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: constructing llama_context
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: n_seq_max     = 2
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: n_ctx         = 65368
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: n_ctx_per_seq = 32684
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: n_batch       = 1024
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: n_ubatch      = 512
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: causal_attn   = 1
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: flash_attn    = 1
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: freq_base     = 1000000000.0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: freq_scale    = 1
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: n_ctx_per_seq (32684) < n_ctx_train (131072) -- the full capacity of the model will not be utilized
Jun 30 09:22:14 Darkstar ollama[2861272]: set_abort_callback: call
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context:  CUDA_Host  output buffer size =     1.04 MiB
Jun 30 09:22:14 Darkstar ollama[2861272]: create_memory: n_ctx = 65536 (padded)
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: kv_size = 65536, type_k = 'q8_0', type_v = 'q8_0', n_layer = 40, can_shift = 1, padding = 256
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer   0: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer   1: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer   2: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer   3: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer   4: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer   5: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer   6: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer   7: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer   8: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer   9: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  10: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  11: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  12: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  13: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  14: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  15: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  16: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  17: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  18: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  19: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  20: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  21: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  22: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  23: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  24: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  25: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  26: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  27: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  28: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  29: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  30: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  31: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  32: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  33: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  34: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  35: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  36: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  37: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  38: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer  39: dev = CUDA0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified:      CUDA0 KV buffer size =  5440.00 MiB
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: KV self size  = 5440.00 MiB, K (q8_0): 2720.00 MiB, V (q8_0): 2720.00 MiB
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: enumerating backends
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: backend_ptrs.size() = 2
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: max_nodes = 65536
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: worst-case: n_tokens = 512, n_seqs = 1, n_outputs = 0
Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: reserving graph for n_tokens = 512, n_seqs = 1
Jun 30 09:22:15 Darkstar ollama[2861272]: llama_context: reserving graph for n_tokens = 1, n_seqs = 1
Jun 30 09:22:15 Darkstar ollama[2861272]: llama_context: reserving graph for n_tokens = 512, n_seqs = 1
Jun 30 09:22:15 Darkstar ollama[2861272]: llama_context:      CUDA0 compute buffer size =   266.00 MiB
Jun 30 09:22:15 Darkstar ollama[2861272]: llama_context:  CUDA_Host compute buffer size =   138.01 MiB
Jun 30 09:22:15 Darkstar ollama[2861272]: llama_context: graph nodes  = 1207
Jun 30 09:22:15 Darkstar ollama[2861272]: llama_context: graph splits = 2
Jun 30 09:22:15 Darkstar ollama[2861272]: time=2025-06-30T09:22:15.144-04:00 level=INFO source=server.go:637 msg="llama runner started in 5.28 seconds"
Jun 30 09:22:15 Darkstar ollama[2861272]: time=2025-06-30T09:22:15.144-04:00 level=DEBUG source=sched.go:495 msg="finished setting up" runner.name=registry.ollama.ai/library/ftidevstral:24b-small-2505-q4_K_M runner.inference=cuda runner.devices=1 runner.size="23.0 GiB" runner.vram="23.0 GiB" runner.parallel=2 runner.pid=2861349 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 runner.num_ctx=65368
Jun 30 09:22:15 Darkstar ollama[2861272]: time=2025-06-30T09:22:15.155-04:00 level=DEBUG source=server.go:736 msg="completion request" images=0 prompt=382 format=""
Jun 30 09:22:15 Darkstar ollama[2861272]: time=2025-06-30T09:22:15.166-04:00 level=DEBUG source=cache.go:104 msg="loading cache slot" id=0 cache=0 prompt=67 used=0 remaining=67
Jun 30 09:22:15 Darkstar ollama[2861272]: [GIN] 2025/06/30 - 09:22:15 | 200 |  7.412351916s |       127.0.0.1 | POST     "/api/chat"
Jun 30 09:22:15 Darkstar ollama[2861272]: time=2025-06-30T09:22:15.842-04:00 level=DEBUG source=sched.go:503 msg="context for request finished"
Jun 30 09:22:15 Darkstar ollama[2861272]: time=2025-06-30T09:22:15.842-04:00 level=DEBUG source=sched.go:343 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/ftidevstral:24b-small-2505-q4_K_M runner.inference=cuda runner.devices=1 runner.size="23.0 GiB" runner.vram="23.0 GiB" runner.parallel=2 runner.pid=2861349 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 runner.num_ctx=65368 duration=5m0s
Jun 30 09:22:15 Darkstar ollama[2861272]: time=2025-06-30T09:22:15.842-04:00 level=DEBUG source=sched.go:361 msg="after processing request finished event" runner.name=registry.ollama.ai/library/ftidevstral:24b-small-2505-q4_K_M runner.inference=cuda runner.devices=1 runner.size="23.0 GiB" runner.vram="23.0 GiB" runner.parallel=2 runner.pid=2861349 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 runner.num_ctx=65368 refCount=0
<!-- gh-comment-id:3019203626 --> @jeepshop commented on GitHub (Jun 30, 2025): Couldn't fit the whole log into one comment, here is the 2nd half: ```log Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 216 '<SPECIAL_216>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 408 '<SPECIAL_408>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 845 '<SPECIAL_845>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 555 '<SPECIAL_555>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 257 '<SPECIAL_257>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 474 '<SPECIAL_474>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 241 '<SPECIAL_241>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 646 '<SPECIAL_646>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 601 '<SPECIAL_601>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 905 '<SPECIAL_905>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 168 '<SPECIAL_168>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 37 '<SPECIAL_37>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 125 '<SPECIAL_125>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 95 '<SPECIAL_95>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 304 '<SPECIAL_304>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 706 '<SPECIAL_706>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 423 '<SPECIAL_423>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 6 '[/AVAILABLE_TOOLS]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 592 '<SPECIAL_592>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 409 '<SPECIAL_409>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 231 '<SPECIAL_231>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 607 '<SPECIAL_607>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 7 '[TOOL_RESULTS]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 138 '<SPECIAL_138>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 455 '<SPECIAL_455>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 801 '<SPECIAL_801>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 288 '<SPECIAL_288>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 619 '<SPECIAL_619>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 133 '<SPECIAL_133>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 827 '<SPECIAL_827>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 771 '<SPECIAL_771>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 723 '<SPECIAL_723>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 494 '<SPECIAL_494>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 444 '<SPECIAL_444>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 422 '<SPECIAL_422>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 441 '<SPECIAL_441>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 372 '<SPECIAL_372>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 874 '<SPECIAL_874>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 137 '<SPECIAL_137>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 250 '<SPECIAL_250>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 840 '<SPECIAL_840>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 846 '<SPECIAL_846>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 465 '<SPECIAL_465>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 425 '<SPECIAL_425>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 984 '<SPECIAL_984>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 328 '<SPECIAL_328>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 186 '<SPECIAL_186>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 973 '<SPECIAL_973>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 394 '<SPECIAL_394>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 522 '<SPECIAL_522>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 385 '<SPECIAL_385>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 496 '<SPECIAL_496>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 498 '<SPECIAL_498>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 489 '<SPECIAL_489>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 767 '<SPECIAL_767>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 916 '<SPECIAL_916>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 818 '<SPECIAL_818>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 894 '<SPECIAL_894>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 668 '<SPECIAL_668>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 566 '<SPECIAL_566>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 898 '<SPECIAL_898>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 490 '<SPECIAL_490>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 977 '<SPECIAL_977>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 900 '<SPECIAL_900>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 541 '<SPECIAL_541>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 21 '<SPECIAL_21>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 787 '<SPECIAL_787>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 722 '<SPECIAL_722>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 803 '<SPECIAL_803>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 210 '<SPECIAL_210>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 205 '<SPECIAL_205>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 485 '<SPECIAL_485>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 40 '<SPECIAL_40>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 57 '<SPECIAL_57>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 115 '<SPECIAL_115>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 798 '<SPECIAL_798>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 700 '<SPECIAL_700>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 961 '<SPECIAL_961>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 101 '<SPECIAL_101>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 279 '<SPECIAL_279>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 139 '<SPECIAL_139>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 903 '<SPECIAL_903>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 625 '<SPECIAL_625>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 147 '<SPECIAL_147>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 837 '<SPECIAL_837>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 438 '<SPECIAL_438>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 500 '<SPECIAL_500>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 371 '<SPECIAL_371>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 31 '<SPECIAL_31>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 27 '<SPECIAL_27>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 948 '<SPECIAL_948>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 72 '<SPECIAL_72>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 53 '<SPECIAL_53>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 70 '<SPECIAL_70>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 737 '<SPECIAL_737>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 864 '<SPECIAL_864>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 623 '<SPECIAL_623>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 421 '<SPECIAL_421>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 431 '<SPECIAL_431>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 589 '<SPECIAL_589>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 926 '<SPECIAL_926>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 743 '<SPECIAL_743>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 484 '<SPECIAL_484>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 721 '<SPECIAL_721>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 940 '<SPECIAL_940>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 971 '<SPECIAL_971>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 136 '<SPECIAL_136>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 445 '<SPECIAL_445>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 142 '<SPECIAL_142>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 934 '<SPECIAL_934>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 316 '<SPECIAL_316>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 690 '<SPECIAL_690>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 887 '<SPECIAL_887>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 531 '<SPECIAL_531>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 482 '<SPECIAL_482>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 560 '<SPECIAL_560>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 333 '<SPECIAL_333>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 574 '<SPECIAL_574>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 734 '<SPECIAL_734>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 491 '<SPECIAL_491>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 199 '<SPECIAL_199>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 449 '<SPECIAL_449>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 704 '<SPECIAL_704>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 618 '<SPECIAL_618>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 516 '<SPECIAL_516>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 661 '<SPECIAL_661>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 459 '<SPECIAL_459>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 134 '<SPECIAL_134>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 708 '<SPECIAL_708>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 426 '<SPECIAL_426>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 727 '<SPECIAL_727>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 506 '<SPECIAL_506>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 265 '<SPECIAL_265>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 861 '<SPECIAL_861>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 988 '<SPECIAL_988>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 189 '<SPECIAL_189>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 367 '<SPECIAL_367>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 118 '<SPECIAL_118>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 526 '<SPECIAL_526>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 527 '<SPECIAL_527>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 448 '<SPECIAL_448>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 86 '<SPECIAL_86>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 554 '<SPECIAL_554>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 895 '<SPECIAL_895>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 608 '<SPECIAL_608>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 681 '<SPECIAL_681>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 11 '<pad>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 403 '<SPECIAL_403>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 503 '<SPECIAL_503>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 20 '<SPECIAL_20>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 797 '<SPECIAL_797>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 476 '<SPECIAL_476>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 359 '<SPECIAL_359>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 909 '<SPECIAL_909>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 323 '<SPECIAL_323>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 435 '<SPECIAL_435>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 43 '<SPECIAL_43>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 970 '<SPECIAL_970>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 175 '<SPECIAL_175>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 300 '<SPECIAL_300>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 505 '<SPECIAL_505>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 158 '<SPECIAL_158>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 890 '<SPECIAL_890>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 855 '<SPECIAL_855>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 182 '<SPECIAL_182>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 312 '<SPECIAL_312>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 688 '<SPECIAL_688>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 795 '<SPECIAL_795>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 883 '<SPECIAL_883>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 817 '<SPECIAL_817>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 886 '<SPECIAL_886>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 50 '<SPECIAL_50>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 314 '<SPECIAL_314>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 519 '<SPECIAL_519>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 989 '<SPECIAL_989>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 653 '<SPECIAL_653>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 779 '<SPECIAL_779>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 377 '<SPECIAL_377>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 473 '<SPECIAL_473>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 61 '<SPECIAL_61>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 165 '<SPECIAL_165>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 745 '<SPECIAL_745>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 963 '<SPECIAL_963>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 775 '<SPECIAL_775>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 450 '<SPECIAL_450>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 396 '<SPECIAL_396>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 587 '<SPECIAL_587>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 418 '<SPECIAL_418>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 414 '<SPECIAL_414>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 859 '<SPECIAL_859>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 218 '<SPECIAL_218>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 252 '<SPECIAL_252>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 55 '<SPECIAL_55>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 802 '<SPECIAL_802>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 249 '<SPECIAL_249>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 130 '<SPECIAL_130>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 34 '<SPECIAL_34>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 834 '<SPECIAL_834>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 660 '<SPECIAL_660>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 638 '<SPECIAL_638>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 380 '<SPECIAL_380>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 411 '<SPECIAL_411>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 62 '<SPECIAL_62>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 719 '<SPECIAL_719>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 340 '<SPECIAL_340>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 939 '<SPECIAL_939>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 891 '<SPECIAL_891>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 184 '<SPECIAL_184>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 714 '<SPECIAL_714>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 794 '<SPECIAL_794>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 736 '<SPECIAL_736>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 509 '<SPECIAL_509>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 983 '<SPECIAL_983>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 862 '<SPECIAL_862>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 829 '<SPECIAL_829>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 925 '<SPECIAL_925>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 698 '<SPECIAL_698>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 451 '<SPECIAL_451>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 570 '<SPECIAL_570>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 214 '<SPECIAL_214>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 144 '<SPECIAL_144>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 561 '<SPECIAL_561>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 582 '<SPECIAL_582>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 523 '<SPECIAL_523>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 65 '<SPECIAL_65>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 311 '<SPECIAL_311>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 693 '<SPECIAL_693>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 857 '<SPECIAL_857>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 513 '<SPECIAL_513>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 271 '<SPECIAL_271>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 919 '<SPECIAL_919>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 720 '<SPECIAL_720>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 542 '<SPECIAL_542>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 594 '<SPECIAL_594>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 338 '<SPECIAL_338>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 32 '<SPECIAL_32>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 955 '<SPECIAL_955>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 969 '<SPECIAL_969>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 460 '<SPECIAL_460>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 518 '<SPECIAL_518>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 588 '<SPECIAL_588>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 701 '<SPECIAL_701>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 319 '<SPECIAL_319>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 320 '<SPECIAL_320>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 233 '<SPECIAL_233>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 277 '<SPECIAL_277>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 585 '<SPECIAL_585>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 213 '<SPECIAL_213>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 599 '<SPECIAL_599>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 291 '<SPECIAL_291>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 583 '<SPECIAL_583>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 160 '<SPECIAL_160>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 109 '<SPECIAL_109>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 164 '<SPECIAL_164>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 436 '<SPECIAL_436>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 461 '<SPECIAL_461>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 982 '<SPECIAL_982>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 621 '<SPECIAL_621>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 303 '<SPECIAL_303>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 207 '<SPECIAL_207>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 654 '<SPECIAL_654>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 868 '<SPECIAL_868>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 437 '<SPECIAL_437>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 641 '<SPECIAL_641>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 200 '<SPECIAL_200>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 741 '<SPECIAL_741>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 18 '[/SYSTEM_PROMPT]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 738 '<SPECIAL_738>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 786 '<SPECIAL_786>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 82 '<SPECIAL_82>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 234 '<SPECIAL_234>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 563 '<SPECIAL_563>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 358 '<SPECIAL_358>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 497 '<SPECIAL_497>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 296 '<SPECIAL_296>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 652 '<SPECIAL_652>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 756 '<SPECIAL_756>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 170 '<SPECIAL_170>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 495 '<SPECIAL_495>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 176 '<SPECIAL_176>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 89 '<SPECIAL_89>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 724 '<SPECIAL_724>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 251 '<SPECIAL_251>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 238 '<SPECIAL_238>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 913 '<SPECIAL_913>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 766 '<SPECIAL_766>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 826 '<SPECIAL_826>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 547 '<SPECIAL_547>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 374 '<SPECIAL_374>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 514 '<SPECIAL_514>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 950 '<SPECIAL_950>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 598 '<SPECIAL_598>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 850 '<SPECIAL_850>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 908 '<SPECIAL_908>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 517 '<SPECIAL_517>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 679 '<SPECIAL_679>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 578 '<SPECIAL_578>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 75 '<SPECIAL_75>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 462 '<SPECIAL_462>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 456 '<SPECIAL_456>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 979 '<SPECIAL_979>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 446 '<SPECIAL_446>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 917 '<SPECIAL_917>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 549 '<SPECIAL_549>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 183 '<SPECIAL_183>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 424 '<SPECIAL_424>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 419 '<SPECIAL_419>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 413 '<SPECIAL_413>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 478 '<SPECIAL_478>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 398 '<SPECIAL_398>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 386 '<SPECIAL_386>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 440 '<SPECIAL_440>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 202 '<SPECIAL_202>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 747 '<SPECIAL_747>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 825 '<SPECIAL_825>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 997 '<SPECIAL_997>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 369 '<SPECIAL_369>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 696 '<SPECIAL_696>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 512 '<SPECIAL_512>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 349 '<SPECIAL_349>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 985 '<SPECIAL_985>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 337 '<SPECIAL_337>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 135 '<SPECIAL_135>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 283 '<SPECIAL_283>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 776 '<SPECIAL_776>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 327 '<SPECIAL_327>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 610 '<SPECIAL_610>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 752 '<SPECIAL_752>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 510 '<SPECIAL_510>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 92 '<SPECIAL_92>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 69 '<SPECIAL_69>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 703 '<SPECIAL_703>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 284 '<SPECIAL_284>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 325 '<SPECIAL_325>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 228 '<SPECIAL_228>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 355 '<SPECIAL_355>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 389 '<SPECIAL_389>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 458 '<SPECIAL_458>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 264 '<SPECIAL_264>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 335 '<SPECIAL_335>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 181 '<SPECIAL_181>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 263 '<SPECIAL_263>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 671 '<SPECIAL_671>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 63 '<SPECIAL_63>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 261 '<SPECIAL_261>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 122 '<SPECIAL_122>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 90 '<SPECIAL_90>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 944 '<SPECIAL_944>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 760 '<SPECIAL_760>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 956 '<SPECIAL_956>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 692 '<SPECIAL_692>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 400 '<SPECIAL_400>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 83 '<SPECIAL_83>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 537 '<SPECIAL_537>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 959 '<SPECIAL_959>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 910 '<SPECIAL_910>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 119 '<SPECIAL_119>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 66 '<SPECIAL_66>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 10 '[IMG]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 285 '<SPECIAL_285>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 524 '<SPECIAL_524>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 565 '<SPECIAL_565>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 744 '<SPECIAL_744>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 255 '<SPECIAL_255>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 866 '<SPECIAL_866>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 538 '<SPECIAL_538>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 280 '<SPECIAL_280>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 815 '<SPECIAL_815>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 204 '<SPECIAL_204>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 276 '<SPECIAL_276>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 757 '<SPECIAL_757>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 475 '<SPECIAL_475>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 480 '<SPECIAL_480>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 166 '<SPECIAL_166>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 45 '<SPECIAL_45>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 262 '<SPECIAL_262>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 301 '<SPECIAL_301>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 2 '</s>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 580 '<SPECIAL_580>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 432 '<SPECIAL_432>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 454 '<SPECIAL_454>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 107 '<SPECIAL_107>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 46 '<SPECIAL_46>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 140 '<SPECIAL_140>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 14 '[PREFIX]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 246 '<SPECIAL_246>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 52 '<SPECIAL_52>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 295 '<SPECIAL_295>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 994 '<SPECIAL_994>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 370 '<SPECIAL_370>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 831 '<SPECIAL_831>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 488 '<SPECIAL_488>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 557 '<SPECIAL_557>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 124 '<SPECIAL_124>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 644 '<SPECIAL_644>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 357 '<SPECIAL_357>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 492 '<SPECIAL_492>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 209 '<SPECIAL_209>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 71 '<SPECIAL_71>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 19 '[TOOL_CONTENT]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 562 '<SPECIAL_562>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 47 '<SPECIAL_47>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 471 '<SPECIAL_471>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 486 '<SPECIAL_486>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 244 '<SPECIAL_244>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 79 '<SPECIAL_79>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 171 '<SPECIAL_171>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 564 '<SPECIAL_564>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 439 '<SPECIAL_439>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 120 '<SPECIAL_120>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 399 '<SPECIAL_399>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 13 '[IMG_END]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 49 '<SPECIAL_49>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 938 '<SPECIAL_938>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 499 '<SPECIAL_499>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 382 '<SPECIAL_382>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 824 '<SPECIAL_824>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 393 '<SPECIAL_393>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 584 '<SPECIAL_584>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 275 '<SPECIAL_275>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 915 '<SPECIAL_915>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 699 '<SPECIAL_699>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 838 '<SPECIAL_838>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 352 '<SPECIAL_352>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 871 '<SPECIAL_871>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 470 '<SPECIAL_470>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 807 '<SPECIAL_807>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 68 '<SPECIAL_68>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 678 '<SPECIAL_678>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 511 '<SPECIAL_511>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 892 '<SPECIAL_892>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 749 '<SPECIAL_749>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 206 '<SPECIAL_206>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 710 '<SPECIAL_710>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 732 '<SPECIAL_732>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 155 '<SPECIAL_155>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 247 '<SPECIAL_247>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 208 '<SPECIAL_208>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 365 '<SPECIAL_365>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 321 '<SPECIAL_321>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 217 '<SPECIAL_217>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 777 '<SPECIAL_777>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 640 '<SPECIAL_640>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 515 '<SPECIAL_515>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 194 '<SPECIAL_194>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 378 '<SPECIAL_378>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 104 '<SPECIAL_104>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 770 '<SPECIAL_770>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 479 '<SPECIAL_479>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 145 '<SPECIAL_145>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 151 '<SPECIAL_151>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 854 '<SPECIAL_854>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 929 '<SPECIAL_929>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 156 '<SPECIAL_156>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 302 '<SPECIAL_302>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 88 '<SPECIAL_88>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 305 '<SPECIAL_305>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 590 '<SPECIAL_590>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 763 '<SPECIAL_763>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 178 '<SPECIAL_178>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 609 '<SPECIAL_609>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 353 '<SPECIAL_353>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 379 '<SPECIAL_379>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 931 '<SPECIAL_931>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 222 '<SPECIAL_222>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 870 '<SPECIAL_870>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 501 '<SPECIAL_501>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 682 '<SPECIAL_682>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 126 '<SPECIAL_126>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 341 '<SPECIAL_341>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 597 '<SPECIAL_597>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 705 '<SPECIAL_705>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 774 '<SPECIAL_774>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 121 '<SPECIAL_121>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 230 '<SPECIAL_230>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 17 '[SYSTEM_PROMPT]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 848 '<SPECIAL_848>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 240 '<SPECIAL_240>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 336 '<SPECIAL_336>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 274 '<SPECIAL_274>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 937 '<SPECIAL_937>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 350 '<SPECIAL_350>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 535 '<SPECIAL_535>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 504 '<SPECIAL_504>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 662 '<SPECIAL_662>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 141 '<SPECIAL_141>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 193 '<SPECIAL_193>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 77 '<SPECIAL_77>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 999 '<SPECIAL_999>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 157 '<SPECIAL_157>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 568 '<SPECIAL_568>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 39 '<SPECIAL_39>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 579 '<SPECIAL_579>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 581 '<SPECIAL_581>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 324 '<SPECIAL_324>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 586 '<SPECIAL_586>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 595 '<SPECIAL_595>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 602 '<SPECIAL_602>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 972 '<SPECIAL_972>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 632 '<SPECIAL_632>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 634 '<SPECIAL_634>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 615 '<SPECIAL_615>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 117 '<SPECIAL_117>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 221 '<SPECIAL_221>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 811 '<SPECIAL_811>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 197 '<SPECIAL_197>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 457 '<SPECIAL_457>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 617 '<SPECIAL_617>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 712 '<SPECIAL_712>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 839 '<SPECIAL_839>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 643 '<SPECIAL_643>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 902 '<SPECIAL_902>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 553 '<SPECIAL_553>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 656 '<SPECIAL_656>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 672 '<SPECIAL_672>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 773 '<SPECIAL_773>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 675 '<SPECIAL_675>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 361 '<SPECIAL_361>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 683 '<SPECIAL_683>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 673 '<SPECIAL_673>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 800 '<SPECIAL_800>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 691 '<SPECIAL_691>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 694 '<SPECIAL_694>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 604 '<SPECIAL_604>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 717 '<SPECIAL_717>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 442 '<SPECIAL_442>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 93 '<SPECIAL_93>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 129 '<SPECIAL_129>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 315 '<SPECIAL_315>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 406 '<SPECIAL_406>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 987 '<SPECIAL_987>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 828 '<SPECIAL_828>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 368 '<SPECIAL_368>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 904 '<SPECIAL_904>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 930 '<SPECIAL_930>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 317 '<SPECIAL_317>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 792 '<SPECIAL_792>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 91 '<SPECIAL_91>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 814 '<SPECIAL_814>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 796 '<SPECIAL_796>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 799 '<SPECIAL_799>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 664 '<SPECIAL_664>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 951 '<SPECIAL_951>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 888 '<SPECIAL_888>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 806 '<SPECIAL_806>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 809 '<SPECIAL_809>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 810 '<SPECIAL_810>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 819 '<SPECIAL_819>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 628 '<SPECIAL_628>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 58 '<SPECIAL_58>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 392 '<SPECIAL_392>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 899 '<SPECIAL_899>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 896 '<SPECIAL_896>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 612 '<SPECIAL_612>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 154 '<SPECIAL_154>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 630 '<SPECIAL_630>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 856 '<SPECIAL_856>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 666 '<SPECIAL_666>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 860 '<SPECIAL_860>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 863 '<SPECIAL_863>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 788 '<SPECIAL_788>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 865 '<SPECIAL_865>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 872 '<SPECIAL_872>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 974 '<SPECIAL_974>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 873 '<SPECIAL_873>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 543 '<SPECIAL_543>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 9 '[TOOL_CALLS]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 665 '<SPECIAL_665>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 354 '<SPECIAL_354>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 243 '<SPECIAL_243>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 637 '<SPECIAL_637>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 735 '<SPECIAL_735>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 901 '<SPECIAL_901>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 363 '<SPECIAL_363>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 821 '<SPECIAL_821>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 41 '<SPECIAL_41>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 920 '<SPECIAL_920>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 928 '<SPECIAL_928>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 220 '<SPECIAL_220>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 942 '<SPECIAL_942>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 947 '<SPECIAL_947>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 556 '<SPECIAL_556>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 962 '<SPECIAL_962>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 889 '<SPECIAL_889>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 235 '<SPECIAL_235>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 927 '<SPECIAL_927>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 967 '<SPECIAL_967>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 968 '<SPECIAL_968>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 78 '<SPECIAL_78>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 980 '<SPECIAL_980>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 223 '<SPECIAL_223>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 360 '<SPECIAL_360>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 822 '<SPECIAL_822>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 342 '<SPECIAL_342>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 294 '<SPECIAL_294>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 715 '<SPECIAL_715>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 187 '<SPECIAL_187>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 248 '<SPECIAL_248>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 481 '<SPECIAL_481>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 548 '<SPECIAL_548>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 110 '<SPECIAL_110>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 687 '<SPECIAL_687>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 593 '<SPECIAL_593>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 259 '<SPECIAL_259>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 686 '<SPECIAL_686>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 188 '<SPECIAL_188>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 229 '<SPECIAL_229>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 24 '<SPECIAL_24>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 131 '<SPECIAL_131>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 253 '<SPECIAL_253>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 318 '<SPECIAL_318>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 633 '<SPECIAL_633>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 716 '<SPECIAL_716>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 685 '<SPECIAL_685>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 224 '<SPECIAL_224>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 180 '<SPECIAL_180>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 572 '<SPECIAL_572>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 463 '<SPECIAL_463>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 689 '<SPECIAL_689>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 0 '<unk>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 758 '<SPECIAL_758>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 674 '<SPECIAL_674>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 329 '<SPECIAL_329>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 525 '<SPECIAL_525>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 25 '<SPECIAL_25>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 573 '<SPECIAL_573>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 833 '<SPECIAL_833>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 847 '<SPECIAL_847>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 334 '<SPECIAL_334>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 289 '<SPECIAL_289>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 923 '<SPECIAL_923>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 64 '<SPECIAL_64>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 784 '<SPECIAL_784>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 791 '<SPECIAL_791>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 404 '<SPECIAL_404>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 952 '<SPECIAL_952>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 8 '[/TOOL_RESULTS]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 880 '<SPECIAL_880>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 981 '<SPECIAL_981>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 551 '<SPECIAL_551>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 343 '<SPECIAL_343>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 726 '<SPECIAL_726>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 620 '<SPECIAL_620>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 832 '<SPECIAL_832>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 405 '<SPECIAL_405>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 534 '<SPECIAL_534>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 467 '<SPECIAL_467>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 391 '<SPECIAL_391>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 540 '<SPECIAL_540>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 911 '<SPECIAL_911>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 626 '<SPECIAL_626>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 782 '<SPECIAL_782>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 232 '<SPECIAL_232>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 362 '<SPECIAL_362>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 835 '<SPECIAL_835>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 867 '<SPECIAL_867>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 100 '<SPECIAL_100>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 417 '<SPECIAL_417>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 267 '<SPECIAL_267>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 918 '<SPECIAL_918>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 98 '<SPECIAL_98>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 22 '<SPECIAL_22>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 306 '<SPECIAL_306>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 366 '<SPECIAL_366>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 290 '<SPECIAL_290>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 844 '<SPECIAL_844>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 769 '<SPECIAL_769>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 885 '<SPECIAL_885>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 711 '<SPECIAL_711>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 709 '<SPECIAL_709>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 663 '<SPECIAL_663>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 15 '[MIDDLE]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 60 '<SPECIAL_60>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 869 '<SPECIAL_869>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 298 '<SPECIAL_298>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 635 '<SPECIAL_635>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 729 '<SPECIAL_729>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 245 '<SPECIAL_245>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 933 '<SPECIAL_933>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 627 '<SPECIAL_627>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 215 '<SPECIAL_215>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 820 '<SPECIAL_820>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 881 '<SPECIAL_881>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 308 '<SPECIAL_308>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 94 '<SPECIAL_94>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 219 '<SPECIAL_219>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 51 '<SPECIAL_51>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 177 '<SPECIAL_177>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 348 '<SPECIAL_348>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 239 '<SPECIAL_239>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 772 '<SPECIAL_772>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 173 '<SPECIAL_173>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 373 '<SPECIAL_373>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 174 '<SPECIAL_174>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 852 '<SPECIAL_852>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 150 '<SPECIAL_150>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 559 '<SPECIAL_559>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 169 '<SPECIAL_169>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 539 '<SPECIAL_539>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 383 '<SPECIAL_383>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 614 '<SPECIAL_614>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 943 '<SPECIAL_943>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 395 '<SPECIAL_395>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 953 '<SPECIAL_953>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 843 '<SPECIAL_843>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 986 '<SPECIAL_986>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 36 '<SPECIAL_36>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 762 '<SPECIAL_762>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 530 '<SPECIAL_530>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 464 '<SPECIAL_464>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 879 '<SPECIAL_879>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 401 '<SPECIAL_401>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 73 '<SPECIAL_73>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 992 '<SPECIAL_992>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 447 '<SPECIAL_447>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 402 '<SPECIAL_402>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 849 '<SPECIAL_849>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 307 '<SPECIAL_307>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 179 '<SPECIAL_179>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 781 '<SPECIAL_781>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 991 '<SPECIAL_991>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 356 '<SPECIAL_356>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 273 '<SPECIAL_273>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 85 '<SPECIAL_85>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 407 '<SPECIAL_407>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 493 '<SPECIAL_493>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 487 '<SPECIAL_487>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 332 '<SPECIAL_332>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 364 '<SPECIAL_364>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 976 '<SPECIAL_976>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 427 '<SPECIAL_427>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 751 '<SPECIAL_751>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 415 '<SPECIAL_415>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 966 '<SPECIAL_966>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 203 '<SPECIAL_203>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 949 '<SPECIAL_949>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 59 '<SPECIAL_59>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 81 '<SPECIAL_81>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 805 '<SPECIAL_805>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 430 '<SPECIAL_430>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 477 '<SPECIAL_477>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 922 '<SPECIAL_922>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 148 '<SPECIAL_148>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 452 '<SPECIAL_452>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 748 '<SPECIAL_748>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 272 '<SPECIAL_272>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 201 '<SPECIAL_201>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 924 '<SPECIAL_924>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 412 '<SPECIAL_412>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 921 '<SPECIAL_921>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 16 '[SUFFIX]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 529 '<SPECIAL_529>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 761 '<SPECIAL_761>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 941 '<SPECIAL_941>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 281 '<SPECIAL_281>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 344 '<SPECIAL_344>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 577 '<SPECIAL_577>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 936 '<SPECIAL_936>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 642 '<SPECIAL_642>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 433 '<SPECIAL_433>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 227 '<SPECIAL_227>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 269 '<SPECIAL_269>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 242 '<SPECIAL_242>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 841 '<SPECIAL_841>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 381 '<SPECIAL_381>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 468 '<SPECIAL_468>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 649 '<SPECIAL_649>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 884 '<SPECIAL_884>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 964 '<SPECIAL_964>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 739 '<SPECIAL_739>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 945 '<SPECIAL_945>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 428 '<SPECIAL_428>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 755 '<SPECIAL_755>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 878 '<SPECIAL_878>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 651 '<SPECIAL_651>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 346 '<SPECIAL_346>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 48 '<SPECIAL_48>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 804 '<SPECIAL_804>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 309 '<SPECIAL_309>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 127 '<SPECIAL_127>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 957 '<SPECIAL_957>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 387 '<SPECIAL_387>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 785 '<SPECIAL_785>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 30 '<SPECIAL_30>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 185 '<SPECIAL_185>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 611 '<SPECIAL_611>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 434 '<SPECIAL_434>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 546 '<SPECIAL_546>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 897 '<SPECIAL_897>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 946 '<SPECIAL_946>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 746 '<SPECIAL_746>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 552 '<SPECIAL_552>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 750 '<SPECIAL_750>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 677 '<SPECIAL_677>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 605 '<SPECIAL_605>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 159 '<SPECIAL_159>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 631 '<SPECIAL_631>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 906 '<SPECIAL_906>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 96 '<SPECIAL_96>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 35 '<SPECIAL_35>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 161 '<SPECIAL_161>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 42 '<SPECIAL_42>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 958 '<SPECIAL_958>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 80 '<SPECIAL_80>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 429 '<SPECIAL_429>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 684 '<SPECIAL_684>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 707 '<SPECIAL_707>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 993 '<SPECIAL_993>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 645 '<SPECIAL_645>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 330 '<SPECIAL_330>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 420 '<SPECIAL_420>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 613 '<SPECIAL_613>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 105 '<SPECIAL_105>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 842 '<SPECIAL_842>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 816 '<SPECIAL_816>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 397 '<SPECIAL_397>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 616 '<SPECIAL_616>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 236 '<SPECIAL_236>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 823 '<SPECIAL_823>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 954 '<SPECIAL_954>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 650 '<SPECIAL_650>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 960 '<SPECIAL_960>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 695 '<SPECIAL_695>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 375 '<SPECIAL_375>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 1 '<s>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 146 '<SPECIAL_146>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 914 '<SPECIAL_914>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 38 '<SPECIAL_38>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 990 '<SPECIAL_990>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 753 '<SPECIAL_753>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 907 '<SPECIAL_907>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 211 '<SPECIAL_211>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 29 '<SPECIAL_29>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 622 '<SPECIAL_622>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 87 '<SPECIAL_87>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 172 '<SPECIAL_172>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 191 '<SPECIAL_191>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 778 '<SPECIAL_778>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 713 '<SPECIAL_713>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 647 '<SPECIAL_647>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 347 '<SPECIAL_347>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 237 '<SPECIAL_237>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 190 '<SPECIAL_190>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 536 '<SPECIAL_536>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 4 '[/INST]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 893 '<SPECIAL_893>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 569 '<SPECIAL_569>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 54 '<SPECIAL_54>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 790 '<SPECIAL_790>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 667 '<SPECIAL_667>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 123 '<SPECIAL_123>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 975 '<SPECIAL_975>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 808 '<SPECIAL_808>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 600 '<SPECIAL_600>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 912 '<SPECIAL_912>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 520 '<SPECIAL_520>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 740 '<SPECIAL_740>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 132 '<SPECIAL_132>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 659 '<SPECIAL_659>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 508 '<SPECIAL_508>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 658 '<SPECIAL_658>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 780 '<SPECIAL_780>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 260 '<SPECIAL_260>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 567 '<SPECIAL_567>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 195 '<SPECIAL_195>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 282 '<SPECIAL_282>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 278 '<SPECIAL_278>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 453 '<SPECIAL_453>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 532 '<SPECIAL_532>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 28 '<SPECIAL_28>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 697 '<SPECIAL_697>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 502 '<SPECIAL_502>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 226 '<SPECIAL_226>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 858 '<SPECIAL_858>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 836 '<SPECIAL_836>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 636 '<SPECIAL_636>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 116 '<SPECIAL_116>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 676 '<SPECIAL_676>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 466 '<SPECIAL_466>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 521 '<SPECIAL_521>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 483 '<SPECIAL_483>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 718 '<SPECIAL_718>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 764 '<SPECIAL_764>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 978 '<SPECIAL_978>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 624 '<SPECIAL_624>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 388 '<SPECIAL_388>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 266 '<SPECIAL_266>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 670 '<SPECIAL_670>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 875 '<SPECIAL_875>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 12 '[IMG_BREAK]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 550 '<SPECIAL_550>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 384 '<SPECIAL_384>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 759 '<SPECIAL_759>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 254 '<SPECIAL_254>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 443 '<SPECIAL_443>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 655 '<SPECIAL_655>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 996 '<SPECIAL_996>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 558 '<SPECIAL_558>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 339 '<SPECIAL_339>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 830 '<SPECIAL_830>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 528 '<SPECIAL_528>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 768 '<SPECIAL_768>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 591 '<SPECIAL_591>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 876 '<SPECIAL_876>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 730 '<SPECIAL_730>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 571 '<SPECIAL_571>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 629 '<SPECIAL_629>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 270 '<SPECIAL_270>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 742 '<SPECIAL_742>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 783 '<SPECIAL_783>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 258 '<SPECIAL_258>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 67 '<SPECIAL_67>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 575 '<SPECIAL_575>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 212 '<SPECIAL_212>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 3 '[INST]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 813 '<SPECIAL_813>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 143 '<SPECIAL_143>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 149 '<SPECIAL_149>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 192 '<SPECIAL_192>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 669 '<SPECIAL_669>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 648 '<SPECIAL_648>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 932 '<SPECIAL_932>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 765 '<SPECIAL_765>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 113 '<SPECIAL_113>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 33 '<SPECIAL_33>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 533 '<SPECIAL_533>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 103 '<SPECIAL_103>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 544 '<SPECIAL_544>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 112 '<SPECIAL_112>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 56 '<SPECIAL_56>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 114 '<SPECIAL_114>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 163 '<SPECIAL_163>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 108 '<SPECIAL_108>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 310 '<SPECIAL_310>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 606 '<SPECIAL_606>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 410 '<SPECIAL_410>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 297 '<SPECIAL_297>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 256 '<SPECIAL_256>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 851 '<SPECIAL_851>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 812 '<SPECIAL_812>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 754 '<SPECIAL_754>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 225 '<SPECIAL_225>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 416 '<SPECIAL_416>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 23 '<SPECIAL_23>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 733 '<SPECIAL_733>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 268 '<SPECIAL_268>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 576 '<SPECIAL_576>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 596 '<SPECIAL_596>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 326 '<SPECIAL_326>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 128 '<SPECIAL_128>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 507 '<SPECIAL_507>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 293 '<SPECIAL_293>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 728 '<SPECIAL_728>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 292 '<SPECIAL_292>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 472 '<SPECIAL_472>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 84 '<SPECIAL_84>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 99 '<SPECIAL_99>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 390 '<SPECIAL_390>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 26 '<SPECIAL_26>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 74 '<SPECIAL_74>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 995 '<SPECIAL_995>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 162 '<SPECIAL_162>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 877 '<SPECIAL_877>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 603 '<SPECIAL_603>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 198 '<SPECIAL_198>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 657 '<SPECIAL_657>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 167 '<SPECIAL_167>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 998 '<SPECIAL_998>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 789 '<SPECIAL_789>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 97 '<SPECIAL_97>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 152 '<SPECIAL_152>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 725 '<SPECIAL_725>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 545 '<SPECIAL_545>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 351 '<SPECIAL_351>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 345 '<SPECIAL_345>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 111 '<SPECIAL_111>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 286 '<SPECIAL_286>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 331 '<SPECIAL_331>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 376 '<SPECIAL_376>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 731 '<SPECIAL_731>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 935 '<SPECIAL_935>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 196 '<SPECIAL_196>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 965 '<SPECIAL_965>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 469 '<SPECIAL_469>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 882 '<SPECIAL_882>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 106 '<SPECIAL_106>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 322 '<SPECIAL_322>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 639 '<SPECIAL_639>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 287 '<SPECIAL_287>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 853 '<SPECIAL_853>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 153 '<SPECIAL_153>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 5 '[AVAILABLE_TOOLS]' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 44 '<SPECIAL_44>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 313 '<SPECIAL_313>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 680 '<SPECIAL_680>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 793 '<SPECIAL_793>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 702 '<SPECIAL_702>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 102 '<SPECIAL_102>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 299 '<SPECIAL_299>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: control token: 76 '<SPECIAL_76>' is not marked as EOG Jun 30 09:22:10 Darkstar ollama[2861272]: load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect Jun 30 09:22:10 Darkstar ollama[2861272]: load: special tokens cache size = 1000 Jun 30 09:22:10 Darkstar ollama[2861272]: load: token to piece cache size = 0.8498 MB Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: arch = llama Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: vocab_only = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_ctx_train = 131072 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_embd = 5120 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_layer = 40 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_head = 32 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_head_kv = 8 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_rot = 128 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_swa_pattern = 1 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_embd_head_k = 128 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_embd_head_v = 128 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_gqa = 4 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_embd_k_gqa = 1024 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_embd_v_gqa = 1024 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: f_norm_eps = 0.0e+00 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: f_norm_rms_eps = 1.0e-05 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: f_clamp_kqv = 0.0e+00 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: f_max_alibi_bias = 0.0e+00 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: f_logit_scale = 0.0e+00 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: f_attn_scale = 0.0e+00 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_ff = 32768 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_expert = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_expert_used = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: causal attn = 1 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: pooling type = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: rope type = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: rope scaling = linear Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: freq_base_train = 1000000000.0 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: freq_scale_train = 1 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_ctx_orig_yarn = 131072 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: rope_finetuned = unknown Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: ssm_d_conv = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: ssm_d_inner = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: ssm_d_state = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: ssm_dt_rank = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: ssm_dt_b_c_rms = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: model type = 13B Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: model params = 23.57 B Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: general.name = Devstral Small 2505 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: vocab type = BPE Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_vocab = 131072 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: n_merges = 269443 Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: BOS token = 1 '<s>' Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: EOS token = 2 '</s>' Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: UNK token = 0 '<unk>' Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: LF token = 1010 '' Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: EOG token = 2 '</s>' Jun 30 09:22:10 Darkstar ollama[2861272]: print_info: max token length = 150 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: loading model tensors, this can take a while... (mmap = true) Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 0 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 1 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 2 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 3 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 4 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 5 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 6 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 7 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 8 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 9 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 10 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 11 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 12 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 13 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 14 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 15 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 16 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 17 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 18 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 19 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 20 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 21 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 22 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 23 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 24 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 25 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 26 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 27 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 28 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 29 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 30 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 31 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 32 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 33 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 34 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 35 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 36 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 37 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 38 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 39 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: layer 40 assigned to device CUDA0, is_swa = 0 Jun 30 09:22:10 Darkstar ollama[2861272]: load_tensors: tensor 'token_embd.weight' (q4_K) (and 0 others) cannot be used with preferred buffer type CUDA_Host, using CPU instead Jun 30 09:22:11 Darkstar ollama[2861272]: load_tensors: offloading 40 repeating layers to GPU Jun 30 09:22:11 Darkstar ollama[2861272]: load_tensors: offloading output layer to GPU Jun 30 09:22:11 Darkstar ollama[2861272]: load_tensors: offloaded 41/41 layers to GPU Jun 30 09:22:11 Darkstar ollama[2861272]: load_tensors: CUDA0 model buffer size = 13302.36 MiB Jun 30 09:22:11 Darkstar ollama[2861272]: load_tensors: CPU_Mapped model buffer size = 360.00 MiB Jun 30 09:22:11 Darkstar ollama[2861272]: time=2025-06-30T09:22:11.373-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.00" Jun 30 09:22:11 Darkstar ollama[2861272]: time=2025-06-30T09:22:11.625-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.12" Jun 30 09:22:11 Darkstar ollama[2861272]: time=2025-06-30T09:22:11.876-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.19" Jun 30 09:22:12 Darkstar ollama[2861272]: time=2025-06-30T09:22:12.127-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.27" Jun 30 09:22:12 Darkstar ollama[2861272]: time=2025-06-30T09:22:12.379-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.35" Jun 30 09:22:12 Darkstar ollama[2861272]: time=2025-06-30T09:22:12.630-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.43" Jun 30 09:22:12 Darkstar ollama[2861272]: time=2025-06-30T09:22:12.882-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.51" Jun 30 09:22:13 Darkstar ollama[2861272]: time=2025-06-30T09:22:13.133-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.58" Jun 30 09:22:13 Darkstar ollama[2861272]: time=2025-06-30T09:22:13.384-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.66" Jun 30 09:22:13 Darkstar ollama[2861272]: time=2025-06-30T09:22:13.636-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.73" Jun 30 09:22:13 Darkstar ollama[2861272]: time=2025-06-30T09:22:13.887-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.80" Jun 30 09:22:14 Darkstar ollama[2861272]: time=2025-06-30T09:22:14.139-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.88" Jun 30 09:22:14 Darkstar ollama[2861272]: time=2025-06-30T09:22:14.390-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.96" Jun 30 09:22:14 Darkstar ollama[2861272]: time=2025-06-30T09:22:14.642-04:00 level=DEBUG source=server.go:643 msg="model load progress 0.97" Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: constructing llama_context Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: n_seq_max = 2 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: n_ctx = 65368 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: n_ctx_per_seq = 32684 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: n_batch = 1024 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: n_ubatch = 512 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: causal_attn = 1 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: flash_attn = 1 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: freq_base = 1000000000.0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: freq_scale = 1 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: n_ctx_per_seq (32684) < n_ctx_train (131072) -- the full capacity of the model will not be utilized Jun 30 09:22:14 Darkstar ollama[2861272]: set_abort_callback: call Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: CUDA_Host output buffer size = 1.04 MiB Jun 30 09:22:14 Darkstar ollama[2861272]: create_memory: n_ctx = 65536 (padded) Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: kv_size = 65536, type_k = 'q8_0', type_v = 'q8_0', n_layer = 40, can_shift = 1, padding = 256 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 0: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 1: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 2: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 3: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 4: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 5: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 6: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 7: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 8: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 9: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 10: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 11: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 12: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 13: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 14: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 15: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 16: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 17: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 18: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 19: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 20: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 21: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 22: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 23: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 24: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 25: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 26: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 27: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 28: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 29: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 30: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 31: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 32: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 33: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 34: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 35: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 36: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 37: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 38: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: layer 39: dev = CUDA0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: CUDA0 KV buffer size = 5440.00 MiB Jun 30 09:22:14 Darkstar ollama[2861272]: llama_kv_cache_unified: KV self size = 5440.00 MiB, K (q8_0): 2720.00 MiB, V (q8_0): 2720.00 MiB Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: enumerating backends Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: backend_ptrs.size() = 2 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: max_nodes = 65536 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: worst-case: n_tokens = 512, n_seqs = 1, n_outputs = 0 Jun 30 09:22:14 Darkstar ollama[2861272]: llama_context: reserving graph for n_tokens = 512, n_seqs = 1 Jun 30 09:22:15 Darkstar ollama[2861272]: llama_context: reserving graph for n_tokens = 1, n_seqs = 1 Jun 30 09:22:15 Darkstar ollama[2861272]: llama_context: reserving graph for n_tokens = 512, n_seqs = 1 Jun 30 09:22:15 Darkstar ollama[2861272]: llama_context: CUDA0 compute buffer size = 266.00 MiB Jun 30 09:22:15 Darkstar ollama[2861272]: llama_context: CUDA_Host compute buffer size = 138.01 MiB Jun 30 09:22:15 Darkstar ollama[2861272]: llama_context: graph nodes = 1207 Jun 30 09:22:15 Darkstar ollama[2861272]: llama_context: graph splits = 2 Jun 30 09:22:15 Darkstar ollama[2861272]: time=2025-06-30T09:22:15.144-04:00 level=INFO source=server.go:637 msg="llama runner started in 5.28 seconds" Jun 30 09:22:15 Darkstar ollama[2861272]: time=2025-06-30T09:22:15.144-04:00 level=DEBUG source=sched.go:495 msg="finished setting up" runner.name=registry.ollama.ai/library/ftidevstral:24b-small-2505-q4_K_M runner.inference=cuda runner.devices=1 runner.size="23.0 GiB" runner.vram="23.0 GiB" runner.parallel=2 runner.pid=2861349 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 runner.num_ctx=65368 Jun 30 09:22:15 Darkstar ollama[2861272]: time=2025-06-30T09:22:15.155-04:00 level=DEBUG source=server.go:736 msg="completion request" images=0 prompt=382 format="" Jun 30 09:22:15 Darkstar ollama[2861272]: time=2025-06-30T09:22:15.166-04:00 level=DEBUG source=cache.go:104 msg="loading cache slot" id=0 cache=0 prompt=67 used=0 remaining=67 Jun 30 09:22:15 Darkstar ollama[2861272]: [GIN] 2025/06/30 - 09:22:15 | 200 | 7.412351916s | 127.0.0.1 | POST "/api/chat" Jun 30 09:22:15 Darkstar ollama[2861272]: time=2025-06-30T09:22:15.842-04:00 level=DEBUG source=sched.go:503 msg="context for request finished" Jun 30 09:22:15 Darkstar ollama[2861272]: time=2025-06-30T09:22:15.842-04:00 level=DEBUG source=sched.go:343 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/ftidevstral:24b-small-2505-q4_K_M runner.inference=cuda runner.devices=1 runner.size="23.0 GiB" runner.vram="23.0 GiB" runner.parallel=2 runner.pid=2861349 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 runner.num_ctx=65368 duration=5m0s Jun 30 09:22:15 Darkstar ollama[2861272]: time=2025-06-30T09:22:15.842-04:00 level=DEBUG source=sched.go:361 msg="after processing request finished event" runner.name=registry.ollama.ai/library/ftidevstral:24b-small-2505-q4_K_M runner.inference=cuda runner.devices=1 runner.size="23.0 GiB" runner.vram="23.0 GiB" runner.parallel=2 runner.pid=2861349 runner.model=/usr/share/ollama/.ollama/models/blobs/sha256-b3a2c9a8fef9be8d2ef951aecca36a36b9ea0b70abe9359eab4315bf4cd9be01 runner.num_ctx=65368 refCount=0 ```
GiteaMirror commented 2026-05-09 22:26:38 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jun 30, 2025):

Here is a log after a fresh restart of Ollama, and loading Devstral. I don't know what I'm looking for, but it seems as if --parallel is set to 2.

If OLLAMA_NUM_PARALLEL is unset, the ollama server takes a look at available VRAM to set the number of parallel requests. If there's enough VRAM to hold two context buffers, it sets parallelism to 2, otherwise 1.

Do I have a fundamental misunderstanding of how parallel works? I assumed it meant how many parallel queries (api services) it could run at the same time, directly relating to how many users could run, but is that really true? Or does something like AnythingLLM use multiple simultanious queries somehow negating the benifit to multiple users?

It's the number of simultaneous requests that the ollama server will handle.

For example, in your attached Graph of an 2x A100 - Can it really serve 4-10 users simultaneously???

If OLLAMA_NUM_PARALLEL=10, then the system will process up to 10 simultaneous queries. Because there's only a limited amount of GPU to be had, the tokens/sec rate for each individual request will be lower than if the system was processing 10 requests in serial, but the overall tokens/sec of the system will be higher.

For a simple test of the parallelism of your system, try the following: set OLLAMA_NUM_PARALLEL=10 in the server environment, restart the ollama server, and run the following:

doit() { curl -s localhost:11434/api/generate -d '{"model":"devstral","prompt":"x='${RANDOM}'\nreturn a list of the numbers 1 to 100 in a JSON array","options":{"num_predict":100,"seed":42},"stream":false,"format":"json"}' | jq 'del(.context)|.+{"prompt_eval_rate":(.prompt_eval_count/(.prompt_eval_duration/1000000000)),"eval_rate":(.eval_count/(.eval_duration/1000000000))}' ; } ; export -f doit
for i in {1..10} ; do echo -n "$i " ; seq 0 9 | /usr/bin/time -f %E parallel -n0 -P$i doit >/dev/null ; done

This sends ten queries with a varying amount of parallelism, and systems that support that should see the overall time go down as parallelism increases. For example, on an RTX6000:

1 0:22.82
2 0:12.99
3 0:12.75
4 0:11.97
5 0:10.74
6 0:11.39
7 0:12.01
8 0:11.88
9 0:09.06
10 0:07.07
<!-- gh-comment-id:3019536564 --> @rick-github commented on GitHub (Jun 30, 2025): > Here is a log after a fresh restart of Ollama, and loading Devstral. I don't know what I'm looking for, but it seems as if --parallel is set to 2. If `OLLAMA_NUM_PARALLEL` is unset, the ollama server takes a look at available VRAM to set the number of parallel requests. If there's enough VRAM to hold two context buffers, it sets parallelism to 2, otherwise 1. > Do I have a fundamental misunderstanding of how parallel works? I assumed it meant how many parallel queries (api services) it could run at the same time, directly relating to how many users could run, but is that really true? Or does something like AnythingLLM use multiple simultanious queries somehow negating the benifit to multiple users? It's the number of simultaneous requests that the ollama server will handle. > For example, in your attached Graph of an 2x A100 - Can it really serve 4-10 users simultaneously??? If `OLLAMA_NUM_PARALLEL=10`, then the system will process up to 10 simultaneous queries. Because there's only a limited amount of GPU to be had, the tokens/sec rate for each individual request will be lower than if the system was processing 10 requests in serial, but the overall tokens/sec of the system will be higher. For a simple test of the parallelism of your system, try the following: set `OLLAMA_NUM_PARALLEL=10` in the server environment, restart the ollama server, and run the following: ``` doit() { curl -s localhost:11434/api/generate -d '{"model":"devstral","prompt":"x='${RANDOM}'\nreturn a list of the numbers 1 to 100 in a JSON array","options":{"num_predict":100,"seed":42},"stream":false,"format":"json"}' | jq 'del(.context)|.+{"prompt_eval_rate":(.prompt_eval_count/(.prompt_eval_duration/1000000000)),"eval_rate":(.eval_count/(.eval_duration/1000000000))}' ; } ; export -f doit for i in {1..10} ; do echo -n "$i " ; seq 0 9 | /usr/bin/time -f %E parallel -n0 -P$i doit >/dev/null ; done ``` This sends ten queries with a varying amount of parallelism, and systems that support that should see the overall time go down as parallelism increases. For example, on an RTX6000: ``` 1 0:22.82 2 0:12.99 3 0:12.75 4 0:11.97 5 0:10.74 6 0:11.39 7 0:12.01 8 0:11.88 9 0:09.06 10 0:07.07 ```
GiteaMirror commented 2026-05-09 22:26:41 -05:00
Author
Owner
Copy Link

@jeepshop commented on GitHub (Jun 30, 2025):

First thank you for taking the time to help me process/understand. It
means a lot to me. Getting your script to not dump over to CPU took me a
couple hours, and a learned a lot in the process. My biggest problem
was because the model kept defaulting to 128k context. I changed the above
script to force context size and ran several iterations watching use from
nvtop.

@4k Context (Fits on single GPU)
1 39.333
2 19.789
3 19.235
4 17.930
5 16.144
6 16.918
7 17.359
8 18.518
9 16.616
10 13.493

@8k Context (Fits in single GPU)
1 33.063
2 20.042
3 19.327
4 18.050
5 16.261
6 17.102
7 17.990
8 18.614
9 16.317
10 15.833

@16k Context (Spans both GPUs ~50% VRAM)
1 41.768
2 20.028
3 19.442
4 18.124
5 16.164
6 16.799
7 17.152
8 18.826
9 16.180
10 13.242

NVTOP During 16k context run shows about 50% VRAM, and only 50% GPU use...
Since I'm getting about the same results as the smaller context runs that
used a single GPU, I feel that running a duplicate model on the second GPU
should double my performance, whereas the performance is nearly identical
between running 1 vs 2 GPUs above.

But I admit I still don't understand all the ramifications;

[image: image.png]

But amongst all of the above testing, I went back to AnythingLLM and spun
up multiple instances in Firefox - and lo-and-behold for the first time
ever I got two simultaneous chats working. Since it never worked before
with Parallel = 2, what are the expectations? Is it Users + 1, Users x 2?

On Mon, Jun 30, 2025 at 11:07 AM frob @.***> wrote:

rick-github left a comment (ollama/ollama#11196)
https://github.com/ollama/ollama/issues/11196#issuecomment-3019536564

Here is a log after a fresh restart of Ollama, and loading Devstral. I
don't know what I'm looking for, but it seems as if --parallel is set to 2.

If OLLAMA_NUM_PARALLEL is unset, the ollama server takes a look at
available VRAM to set the number of parallel requests. If there's enough
VRAM to hold two context buffers, it sets parallelism to 2, otherwise 1.

Do I have a fundamental misunderstanding of how parallel works? I assumed
it meant how many parallel queries (api services) it could run at the same
time, directly relating to how many users could run, but is that really
true? Or does something like AnythingLLM use multiple simultanious queries
somehow negating the benifit to multiple users?

It's the number of simultaneous requests that the ollama server will
handle.

For example, in your attached Graph of an 2x A100 - Can it really serve
4-10 users simultaneously???

If OLLAMA_NUM_PARALLEL=10, then the system will process up to 10
simultaneous queries. Because there's only a limited amount of GPU to be
had, the tokens/sec rate for each individual request will be lower than if
the system was processing 10 requests in serial, but the overall tokens/sec
of the system will be higher.

For a simple test of the parallelism of your system, try the following:
set OLLAMA_NUM_PARALLEL=10 in the server environment, restart the ollama
server, and run the following:

doit() { curl -s localhost:11434/api/generate -d '{"model":"devstral","prompt":"x='${RANDOM}'\nreturn a list of the numbers 1 to 100 in a JSON array","options":{"num_predict":100,"seed":42},"stream":false,"format":"json"}' | jq 'del(.context)|.+{"prompt_eval_rate":(.prompt_eval_count/(.prompt_eval_duration/1000000000)),"eval_rate":(.eval_count/(.eval_duration/1000000000))}' ; } ; export -f doit
for i in {1..10} ; do echo -n "$i " ; seq 0 9 | /usr/bin/time -f %E parallel -n0 -P$i doit >/dev/null ; done

This sends ten queries with a varying amount of parallelism, and systems
that support that should see the overall time go down as parallelism
increases. For example, on an RTX6000:

1 0:22.82
2 0:12.99
3 0:12.75
4 0:11.97
5 0:10.74
6 0:11.39
7 0:12.01
8 0:11.88
9 0:09.06
10 0:07.07

—
Reply to this email directly, view it on GitHub
https://github.com/ollama/ollama/issues/11196#issuecomment-3019536564,
or unsubscribe
https://github.com/notifications/unsubscribe-auth/AF6EMS53WNQMUK7XYER62ID3GFHCPAVCNFSM6AAAAACADT54SWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTAMJZGUZTMNJWGQ
.
You are receiving this because you authored the thread.Message ID:
@.***>

<!-- gh-comment-id:3020118790 --> @jeepshop commented on GitHub (Jun 30, 2025): First thank you for taking the time to help me process/understand. It means a lot to me. Getting your script to not dump over to CPU took me a couple hours, and a learned a lot in the process. My biggest problem was because the model kept defaulting to 128k context. I changed the above script to force context size and ran several iterations watching use from nvtop. @4k Context (Fits on single GPU) 1 39.333 2 19.789 3 19.235 4 17.930 5 16.144 6 16.918 7 17.359 8 18.518 9 16.616 10 13.493 @8k Context (Fits in single GPU) 1 33.063 2 20.042 3 19.327 4 18.050 5 16.261 6 17.102 7 17.990 8 18.614 9 16.317 10 15.833 @16k Context (Spans both GPUs ~50% VRAM) 1 41.768 2 20.028 3 19.442 4 18.124 5 16.164 6 16.799 7 17.152 8 18.826 9 16.180 10 13.242 NVTOP During 16k context run shows about 50% VRAM, and only 50% GPU use... Since I'm getting about the same results as the smaller context runs that used a single GPU, I feel that running a duplicate model on the second GPU should double my performance, whereas the performance is nearly identical between running 1 vs 2 GPUs above. But I admit I still don't understand all the ramifications; [image: image.png] But amongst all of the above testing, I went back to AnythingLLM and spun up multiple instances in Firefox - and lo-and-behold for the first time ever I got two simultaneous chats working. Since it never worked before with Parallel = 2, what are the expectations? Is it Users + 1, Users x 2? On Mon, Jun 30, 2025 at 11:07 AM frob ***@***.***> wrote: > *rick-github* left a comment (ollama/ollama#11196) > <https://github.com/ollama/ollama/issues/11196#issuecomment-3019536564> > > Here is a log after a fresh restart of Ollama, and loading Devstral. I > don't know what I'm looking for, but it seems as if --parallel is set to 2. > > If OLLAMA_NUM_PARALLEL is unset, the ollama server takes a look at > available VRAM to set the number of parallel requests. If there's enough > VRAM to hold two context buffers, it sets parallelism to 2, otherwise 1. > > Do I have a fundamental misunderstanding of how parallel works? I assumed > it meant how many parallel queries (api services) it could run at the same > time, directly relating to how many users could run, but is that really > true? Or does something like AnythingLLM use multiple simultanious queries > somehow negating the benifit to multiple users? > > It's the number of simultaneous requests that the ollama server will > handle. > > For example, in your attached Graph of an 2x A100 - Can it really serve > 4-10 users simultaneously??? > > If OLLAMA_NUM_PARALLEL=10, then the system will process up to 10 > simultaneous queries. Because there's only a limited amount of GPU to be > had, the tokens/sec rate for each individual request will be lower than if > the system was processing 10 requests in serial, but the overall tokens/sec > of the system will be higher. > > For a simple test of the parallelism of your system, try the following: > set OLLAMA_NUM_PARALLEL=10 in the server environment, restart the ollama > server, and run the following: > > doit() { curl -s localhost:11434/api/generate -d '{"model":"devstral","prompt":"x='${RANDOM}'\nreturn a list of the numbers 1 to 100 in a JSON array","options":{"num_predict":100,"seed":42},"stream":false,"format":"json"}' | jq 'del(.context)|.+{"prompt_eval_rate":(.prompt_eval_count/(.prompt_eval_duration/1000000000)),"eval_rate":(.eval_count/(.eval_duration/1000000000))}' ; } ; export -f doit > for i in {1..10} ; do echo -n "$i " ; seq 0 9 | /usr/bin/time -f %E parallel -n0 -P$i doit >/dev/null ; done > > This sends ten queries with a varying amount of parallelism, and systems > that support that should see the overall time go down as parallelism > increases. For example, on an RTX6000: > > 1 0:22.82 > 2 0:12.99 > 3 0:12.75 > 4 0:11.97 > 5 0:10.74 > 6 0:11.39 > 7 0:12.01 > 8 0:11.88 > 9 0:09.06 > 10 0:07.07 > > — > Reply to this email directly, view it on GitHub > <https://github.com/ollama/ollama/issues/11196#issuecomment-3019536564>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AF6EMS53WNQMUK7XYER62ID3GFHCPAVCNFSM6AAAAACADT54SWVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZTAMJZGUZTMNJWGQ> > . > You are receiving this because you authored the thread.Message ID: > ***@***.***> >
GiteaMirror commented 2026-05-09 22:26:42 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jun 30, 2025):

My biggest problem was because the model kept defaulting to 128k context.

The default context for the server can be set with OLLAMA_CONTEXT_LENGTH.

NVTOP During 16k context run shows about 50% VRAM, and only 50% GPU use...

Models are a set of layers, and computation in each layer needs to be completed before computation starts in the next. If a model is composed of 40 layers, 20 get loaded in GPU1 and 20 in GPU2. Inference starts in the first layer in GPU1, goes to layer 20, then intermediate results get moved to GPU2, and inference continues with layer 1 of GPU (21st layer of the model), then to layer 20 of GPU2. That completes one token, and processing starts again at layer 1 in GPU1 for the next token.

This means that for a single completion, the average utilization of the GPUs is 50%. The test script tries to maximize parallel processing (same seed, same prompt, same token limit) so even when doing multiple queries, processing will be sequentially localized to one of the GPUs during processing. This means that over all queries, average utilization of the two GPUs will be 50%. In real life, the query processing would be more distributed, likely resulting in more than 50% utilization, although the actual amount will depend on hardware and query patterns.

Since I'm getting about the same results as the smaller context runs that
used a single GPU, I feel that running a duplicate model on the second GPU
should double my performance, whereas the performance is nearly identical
between running 1 vs 2 GPUs above.

The problem with running a second copy is that you waste a bunch of VRAM that could be used to either increase parallelism or increase context size (or both). Running a second copy is doable via the proxy method as described earlier, for which the downsides have already been discussed.

But amongst all of the above testing, I went back to AnythingLLM and spun
up multiple instances in Firefox - and lo-and-behold for the first time
ever I got two simultaneous chats working. Since it never worked before
with Parallel = 2, what are the expectations? Is it Users + 1, Users x 2?
…

Parallel=2 is only true if OLLAMA_NUM_PARALLEL is unset and there is enough VRAM to hold two context buffers. It could be that in previous chats, context size was larger or some VRAM was being used that resulted in ollama using parallel=1. Every extra context buffer (ie, every increment of OLLAMA_NUM_PARALLEL) results in another concurrent request processing slot, so increasing the number of simultaneous requests. However, if all of those requests slots are filled at the same time, the processing time will increase, so clients will see a lower tokens/second rate. So the capacity increase is not a linear function and depends on a number of factors - parallelism, types of queries, hardware, etc - see the earlier graphs.

<!-- gh-comment-id:3020446459 --> @rick-github commented on GitHub (Jun 30, 2025): > My biggest problem was because the model kept defaulting to 128k context. The default context for the server can be set with `OLLAMA_CONTEXT_LENGTH`. > NVTOP During 16k context run shows about 50% VRAM, and only 50% GPU use... Models are a set of layers, and computation in each layer needs to be completed before computation starts in the next. If a model is composed of 40 layers, 20 get loaded in GPU1 and 20 in GPU2. Inference starts in the first layer in GPU1, goes to layer 20, then intermediate results get moved to GPU2, and inference continues with layer 1 of GPU (21st layer of the model), then to layer 20 of GPU2. That completes one token, and processing starts again at layer 1 in GPU1 for the next token. This means that for a single completion, the average utilization of the GPUs is 50%. The test script tries to maximize parallel processing (same seed, same prompt, same token limit) so even when doing multiple queries, processing will be sequentially localized to one of the GPUs during processing. This means that over all queries, average utilization of the two GPUs will be 50%. In real life, the query processing would be more distributed, likely resulting in more than 50% utilization, although the actual amount will depend on hardware and query patterns. > Since I'm getting about the same results as the smaller context runs that > used a single GPU, I feel that running a duplicate model on the second GPU > should double my performance, whereas the performance is nearly identical > between running 1 vs 2 GPUs above. The problem with running a second copy is that you waste a bunch of VRAM that could be used to either increase parallelism or increase context size (or both). Running a second copy is doable via the proxy method as described earlier, for which the downsides have already been discussed. > But amongst all of the above testing, I went back to AnythingLLM and spun > up multiple instances in Firefox - and lo-and-behold for the first time > ever I got two simultaneous chats working. Since it never worked before > with Parallel = 2, what are the expectations? Is it Users + 1, Users x 2? > […](#) Parallel=2 is only true if `OLLAMA_NUM_PARALLEL` is unset and there is enough VRAM to hold two context buffers. It could be that in previous chats, context size was larger or some VRAM was being used that resulted in ollama using parallel=1. Every extra context buffer (ie, every increment of `OLLAMA_NUM_PARALLEL`) results in another concurrent request processing slot, so increasing the number of simultaneous requests. However, if all of those requests slots are filled at the same time, the processing time will increase, so clients will see a lower tokens/second rate. So the capacity increase is not a linear function and depends on a number of factors - parallelism, types of queries, hardware, etc - see the earlier graphs.
GiteaMirror commented 2026-05-09 22:26:45 -05:00
Author
Owner
Copy Link

@jeepshop commented on GitHub (Jul 1, 2025):

Models are a set of layers, and computation in each layer needs to be completed before computation starts in the next. If a model is composed of 40 layers, 20 get loaded in GPU1 and 20 in GPU2. Inference starts in the first layer in GPU1, goes to layer 20, then intermediate results get moved to GPU2, and inference continues with layer 1 of GPU (21st layer of the model), then to layer 20 of GPU2. That completes one token, and processing starts again at layer 1 in GPU1 for the next token.

Thank you, that makes a lot of since. I feel like I've read it before, but it never clicked.

The problem with running a second copy is that you waste a bunch of VRAM that could be used to either increase parallelism or increase context size (or both). Running a second copy is doable via the proxy method as described earlier, for which the downsides have already been discussed.

You see it as a problem 'wasting VRAM' for parallelism. I see it as a worthy tradeoff wasting some VRAM to get a 30% performance gain.

That said, I might have found a work around - use two 'nearly' identical models; e.g. one that is 4_k_m and one that is 4_k_xl. It's not ideal because I have to balance configurations between developers, but it's better than dedicating GPUs behind a proxy.

<!-- gh-comment-id:3023847815 --> @jeepshop commented on GitHub (Jul 1, 2025): > Models are a set of layers, and computation in each layer needs to be completed before computation starts in the next. If a model is composed of 40 layers, 20 get loaded in GPU1 and 20 in GPU2. Inference starts in the first layer in GPU1, goes to layer 20, then intermediate results get moved to GPU2, and inference continues with layer 1 of GPU (21st layer of the model), then to layer 20 of GPU2. That completes one token, and processing starts again at layer 1 in GPU1 for the next token. Thank you, that makes a lot of since. I feel like I've read it before, but it never clicked. > The problem with running a second copy is that you waste a bunch of VRAM that could be used to either increase parallelism or increase context size (or both). Running a second copy is doable via the proxy method as described earlier, for which the downsides have already been discussed. You see it as a problem 'wasting VRAM' for parallelism. I see it as a worthy tradeoff wasting some VRAM to get a 30% performance gain. That said, I might have found a work around - use two 'nearly' identical models; e.g. one that is 4_k_m and one that is 4_k_xl. It's not ideal because I have to balance configurations between developers, but it's better than dedicating GPUs behind a proxy.
GiteaMirror commented 2026-05-09 22:26:46 -05:00
Author
Owner
Copy Link

@rick-github commented on GitHub (Jul 1, 2025):

That said, I might have found a work around - use two 'nearly' identical models; e.g. one that is 4_k_m and one that is 4_k_xl. It's not ideal because I have to balance configurations between developers, but it's better than dedicating GPUs behind a proxy.

You can create a copy with the exact same weights by copying the GGUF file of the model, hex editing an entry in the KV table to change a byte, and then using ollama create to create the new model. Due to the edited KV entry the model will have a different sha256sum and ollama will happily load it alongside the original model. Then you could run a simple proxy that switches the model parameter in an API request to choose one or the other model with a choice of selection algorithms: round robin, sticky, least loaded, etc. This can be done with litellm or a simple script in nginx or mitmproxy. This way the developers wouldn't have to deal with configuration, they just send a request to our-developer-model.

<!-- gh-comment-id:3023947782 --> @rick-github commented on GitHub (Jul 1, 2025): > That said, I might have found a work around - use two 'nearly' identical models; e.g. one that is 4_k_m and one that is 4_k_xl. It's not ideal because I have to balance configurations between developers, but it's better than dedicating GPUs behind a proxy. You can create a copy with the exact same weights by copying the GGUF file of the model, hex editing an entry in the KV table to change a byte, and then using `ollama create` to create the new model. Due to the edited KV entry the model will have a different sha256sum and ollama will happily load it alongside the original model. Then you could run a simple proxy that switches the `model` parameter in an API request to choose one or the other model with a choice of selection algorithms: round robin, sticky, least loaded, etc. This can be done with [litellm](https://docs.litellm.ai/docs/proxy/load_balancing) or a simple script in [nginx](https://github.com/ollama/ollama/issues/10207#issuecomment-2797818749) or [mitmproxy](https://github.com/ollama/ollama/issues/11002#issuecomment-2959740647). This way the developers wouldn't have to deal with configuration, they just send a request to `our-developer-model`.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#85061
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?