[GH-ISSUE #15471] 500 Internal Server Error: MLX runner failed - libmlxc.dylib not found #9888

Closed
opened 2026-04-12 22:44:43 -05:00 by GiteaMirror · 0 comments
Owner

Originally created by @milindmore22 on GitHub (Apr 10, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/15471

What is the issue?

Description

When attempting to run the x/flux2-klein model, Ollama fails with an MLX initialization error stating that libmlxc.dylib cannot be found.

Error Message

Error: 500 Internal Server Error: mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)

Steps to Reproduce

  1. Run the command: ollama run x/flux2-klein "A cat holding sign say Hello World"
  2. Error occurs immediately during model initialization

Expected Behavior

The model should either:

  • Initialize successfully if MLX dependencies are properly bundled/installed
  • Provide a clear error message with instructions on how to install MLX dependencies
  • Fall back to a non-MLX backend if available

Actual Behavior

The model fails to run with a 500 Internal Server Error, and the MLX library cannot be found.

Relevant log output

time=2026-04-10T13:19:17.037+05:30 level=INFO source=routes.go:1752 msg="server config" env="map[HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:0 OLLAMA_DEBUG:INFO OLLAMA_DEBUG_LOG_REQUESTS:false OLLAMA_EDITOR: OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/Users/milind/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NO_CLOUD:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false http_proxy: https_proxy: no_proxy:]"
time=2026-04-10T13:19:17.038+05:30 level=INFO source=routes.go:1754 msg="Ollama cloud disabled: false"
time=2026-04-10T13:19:17.072+05:30 level=INFO source=images.go:499 msg="total blobs: 1553"
time=2026-04-10T13:19:17.075+05:30 level=INFO source=images.go:506 msg="total unused blobs removed: 0"
time=2026-04-10T13:19:17.076+05:30 level=INFO source=routes.go:1810 msg="Listening on 127.0.0.1:11434 (version 0.20.5)"
time=2026-04-10T13:19:17.076+05:30 level=INFO source=runner.go:67 msg="discovering available GPUs..."
time=2026-04-10T13:19:17.078+05:30 level=INFO source=server.go:444 msg="starting runner" cmd="/Applications/Ollama.app/Contents/Resources/ollama runner --ollama-engine --port 52713"
time=2026-04-10T13:19:17.231+05:30 level=INFO source=types.go:42 msg="inference compute" id=0 filter_id=0 library=Metal compute=0.0 name=Metal description="Apple M3" libdirs="" driver=0.0 pci_id="" type=discrete total="11.8 GiB" available="11.8 GiB"
time=2026-04-10T13:19:17.231+05:30 level=INFO source=routes.go:1860 msg="vram-based default context" total_vram="11.8 GiB" default_num_ctx=4096
[GIN] 2026/04/10 - 13:19:17 | 200 |     111.166µs |       127.0.0.1 | GET      "/api/version"
[GIN] 2026/04/10 - 13:19:17 | 200 |      104.75µs |       127.0.0.1 | HEAD     "/"
[GIN] 2026/04/10 - 13:19:17 | 200 |   56.171209ms |       127.0.0.1 | POST     "/api/show"
time=2026-04-10T13:19:17.556+05:30 level=INFO source=sched.go:484 msg="system memory" total="16.0 GiB" free="6.2 GiB" free_swap="0 B"
time=2026-04-10T13:19:17.556+05:30 level=INFO source=sched.go:491 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B"
time=2026-04-10T13:19:17.558+05:30 level=INFO source=server.go:171 msg="starting mlx runner subprocess" model=x/flux2-klein:latest port=52720
time=2026-04-10T13:19:17.559+05:30 level=INFO source=sched.go:561 msg="loaded runners" count=1
time=2026-04-10T13:19:17.572+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:19:17.572+05:30 level=INFO msg=\"starting mlx runner\" model=x/flux2-klein:latest port=52720 mode=imagegen"
time=2026-04-10T13:19:17.572+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:19:17.572+05:30 level=ERROR msg=\"unable to initialize MLX\" error=\"failed to initialize MLX: libmlxc.dylib not found\""
time=2026-04-10T13:19:17.572+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="Error: failed to initialize MLX: libmlxc.dylib not found"
time=2026-04-10T13:19:17.574+05:30 level=ERROR source=sched.go:567 msg="error loading llama server" error="mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)"
time=2026-04-10T13:19:17.574+05:30 level=INFO source=server.go:363 msg="stopping mlx runner subprocess" pid=16585
[GIN] 2026/04/10 - 13:19:17 | 500 |    59.76075ms |       127.0.0.1 | POST     "/api/generate"
[GIN] 2026/04/10 - 13:30:42 | 200 |      54.625µs |       127.0.0.1 | HEAD     "/"
[GIN] 2026/04/10 - 13:30:42 | 200 |   14.755917ms |       127.0.0.1 | GET      "/api/tags"
[GIN] 2026/04/10 - 13:31:52 | 200 |       36.25µs |       127.0.0.1 | HEAD     "/"
[GIN] 2026/04/10 - 13:31:52 | 200 |   51.950833ms |       127.0.0.1 | POST     "/api/show"
time=2026-04-10T13:31:52.923+05:30 level=INFO source=sched.go:484 msg="system memory" total="16.0 GiB" free="7.1 GiB" free_swap="0 B"
time=2026-04-10T13:31:52.923+05:30 level=INFO source=sched.go:491 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B"
time=2026-04-10T13:31:52.925+05:30 level=INFO source=server.go:171 msg="starting mlx runner subprocess" model=x/flux2-klein:latest port=53670
time=2026-04-10T13:31:52.926+05:30 level=INFO source=sched.go:561 msg="loaded runners" count=1
time=2026-04-10T13:31:52.939+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:31:52.939+05:30 level=INFO msg=\"starting mlx runner\" model=x/flux2-klein:latest port=53670 mode=imagegen"
time=2026-04-10T13:31:52.939+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:31:52.939+05:30 level=ERROR msg=\"unable to initialize MLX\" error=\"failed to initialize MLX: libmlxc.dylib not found\""
time=2026-04-10T13:31:52.939+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="Error: failed to initialize MLX: libmlxc.dylib not found"
time=2026-04-10T13:31:52.940+05:30 level=ERROR source=sched.go:567 msg="error loading llama server" error="mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)"
time=2026-04-10T13:31:52.940+05:30 level=INFO source=server.go:363 msg="stopping mlx runner subprocess" pid=16785
[GIN] 2026/04/10 - 13:31:52 | 500 |     59.3245ms |       127.0.0.1 | POST     "/api/generate"
[GIN] 2026/04/10 - 13:32:21 | 200 |       35.75µs |       127.0.0.1 | GET      "/api/version"
[GIN] 2026/04/10 - 13:32:21 | 200 |    9.848208ms |       127.0.0.1 | GET      "/api/tags"
[GIN] 2026/04/10 - 13:32:21 | 200 |  640.730416ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:32:21 | 200 |   169.29725ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:32:22 | 200 |  149.339042ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:32:22 | 200 |   23.185834ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:32:22 | 200 |   12.321875ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:32:34 | 200 |      19.792µs |       127.0.0.1 | GET      "/api/version"
[GIN] 2026/04/10 - 13:32:34 | 200 |    6.410292ms |       127.0.0.1 | GET      "/api/tags"
[GIN] 2026/04/10 - 13:32:34 | 200 |  298.730542ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:32:35 | 200 |  189.360375ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:32:35 | 200 |  260.477666ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:32:35 | 200 |   39.996916ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:32:35 | 200 |   19.488292ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:37:19 | 200 |      54.334µs |       127.0.0.1 | HEAD     "/"
[GIN] 2026/04/10 - 13:37:19 | 404 |   11.906208ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:37:20 | 200 |     1.010746s |       127.0.0.1 | POST     "/api/pull"
[GIN] 2026/04/10 - 13:37:59 | 200 |          45µs |       127.0.0.1 | HEAD     "/"
[GIN] 2026/04/10 - 13:38:01 | 200 |  2.342140584s |       127.0.0.1 | POST     "/api/pull"
[GIN] 2026/04/10 - 13:38:06 | 200 |      45.917µs |       127.0.0.1 | HEAD     "/"
[GIN] 2026/04/10 - 13:38:06 | 200 |    51.52325ms |       127.0.0.1 | POST     "/api/show"
time=2026-04-10T13:38:07.041+05:30 level=INFO source=sched.go:484 msg="system memory" total="16.0 GiB" free="6.3 GiB" free_swap="0 B"
time=2026-04-10T13:38:07.041+05:30 level=INFO source=sched.go:491 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B"
time=2026-04-10T13:38:07.044+05:30 level=INFO source=server.go:171 msg="starting mlx runner subprocess" model=x/flux2-klein:latest port=53791
time=2026-04-10T13:38:07.045+05:30 level=INFO source=sched.go:561 msg="loaded runners" count=1
time=2026-04-10T13:38:07.058+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:38:07.058+05:30 level=INFO msg=\"starting mlx runner\" model=x/flux2-klein:latest port=53791 mode=imagegen"
time=2026-04-10T13:38:07.059+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:38:07.058+05:30 level=ERROR msg=\"unable to initialize MLX\" error=\"failed to initialize MLX: libmlxc.dylib not found\""
time=2026-04-10T13:38:07.059+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="Error: failed to initialize MLX: libmlxc.dylib not found"
time=2026-04-10T13:38:07.059+05:30 level=ERROR source=sched.go:567 msg="error loading llama server" error="mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)"
time=2026-04-10T13:38:07.059+05:30 level=INFO source=server.go:363 msg="stopping mlx runner subprocess" pid=18983
[GIN] 2026/04/10 - 13:38:07 | 500 |     61.4045ms |       127.0.0.1 | POST     "/api/generate"
[GIN] 2026/04/10 - 13:38:08 | 200 |      58.917µs |       127.0.0.1 | HEAD     "/"
[GIN] 2026/04/10 - 13:38:08 | 200 |   55.581583ms |       127.0.0.1 | POST     "/api/show"
time=2026-04-10T13:38:12.061+05:30 level=INFO source=sched.go:484 msg="system memory" total="16.0 GiB" free="6.3 GiB" free_swap="0 B"
time=2026-04-10T13:38:12.061+05:30 level=INFO source=sched.go:491 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B"
time=2026-04-10T13:38:12.071+05:30 level=INFO source=server.go:171 msg="starting mlx runner subprocess" model=x/flux2-klein:latest port=53793
time=2026-04-10T13:38:12.076+05:30 level=INFO source=sched.go:561 msg="loaded runners" count=1
time=2026-04-10T13:38:12.109+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:38:12.109+05:30 level=INFO msg=\"starting mlx runner\" model=x/flux2-klein:latest port=53793 mode=imagegen"
time=2026-04-10T13:38:12.109+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:38:12.109+05:30 level=ERROR msg=\"unable to initialize MLX\" error=\"failed to initialize MLX: libmlxc.dylib not found\""
time=2026-04-10T13:38:12.109+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="Error: failed to initialize MLX: libmlxc.dylib not found"
time=2026-04-10T13:38:12.110+05:30 level=ERROR source=sched.go:567 msg="error loading llama server" error="mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)"
time=2026-04-10T13:38:12.110+05:30 level=INFO source=server.go:363 msg="stopping mlx runner subprocess" pid=19000
[GIN] 2026/04/10 - 13:38:12 | 500 |  3.574317875s |       127.0.0.1 | POST     "/api/generate"
[GIN] 2026/04/10 - 13:38:25 | 200 |      49.625µs |       127.0.0.1 | HEAD     "/"
[GIN] 2026/04/10 - 13:38:25 | 200 |   54.107125ms |       127.0.0.1 | POST     "/api/show"
time=2026-04-10T13:38:26.005+05:30 level=INFO source=sched.go:484 msg="system memory" total="16.0 GiB" free="6.3 GiB" free_swap="0 B"
time=2026-04-10T13:38:26.005+05:30 level=INFO source=sched.go:491 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B"
time=2026-04-10T13:38:26.007+05:30 level=INFO source=server.go:171 msg="starting mlx runner subprocess" model=x/flux2-klein:latest port=53795
time=2026-04-10T13:38:26.008+05:30 level=INFO source=sched.go:561 msg="loaded runners" count=1
time=2026-04-10T13:38:26.021+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:38:26.021+05:30 level=INFO msg=\"starting mlx runner\" model=x/flux2-klein:latest port=53795 mode=imagegen"
time=2026-04-10T13:38:26.021+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:38:26.021+05:30 level=ERROR msg=\"unable to initialize MLX\" error=\"failed to initialize MLX: libmlxc.dylib not found\""
time=2026-04-10T13:38:26.021+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="Error: failed to initialize MLX: libmlxc.dylib not found"
time=2026-04-10T13:38:26.022+05:30 level=ERROR source=sched.go:567 msg="error loading llama server" error="mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)"
time=2026-04-10T13:38:26.022+05:30 level=INFO source=server.go:363 msg="stopping mlx runner subprocess" pid=19017
[GIN] 2026/04/10 - 13:38:26 | 500 |   58.961458ms |       127.0.0.1 | POST     "/api/generate"
[GIN] 2026/04/10 - 13:40:24 | 200 |      88.625µs |       127.0.0.1 | GET      "/api/version"
[GIN] 2026/04/10 - 13:40:32 | 200 |      38.375µs |       127.0.0.1 | GET      "/api/version"
[GIN] 2026/04/10 - 13:40:32 | 200 |      12.076ms |       127.0.0.1 | GET      "/api/tags"
[GIN] 2026/04/10 - 13:40:32 | 200 |   40.718708ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:40:32 | 200 |    338.9075ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:40:32 | 200 |  137.987458ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:40:33 | 200 |     194.342ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:40:33 | 200 |   13.212334ms |       127.0.0.1 | POST     "/api/show"
[GIN] 2026/04/10 - 13:41:12 | 200 |      60.167µs |       127.0.0.1 | HEAD     "/"
[GIN] 2026/04/10 - 13:41:12 | 200 |     56.2805ms |       127.0.0.1 | POST     "/api/show"
time=2026-04-10T13:41:12.940+05:30 level=INFO source=sched.go:484 msg="system memory" total="16.0 GiB" free="5.8 GiB" free_swap="0 B"
time=2026-04-10T13:41:12.940+05:30 level=INFO source=sched.go:491 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B"
time=2026-04-10T13:41:12.942+05:30 level=INFO source=server.go:171 msg="starting mlx runner subprocess" model=x/flux2-klein:latest port=53866
time=2026-04-10T13:41:12.943+05:30 level=INFO source=sched.go:561 msg="loaded runners" count=1
time=2026-04-10T13:41:12.956+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:41:12.955+05:30 level=INFO msg=\"starting mlx runner\" model=x/flux2-klein:latest port=53866 mode=imagegen"
time=2026-04-10T13:41:12.956+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:41:12.956+05:30 level=ERROR msg=\"unable to initialize MLX\" error=\"failed to initialize MLX: libmlxc.dylib not found\""
time=2026-04-10T13:41:12.956+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="Error: failed to initialize MLX: libmlxc.dylib not found"
time=2026-04-10T13:41:12.956+05:30 level=ERROR source=sched.go:567 msg="error loading llama server" error="mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)"
time=2026-04-10T13:41:12.956+05:30 level=INFO source=server.go:363 msg="stopping mlx runner subprocess" pid=20060
[GIN] 2026/04/10 - 13:41:12 | 500 |   57.925375ms |       127.0.0.1 | POST     "/api/generate"
[GIN] 2026/04/10 - 13:41:51 | 200 |      33.917µs |       127.0.0.1 | HEAD     "/"
[GIN] 2026/04/10 - 13:41:51 | 200 |     55.2735ms |       127.0.0.1 | POST     "/api/show"
time=2026-04-10T13:41:51.260+05:30 level=INFO source=sched.go:484 msg="system memory" total="16.0 GiB" free="5.8 GiB" free_swap="0 B"
time=2026-04-10T13:41:51.260+05:30 level=INFO source=sched.go:491 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B"
time=2026-04-10T13:41:51.262+05:30 level=INFO source=server.go:171 msg="starting mlx runner subprocess" model=x/flux2-klein:latest port=53893
time=2026-04-10T13:41:51.264+05:30 level=INFO source=sched.go:561 msg="loaded runners" count=1
time=2026-04-10T13:41:51.277+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:41:51.277+05:30 level=INFO msg=\"starting mlx runner\" model=x/flux2-klein:latest port=53893 mode=imagegen"
time=2026-04-10T13:41:51.277+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:41:51.277+05:30 level=ERROR msg=\"unable to initialize MLX\" error=\"failed to initialize MLX: libmlxc.dylib not found\""
time=2026-04-10T13:41:51.277+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="Error: failed to initialize MLX: libmlxc.dylib not found"
time=2026-04-10T13:41:51.278+05:30 level=ERROR source=sched.go:567 msg="error loading llama server" error="mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)"
time=2026-04-10T13:41:51.278+05:30 level=INFO source=server.go:363 msg="stopping mlx runner subprocess" pid=20093
[GIN] 2026/04/10 - 13:41:51 | 500 |   59.807375ms |       127.0.0.1 | POST     "/api/generate"

OS

macOS

GPU

Apple

CPU

Apple

Ollama version

0.20.5

Originally created by @milindmore22 on GitHub (Apr 10, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/15471 ### What is the issue? ## Description When attempting to run the `x/flux2-klein` model, Ollama fails with an MLX initialization error stating that `libmlxc.dylib` cannot be found. ## Error Message ``` Error: 500 Internal Server Error: mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1) ``` ## Steps to Reproduce 1. Run the command: `ollama run x/flux2-klein "A cat holding sign say Hello World"` 2. Error occurs immediately during model initialization ## Expected Behavior The model should either: - Initialize successfully if MLX dependencies are properly bundled/installed - Provide a clear error message with instructions on how to install MLX dependencies - Fall back to a non-MLX backend if available ## Actual Behavior The model fails to run with a 500 Internal Server Error, and the MLX library cannot be found. ### Relevant log output ```shell time=2026-04-10T13:19:17.037+05:30 level=INFO source=routes.go:1752 msg="server config" env="map[HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:0 OLLAMA_DEBUG:INFO OLLAMA_DEBUG_LOG_REQUESTS:false OLLAMA_EDITOR: OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/Users/milind/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NO_CLOUD:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_REMOTES:[ollama.com] OLLAMA_SCHED_SPREAD:false http_proxy: https_proxy: no_proxy:]" time=2026-04-10T13:19:17.038+05:30 level=INFO source=routes.go:1754 msg="Ollama cloud disabled: false" time=2026-04-10T13:19:17.072+05:30 level=INFO source=images.go:499 msg="total blobs: 1553" time=2026-04-10T13:19:17.075+05:30 level=INFO source=images.go:506 msg="total unused blobs removed: 0" time=2026-04-10T13:19:17.076+05:30 level=INFO source=routes.go:1810 msg="Listening on 127.0.0.1:11434 (version 0.20.5)" time=2026-04-10T13:19:17.076+05:30 level=INFO source=runner.go:67 msg="discovering available GPUs..." time=2026-04-10T13:19:17.078+05:30 level=INFO source=server.go:444 msg="starting runner" cmd="/Applications/Ollama.app/Contents/Resources/ollama runner --ollama-engine --port 52713" time=2026-04-10T13:19:17.231+05:30 level=INFO source=types.go:42 msg="inference compute" id=0 filter_id=0 library=Metal compute=0.0 name=Metal description="Apple M3" libdirs="" driver=0.0 pci_id="" type=discrete total="11.8 GiB" available="11.8 GiB" time=2026-04-10T13:19:17.231+05:30 level=INFO source=routes.go:1860 msg="vram-based default context" total_vram="11.8 GiB" default_num_ctx=4096 [GIN] 2026/04/10 - 13:19:17 | 200 | 111.166µs | 127.0.0.1 | GET "/api/version" [GIN] 2026/04/10 - 13:19:17 | 200 | 104.75µs | 127.0.0.1 | HEAD "/" [GIN] 2026/04/10 - 13:19:17 | 200 | 56.171209ms | 127.0.0.1 | POST "/api/show" time=2026-04-10T13:19:17.556+05:30 level=INFO source=sched.go:484 msg="system memory" total="16.0 GiB" free="6.2 GiB" free_swap="0 B" time=2026-04-10T13:19:17.556+05:30 level=INFO source=sched.go:491 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B" time=2026-04-10T13:19:17.558+05:30 level=INFO source=server.go:171 msg="starting mlx runner subprocess" model=x/flux2-klein:latest port=52720 time=2026-04-10T13:19:17.559+05:30 level=INFO source=sched.go:561 msg="loaded runners" count=1 time=2026-04-10T13:19:17.572+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:19:17.572+05:30 level=INFO msg=\"starting mlx runner\" model=x/flux2-klein:latest port=52720 mode=imagegen" time=2026-04-10T13:19:17.572+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:19:17.572+05:30 level=ERROR msg=\"unable to initialize MLX\" error=\"failed to initialize MLX: libmlxc.dylib not found\"" time=2026-04-10T13:19:17.572+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="Error: failed to initialize MLX: libmlxc.dylib not found" time=2026-04-10T13:19:17.574+05:30 level=ERROR source=sched.go:567 msg="error loading llama server" error="mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)" time=2026-04-10T13:19:17.574+05:30 level=INFO source=server.go:363 msg="stopping mlx runner subprocess" pid=16585 [GIN] 2026/04/10 - 13:19:17 | 500 | 59.76075ms | 127.0.0.1 | POST "/api/generate" [GIN] 2026/04/10 - 13:30:42 | 200 | 54.625µs | 127.0.0.1 | HEAD "/" [GIN] 2026/04/10 - 13:30:42 | 200 | 14.755917ms | 127.0.0.1 | GET "/api/tags" [GIN] 2026/04/10 - 13:31:52 | 200 | 36.25µs | 127.0.0.1 | HEAD "/" [GIN] 2026/04/10 - 13:31:52 | 200 | 51.950833ms | 127.0.0.1 | POST "/api/show" time=2026-04-10T13:31:52.923+05:30 level=INFO source=sched.go:484 msg="system memory" total="16.0 GiB" free="7.1 GiB" free_swap="0 B" time=2026-04-10T13:31:52.923+05:30 level=INFO source=sched.go:491 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B" time=2026-04-10T13:31:52.925+05:30 level=INFO source=server.go:171 msg="starting mlx runner subprocess" model=x/flux2-klein:latest port=53670 time=2026-04-10T13:31:52.926+05:30 level=INFO source=sched.go:561 msg="loaded runners" count=1 time=2026-04-10T13:31:52.939+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:31:52.939+05:30 level=INFO msg=\"starting mlx runner\" model=x/flux2-klein:latest port=53670 mode=imagegen" time=2026-04-10T13:31:52.939+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:31:52.939+05:30 level=ERROR msg=\"unable to initialize MLX\" error=\"failed to initialize MLX: libmlxc.dylib not found\"" time=2026-04-10T13:31:52.939+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="Error: failed to initialize MLX: libmlxc.dylib not found" time=2026-04-10T13:31:52.940+05:30 level=ERROR source=sched.go:567 msg="error loading llama server" error="mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)" time=2026-04-10T13:31:52.940+05:30 level=INFO source=server.go:363 msg="stopping mlx runner subprocess" pid=16785 [GIN] 2026/04/10 - 13:31:52 | 500 | 59.3245ms | 127.0.0.1 | POST "/api/generate" [GIN] 2026/04/10 - 13:32:21 | 200 | 35.75µs | 127.0.0.1 | GET "/api/version" [GIN] 2026/04/10 - 13:32:21 | 200 | 9.848208ms | 127.0.0.1 | GET "/api/tags" [GIN] 2026/04/10 - 13:32:21 | 200 | 640.730416ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:32:21 | 200 | 169.29725ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:32:22 | 200 | 149.339042ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:32:22 | 200 | 23.185834ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:32:22 | 200 | 12.321875ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:32:34 | 200 | 19.792µs | 127.0.0.1 | GET "/api/version" [GIN] 2026/04/10 - 13:32:34 | 200 | 6.410292ms | 127.0.0.1 | GET "/api/tags" [GIN] 2026/04/10 - 13:32:34 | 200 | 298.730542ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:32:35 | 200 | 189.360375ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:32:35 | 200 | 260.477666ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:32:35 | 200 | 39.996916ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:32:35 | 200 | 19.488292ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:37:19 | 200 | 54.334µs | 127.0.0.1 | HEAD "/" [GIN] 2026/04/10 - 13:37:19 | 404 | 11.906208ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:37:20 | 200 | 1.010746s | 127.0.0.1 | POST "/api/pull" [GIN] 2026/04/10 - 13:37:59 | 200 | 45µs | 127.0.0.1 | HEAD "/" [GIN] 2026/04/10 - 13:38:01 | 200 | 2.342140584s | 127.0.0.1 | POST "/api/pull" [GIN] 2026/04/10 - 13:38:06 | 200 | 45.917µs | 127.0.0.1 | HEAD "/" [GIN] 2026/04/10 - 13:38:06 | 200 | 51.52325ms | 127.0.0.1 | POST "/api/show" time=2026-04-10T13:38:07.041+05:30 level=INFO source=sched.go:484 msg="system memory" total="16.0 GiB" free="6.3 GiB" free_swap="0 B" time=2026-04-10T13:38:07.041+05:30 level=INFO source=sched.go:491 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B" time=2026-04-10T13:38:07.044+05:30 level=INFO source=server.go:171 msg="starting mlx runner subprocess" model=x/flux2-klein:latest port=53791 time=2026-04-10T13:38:07.045+05:30 level=INFO source=sched.go:561 msg="loaded runners" count=1 time=2026-04-10T13:38:07.058+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:38:07.058+05:30 level=INFO msg=\"starting mlx runner\" model=x/flux2-klein:latest port=53791 mode=imagegen" time=2026-04-10T13:38:07.059+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:38:07.058+05:30 level=ERROR msg=\"unable to initialize MLX\" error=\"failed to initialize MLX: libmlxc.dylib not found\"" time=2026-04-10T13:38:07.059+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="Error: failed to initialize MLX: libmlxc.dylib not found" time=2026-04-10T13:38:07.059+05:30 level=ERROR source=sched.go:567 msg="error loading llama server" error="mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)" time=2026-04-10T13:38:07.059+05:30 level=INFO source=server.go:363 msg="stopping mlx runner subprocess" pid=18983 [GIN] 2026/04/10 - 13:38:07 | 500 | 61.4045ms | 127.0.0.1 | POST "/api/generate" [GIN] 2026/04/10 - 13:38:08 | 200 | 58.917µs | 127.0.0.1 | HEAD "/" [GIN] 2026/04/10 - 13:38:08 | 200 | 55.581583ms | 127.0.0.1 | POST "/api/show" time=2026-04-10T13:38:12.061+05:30 level=INFO source=sched.go:484 msg="system memory" total="16.0 GiB" free="6.3 GiB" free_swap="0 B" time=2026-04-10T13:38:12.061+05:30 level=INFO source=sched.go:491 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B" time=2026-04-10T13:38:12.071+05:30 level=INFO source=server.go:171 msg="starting mlx runner subprocess" model=x/flux2-klein:latest port=53793 time=2026-04-10T13:38:12.076+05:30 level=INFO source=sched.go:561 msg="loaded runners" count=1 time=2026-04-10T13:38:12.109+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:38:12.109+05:30 level=INFO msg=\"starting mlx runner\" model=x/flux2-klein:latest port=53793 mode=imagegen" time=2026-04-10T13:38:12.109+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:38:12.109+05:30 level=ERROR msg=\"unable to initialize MLX\" error=\"failed to initialize MLX: libmlxc.dylib not found\"" time=2026-04-10T13:38:12.109+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="Error: failed to initialize MLX: libmlxc.dylib not found" time=2026-04-10T13:38:12.110+05:30 level=ERROR source=sched.go:567 msg="error loading llama server" error="mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)" time=2026-04-10T13:38:12.110+05:30 level=INFO source=server.go:363 msg="stopping mlx runner subprocess" pid=19000 [GIN] 2026/04/10 - 13:38:12 | 500 | 3.574317875s | 127.0.0.1 | POST "/api/generate" [GIN] 2026/04/10 - 13:38:25 | 200 | 49.625µs | 127.0.0.1 | HEAD "/" [GIN] 2026/04/10 - 13:38:25 | 200 | 54.107125ms | 127.0.0.1 | POST "/api/show" time=2026-04-10T13:38:26.005+05:30 level=INFO source=sched.go:484 msg="system memory" total="16.0 GiB" free="6.3 GiB" free_swap="0 B" time=2026-04-10T13:38:26.005+05:30 level=INFO source=sched.go:491 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B" time=2026-04-10T13:38:26.007+05:30 level=INFO source=server.go:171 msg="starting mlx runner subprocess" model=x/flux2-klein:latest port=53795 time=2026-04-10T13:38:26.008+05:30 level=INFO source=sched.go:561 msg="loaded runners" count=1 time=2026-04-10T13:38:26.021+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:38:26.021+05:30 level=INFO msg=\"starting mlx runner\" model=x/flux2-klein:latest port=53795 mode=imagegen" time=2026-04-10T13:38:26.021+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:38:26.021+05:30 level=ERROR msg=\"unable to initialize MLX\" error=\"failed to initialize MLX: libmlxc.dylib not found\"" time=2026-04-10T13:38:26.021+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="Error: failed to initialize MLX: libmlxc.dylib not found" time=2026-04-10T13:38:26.022+05:30 level=ERROR source=sched.go:567 msg="error loading llama server" error="mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)" time=2026-04-10T13:38:26.022+05:30 level=INFO source=server.go:363 msg="stopping mlx runner subprocess" pid=19017 [GIN] 2026/04/10 - 13:38:26 | 500 | 58.961458ms | 127.0.0.1 | POST "/api/generate" [GIN] 2026/04/10 - 13:40:24 | 200 | 88.625µs | 127.0.0.1 | GET "/api/version" [GIN] 2026/04/10 - 13:40:32 | 200 | 38.375µs | 127.0.0.1 | GET "/api/version" [GIN] 2026/04/10 - 13:40:32 | 200 | 12.076ms | 127.0.0.1 | GET "/api/tags" [GIN] 2026/04/10 - 13:40:32 | 200 | 40.718708ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:40:32 | 200 | 338.9075ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:40:32 | 200 | 137.987458ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:40:33 | 200 | 194.342ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:40:33 | 200 | 13.212334ms | 127.0.0.1 | POST "/api/show" [GIN] 2026/04/10 - 13:41:12 | 200 | 60.167µs | 127.0.0.1 | HEAD "/" [GIN] 2026/04/10 - 13:41:12 | 200 | 56.2805ms | 127.0.0.1 | POST "/api/show" time=2026-04-10T13:41:12.940+05:30 level=INFO source=sched.go:484 msg="system memory" total="16.0 GiB" free="5.8 GiB" free_swap="0 B" time=2026-04-10T13:41:12.940+05:30 level=INFO source=sched.go:491 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B" time=2026-04-10T13:41:12.942+05:30 level=INFO source=server.go:171 msg="starting mlx runner subprocess" model=x/flux2-klein:latest port=53866 time=2026-04-10T13:41:12.943+05:30 level=INFO source=sched.go:561 msg="loaded runners" count=1 time=2026-04-10T13:41:12.956+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:41:12.955+05:30 level=INFO msg=\"starting mlx runner\" model=x/flux2-klein:latest port=53866 mode=imagegen" time=2026-04-10T13:41:12.956+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:41:12.956+05:30 level=ERROR msg=\"unable to initialize MLX\" error=\"failed to initialize MLX: libmlxc.dylib not found\"" time=2026-04-10T13:41:12.956+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="Error: failed to initialize MLX: libmlxc.dylib not found" time=2026-04-10T13:41:12.956+05:30 level=ERROR source=sched.go:567 msg="error loading llama server" error="mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)" time=2026-04-10T13:41:12.956+05:30 level=INFO source=server.go:363 msg="stopping mlx runner subprocess" pid=20060 [GIN] 2026/04/10 - 13:41:12 | 500 | 57.925375ms | 127.0.0.1 | POST "/api/generate" [GIN] 2026/04/10 - 13:41:51 | 200 | 33.917µs | 127.0.0.1 | HEAD "/" [GIN] 2026/04/10 - 13:41:51 | 200 | 55.2735ms | 127.0.0.1 | POST "/api/show" time=2026-04-10T13:41:51.260+05:30 level=INFO source=sched.go:484 msg="system memory" total="16.0 GiB" free="5.8 GiB" free_swap="0 B" time=2026-04-10T13:41:51.260+05:30 level=INFO source=sched.go:491 msg="gpu memory" id=0 library=Metal available="11.3 GiB" free="11.8 GiB" minimum="512.0 MiB" overhead="0 B" time=2026-04-10T13:41:51.262+05:30 level=INFO source=server.go:171 msg="starting mlx runner subprocess" model=x/flux2-klein:latest port=53893 time=2026-04-10T13:41:51.264+05:30 level=INFO source=sched.go:561 msg="loaded runners" count=1 time=2026-04-10T13:41:51.277+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:41:51.277+05:30 level=INFO msg=\"starting mlx runner\" model=x/flux2-klein:latest port=53893 mode=imagegen" time=2026-04-10T13:41:51.277+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="time=2026-04-10T13:41:51.277+05:30 level=ERROR msg=\"unable to initialize MLX\" error=\"failed to initialize MLX: libmlxc.dylib not found\"" time=2026-04-10T13:41:51.277+05:30 level=WARN source=server.go:164 msg=mlx-runner msg="Error: failed to initialize MLX: libmlxc.dylib not found" time=2026-04-10T13:41:51.278+05:30 level=ERROR source=sched.go:567 msg="error loading llama server" error="mlx runner failed: Error: failed to initialize MLX: libmlxc.dylib not found (exit: exit status 1)" time=2026-04-10T13:41:51.278+05:30 level=INFO source=server.go:363 msg="stopping mlx runner subprocess" pid=20093 [GIN] 2026/04/10 - 13:41:51 | 500 | 59.807375ms | 127.0.0.1 | POST "/api/generate" ``` ### OS macOS ### GPU Apple ### CPU Apple ### Ollama version 0.20.5
GiteaMirror added the bug label 2026-04-12 22:44:43 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#9888