[GH-ISSUE #2327] AMD EOF Model Error #27105

Closed
opened 2026-04-22 04:04:26 -05:00 by GiteaMirror · 13 comments
Owner

Originally created by @jusgrave on GitHub (Feb 2, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/2327

I been having issues trying to get Ollama running when i run a model Im get a EOF error and invaild pointer

Feb 02 07:53:39 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:39 payload_common.go:106: INFO Extracting d>
Feb 02 07:53:41 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:41 payload_common.go:145: INFO Dynamic LLM >
Feb 02 07:53:41 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:41 gpu.go:94: INFO Detecting GPU type
Feb 02 07:53:41 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:41 gpu.go:236: INFO Searching for GPU manag>
Feb 02 07:53:41 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:41 gpu.go:282: INFO Discovered GPU librarie>
Feb 02 07:53:41 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:41 gpu.go:236: INFO Searching for GPU manag>
Feb 02 07:53:41 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:41 gpu.go:282: INFO Discovered GPU librarie>
Feb 02 07:53:41 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:41 gpu.go:109: INFO Radeon GPU detected
Feb 02 07:57:16 justin-ArchEndos systemd[1]: Stopping Ollama Service...
Feb 02 07:57:16 justin-ArchEndos systemd[1]: ollama.service: Deactivated successfully.
Feb 02 07:57:16 justin-ArchEndos systemd[1]: Stopped Ollama Service.
Feb 02 07:57:16 justin-ArchEndos systemd[1]: ollama.service: Consumed 3.370s CPU time, 469.4M memory peak, 0>
Feb 02 07:57:16 justin-ArchEndos systemd[1]: Started Ollama Service.
Feb 02 07:57:16 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:16 images.go:857: INFO total blobs: 6
Feb 02 07:57:16 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:16 images.go:864: INFO total unused blobs r>
Feb 02 07:57:16 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:16 routes.go:950: INFO Listening on 127.0.0>
Feb 02 07:57:16 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:16 payload_common.go:106: INFO Extracting d>
Feb 02 07:57:18 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:18 payload_common.go:145: INFO Dynamic LLM >
Feb 02 07:57:18 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:18 gpu.go:94: INFO Detecting GPU type
Feb 02 07:57:18 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:18 gpu.go:236: INFO Searching for GPU manag>
Feb 02 07:57:18 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:18 gpu.go:282: INFO Discovered GPU librarie>
Feb 02 07:57:18 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:18 gpu.go:236: INFO Searching for GPU manag>
Feb 02 07:57:18 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:18 gpu.go:282: INFO Discovered GPU librarie>
Feb 02 07:57:18 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:18 gpu.go:109: INFO Radeon GPU detected
Feb 02 07:57:52 justin-ArchEndos ollama[50808]: [GIN] 2024/02/02 - 07:57:52 | 200 |      20.589µs |       12>
Feb 02 07:57:52 justin-ArchEndos ollama[50808]: [GIN] 2024/02/02 - 07:57:52 | 200 |     304.326µs |       12>
Feb 02 07:58:02 justin-ArchEndos ollama[50808]: [GIN] 2024/02/02 - 07:58:02 | 200 |      12.744µs |       12>
Feb 02 07:58:02 justin-ArchEndos ollama[50808]: [GIN] 2024/02/02 - 07:58:02 | 200 |      353.62µs |       12>
Feb 02 07:58:02 justin-ArchEndos ollama[50808]: [GIN] 2024/02/02 - 07:58:02 | 200 |     190.992µs |       12>
Feb 02 07:58:02 justin-ArchEndos ollama[50808]: 2024/02/02 07:58:02 cpu_common.go:11: INFO CPU has AVX2
Feb 02 07:58:02 justin-ArchEndos ollama[50808]: 2024/02/02 07:58:02 dyn_ext_server.go:90: INFO Loading Dynam>
Feb 02 07:58:02 justin-ArchEndos ollama[50808]: 2024/02/02 07:58:02 dyn_ext_server.go:145: INFO Initializing>
Feb 02 07:58:02 justin-ArchEndos ollama[50808]: free(): invalid pointer
Feb 02 07:58:04 justin-ArchEndos systemd[1]: ollama.service: Main process exited, code=dumped, status=6/ABRT
Feb 02 07:58:04 justin-ArchEndos systemd[1]: ollama.service: Failed with result 'core-dump'.
Feb 02 07:58:04 justin-ArchEndos systemd[1]: ollama.service: Consumed 4.134s CPU time.
Feb 02 07:58:07 justin-ArchEndos systemd[1]: ollama.service: Scheduled restart job, restart counter is at 1.
Feb 02 07:58:07 justin-ArchEndos systemd[1]: Started Ollama Service.
Feb 02 07:58:07 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:07 images.go:857: INFO total blobs: 6
Feb 02 07:58:07 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:07 images.go:864: INFO total unused blobs r>
Feb 02 07:58:07 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:07 routes.go:950: INFO Listening on 127.0.0>
Feb 02 07:58:07 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:07 payload_common.go:106: INFO Extracting d>
Feb 02 07:58:09 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:09 payload_common.go:145: INFO Dynamic LLM >
Feb 02 07:58:09 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:09 gpu.go:94: INFO Detecting GPU type
Feb 02 07:58:09 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:09 gpu.go:236: INFO Searching for GPU manag>
Feb 02 07:58:09 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:09 gpu.go:282: INFO Discovered GPU librarie>
Feb 02 07:58:09 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:09 gpu.go:236: INFO Searching for GPU manag>
Feb 02 07:58:09 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:09 gpu.go:282: INFO Discovered GPU librarie>
Feb 02 07:58:09 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:09 gpu.go:109: INFO Radeon GPU detected
Feb 02 07:58:09 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 07:58:09 | 404 |       2.615µs |       12>
Feb 02 08:00:40 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:00:40 | 200 |      28.915µs |       12>
Feb 02 08:00:40 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:00:40 | 200 |   55.099782ms |       12>
Feb 02 08:00:49 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:00:49 | 200 |       16.02µs |       12>
Feb 02 08:00:49 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:00:49 | 200 |     126.881µs |       12>
Feb 02 08:00:59 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:00:59 | 200 |      14.598µs |       12>
Feb 02 08:00:59 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:00:59 | 404 |      69.532µs |       12>
Feb 02 08:01:05 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:01:05 | 200 |      15.961µs |       12>
Feb 02 08:01:05 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:01:05 | 404 |      80.633µs |       12>
Feb 02 08:01:07 justin-ArchEndos ollama[51400]: 2024/02/02 08:01:07 download.go:123: INFO downloading e8a35b>
Feb 02 08:01:31 justin-ArchEndos ollama[51400]: 2024/02/02 08:01:31 images.go:1187: INFO request failed: Get>
Feb 02 08:01:31 justin-ArchEndos ollama[51400]: 2024/02/02 08:01:31 download.go:162: INFO e8a35b5937a5 part >
Feb 02 08:01:31 justin-ArchEndos ollama[51400]: 2024/02/02 08:01:31 images.go:1187: INFO request failed: Get>
Feb 02 08:01:31 justin-ArchEndos ollama[51400]: 2024/02/02 08:01:31 download.go:162: INFO e8a35b5937a5 part >
Feb 02 08:01:33 justin-ArchEndos ollama[51400]: 2024/02/02 08:01:33 images.go:1187: INFO request failed: Get>
Feb 02 08:01:33 justin-ArchEndos ollama[51400]: 2024/02/02 08:01:33 download.go:162: INFO e8a35b5937a5 part >
Feb 02 08:02:39 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:39 download.go:162: INFO e8a35b5937a5 part >
Feb 02 08:02:44 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:44 download.go:123: INFO downloading 43070e>
Feb 02 08:02:46 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:46 download.go:123: INFO downloading e68360>
Feb 02 08:02:48 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:48 download.go:123: INFO downloading ed11ed>
Feb 02 08:02:50 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:50 download.go:123: INFO downloading f9b1e3>
Feb 02 08:02:54 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:02:54 | 200 |         1m49s |       12>
Feb 02 08:02:54 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:02:54 | 200 |     298.176µs |       12>
Feb 02 08:02:55 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:55 cpu_common.go:11: INFO CPU has AVX2
Feb 02 08:02:55 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:55 dyn_ext_server.go:90: INFO Loading Dynam>
Feb 02 08:02:55 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:55 dyn_ext_server.go:145: INFO Initializing>
Feb 02 08:02:55 justin-ArchEndos ollama[51400]: free(): invalid pointer
Feb 02 08:02:57 justin-ArchEndos systemd[1]: ollama.service: Main process exited, code=dumped, status=6/ABRT
Feb 02 08:02:57 justin-ArchEndos systemd[1]: ollama.service: Failed with result 'core-dump'.
Feb 02 08:02:57 justin-ArchEndos systemd[1]: ollama.service: Consumed 15.602s CPU time.
Feb 02 08:03:00 justin-ArchEndos systemd[1]: ollama.service: Scheduled restart job, restart counter is at 2.
Feb 02 08:03:00 justin-ArchEndos systemd[1]: Started Ollama Service.
Feb 02 08:03:01 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:01 images.go:857: INFO total blobs: 5
Feb 02 08:03:01 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:01 images.go:864: INFO total unused blobs r>
Feb 02 08:03:01 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:01 routes.go:950: INFO Listening on 127.0.0>
Feb 02 08:03:01 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:01 payload_common.go:106: INFO Extracting d>
Feb 02 08:03:03 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:03 payload_common.go:145: INFO Dynamic LLM >
Feb 02 08:03:03 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:03 gpu.go:94: INFO Detecting GPU type
Feb 02 08:03:03 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:03 gpu.go:236: INFO Searching for GPU manag>
Feb 02 08:03:03 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:03 gpu.go:282: INFO Discovered GPU librarie>
Feb 02 08:03:03 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:03 gpu.go:236: INFO Searching for GPU manag>
Feb 02 08:03:03 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:03 gpu.go:282: INFO Discovered GPU librarie>
Feb 02 08:03:03 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:03 gpu.go:109: INFO Radeon GPU detected
Originally created by @jusgrave on GitHub (Feb 2, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/2327 I been having issues trying to get Ollama running when i run a model Im get a EOF error and invaild pointer ``` Feb 02 07:53:39 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:39 payload_common.go:106: INFO Extracting d> Feb 02 07:53:41 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:41 payload_common.go:145: INFO Dynamic LLM > Feb 02 07:53:41 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:41 gpu.go:94: INFO Detecting GPU type Feb 02 07:53:41 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:41 gpu.go:236: INFO Searching for GPU manag> Feb 02 07:53:41 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:41 gpu.go:282: INFO Discovered GPU librarie> Feb 02 07:53:41 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:41 gpu.go:236: INFO Searching for GPU manag> Feb 02 07:53:41 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:41 gpu.go:282: INFO Discovered GPU librarie> Feb 02 07:53:41 justin-ArchEndos ollama[48332]: 2024/02/02 07:53:41 gpu.go:109: INFO Radeon GPU detected Feb 02 07:57:16 justin-ArchEndos systemd[1]: Stopping Ollama Service... Feb 02 07:57:16 justin-ArchEndos systemd[1]: ollama.service: Deactivated successfully. Feb 02 07:57:16 justin-ArchEndos systemd[1]: Stopped Ollama Service. Feb 02 07:57:16 justin-ArchEndos systemd[1]: ollama.service: Consumed 3.370s CPU time, 469.4M memory peak, 0> Feb 02 07:57:16 justin-ArchEndos systemd[1]: Started Ollama Service. Feb 02 07:57:16 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:16 images.go:857: INFO total blobs: 6 Feb 02 07:57:16 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:16 images.go:864: INFO total unused blobs r> Feb 02 07:57:16 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:16 routes.go:950: INFO Listening on 127.0.0> Feb 02 07:57:16 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:16 payload_common.go:106: INFO Extracting d> Feb 02 07:57:18 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:18 payload_common.go:145: INFO Dynamic LLM > Feb 02 07:57:18 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:18 gpu.go:94: INFO Detecting GPU type Feb 02 07:57:18 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:18 gpu.go:236: INFO Searching for GPU manag> Feb 02 07:57:18 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:18 gpu.go:282: INFO Discovered GPU librarie> Feb 02 07:57:18 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:18 gpu.go:236: INFO Searching for GPU manag> Feb 02 07:57:18 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:18 gpu.go:282: INFO Discovered GPU librarie> Feb 02 07:57:18 justin-ArchEndos ollama[50808]: 2024/02/02 07:57:18 gpu.go:109: INFO Radeon GPU detected Feb 02 07:57:52 justin-ArchEndos ollama[50808]: [GIN] 2024/02/02 - 07:57:52 | 200 | 20.589µs | 12> Feb 02 07:57:52 justin-ArchEndos ollama[50808]: [GIN] 2024/02/02 - 07:57:52 | 200 | 304.326µs | 12> Feb 02 07:58:02 justin-ArchEndos ollama[50808]: [GIN] 2024/02/02 - 07:58:02 | 200 | 12.744µs | 12> Feb 02 07:58:02 justin-ArchEndos ollama[50808]: [GIN] 2024/02/02 - 07:58:02 | 200 | 353.62µs | 12> Feb 02 07:58:02 justin-ArchEndos ollama[50808]: [GIN] 2024/02/02 - 07:58:02 | 200 | 190.992µs | 12> Feb 02 07:58:02 justin-ArchEndos ollama[50808]: 2024/02/02 07:58:02 cpu_common.go:11: INFO CPU has AVX2 Feb 02 07:58:02 justin-ArchEndos ollama[50808]: 2024/02/02 07:58:02 dyn_ext_server.go:90: INFO Loading Dynam> Feb 02 07:58:02 justin-ArchEndos ollama[50808]: 2024/02/02 07:58:02 dyn_ext_server.go:145: INFO Initializing> Feb 02 07:58:02 justin-ArchEndos ollama[50808]: free(): invalid pointer Feb 02 07:58:04 justin-ArchEndos systemd[1]: ollama.service: Main process exited, code=dumped, status=6/ABRT Feb 02 07:58:04 justin-ArchEndos systemd[1]: ollama.service: Failed with result 'core-dump'. Feb 02 07:58:04 justin-ArchEndos systemd[1]: ollama.service: Consumed 4.134s CPU time. Feb 02 07:58:07 justin-ArchEndos systemd[1]: ollama.service: Scheduled restart job, restart counter is at 1. Feb 02 07:58:07 justin-ArchEndos systemd[1]: Started Ollama Service. Feb 02 07:58:07 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:07 images.go:857: INFO total blobs: 6 Feb 02 07:58:07 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:07 images.go:864: INFO total unused blobs r> Feb 02 07:58:07 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:07 routes.go:950: INFO Listening on 127.0.0> Feb 02 07:58:07 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:07 payload_common.go:106: INFO Extracting d> Feb 02 07:58:09 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:09 payload_common.go:145: INFO Dynamic LLM > Feb 02 07:58:09 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:09 gpu.go:94: INFO Detecting GPU type Feb 02 07:58:09 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:09 gpu.go:236: INFO Searching for GPU manag> Feb 02 07:58:09 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:09 gpu.go:282: INFO Discovered GPU librarie> Feb 02 07:58:09 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:09 gpu.go:236: INFO Searching for GPU manag> Feb 02 07:58:09 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:09 gpu.go:282: INFO Discovered GPU librarie> Feb 02 07:58:09 justin-ArchEndos ollama[51400]: 2024/02/02 07:58:09 gpu.go:109: INFO Radeon GPU detected Feb 02 07:58:09 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 07:58:09 | 404 | 2.615µs | 12> Feb 02 08:00:40 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:00:40 | 200 | 28.915µs | 12> Feb 02 08:00:40 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:00:40 | 200 | 55.099782ms | 12> Feb 02 08:00:49 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:00:49 | 200 | 16.02µs | 12> Feb 02 08:00:49 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:00:49 | 200 | 126.881µs | 12> Feb 02 08:00:59 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:00:59 | 200 | 14.598µs | 12> Feb 02 08:00:59 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:00:59 | 404 | 69.532µs | 12> Feb 02 08:01:05 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:01:05 | 200 | 15.961µs | 12> Feb 02 08:01:05 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:01:05 | 404 | 80.633µs | 12> Feb 02 08:01:07 justin-ArchEndos ollama[51400]: 2024/02/02 08:01:07 download.go:123: INFO downloading e8a35b> Feb 02 08:01:31 justin-ArchEndos ollama[51400]: 2024/02/02 08:01:31 images.go:1187: INFO request failed: Get> Feb 02 08:01:31 justin-ArchEndos ollama[51400]: 2024/02/02 08:01:31 download.go:162: INFO e8a35b5937a5 part > Feb 02 08:01:31 justin-ArchEndos ollama[51400]: 2024/02/02 08:01:31 images.go:1187: INFO request failed: Get> Feb 02 08:01:31 justin-ArchEndos ollama[51400]: 2024/02/02 08:01:31 download.go:162: INFO e8a35b5937a5 part > Feb 02 08:01:33 justin-ArchEndos ollama[51400]: 2024/02/02 08:01:33 images.go:1187: INFO request failed: Get> Feb 02 08:01:33 justin-ArchEndos ollama[51400]: 2024/02/02 08:01:33 download.go:162: INFO e8a35b5937a5 part > Feb 02 08:02:39 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:39 download.go:162: INFO e8a35b5937a5 part > Feb 02 08:02:44 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:44 download.go:123: INFO downloading 43070e> Feb 02 08:02:46 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:46 download.go:123: INFO downloading e68360> Feb 02 08:02:48 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:48 download.go:123: INFO downloading ed11ed> Feb 02 08:02:50 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:50 download.go:123: INFO downloading f9b1e3> Feb 02 08:02:54 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:02:54 | 200 | 1m49s | 12> Feb 02 08:02:54 justin-ArchEndos ollama[51400]: [GIN] 2024/02/02 - 08:02:54 | 200 | 298.176µs | 12> Feb 02 08:02:55 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:55 cpu_common.go:11: INFO CPU has AVX2 Feb 02 08:02:55 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:55 dyn_ext_server.go:90: INFO Loading Dynam> Feb 02 08:02:55 justin-ArchEndos ollama[51400]: 2024/02/02 08:02:55 dyn_ext_server.go:145: INFO Initializing> Feb 02 08:02:55 justin-ArchEndos ollama[51400]: free(): invalid pointer Feb 02 08:02:57 justin-ArchEndos systemd[1]: ollama.service: Main process exited, code=dumped, status=6/ABRT Feb 02 08:02:57 justin-ArchEndos systemd[1]: ollama.service: Failed with result 'core-dump'. Feb 02 08:02:57 justin-ArchEndos systemd[1]: ollama.service: Consumed 15.602s CPU time. Feb 02 08:03:00 justin-ArchEndos systemd[1]: ollama.service: Scheduled restart job, restart counter is at 2. Feb 02 08:03:00 justin-ArchEndos systemd[1]: Started Ollama Service. Feb 02 08:03:01 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:01 images.go:857: INFO total blobs: 5 Feb 02 08:03:01 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:01 images.go:864: INFO total unused blobs r> Feb 02 08:03:01 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:01 routes.go:950: INFO Listening on 127.0.0> Feb 02 08:03:01 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:01 payload_common.go:106: INFO Extracting d> Feb 02 08:03:03 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:03 payload_common.go:145: INFO Dynamic LLM > Feb 02 08:03:03 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:03 gpu.go:94: INFO Detecting GPU type Feb 02 08:03:03 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:03 gpu.go:236: INFO Searching for GPU manag> Feb 02 08:03:03 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:03 gpu.go:282: INFO Discovered GPU librarie> Feb 02 08:03:03 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:03 gpu.go:236: INFO Searching for GPU manag> Feb 02 08:03:03 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:03 gpu.go:282: INFO Discovered GPU librarie> Feb 02 08:03:03 justin-ArchEndos ollama[55270]: 2024/02/02 08:03:03 gpu.go:109: INFO Radeon GPU detected ```
Author
Owner

@MichaelFomenko commented on GitHub (Feb 2, 2024):

your Log is cut off at the end of each line, please update it. And provide all Information about your Hardware and Software Versions.

<!-- gh-comment-id:1923830820 --> @MichaelFomenko commented on GitHub (Feb 2, 2024): your Log is cut off at the end of each line, please update it. And provide all Information about your Hardware and Software Versions.
Author
Owner

@acbp commented on GitHub (Feb 2, 2024):

I've also had this problem here the log:
ollama.debug.2.log

fev 02 13:27:34 amd systemd[1]: Started Ollama Service.
fev 02 13:27:34 amd ollama[23928]: 2024/02/02 13:27:34 images.go:857: INFO total blobs: 12
fev 02 13:27:34 amd ollama[23928]: 2024/02/02 13:27:34 images.go:864: INFO total unused blobs removed: 0
fev 02 13:27:34 amd ollama[23928]: 2024/02/02 13:27:34 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22)
fev 02 13:27:34 amd ollama[23928]: 2024/02/02 13:27:34 payload_common.go:106: INFO Extracting dynamic libraries...
fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 payload_common.go:145: INFO Dynamic LLM libraries [rocm_v6 cuda_v11 rocm_v5 cpu_avx cpu_avx2 cpu]
fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:94: INFO Detecting GPU type
fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so
fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so]
fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:27:37 amd ollama[23956]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc
fev 02 13:27:37 amd ollama[23956]:       Output information may be incomplete.
fev 02 13:27:37 amd ollama[23956]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs
fev 02 13:27:37 amd ollama[23956]:       Output information may be incomplete.
fev 02 13:27:37 amd ollama[23956]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD
fev 02 13:27:37 amd ollama[23956]:       Output information may be incomplete.
fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9
fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so
fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0]
fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:109: INFO Radeon GPU detected
fev 02 13:27:52 amd ollama[23928]: [GIN] 2024/02/02 - 13:27:52 | 200 |      40.506µs |       127.0.0.1 | HEAD     "/"
fev 02 13:27:52 amd ollama[23928]: [GIN] 2024/02/02 - 13:27:52 | 200 |      981.32µs |       127.0.0.1 | GET      "/api/tags"
fev 02 13:27:54 amd ollama[23928]: [GIN] 2024/02/02 - 13:27:54 | 200 |      30.938µs |       127.0.0.1 | HEAD     "/"
fev 02 13:27:54 amd ollama[23928]: [GIN] 2024/02/02 - 13:27:54 | 404 |     155.912µs |       127.0.0.1 | POST     "/api/show"
fev 02 13:27:57 amd ollama[23928]: 2024/02/02 13:27:57 download.go:123: INFO downloading 59bb50d8116b in 39 100 MB part(s)
fev 02 13:28:47 amd ollama[23928]: 2024/02/02 13:28:47 download.go:123: INFO downloading a3a0e9449cb6 in 1 13 KB part(s)
fev 02 13:28:51 amd ollama[23928]: 2024/02/02 13:28:51 download.go:123: INFO downloading 8893e08fa9f9 in 1 59 B part(s)
fev 02 13:28:54 amd ollama[23928]: 2024/02/02 13:28:54 download.go:123: INFO downloading 8972a96b8ff1 in 1 297 B part(s)
fev 02 13:28:58 amd ollama[23928]: 2024/02/02 13:28:58 download.go:123: INFO downloading 772f510b9558 in 1 483 B part(s)
fev 02 13:29:03 amd ollama[23928]: [GIN] 2024/02/02 - 13:29:03 | 200 |          1m9s |       127.0.0.1 | POST     "/api/pull"
fev 02 13:29:04 amd ollama[23928]: 2024/02/02 13:29:04 cpu_common.go:11: INFO CPU has AVX2
fev 02 13:29:04 amd ollama[23928]: 2024/02/02 13:29:04 dyn_ext_server.go:90: INFO Loading Dynamic llm server: /tmp/ollama3947053172/rocm_v5/libext_server.so
fev 02 13:29:04 amd ollama[23928]: 2024/02/02 13:29:04 dyn_ext_server.go:145: INFO Initializing llama server
fev 02 13:29:04 amd ollama[23928]: free(): invalid pointer
fev 02 13:29:08 amd systemd[1]: ollama.service: Main process exited, code=dumped, status=6/ABRT
fev 02 13:29:08 amd systemd[1]: ollama.service: Failed with result 'core-dump'.
fev 02 13:29:08 amd systemd[1]: ollama.service: Consumed 17.462s CPU time.
fev 02 13:29:11 amd systemd[1]: ollama.service: Scheduled restart job, restart counter is at 1.
fev 02 13:29:11 amd systemd[1]: Started Ollama Service.
fev 02 13:29:11 amd ollama[24199]: 2024/02/02 13:29:11 images.go:857: INFO total blobs: 17
fev 02 13:29:11 amd ollama[24199]: 2024/02/02 13:29:11 images.go:864: INFO total unused blobs removed: 0
fev 02 13:29:11 amd ollama[24199]: 2024/02/02 13:29:11 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22)
fev 02 13:29:11 amd ollama[24199]: 2024/02/02 13:29:11 payload_common.go:106: INFO Extracting dynamic libraries...
fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 payload_common.go:145: INFO Dynamic LLM libraries [cpu_avx cpu cpu_avx2 cuda_v11 rocm_v5 rocm_v6]
fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:94: INFO Detecting GPU type
fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so
fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so]
fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:29:14 amd ollama[24224]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc
fev 02 13:29:14 amd ollama[24224]:       Output information may be incomplete.
fev 02 13:29:14 amd ollama[24224]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs
fev 02 13:29:14 amd ollama[24224]:       Output information may be incomplete.
fev 02 13:29:14 amd ollama[24224]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD
fev 02 13:29:14 amd ollama[24224]:       Output information may be incomplete.
fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9
fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so
fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0]
fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:109: INFO Radeon GPU detected
fev 02 13:30:24 amd systemd[1]: Stopping Ollama Service...
fev 02 13:30:24 amd systemd[1]: ollama.service: Deactivated successfully.
fev 02 13:30:24 amd systemd[1]: Stopped Ollama Service.
fev 02 13:30:24 amd systemd[1]: ollama.service: Consumed 4.039s CPU time.
fev 02 13:30:24 amd systemd[1]: Started Ollama Service.
fev 02 13:30:24 amd ollama[24419]: 2024/02/02 13:30:24 images.go:857: INFO total blobs: 17
fev 02 13:30:24 amd ollama[24419]: 2024/02/02 13:30:24 images.go:864: INFO total unused blobs removed: 0
fev 02 13:30:24 amd ollama[24419]: 2024/02/02 13:30:24 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22)
fev 02 13:30:24 amd ollama[24419]: 2024/02/02 13:30:24 payload_common.go:106: INFO Extracting dynamic libraries...
fev 02 13:30:26 amd ollama[24419]: 2024/02/02 13:30:26 payload_common.go:145: INFO Dynamic LLM libraries [cpu_avx cpu_avx2 cpu rocm_v5 cuda_v11 rocm_v6]
fev 02 13:30:26 amd ollama[24419]: 2024/02/02 13:30:26 gpu.go:94: INFO Detecting GPU type
fev 02 13:30:26 amd ollama[24419]: 2024/02/02 13:30:26 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so
fev 02 13:30:26 amd ollama[24419]: 2024/02/02 13:30:26 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so]
fev 02 13:30:27 amd ollama[24419]: 2024/02/02 13:30:27 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:30:27 amd ollama[24419]: 2024/02/02 13:30:27 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:30:27 amd ollama[24458]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc
fev 02 13:30:27 amd ollama[24458]:       Output information may be incomplete.
fev 02 13:30:27 amd ollama[24458]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs
fev 02 13:30:27 amd ollama[24458]:       Output information may be incomplete.
fev 02 13:30:27 amd ollama[24458]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD
fev 02 13:30:27 amd ollama[24458]:       Output information may be incomplete.
fev 02 13:30:27 amd ollama[24419]: 2024/02/02 13:30:27 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9
fev 02 13:30:27 amd ollama[24419]: 2024/02/02 13:30:27 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so
fev 02 13:30:27 amd ollama[24419]: 2024/02/02 13:30:27 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0]
fev 02 13:30:27 amd ollama[24419]: 2024/02/02 13:30:27 gpu.go:109: INFO Radeon GPU detected
fev 02 13:30:33 amd systemd[1]: ollama.service: Deactivated successfully.
fev 02 13:30:33 amd systemd[1]: ollama.service: Consumed 4.023s CPU time.
fev 02 13:30:36 amd systemd[1]: ollama.service: Scheduled restart job, restart counter is at 1.
fev 02 13:30:36 amd systemd[1]: Started Ollama Service.
fev 02 13:30:36 amd ollama[24504]: 2024/02/02 13:30:36 images.go:857: INFO total blobs: 17
fev 02 13:30:36 amd ollama[24504]: 2024/02/02 13:30:36 images.go:864: INFO total unused blobs removed: 0
fev 02 13:30:36 amd ollama[24504]: 2024/02/02 13:30:36 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22)
fev 02 13:30:36 amd ollama[24504]: 2024/02/02 13:30:36 payload_common.go:106: INFO Extracting dynamic libraries...
fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 payload_common.go:145: INFO Dynamic LLM libraries [cuda_v11 cpu_avx rocm_v5 cpu_avx2 cpu rocm_v6]
fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:94: INFO Detecting GPU type
fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so
fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so]
fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:30:38 amd ollama[24529]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc
fev 02 13:30:38 amd ollama[24529]:       Output information may be incomplete.
fev 02 13:30:38 amd ollama[24529]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs
fev 02 13:30:38 amd ollama[24529]:       Output information may be incomplete.
fev 02 13:30:38 amd ollama[24529]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD
fev 02 13:30:38 amd ollama[24529]:       Output information may be incomplete.
fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9
fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so
fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0]
fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:109: INFO Radeon GPU detected
fev 02 13:30:50 amd ollama[24504]: [GIN] 2024/02/02 - 13:30:50 | 200 |      43.311µs |       127.0.0.1 | HEAD     "/"
fev 02 13:30:50 amd ollama[24504]: [GIN] 2024/02/02 - 13:30:50 | 200 |     831.741µs |       127.0.0.1 | POST     "/api/show"
fev 02 13:30:51 amd ollama[24504]: 2024/02/02 13:30:51 cpu_common.go:11: INFO CPU has AVX2
fev 02 13:30:51 amd ollama[24504]: 2024/02/02 13:30:51 dyn_ext_server.go:90: INFO Loading Dynamic llm server: /tmp/ollama4208769625/rocm_v5/libext_server.so
fev 02 13:30:51 amd ollama[24504]: 2024/02/02 13:30:51 dyn_ext_server.go:145: INFO Initializing llama server
fev 02 13:30:51 amd ollama[24504]: free(): invalid pointer
fev 02 13:30:52 amd systemd[1]: ollama.service: Main process exited, code=dumped, status=6/ABRT
fev 02 13:30:52 amd systemd[1]: ollama.service: Failed with result 'core-dump'.
fev 02 13:30:52 amd systemd[1]: ollama.service: Consumed 4.797s CPU time.
fev 02 13:30:55 amd systemd[1]: ollama.service: Scheduled restart job, restart counter is at 2.
fev 02 13:30:55 amd systemd[1]: Started Ollama Service.
fev 02 13:30:55 amd ollama[24593]: 2024/02/02 13:30:55 images.go:857: INFO total blobs: 17
fev 02 13:30:55 amd ollama[24593]: 2024/02/02 13:30:55 images.go:864: INFO total unused blobs removed: 0
fev 02 13:30:55 amd ollama[24593]: 2024/02/02 13:30:55 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22)
fev 02 13:30:55 amd ollama[24593]: 2024/02/02 13:30:55 payload_common.go:106: INFO Extracting dynamic libraries...
fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 payload_common.go:145: INFO Dynamic LLM libraries [cpu_avx2 rocm_v5 cuda_v11 rocm_v6 cpu cpu_avx]
fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:94: INFO Detecting GPU type
fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so
fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so]
fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:30:57 amd ollama[24621]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc
fev 02 13:30:57 amd ollama[24621]:       Output information may be incomplete.
fev 02 13:30:57 amd ollama[24621]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs
fev 02 13:30:57 amd ollama[24621]:       Output information may be incomplete.
fev 02 13:30:57 amd ollama[24621]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD
fev 02 13:30:57 amd ollama[24621]:       Output information may be incomplete.
fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9
fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so
fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0]
fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:109: INFO Radeon GPU detected
fev 02 13:33:37 amd ollama[24593]: [GIN] 2024/02/02 - 13:33:37 | 200 |      37.721µs |       127.0.0.1 | HEAD     "/"
fev 02 13:33:37 amd ollama[24593]: [GIN] 2024/02/02 - 13:33:37 | 200 |     2.02589ms |       127.0.0.1 | GET      "/api/tags"
fev 02 13:33:55 amd ollama[24593]: [GIN] 2024/02/02 - 13:33:55 | 200 |      24.376µs |       127.0.0.1 | HEAD     "/"
fev 02 13:33:55 amd ollama[24593]: [GIN] 2024/02/02 - 13:33:55 | 200 |     508.163µs |       127.0.0.1 | POST     "/api/show"
fev 02 13:33:55 amd ollama[24593]: 2024/02/02 13:33:55 cpu_common.go:11: INFO CPU has AVX2
fev 02 13:33:55 amd ollama[24593]: 2024/02/02 13:33:55 dyn_ext_server.go:90: INFO Loading Dynamic llm server: /tmp/ollama2758806773/rocm_v5/libext_server.so
fev 02 13:33:55 amd ollama[24593]: 2024/02/02 13:33:55 dyn_ext_server.go:145: INFO Initializing llama server
fev 02 13:33:55 amd ollama[24593]: free(): invalid pointer
fev 02 13:33:57 amd systemd[1]: ollama.service: Main process exited, code=dumped, status=6/ABRT
fev 02 13:33:57 amd systemd[1]: ollama.service: Failed with result 'core-dump'.
fev 02 13:33:57 amd systemd[1]: ollama.service: Consumed 5.015s CPU time, 443.9M memory peak, 111.2M memory swap peak.
fev 02 13:34:00 amd systemd[1]: ollama.service: Scheduled restart job, restart counter is at 3.
fev 02 13:34:00 amd systemd[1]: Started Ollama Service.
fev 02 13:34:00 amd ollama[25040]: 2024/02/02 13:34:00 images.go:857: INFO total blobs: 17
fev 02 13:34:00 amd ollama[25040]: 2024/02/02 13:34:00 images.go:864: INFO total unused blobs removed: 0
fev 02 13:34:00 amd ollama[25040]: 2024/02/02 13:34:00 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22)
fev 02 13:34:00 amd ollama[25040]: 2024/02/02 13:34:00 payload_common.go:106: INFO Extracting dynamic libraries...
fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 payload_common.go:145: INFO Dynamic LLM libraries [rocm_v6 cpu cpu_avx cpu_avx2 rocm_v5 cuda_v11]
fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:94: INFO Detecting GPU type
fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so
fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so]
fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:34:03 amd ollama[25069]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc
fev 02 13:34:03 amd ollama[25069]:       Output information may be incomplete.
fev 02 13:34:03 amd ollama[25069]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs
fev 02 13:34:03 amd ollama[25069]:       Output information may be incomplete.
fev 02 13:34:03 amd ollama[25069]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD
fev 02 13:34:03 amd ollama[25069]:       Output information may be incomplete.
fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9
fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so
fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0]
fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:109: INFO Radeon GPU detected
fev 02 13:34:40 amd ollama[25040]: [GIN] 2024/02/02 - 13:34:40 | 200 |      45.275µs |       127.0.0.1 | HEAD     "/"
fev 02 13:34:40 amd ollama[25040]: [GIN] 2024/02/02 - 13:34:40 | 200 |  290.714045ms |       127.0.0.1 | POST     "/api/show"
fev 02 13:34:41 amd ollama[25040]: 2024/02/02 13:34:41 cpu_common.go:11: INFO CPU has AVX2
fev 02 13:34:41 amd ollama[25040]: 2024/02/02 13:34:41 dyn_ext_server.go:90: INFO Loading Dynamic llm server: /tmp/ollama2464163725/rocm_v5/libext_server.so
fev 02 13:34:41 amd ollama[25040]: 2024/02/02 13:34:41 dyn_ext_server.go:145: INFO Initializing llama server
fev 02 13:34:41 amd ollama[25040]: free(): invalid pointer
fev 02 13:34:43 amd systemd[1]: ollama.service: Main process exited, code=dumped, status=6/ABRT
fev 02 13:34:43 amd systemd[1]: ollama.service: Failed with result 'core-dump'.
fev 02 13:34:43 amd systemd[1]: ollama.service: Consumed 4.882s CPU time.
fev 02 13:34:46 amd systemd[1]: ollama.service: Scheduled restart job, restart counter is at 4.
fev 02 13:34:46 amd systemd[1]: Started Ollama Service.
fev 02 13:34:46 amd ollama[25162]: 2024/02/02 13:34:46 images.go:857: INFO total blobs: 17
fev 02 13:34:46 amd ollama[25162]: 2024/02/02 13:34:46 images.go:864: INFO total unused blobs removed: 0
fev 02 13:34:46 amd ollama[25162]: 2024/02/02 13:34:46 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22)
fev 02 13:34:46 amd ollama[25162]: 2024/02/02 13:34:46 payload_common.go:106: INFO Extracting dynamic libraries...
fev 02 13:34:48 amd ollama[25162]: 2024/02/02 13:34:48 payload_common.go:145: INFO Dynamic LLM libraries [rocm_v6 cpu cpu_avx cpu_avx2 cuda_v11 rocm_v5]
fev 02 13:34:48 amd ollama[25162]: 2024/02/02 13:34:48 gpu.go:94: INFO Detecting GPU type
fev 02 13:34:48 amd ollama[25162]: 2024/02/02 13:34:48 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so
fev 02 13:34:48 amd ollama[25162]: 2024/02/02 13:34:48 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so]
fev 02 13:34:48 amd ollama[25162]: 2024/02/02 13:34:48 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:34:48 amd ollama[25162]: 2024/02/02 13:34:48 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:34:48 amd ollama[25197]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc
fev 02 13:34:48 amd ollama[25197]:       Output information may be incomplete.
fev 02 13:34:48 amd ollama[25197]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs
fev 02 13:34:48 amd ollama[25197]:       Output information may be incomplete.
fev 02 13:34:48 amd ollama[25197]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD
fev 02 13:34:48 amd ollama[25197]:       Output information may be incomplete.
fev 02 13:34:49 amd ollama[25162]: 2024/02/02 13:34:49 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9
fev 02 13:34:49 amd ollama[25162]: 2024/02/02 13:34:49 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so
fev 02 13:34:49 amd ollama[25162]: 2024/02/02 13:34:49 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0]
fev 02 13:34:49 amd ollama[25162]: 2024/02/02 13:34:49 gpu.go:109: INFO Radeon GPU detected
fev 02 13:36:33 amd systemd[1]: Stopping Ollama Service...
fev 02 13:36:33 amd systemd[1]: ollama.service: Deactivated successfully.
fev 02 13:36:33 amd systemd[1]: Stopped Ollama Service.
fev 02 13:36:33 amd systemd[1]: ollama.service: Consumed 4.054s CPU time.
fev 02 13:41:23 amd systemd[1]: Started Ollama Service.
fev 02 13:41:23 amd ollama[25775]: 2024/02/02 13:41:23 images.go:857: INFO total blobs: 17
fev 02 13:41:23 amd ollama[25775]: 2024/02/02 13:41:23 images.go:864: INFO total unused blobs removed: 0
fev 02 13:41:23 amd ollama[25775]: 2024/02/02 13:41:23 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22)
fev 02 13:41:23 amd ollama[25775]: 2024/02/02 13:41:23 payload_common.go:106: INFO Extracting dynamic libraries...
fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 payload_common.go:145: INFO Dynamic LLM libraries [cpu_avx cuda_v11 rocm_v5 cpu rocm_v6 cpu_avx2]
fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:94: INFO Detecting GPU type
fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so
fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so]
fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9
fev 02 13:41:25 amd ollama[25803]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc
fev 02 13:41:25 amd ollama[25803]:       Output information may be incomplete.
fev 02 13:41:25 amd ollama[25803]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs
fev 02 13:41:25 amd ollama[25803]:       Output information may be incomplete.
fev 02 13:41:25 amd ollama[25803]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD
fev 02 13:41:25 amd ollama[25803]:       Output information may be incomplete.
fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9
fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so
fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0]
fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:109: INFO Radeon GPU detected
fev 02 13:41:32 amd systemd[1]: Stopping Ollama Service...
fev 02 13:41:32 amd systemd[1]: ollama.service: Deactivated successfully.
fev 02 13:41:32 amd systemd[1]: Stopped Ollama Service.
fev 02 13:41:32 amd systemd[1]: ollama.service: Consumed 4.057s CPU time.
<!-- gh-comment-id:1924273011 --> @acbp commented on GitHub (Feb 2, 2024): I've also had this problem here the log: [ollama.debug.2.log](https://github.com/ollama/ollama/files/14142979/ollama.debug.2.log) ``` fev 02 13:27:34 amd systemd[1]: Started Ollama Service. fev 02 13:27:34 amd ollama[23928]: 2024/02/02 13:27:34 images.go:857: INFO total blobs: 12 fev 02 13:27:34 amd ollama[23928]: 2024/02/02 13:27:34 images.go:864: INFO total unused blobs removed: 0 fev 02 13:27:34 amd ollama[23928]: 2024/02/02 13:27:34 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22) fev 02 13:27:34 amd ollama[23928]: 2024/02/02 13:27:34 payload_common.go:106: INFO Extracting dynamic libraries... fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 payload_common.go:145: INFO Dynamic LLM libraries [rocm_v6 cuda_v11 rocm_v5 cpu_avx cpu_avx2 cpu] fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:94: INFO Detecting GPU type fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so] fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:27:37 amd ollama[23956]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc fev 02 13:27:37 amd ollama[23956]: Output information may be incomplete. fev 02 13:27:37 amd ollama[23956]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs fev 02 13:27:37 amd ollama[23956]: Output information may be incomplete. fev 02 13:27:37 amd ollama[23956]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD fev 02 13:27:37 amd ollama[23956]: Output information may be incomplete. fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9 fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0] fev 02 13:27:37 amd ollama[23928]: 2024/02/02 13:27:37 gpu.go:109: INFO Radeon GPU detected fev 02 13:27:52 amd ollama[23928]: [GIN] 2024/02/02 - 13:27:52 | 200 | 40.506µs | 127.0.0.1 | HEAD "/" fev 02 13:27:52 amd ollama[23928]: [GIN] 2024/02/02 - 13:27:52 | 200 | 981.32µs | 127.0.0.1 | GET "/api/tags" fev 02 13:27:54 amd ollama[23928]: [GIN] 2024/02/02 - 13:27:54 | 200 | 30.938µs | 127.0.0.1 | HEAD "/" fev 02 13:27:54 amd ollama[23928]: [GIN] 2024/02/02 - 13:27:54 | 404 | 155.912µs | 127.0.0.1 | POST "/api/show" fev 02 13:27:57 amd ollama[23928]: 2024/02/02 13:27:57 download.go:123: INFO downloading 59bb50d8116b in 39 100 MB part(s) fev 02 13:28:47 amd ollama[23928]: 2024/02/02 13:28:47 download.go:123: INFO downloading a3a0e9449cb6 in 1 13 KB part(s) fev 02 13:28:51 amd ollama[23928]: 2024/02/02 13:28:51 download.go:123: INFO downloading 8893e08fa9f9 in 1 59 B part(s) fev 02 13:28:54 amd ollama[23928]: 2024/02/02 13:28:54 download.go:123: INFO downloading 8972a96b8ff1 in 1 297 B part(s) fev 02 13:28:58 amd ollama[23928]: 2024/02/02 13:28:58 download.go:123: INFO downloading 772f510b9558 in 1 483 B part(s) fev 02 13:29:03 amd ollama[23928]: [GIN] 2024/02/02 - 13:29:03 | 200 | 1m9s | 127.0.0.1 | POST "/api/pull" fev 02 13:29:04 amd ollama[23928]: 2024/02/02 13:29:04 cpu_common.go:11: INFO CPU has AVX2 fev 02 13:29:04 amd ollama[23928]: 2024/02/02 13:29:04 dyn_ext_server.go:90: INFO Loading Dynamic llm server: /tmp/ollama3947053172/rocm_v5/libext_server.so fev 02 13:29:04 amd ollama[23928]: 2024/02/02 13:29:04 dyn_ext_server.go:145: INFO Initializing llama server fev 02 13:29:04 amd ollama[23928]: free(): invalid pointer fev 02 13:29:08 amd systemd[1]: ollama.service: Main process exited, code=dumped, status=6/ABRT fev 02 13:29:08 amd systemd[1]: ollama.service: Failed with result 'core-dump'. fev 02 13:29:08 amd systemd[1]: ollama.service: Consumed 17.462s CPU time. fev 02 13:29:11 amd systemd[1]: ollama.service: Scheduled restart job, restart counter is at 1. fev 02 13:29:11 amd systemd[1]: Started Ollama Service. fev 02 13:29:11 amd ollama[24199]: 2024/02/02 13:29:11 images.go:857: INFO total blobs: 17 fev 02 13:29:11 amd ollama[24199]: 2024/02/02 13:29:11 images.go:864: INFO total unused blobs removed: 0 fev 02 13:29:11 amd ollama[24199]: 2024/02/02 13:29:11 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22) fev 02 13:29:11 amd ollama[24199]: 2024/02/02 13:29:11 payload_common.go:106: INFO Extracting dynamic libraries... fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 payload_common.go:145: INFO Dynamic LLM libraries [cpu_avx cpu cpu_avx2 cuda_v11 rocm_v5 rocm_v6] fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:94: INFO Detecting GPU type fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so] fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:29:14 amd ollama[24224]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc fev 02 13:29:14 amd ollama[24224]: Output information may be incomplete. fev 02 13:29:14 amd ollama[24224]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs fev 02 13:29:14 amd ollama[24224]: Output information may be incomplete. fev 02 13:29:14 amd ollama[24224]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD fev 02 13:29:14 amd ollama[24224]: Output information may be incomplete. fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9 fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0] fev 02 13:29:14 amd ollama[24199]: 2024/02/02 13:29:14 gpu.go:109: INFO Radeon GPU detected fev 02 13:30:24 amd systemd[1]: Stopping Ollama Service... fev 02 13:30:24 amd systemd[1]: ollama.service: Deactivated successfully. fev 02 13:30:24 amd systemd[1]: Stopped Ollama Service. fev 02 13:30:24 amd systemd[1]: ollama.service: Consumed 4.039s CPU time. fev 02 13:30:24 amd systemd[1]: Started Ollama Service. fev 02 13:30:24 amd ollama[24419]: 2024/02/02 13:30:24 images.go:857: INFO total blobs: 17 fev 02 13:30:24 amd ollama[24419]: 2024/02/02 13:30:24 images.go:864: INFO total unused blobs removed: 0 fev 02 13:30:24 amd ollama[24419]: 2024/02/02 13:30:24 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22) fev 02 13:30:24 amd ollama[24419]: 2024/02/02 13:30:24 payload_common.go:106: INFO Extracting dynamic libraries... fev 02 13:30:26 amd ollama[24419]: 2024/02/02 13:30:26 payload_common.go:145: INFO Dynamic LLM libraries [cpu_avx cpu_avx2 cpu rocm_v5 cuda_v11 rocm_v6] fev 02 13:30:26 amd ollama[24419]: 2024/02/02 13:30:26 gpu.go:94: INFO Detecting GPU type fev 02 13:30:26 amd ollama[24419]: 2024/02/02 13:30:26 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so fev 02 13:30:26 amd ollama[24419]: 2024/02/02 13:30:26 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so] fev 02 13:30:27 amd ollama[24419]: 2024/02/02 13:30:27 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:30:27 amd ollama[24419]: 2024/02/02 13:30:27 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:30:27 amd ollama[24458]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc fev 02 13:30:27 amd ollama[24458]: Output information may be incomplete. fev 02 13:30:27 amd ollama[24458]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs fev 02 13:30:27 amd ollama[24458]: Output information may be incomplete. fev 02 13:30:27 amd ollama[24458]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD fev 02 13:30:27 amd ollama[24458]: Output information may be incomplete. fev 02 13:30:27 amd ollama[24419]: 2024/02/02 13:30:27 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9 fev 02 13:30:27 amd ollama[24419]: 2024/02/02 13:30:27 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so fev 02 13:30:27 amd ollama[24419]: 2024/02/02 13:30:27 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0] fev 02 13:30:27 amd ollama[24419]: 2024/02/02 13:30:27 gpu.go:109: INFO Radeon GPU detected fev 02 13:30:33 amd systemd[1]: ollama.service: Deactivated successfully. fev 02 13:30:33 amd systemd[1]: ollama.service: Consumed 4.023s CPU time. fev 02 13:30:36 amd systemd[1]: ollama.service: Scheduled restart job, restart counter is at 1. fev 02 13:30:36 amd systemd[1]: Started Ollama Service. fev 02 13:30:36 amd ollama[24504]: 2024/02/02 13:30:36 images.go:857: INFO total blobs: 17 fev 02 13:30:36 amd ollama[24504]: 2024/02/02 13:30:36 images.go:864: INFO total unused blobs removed: 0 fev 02 13:30:36 amd ollama[24504]: 2024/02/02 13:30:36 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22) fev 02 13:30:36 amd ollama[24504]: 2024/02/02 13:30:36 payload_common.go:106: INFO Extracting dynamic libraries... fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 payload_common.go:145: INFO Dynamic LLM libraries [cuda_v11 cpu_avx rocm_v5 cpu_avx2 cpu rocm_v6] fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:94: INFO Detecting GPU type fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so] fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:30:38 amd ollama[24529]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc fev 02 13:30:38 amd ollama[24529]: Output information may be incomplete. fev 02 13:30:38 amd ollama[24529]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs fev 02 13:30:38 amd ollama[24529]: Output information may be incomplete. fev 02 13:30:38 amd ollama[24529]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD fev 02 13:30:38 amd ollama[24529]: Output information may be incomplete. fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9 fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0] fev 02 13:30:38 amd ollama[24504]: 2024/02/02 13:30:38 gpu.go:109: INFO Radeon GPU detected fev 02 13:30:50 amd ollama[24504]: [GIN] 2024/02/02 - 13:30:50 | 200 | 43.311µs | 127.0.0.1 | HEAD "/" fev 02 13:30:50 amd ollama[24504]: [GIN] 2024/02/02 - 13:30:50 | 200 | 831.741µs | 127.0.0.1 | POST "/api/show" fev 02 13:30:51 amd ollama[24504]: 2024/02/02 13:30:51 cpu_common.go:11: INFO CPU has AVX2 fev 02 13:30:51 amd ollama[24504]: 2024/02/02 13:30:51 dyn_ext_server.go:90: INFO Loading Dynamic llm server: /tmp/ollama4208769625/rocm_v5/libext_server.so fev 02 13:30:51 amd ollama[24504]: 2024/02/02 13:30:51 dyn_ext_server.go:145: INFO Initializing llama server fev 02 13:30:51 amd ollama[24504]: free(): invalid pointer fev 02 13:30:52 amd systemd[1]: ollama.service: Main process exited, code=dumped, status=6/ABRT fev 02 13:30:52 amd systemd[1]: ollama.service: Failed with result 'core-dump'. fev 02 13:30:52 amd systemd[1]: ollama.service: Consumed 4.797s CPU time. fev 02 13:30:55 amd systemd[1]: ollama.service: Scheduled restart job, restart counter is at 2. fev 02 13:30:55 amd systemd[1]: Started Ollama Service. fev 02 13:30:55 amd ollama[24593]: 2024/02/02 13:30:55 images.go:857: INFO total blobs: 17 fev 02 13:30:55 amd ollama[24593]: 2024/02/02 13:30:55 images.go:864: INFO total unused blobs removed: 0 fev 02 13:30:55 amd ollama[24593]: 2024/02/02 13:30:55 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22) fev 02 13:30:55 amd ollama[24593]: 2024/02/02 13:30:55 payload_common.go:106: INFO Extracting dynamic libraries... fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 payload_common.go:145: INFO Dynamic LLM libraries [cpu_avx2 rocm_v5 cuda_v11 rocm_v6 cpu cpu_avx] fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:94: INFO Detecting GPU type fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so] fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:30:57 amd ollama[24621]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc fev 02 13:30:57 amd ollama[24621]: Output information may be incomplete. fev 02 13:30:57 amd ollama[24621]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs fev 02 13:30:57 amd ollama[24621]: Output information may be incomplete. fev 02 13:30:57 amd ollama[24621]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD fev 02 13:30:57 amd ollama[24621]: Output information may be incomplete. fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9 fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0] fev 02 13:30:57 amd ollama[24593]: 2024/02/02 13:30:57 gpu.go:109: INFO Radeon GPU detected fev 02 13:33:37 amd ollama[24593]: [GIN] 2024/02/02 - 13:33:37 | 200 | 37.721µs | 127.0.0.1 | HEAD "/" fev 02 13:33:37 amd ollama[24593]: [GIN] 2024/02/02 - 13:33:37 | 200 | 2.02589ms | 127.0.0.1 | GET "/api/tags" fev 02 13:33:55 amd ollama[24593]: [GIN] 2024/02/02 - 13:33:55 | 200 | 24.376µs | 127.0.0.1 | HEAD "/" fev 02 13:33:55 amd ollama[24593]: [GIN] 2024/02/02 - 13:33:55 | 200 | 508.163µs | 127.0.0.1 | POST "/api/show" fev 02 13:33:55 amd ollama[24593]: 2024/02/02 13:33:55 cpu_common.go:11: INFO CPU has AVX2 fev 02 13:33:55 amd ollama[24593]: 2024/02/02 13:33:55 dyn_ext_server.go:90: INFO Loading Dynamic llm server: /tmp/ollama2758806773/rocm_v5/libext_server.so fev 02 13:33:55 amd ollama[24593]: 2024/02/02 13:33:55 dyn_ext_server.go:145: INFO Initializing llama server fev 02 13:33:55 amd ollama[24593]: free(): invalid pointer fev 02 13:33:57 amd systemd[1]: ollama.service: Main process exited, code=dumped, status=6/ABRT fev 02 13:33:57 amd systemd[1]: ollama.service: Failed with result 'core-dump'. fev 02 13:33:57 amd systemd[1]: ollama.service: Consumed 5.015s CPU time, 443.9M memory peak, 111.2M memory swap peak. fev 02 13:34:00 amd systemd[1]: ollama.service: Scheduled restart job, restart counter is at 3. fev 02 13:34:00 amd systemd[1]: Started Ollama Service. fev 02 13:34:00 amd ollama[25040]: 2024/02/02 13:34:00 images.go:857: INFO total blobs: 17 fev 02 13:34:00 amd ollama[25040]: 2024/02/02 13:34:00 images.go:864: INFO total unused blobs removed: 0 fev 02 13:34:00 amd ollama[25040]: 2024/02/02 13:34:00 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22) fev 02 13:34:00 amd ollama[25040]: 2024/02/02 13:34:00 payload_common.go:106: INFO Extracting dynamic libraries... fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 payload_common.go:145: INFO Dynamic LLM libraries [rocm_v6 cpu cpu_avx cpu_avx2 rocm_v5 cuda_v11] fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:94: INFO Detecting GPU type fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so] fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:34:03 amd ollama[25069]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc fev 02 13:34:03 amd ollama[25069]: Output information may be incomplete. fev 02 13:34:03 amd ollama[25069]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs fev 02 13:34:03 amd ollama[25069]: Output information may be incomplete. fev 02 13:34:03 amd ollama[25069]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD fev 02 13:34:03 amd ollama[25069]: Output information may be incomplete. fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9 fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0] fev 02 13:34:03 amd ollama[25040]: 2024/02/02 13:34:03 gpu.go:109: INFO Radeon GPU detected fev 02 13:34:40 amd ollama[25040]: [GIN] 2024/02/02 - 13:34:40 | 200 | 45.275µs | 127.0.0.1 | HEAD "/" fev 02 13:34:40 amd ollama[25040]: [GIN] 2024/02/02 - 13:34:40 | 200 | 290.714045ms | 127.0.0.1 | POST "/api/show" fev 02 13:34:41 amd ollama[25040]: 2024/02/02 13:34:41 cpu_common.go:11: INFO CPU has AVX2 fev 02 13:34:41 amd ollama[25040]: 2024/02/02 13:34:41 dyn_ext_server.go:90: INFO Loading Dynamic llm server: /tmp/ollama2464163725/rocm_v5/libext_server.so fev 02 13:34:41 amd ollama[25040]: 2024/02/02 13:34:41 dyn_ext_server.go:145: INFO Initializing llama server fev 02 13:34:41 amd ollama[25040]: free(): invalid pointer fev 02 13:34:43 amd systemd[1]: ollama.service: Main process exited, code=dumped, status=6/ABRT fev 02 13:34:43 amd systemd[1]: ollama.service: Failed with result 'core-dump'. fev 02 13:34:43 amd systemd[1]: ollama.service: Consumed 4.882s CPU time. fev 02 13:34:46 amd systemd[1]: ollama.service: Scheduled restart job, restart counter is at 4. fev 02 13:34:46 amd systemd[1]: Started Ollama Service. fev 02 13:34:46 amd ollama[25162]: 2024/02/02 13:34:46 images.go:857: INFO total blobs: 17 fev 02 13:34:46 amd ollama[25162]: 2024/02/02 13:34:46 images.go:864: INFO total unused blobs removed: 0 fev 02 13:34:46 amd ollama[25162]: 2024/02/02 13:34:46 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22) fev 02 13:34:46 amd ollama[25162]: 2024/02/02 13:34:46 payload_common.go:106: INFO Extracting dynamic libraries... fev 02 13:34:48 amd ollama[25162]: 2024/02/02 13:34:48 payload_common.go:145: INFO Dynamic LLM libraries [rocm_v6 cpu cpu_avx cpu_avx2 cuda_v11 rocm_v5] fev 02 13:34:48 amd ollama[25162]: 2024/02/02 13:34:48 gpu.go:94: INFO Detecting GPU type fev 02 13:34:48 amd ollama[25162]: 2024/02/02 13:34:48 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so fev 02 13:34:48 amd ollama[25162]: 2024/02/02 13:34:48 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so] fev 02 13:34:48 amd ollama[25162]: 2024/02/02 13:34:48 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:34:48 amd ollama[25162]: 2024/02/02 13:34:48 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:34:48 amd ollama[25197]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc fev 02 13:34:48 amd ollama[25197]: Output information may be incomplete. fev 02 13:34:48 amd ollama[25197]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs fev 02 13:34:48 amd ollama[25197]: Output information may be incomplete. fev 02 13:34:48 amd ollama[25197]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD fev 02 13:34:48 amd ollama[25197]: Output information may be incomplete. fev 02 13:34:49 amd ollama[25162]: 2024/02/02 13:34:49 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9 fev 02 13:34:49 amd ollama[25162]: 2024/02/02 13:34:49 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so fev 02 13:34:49 amd ollama[25162]: 2024/02/02 13:34:49 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0] fev 02 13:34:49 amd ollama[25162]: 2024/02/02 13:34:49 gpu.go:109: INFO Radeon GPU detected fev 02 13:36:33 amd systemd[1]: Stopping Ollama Service... fev 02 13:36:33 amd systemd[1]: ollama.service: Deactivated successfully. fev 02 13:36:33 amd systemd[1]: Stopped Ollama Service. fev 02 13:36:33 amd systemd[1]: ollama.service: Consumed 4.054s CPU time. fev 02 13:41:23 amd systemd[1]: Started Ollama Service. fev 02 13:41:23 amd ollama[25775]: 2024/02/02 13:41:23 images.go:857: INFO total blobs: 17 fev 02 13:41:23 amd ollama[25775]: 2024/02/02 13:41:23 images.go:864: INFO total unused blobs removed: 0 fev 02 13:41:23 amd ollama[25775]: 2024/02/02 13:41:23 routes.go:950: INFO Listening on 127.0.0.1:11434 (version 0.1.22) fev 02 13:41:23 amd ollama[25775]: 2024/02/02 13:41:23 payload_common.go:106: INFO Extracting dynamic libraries... fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 payload_common.go:145: INFO Dynamic LLM libraries [cpu_avx cuda_v11 rocm_v5 cpu rocm_v6 cpu_avx2] fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:94: INFO Detecting GPU type fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:236: INFO Searching for GPU management library libnvidia-ml.so fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:282: INFO Discovered GPU libraries: [/usr/lib/libnvidia-ml.so.545.29.06 /usr/lib64/libnvidia-ml.so.545.29.06 /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so] fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:294: INFO Unable to load CUDA management library /usr/lib/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:294: INFO Unable to load CUDA management library /usr/lib64/libnvidia-ml.so.545.29.06: nvml vram init failure: 9 fev 02 13:41:25 amd ollama[25803]: lsof: WARNING: can't stat() fuse.portal file system /run/user/1000/doc fev 02 13:41:25 amd ollama[25803]: Output information may be incomplete. fev 02 13:41:25 amd ollama[25803]: lsof: WARNING: can't stat() fuse.gvfsd-fuse file system /run/user/1000/gvfs fev 02 13:41:25 amd ollama[25803]: Output information may be incomplete. fev 02 13:41:25 amd ollama[25803]: lsof: WARNING: can't stat() ext4 file system /run/media/ale/HHD fev 02 13:41:25 amd ollama[25803]: Output information may be incomplete. fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:294: INFO Unable to load CUDA management library /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so: nvml vram init failure: 9 fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:236: INFO Searching for GPU management library librocm_smi64.so fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:282: INFO Discovered GPU libraries: [/opt/rocm/lib/librocm_smi64.so.5.0] fev 02 13:41:25 amd ollama[25775]: 2024/02/02 13:41:25 gpu.go:109: INFO Radeon GPU detected fev 02 13:41:32 amd systemd[1]: Stopping Ollama Service... fev 02 13:41:32 amd systemd[1]: ollama.service: Deactivated successfully. fev 02 13:41:32 amd systemd[1]: Stopped Ollama Service. fev 02 13:41:32 amd systemd[1]: ollama.service: Consumed 4.057s CPU time. ```
Author
Owner

@MichaelFomenko commented on GitHub (Feb 2, 2024):

I've also had this problem here the log: ollama.debug.2.log

provide all Information about your Hardware and Software Versions.

<!-- gh-comment-id:1924408328 --> @MichaelFomenko commented on GitHub (Feb 2, 2024): > I've also had this problem here the log: [ollama.debug.2.log](https://github.com/ollama/ollama/files/14142979/ollama.debug.2.log) provide all Information about your Hardware and Software Versions.
Author
Owner

@jusgrave commented on GitHub (Feb 2, 2024):

your Log is cut off at the end of each line, please update it. And provide all Information about your Hardware and Software Versions.

ollama_logs.txt

<!-- gh-comment-id:1924423118 --> @jusgrave commented on GitHub (Feb 2, 2024): > your Log is cut off at the end of each line, please update it. And provide all Information about your Hardware and Software Versions. [ollama_logs.txt](https://github.com/ollama/ollama/files/14143621/ollama_logs.txt)
Author
Owner

@jusgrave commented on GitHub (Feb 2, 2024):

                                            ​ ​​  OS : EndeavourOS Linux x86_64 
                                           ​​ ​  Kernel : 6.7.2-arch1-2 
                                           ​​ ​  Packages : 953 (pacman) 
                                           ​​ ​  Resolution : 2560x1440 
                                           ​​ ​  DE : Hyprland 
                                           ​​ ​  Terminal : kitty 
                            └──────────────────────────────────────────┘ 
                                           ​​ ​  CPU : AMD Ryzen 7 5800X3D (16) @ 3.400GHz 
                                           ​​ ​  GPU : AMD ATI Radeon RX 7700 XT / 7800 XT 
                                           ​​ ​  GPU Driver : nvme 
                                           ​​ ​ ﬙ Memory : 3894MiB / 15897MiB 
<!-- gh-comment-id:1924429114 --> @jusgrave commented on GitHub (Feb 2, 2024): ​ ​​  OS : EndeavourOS Linux x86_64 ​​ ​  Kernel : 6.7.2-arch1-2 ​​ ​  Packages : 953 (pacman) ​​ ​  Resolution : 2560x1440 ​​ ​  DE : Hyprland ​​ ​  Terminal : kitty └──────────────────────────────────────────┘ ​​ ​  CPU : AMD Ryzen 7 5800X3D (16) @ 3.400GHz ​​ ​  GPU : AMD ATI Radeon RX 7700 XT / 7800 XT ​​ ​  GPU Driver : nvme ​​ ​ ﬙ Memory : 3894MiB / 15897MiB
Author
Owner

@MichaelFomenko commented on GitHub (Feb 2, 2024):

                                            ​ ​​  OS : EndeavourOS Linux x86_64 
                                           ​​ ​  Kernel : 6.7.2-arch1-2 
                                           ​​ ​  Packages : 953 (pacman) 
                                           ​​ ​  Resolution : 2560x1440 
                                           ​​ ​  DE : Hyprland 
                                           ​​ ​  Terminal : kitty 
                            └──────────────────────────────────────────┘ 
                                           ​​ ​  CPU : AMD Ryzen 7 5800X3D (16) @ 3.400GHz 
                                           ​​ ​  GPU : AMD ATI Radeon RX 7700 XT / 7800 XT 
                                           ​​ ​  GPU Driver : nvme 
                                           ​​ ​ ﬙ Memory : 3894MiB / 15897MiB 

Is your GPU supported by ROCm? I cant find it in the official List of Supported AMD GPUs.

<!-- gh-comment-id:1924440489 --> @MichaelFomenko commented on GitHub (Feb 2, 2024): > ``` > ​ ​​  OS : EndeavourOS Linux x86_64 > ​​ ​  Kernel : 6.7.2-arch1-2 > ​​ ​  Packages : 953 (pacman) > ​​ ​  Resolution : 2560x1440 > ​​ ​  DE : Hyprland > ​​ ​  Terminal : kitty > └──────────────────────────────────────────┘ > ​​ ​  CPU : AMD Ryzen 7 5800X3D (16) @ 3.400GHz > ​​ ​  GPU : AMD ATI Radeon RX 7700 XT / 7800 XT > ​​ ​  GPU Driver : nvme > ​​ ​ ﬙ Memory : 3894MiB / 15897MiB > ``` Is your GPU supported by ROCm? I cant find it in the official List of Supported AMD GPUs.
Author
Owner

@acbp commented on GitHub (Feb 2, 2024):

rocminfo

ROCk module is loaded
=====================    
HSA System Attributes    
=====================    
Runtime Version:         1.1
System Timestamp Freq.:  1000.000000MHz
Sig. Max Wait Duration:  18446744073709551615 (0xFFFFFFFFFFFFFFFF) (timestamp count)
Machine Model:           LARGE                              
System Endianness:       LITTLE                             
Mwaitx:                  DISABLED
DMAbuf Support:          YES

==========               
HSA Agents               
==========               
*******                  
Agent 1                  
*******                  
  Name:                    AMD Ryzen 5 3600 6-Core Processor  
  Uuid:                    CPU-XX                             
  Marketing Name:          AMD Ryzen 5 3600 6-Core Processor  
  Vendor Name:             CPU                                
  Feature:                 None specified                     
  Profile:                 FULL_PROFILE                       
  Float Round Mode:        NEAR                               
  Max Queue Number:        0(0x0)                             
  Queue Min Size:          0(0x0)                             
  Queue Max Size:          0(0x0)                             
  Queue Type:              MULTI                              
  Node:                    0                                  
  Device Type:             CPU                                
  Cache Info:              
    L1:                      32768(0x8000) KB                   
  Chip ID:                 0(0x0)                             
  ASIC Revision:           0(0x0)                             
  Cacheline Size:          64(0x40)                           
  Max Clock Freq. (MHz):   3950                               
  BDFID:                   0                                  
  Internal Node ID:        0                                  
  Compute Unit:            12                                 
  SIMDs per CU:            0                                  
  Shader Engines:          0                                  
  Shader Arrs. per Eng.:   0                                  
  WatchPts on Addr. Ranges:1                                  
  Features:                None
  Pool Info:               
    Pool 1                   
      Segment:                 GLOBAL; FLAGS: FINE GRAINED        
      Size:                    16284588(0xf87bac) KB              
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       TRUE                               
    Pool 2                   
      Segment:                 GLOBAL; FLAGS: KERNARG, FINE GRAINED
      Size:                    16284588(0xf87bac) KB              
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       TRUE                               
    Pool 3                   
      Segment:                 GLOBAL; FLAGS: COARSE GRAINED      
      Size:                    16284588(0xf87bac) KB              
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       TRUE                               
  ISA Info:                
*******                  
Agent 2                  
*******                  
  Name:                    gfx803                             
  Uuid:                    GPU-XX                             
  Marketing Name:          AMD Radeon RX 480 Graphics         
  Vendor Name:             AMD                                
  Feature:                 KERNEL_DISPATCH                    
  Profile:                 BASE_PROFILE                       
  Float Round Mode:        NEAR                               
  Max Queue Number:        128(0x80)                          
  Queue Min Size:          64(0x40)                           
  Queue Max Size:          131072(0x20000)                    
  Queue Type:              MULTI                              
  Node:                    1                                  
  Device Type:             GPU                                
  Cache Info:              
    L1:                      16(0x10) KB                        
  Chip ID:                 26591(0x67df)                      
  ASIC Revision:           1(0x1)                             
  Cacheline Size:          64(0x40)                           
  Max Clock Freq. (MHz):   1279                               
  BDFID:                   1536                               
  Internal Node ID:        1                                  
  Compute Unit:            36                                 
  SIMDs per CU:            4                                  
  Shader Engines:          4                                  
  Shader Arrs. per Eng.:   1                                  
  WatchPts on Addr. Ranges:4                                  
  Features:                KERNEL_DISPATCH 
  Fast F16 Operation:      TRUE                               
  Wavefront Size:          64(0x40)                           
  Workgroup Max Size:      1024(0x400)                        
  Workgroup Max Size per Dimension:
    x                        1024(0x400)                        
    y                        1024(0x400)                        
    z                        1024(0x400)                        
  Max Waves Per CU:        40(0x28)                           
  Max Work-item Per CU:    2560(0xa00)                        
  Grid Max Size:           4294967295(0xffffffff)             
  Grid Max Size per Dimension:
    x                        4294967295(0xffffffff)             
    y                        4294967295(0xffffffff)             
    z                        4294967295(0xffffffff)             
  Max fbarriers/Workgrp:   32                                 
  Packet Processor uCode:: 730                                
  SDMA engine uCode::      58                                 
  IOMMU Support::          None                               
  Pool Info:               
    Pool 1                   
      Segment:                 GLOBAL; FLAGS: COARSE GRAINED      
      Size:                    8388608(0x800000) KB               
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       FALSE                              
    Pool 2                   
      Segment:                 GLOBAL; FLAGS:                     
      Size:                    8388608(0x800000) KB               
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       FALSE                              
    Pool 3                   
      Segment:                 GROUP                              
      Size:                    64(0x40) KB                        
      Allocatable:             FALSE                              
      Alloc Granule:           0KB                                
      Alloc Alignment:         0KB                                
      Accessible by all:       FALSE                              
  ISA Info:                
    ISA 1                    
      Name:                    amdgcn-amd-amdhsa--gfx803          
      Machine Models:          HSA_MACHINE_MODEL_LARGE            
      Profiles:                HSA_PROFILE_BASE                   
      Default Rounding Mode:   NEAR                               
      Default Rounding Mode:   NEAR                               
      Fast f16:                TRUE                               
      Workgroup Max Size:      1024(0x400)                        
      Workgroup Max Size per Dimension:
        x                        1024(0x400)                        
        y                        1024(0x400)                        
        z                        1024(0x400)                        
      Grid Max Size:           4294967295(0xffffffff)             
      Grid Max Size per Dimension:
        x                        4294967295(0xffffffff)             
        y                        4294967295(0xffffffff)             
        z                        4294967295(0xffffffff)             
      FBarrier Max Size:       32                                 
*** Done ***             
<!-- gh-comment-id:1924466099 --> @acbp commented on GitHub (Feb 2, 2024): rocminfo ``` ROCk module is loaded ===================== HSA System Attributes ===================== Runtime Version: 1.1 System Timestamp Freq.: 1000.000000MHz Sig. Max Wait Duration: 18446744073709551615 (0xFFFFFFFFFFFFFFFF) (timestamp count) Machine Model: LARGE System Endianness: LITTLE Mwaitx: DISABLED DMAbuf Support: YES ========== HSA Agents ========== ******* Agent 1 ******* Name: AMD Ryzen 5 3600 6-Core Processor Uuid: CPU-XX Marketing Name: AMD Ryzen 5 3600 6-Core Processor Vendor Name: CPU Feature: None specified Profile: FULL_PROFILE Float Round Mode: NEAR Max Queue Number: 0(0x0) Queue Min Size: 0(0x0) Queue Max Size: 0(0x0) Queue Type: MULTI Node: 0 Device Type: CPU Cache Info: L1: 32768(0x8000) KB Chip ID: 0(0x0) ASIC Revision: 0(0x0) Cacheline Size: 64(0x40) Max Clock Freq. (MHz): 3950 BDFID: 0 Internal Node ID: 0 Compute Unit: 12 SIMDs per CU: 0 Shader Engines: 0 Shader Arrs. per Eng.: 0 WatchPts on Addr. Ranges:1 Features: None Pool Info: Pool 1 Segment: GLOBAL; FLAGS: FINE GRAINED Size: 16284588(0xf87bac) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Alignment: 4KB Accessible by all: TRUE Pool 2 Segment: GLOBAL; FLAGS: KERNARG, FINE GRAINED Size: 16284588(0xf87bac) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Alignment: 4KB Accessible by all: TRUE Pool 3 Segment: GLOBAL; FLAGS: COARSE GRAINED Size: 16284588(0xf87bac) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Alignment: 4KB Accessible by all: TRUE ISA Info: ******* Agent 2 ******* Name: gfx803 Uuid: GPU-XX Marketing Name: AMD Radeon RX 480 Graphics Vendor Name: AMD Feature: KERNEL_DISPATCH Profile: BASE_PROFILE Float Round Mode: NEAR Max Queue Number: 128(0x80) Queue Min Size: 64(0x40) Queue Max Size: 131072(0x20000) Queue Type: MULTI Node: 1 Device Type: GPU Cache Info: L1: 16(0x10) KB Chip ID: 26591(0x67df) ASIC Revision: 1(0x1) Cacheline Size: 64(0x40) Max Clock Freq. (MHz): 1279 BDFID: 1536 Internal Node ID: 1 Compute Unit: 36 SIMDs per CU: 4 Shader Engines: 4 Shader Arrs. per Eng.: 1 WatchPts on Addr. Ranges:4 Features: KERNEL_DISPATCH Fast F16 Operation: TRUE Wavefront Size: 64(0x40) Workgroup Max Size: 1024(0x400) Workgroup Max Size per Dimension: x 1024(0x400) y 1024(0x400) z 1024(0x400) Max Waves Per CU: 40(0x28) Max Work-item Per CU: 2560(0xa00) Grid Max Size: 4294967295(0xffffffff) Grid Max Size per Dimension: x 4294967295(0xffffffff) y 4294967295(0xffffffff) z 4294967295(0xffffffff) Max fbarriers/Workgrp: 32 Packet Processor uCode:: 730 SDMA engine uCode:: 58 IOMMU Support:: None Pool Info: Pool 1 Segment: GLOBAL; FLAGS: COARSE GRAINED Size: 8388608(0x800000) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Alignment: 4KB Accessible by all: FALSE Pool 2 Segment: GLOBAL; FLAGS: Size: 8388608(0x800000) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Alignment: 4KB Accessible by all: FALSE Pool 3 Segment: GROUP Size: 64(0x40) KB Allocatable: FALSE Alloc Granule: 0KB Alloc Alignment: 0KB Accessible by all: FALSE ISA Info: ISA 1 Name: amdgcn-amd-amdhsa--gfx803 Machine Models: HSA_MACHINE_MODEL_LARGE Profiles: HSA_PROFILE_BASE Default Rounding Mode: NEAR Default Rounding Mode: NEAR Fast f16: TRUE Workgroup Max Size: 1024(0x400) Workgroup Max Size per Dimension: x 1024(0x400) y 1024(0x400) z 1024(0x400) Grid Max Size: 4294967295(0xffffffff) Grid Max Size per Dimension: x 4294967295(0xffffffff) y 4294967295(0xffffffff) z 4294967295(0xffffffff) FBarrier Max Size: 32 *** Done *** ```
Author
Owner

@jusgrave commented on GitHub (Feb 2, 2024):

                                            ​ ​​  OS : EndeavourOS Linux x86_64 
                                           ​​ ​  Kernel : 6.7.2-arch1-2 
                                           ​​ ​  Packages : 953 (pacman) 
                                           ​​ ​  Resolution : 2560x1440 
                                           ​​ ​  DE : Hyprland 
                                           ​​ ​  Terminal : kitty 
                            └──────────────────────────────────────────┘ 
                                           ​​ ​  CPU : AMD Ryzen 7 5800X3D (16) @ 3.400GHz 
                                           ​​ ​  GPU : AMD ATI Radeon RX 7700 XT / 7800 XT 
                                           ​​ ​  GPU Driver : nvme 
                                           ​​ ​ ﬙ Memory : 3894MiB / 15897MiB 

Is your GPU supported by ROCm? I cant find it in the official List of Supported AMD GPUs.
I just checked it no it is not

<!-- gh-comment-id:1924472815 --> @jusgrave commented on GitHub (Feb 2, 2024): > > ``` > > ​ ​​  OS : EndeavourOS Linux x86_64 > > ​​ ​  Kernel : 6.7.2-arch1-2 > > ​​ ​  Packages : 953 (pacman) > > ​​ ​  Resolution : 2560x1440 > > ​​ ​  DE : Hyprland > > ​​ ​  Terminal : kitty > > └──────────────────────────────────────────┘ > > ​​ ​  CPU : AMD Ryzen 7 5800X3D (16) @ 3.400GHz > > ​​ ​  GPU : AMD ATI Radeon RX 7700 XT / 7800 XT > > ​​ ​  GPU Driver : nvme > > ​​ ​ ﬙ Memory : 3894MiB / 15897MiB > > ``` > > Is your GPU supported by ROCm? I cant find it in the official List of Supported AMD GPUs. I just checked it no it is not
Author
Owner

@acbp commented on GitHub (Feb 2, 2024):

my rocminfo

ROCk module is loaded
=====================    
HSA System Attributes    
=====================    
Runtime Version:         1.1
System Timestamp Freq.:  1000.000000MHz
Sig. Max Wait Duration:  18446744073709551615 (0xFFFFFFFFFFFFFFFF) (timestamp count)
Machine Model:           LARGE                              
System Endianness:       LITTLE                             
Mwaitx:                  DISABLED
DMAbuf Support:          YES

==========               
HSA Agents               
==========               
*******                  
Agent 1                  
*******                  
  Name:                    AMD Ryzen 5 3600 6-Core Processor  
  Uuid:                    CPU-XX                             
  Marketing Name:          AMD Ryzen 5 3600 6-Core Processor  
  Vendor Name:             CPU                                
  Feature:                 None specified                     
  Profile:                 FULL_PROFILE                       
  Float Round Mode:        NEAR                               
  Max Queue Number:        0(0x0)                             
  Queue Min Size:          0(0x0)                             
  Queue Max Size:          0(0x0)                             
  Queue Type:              MULTI                              
  Node:                    0                                  
  Device Type:             CPU                                
  Cache Info:              
    L1:                      32768(0x8000) KB                   
  Chip ID:                 0(0x0)                             
  ASIC Revision:           0(0x0)                             
  Cacheline Size:          64(0x40)                           
  Max Clock Freq. (MHz):   3950                               
  BDFID:                   0                                  
  Internal Node ID:        0                                  
  Compute Unit:            12                                 
  SIMDs per CU:            0                                  
  Shader Engines:          0                                  
  Shader Arrs. per Eng.:   0                                  
  WatchPts on Addr. Ranges:1                                  
  Features:                None
  Pool Info:               
    Pool 1                   
      Segment:                 GLOBAL; FLAGS: FINE GRAINED        
      Size:                    16284588(0xf87bac) KB              
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       TRUE                               
    Pool 2                   
      Segment:                 GLOBAL; FLAGS: KERNARG, FINE GRAINED
      Size:                    16284588(0xf87bac) KB              
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       TRUE                               
    Pool 3                   
      Segment:                 GLOBAL; FLAGS: COARSE GRAINED      
      Size:                    16284588(0xf87bac) KB              
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       TRUE                               
  ISA Info:                
*******                  
Agent 2                  
*******                  
  Name:                    gfx803                             
  Uuid:                    GPU-XX                             
  Marketing Name:          AMD Radeon RX 480 Graphics         
  Vendor Name:             AMD                                
  Feature:                 KERNEL_DISPATCH                    
  Profile:                 BASE_PROFILE                       
  Float Round Mode:        NEAR                               
  Max Queue Number:        128(0x80)                          
  Queue Min Size:          64(0x40)                           
  Queue Max Size:          131072(0x20000)                    
  Queue Type:              MULTI                              
  Node:                    1                                  
  Device Type:             GPU                                
  Cache Info:              
    L1:                      16(0x10) KB                        
  Chip ID:                 26591(0x67df)                      
  ASIC Revision:           1(0x1)                             
  Cacheline Size:          64(0x40)                           
  Max Clock Freq. (MHz):   1279                               
  BDFID:                   1536                               
  Internal Node ID:        1                                  
  Compute Unit:            36                                 
  SIMDs per CU:            4                                  
  Shader Engines:          4                                  
  Shader Arrs. per Eng.:   1                                  
  WatchPts on Addr. Ranges:4                                  
  Features:                KERNEL_DISPATCH 
  Fast F16 Operation:      TRUE                               
  Wavefront Size:          64(0x40)                           
  Workgroup Max Size:      1024(0x400)                        
  Workgroup Max Size per Dimension:
    x                        1024(0x400)                        
    y                        1024(0x400)                        
    z                        1024(0x400)                        
  Max Waves Per CU:        40(0x28)                           
  Max Work-item Per CU:    2560(0xa00)                        
  Grid Max Size:           4294967295(0xffffffff)             
  Grid Max Size per Dimension:
    x                        4294967295(0xffffffff)             
    y                        4294967295(0xffffffff)             
    z                        4294967295(0xffffffff)             
  Max fbarriers/Workgrp:   32                                 
  Packet Processor uCode:: 730                                
  SDMA engine uCode::      58                                 
  IOMMU Support::          None                               
  Pool Info:               
    Pool 1                   
      Segment:                 GLOBAL; FLAGS: COARSE GRAINED      
      Size:                    8388608(0x800000) KB               
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       FALSE                              
    Pool 2                   
      Segment:                 GLOBAL; FLAGS:                     
      Size:                    8388608(0x800000) KB               
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       FALSE                              
    Pool 3                   
      Segment:                 GROUP                              
      Size:                    64(0x40) KB                        
      Allocatable:             FALSE                              
      Alloc Granule:           0KB                                
      Alloc Alignment:         0KB                                
      Accessible by all:       FALSE                              
  ISA Info:                
    ISA 1                    
      Name:                    amdgcn-amd-amdhsa--gfx803          
      Machine Models:          HSA_MACHINE_MODEL_LARGE            
      Profiles:                HSA_PROFILE_BASE                   
      Default Rounding Mode:   NEAR                               
      Default Rounding Mode:   NEAR                               
      Fast f16:                TRUE                               
      Workgroup Max Size:      1024(0x400)                        
      Workgroup Max Size per Dimension:
        x                        1024(0x400)                        
        y                        1024(0x400)                        
        z                        1024(0x400)                        
      Grid Max Size:           4294967295(0xffffffff)             
      Grid Max Size per Dimension:
        x                        4294967295(0xffffffff)             
        y                        4294967295(0xffffffff)             
        z                        4294967295(0xffffffff)             
      FBarrier Max Size:       32                                 
*** Done ***             
<!-- gh-comment-id:1924485242 --> @acbp commented on GitHub (Feb 2, 2024): my rocminfo ``` ROCk module is loaded ===================== HSA System Attributes ===================== Runtime Version: 1.1 System Timestamp Freq.: 1000.000000MHz Sig. Max Wait Duration: 18446744073709551615 (0xFFFFFFFFFFFFFFFF) (timestamp count) Machine Model: LARGE System Endianness: LITTLE Mwaitx: DISABLED DMAbuf Support: YES ========== HSA Agents ========== ******* Agent 1 ******* Name: AMD Ryzen 5 3600 6-Core Processor Uuid: CPU-XX Marketing Name: AMD Ryzen 5 3600 6-Core Processor Vendor Name: CPU Feature: None specified Profile: FULL_PROFILE Float Round Mode: NEAR Max Queue Number: 0(0x0) Queue Min Size: 0(0x0) Queue Max Size: 0(0x0) Queue Type: MULTI Node: 0 Device Type: CPU Cache Info: L1: 32768(0x8000) KB Chip ID: 0(0x0) ASIC Revision: 0(0x0) Cacheline Size: 64(0x40) Max Clock Freq. (MHz): 3950 BDFID: 0 Internal Node ID: 0 Compute Unit: 12 SIMDs per CU: 0 Shader Engines: 0 Shader Arrs. per Eng.: 0 WatchPts on Addr. Ranges:1 Features: None Pool Info: Pool 1 Segment: GLOBAL; FLAGS: FINE GRAINED Size: 16284588(0xf87bac) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Alignment: 4KB Accessible by all: TRUE Pool 2 Segment: GLOBAL; FLAGS: KERNARG, FINE GRAINED Size: 16284588(0xf87bac) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Alignment: 4KB Accessible by all: TRUE Pool 3 Segment: GLOBAL; FLAGS: COARSE GRAINED Size: 16284588(0xf87bac) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Alignment: 4KB Accessible by all: TRUE ISA Info: ******* Agent 2 ******* Name: gfx803 Uuid: GPU-XX Marketing Name: AMD Radeon RX 480 Graphics Vendor Name: AMD Feature: KERNEL_DISPATCH Profile: BASE_PROFILE Float Round Mode: NEAR Max Queue Number: 128(0x80) Queue Min Size: 64(0x40) Queue Max Size: 131072(0x20000) Queue Type: MULTI Node: 1 Device Type: GPU Cache Info: L1: 16(0x10) KB Chip ID: 26591(0x67df) ASIC Revision: 1(0x1) Cacheline Size: 64(0x40) Max Clock Freq. (MHz): 1279 BDFID: 1536 Internal Node ID: 1 Compute Unit: 36 SIMDs per CU: 4 Shader Engines: 4 Shader Arrs. per Eng.: 1 WatchPts on Addr. Ranges:4 Features: KERNEL_DISPATCH Fast F16 Operation: TRUE Wavefront Size: 64(0x40) Workgroup Max Size: 1024(0x400) Workgroup Max Size per Dimension: x 1024(0x400) y 1024(0x400) z 1024(0x400) Max Waves Per CU: 40(0x28) Max Work-item Per CU: 2560(0xa00) Grid Max Size: 4294967295(0xffffffff) Grid Max Size per Dimension: x 4294967295(0xffffffff) y 4294967295(0xffffffff) z 4294967295(0xffffffff) Max fbarriers/Workgrp: 32 Packet Processor uCode:: 730 SDMA engine uCode:: 58 IOMMU Support:: None Pool Info: Pool 1 Segment: GLOBAL; FLAGS: COARSE GRAINED Size: 8388608(0x800000) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Alignment: 4KB Accessible by all: FALSE Pool 2 Segment: GLOBAL; FLAGS: Size: 8388608(0x800000) KB Allocatable: TRUE Alloc Granule: 4KB Alloc Alignment: 4KB Accessible by all: FALSE Pool 3 Segment: GROUP Size: 64(0x40) KB Allocatable: FALSE Alloc Granule: 0KB Alloc Alignment: 0KB Accessible by all: FALSE ISA Info: ISA 1 Name: amdgcn-amd-amdhsa--gfx803 Machine Models: HSA_MACHINE_MODEL_LARGE Profiles: HSA_PROFILE_BASE Default Rounding Mode: NEAR Default Rounding Mode: NEAR Fast f16: TRUE Workgroup Max Size: 1024(0x400) Workgroup Max Size per Dimension: x 1024(0x400) y 1024(0x400) z 1024(0x400) Grid Max Size: 4294967295(0xffffffff) Grid Max Size per Dimension: x 4294967295(0xffffffff) y 4294967295(0xffffffff) z 4294967295(0xffffffff) FBarrier Max Size: 32 *** Done *** ```
Author
Owner

@MichaelFomenko commented on GitHub (Feb 2, 2024):

my rocminfo

�[37mROCk module is loaded�[0m
=====================    
HSA System Attributes    
=====================    
Runtime Version:         1.1
System Timestamp Freq.:  1000.000000MHz
Sig. Max Wait Duration:  18446744073709551615 (0xFFFFFFFFFFFFFFFF) (timestamp count)
Machine Model:           LARGE                              
System Endianness:       LITTLE                             
Mwaitx:                  DISABLED
DMAbuf Support:          YES

==========               
HSA Agents               
==========               
*******                  
Agent 1                  
*******                  
  Name:                    AMD Ryzen 5 3600 6-Core Processor  
  Uuid:                    CPU-XX                             
  Marketing Name:          AMD Ryzen 5 3600 6-Core Processor  
  Vendor Name:             CPU                                
  Feature:                 None specified                     
  Profile:                 FULL_PROFILE                       
  Float Round Mode:        NEAR                               
  Max Queue Number:        0(0x0)                             
  Queue Min Size:          0(0x0)                             
  Queue Max Size:          0(0x0)                             
  Queue Type:              MULTI                              
  Node:                    0                                  
  Device Type:             CPU                                
  Cache Info:              
    L1:                      32768(0x8000) KB                   
  Chip ID:                 0(0x0)                             
  ASIC Revision:           0(0x0)                             
  Cacheline Size:          64(0x40)                           
  Max Clock Freq. (MHz):   3950                               
  BDFID:                   0                                  
  Internal Node ID:        0                                  
  Compute Unit:            12                                 
  SIMDs per CU:            0                                  
  Shader Engines:          0                                  
  Shader Arrs. per Eng.:   0                                  
  WatchPts on Addr. Ranges:1                                  
  Features:                None
  Pool Info:               
    Pool 1                   
      Segment:                 GLOBAL; FLAGS: FINE GRAINED        
      Size:                    16284588(0xf87bac) KB              
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       TRUE                               
    Pool 2                   
      Segment:                 GLOBAL; FLAGS: KERNARG, FINE GRAINED
      Size:                    16284588(0xf87bac) KB              
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       TRUE                               
    Pool 3                   
      Segment:                 GLOBAL; FLAGS: COARSE GRAINED      
      Size:                    16284588(0xf87bac) KB              
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       TRUE                               
  ISA Info:                
*******                  
Agent 2                  
*******                  
  Name:                    gfx803                             
  Uuid:                    GPU-XX                             
  Marketing Name:          AMD Radeon RX 480 Graphics         
  Vendor Name:             AMD                                
  Feature:                 KERNEL_DISPATCH                    
  Profile:                 BASE_PROFILE                       
  Float Round Mode:        NEAR                               
  Max Queue Number:        128(0x80)                          
  Queue Min Size:          64(0x40)                           
  Queue Max Size:          131072(0x20000)                    
  Queue Type:              MULTI                              
  Node:                    1                                  
  Device Type:             GPU                                
  Cache Info:              
    L1:                      16(0x10) KB                        
  Chip ID:                 26591(0x67df)                      
  ASIC Revision:           1(0x1)                             
  Cacheline Size:          64(0x40)                           
  Max Clock Freq. (MHz):   1279                               
  BDFID:                   1536                               
  Internal Node ID:        1                                  
  Compute Unit:            36                                 
  SIMDs per CU:            4                                  
  Shader Engines:          4                                  
  Shader Arrs. per Eng.:   1                                  
  WatchPts on Addr. Ranges:4                                  
  Features:                KERNEL_DISPATCH 
  Fast F16 Operation:      TRUE                               
  Wavefront Size:          64(0x40)                           
  Workgroup Max Size:      1024(0x400)                        
  Workgroup Max Size per Dimension:
    x                        1024(0x400)                        
    y                        1024(0x400)                        
    z                        1024(0x400)                        
  Max Waves Per CU:        40(0x28)                           
  Max Work-item Per CU:    2560(0xa00)                        
  Grid Max Size:           4294967295(0xffffffff)             
  Grid Max Size per Dimension:
    x                        4294967295(0xffffffff)             
    y                        4294967295(0xffffffff)             
    z                        4294967295(0xffffffff)             
  Max fbarriers/Workgrp:   32                                 
  Packet Processor uCode:: 730                                
  SDMA engine uCode::      58                                 
  IOMMU Support::          None                               
  Pool Info:               
    Pool 1                   
      Segment:                 GLOBAL; FLAGS: COARSE GRAINED      
      Size:                    8388608(0x800000) KB               
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       FALSE                              
    Pool 2                   
      Segment:                 GLOBAL; FLAGS:                     
      Size:                    8388608(0x800000) KB               
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       FALSE                              
    Pool 3                   
      Segment:                 GROUP                              
      Size:                    64(0x40) KB                        
      Allocatable:             FALSE                              
      Alloc Granule:           0KB                                
      Alloc Alignment:         0KB                                
      Accessible by all:       FALSE                              
  ISA Info:                
    ISA 1                    
      Name:                    amdgcn-amd-amdhsa--gfx803          
      Machine Models:          HSA_MACHINE_MODEL_LARGE            
      Profiles:                HSA_PROFILE_BASE                   
      Default Rounding Mode:   NEAR                               
      Default Rounding Mode:   NEAR                               
      Fast f16:                TRUE                               
      Workgroup Max Size:      1024(0x400)                        
      Workgroup Max Size per Dimension:
        x                        1024(0x400)                        
        y                        1024(0x400)                        
        z                        1024(0x400)                        
      Grid Max Size:           4294967295(0xffffffff)             
      Grid Max Size per Dimension:
        x                        4294967295(0xffffffff)             
        y                        4294967295(0xffffffff)             
        z                        4294967295(0xffffffff)             
      FBarrier Max Size:       32                                 
*** Done ***             

You have the same GPU like jusgrave why do you not check first if your GPU is officially Supported by ROCm?

<!-- gh-comment-id:1924496499 --> @MichaelFomenko commented on GitHub (Feb 2, 2024): > my rocminfo > > ``` > �[37mROCk module is loaded�[0m > ===================== > HSA System Attributes > ===================== > Runtime Version: 1.1 > System Timestamp Freq.: 1000.000000MHz > Sig. Max Wait Duration: 18446744073709551615 (0xFFFFFFFFFFFFFFFF) (timestamp count) > Machine Model: LARGE > System Endianness: LITTLE > Mwaitx: DISABLED > DMAbuf Support: YES > > ========== > HSA Agents > ========== > ******* > Agent 1 > ******* > Name: AMD Ryzen 5 3600 6-Core Processor > Uuid: CPU-XX > Marketing Name: AMD Ryzen 5 3600 6-Core Processor > Vendor Name: CPU > Feature: None specified > Profile: FULL_PROFILE > Float Round Mode: NEAR > Max Queue Number: 0(0x0) > Queue Min Size: 0(0x0) > Queue Max Size: 0(0x0) > Queue Type: MULTI > Node: 0 > Device Type: CPU > Cache Info: > L1: 32768(0x8000) KB > Chip ID: 0(0x0) > ASIC Revision: 0(0x0) > Cacheline Size: 64(0x40) > Max Clock Freq. (MHz): 3950 > BDFID: 0 > Internal Node ID: 0 > Compute Unit: 12 > SIMDs per CU: 0 > Shader Engines: 0 > Shader Arrs. per Eng.: 0 > WatchPts on Addr. Ranges:1 > Features: None > Pool Info: > Pool 1 > Segment: GLOBAL; FLAGS: FINE GRAINED > Size: 16284588(0xf87bac) KB > Allocatable: TRUE > Alloc Granule: 4KB > Alloc Alignment: 4KB > Accessible by all: TRUE > Pool 2 > Segment: GLOBAL; FLAGS: KERNARG, FINE GRAINED > Size: 16284588(0xf87bac) KB > Allocatable: TRUE > Alloc Granule: 4KB > Alloc Alignment: 4KB > Accessible by all: TRUE > Pool 3 > Segment: GLOBAL; FLAGS: COARSE GRAINED > Size: 16284588(0xf87bac) KB > Allocatable: TRUE > Alloc Granule: 4KB > Alloc Alignment: 4KB > Accessible by all: TRUE > ISA Info: > ******* > Agent 2 > ******* > Name: gfx803 > Uuid: GPU-XX > Marketing Name: AMD Radeon RX 480 Graphics > Vendor Name: AMD > Feature: KERNEL_DISPATCH > Profile: BASE_PROFILE > Float Round Mode: NEAR > Max Queue Number: 128(0x80) > Queue Min Size: 64(0x40) > Queue Max Size: 131072(0x20000) > Queue Type: MULTI > Node: 1 > Device Type: GPU > Cache Info: > L1: 16(0x10) KB > Chip ID: 26591(0x67df) > ASIC Revision: 1(0x1) > Cacheline Size: 64(0x40) > Max Clock Freq. (MHz): 1279 > BDFID: 1536 > Internal Node ID: 1 > Compute Unit: 36 > SIMDs per CU: 4 > Shader Engines: 4 > Shader Arrs. per Eng.: 1 > WatchPts on Addr. Ranges:4 > Features: KERNEL_DISPATCH > Fast F16 Operation: TRUE > Wavefront Size: 64(0x40) > Workgroup Max Size: 1024(0x400) > Workgroup Max Size per Dimension: > x 1024(0x400) > y 1024(0x400) > z 1024(0x400) > Max Waves Per CU: 40(0x28) > Max Work-item Per CU: 2560(0xa00) > Grid Max Size: 4294967295(0xffffffff) > Grid Max Size per Dimension: > x 4294967295(0xffffffff) > y 4294967295(0xffffffff) > z 4294967295(0xffffffff) > Max fbarriers/Workgrp: 32 > Packet Processor uCode:: 730 > SDMA engine uCode:: 58 > IOMMU Support:: None > Pool Info: > Pool 1 > Segment: GLOBAL; FLAGS: COARSE GRAINED > Size: 8388608(0x800000) KB > Allocatable: TRUE > Alloc Granule: 4KB > Alloc Alignment: 4KB > Accessible by all: FALSE > Pool 2 > Segment: GLOBAL; FLAGS: > Size: 8388608(0x800000) KB > Allocatable: TRUE > Alloc Granule: 4KB > Alloc Alignment: 4KB > Accessible by all: FALSE > Pool 3 > Segment: GROUP > Size: 64(0x40) KB > Allocatable: FALSE > Alloc Granule: 0KB > Alloc Alignment: 0KB > Accessible by all: FALSE > ISA Info: > ISA 1 > Name: amdgcn-amd-amdhsa--gfx803 > Machine Models: HSA_MACHINE_MODEL_LARGE > Profiles: HSA_PROFILE_BASE > Default Rounding Mode: NEAR > Default Rounding Mode: NEAR > Fast f16: TRUE > Workgroup Max Size: 1024(0x400) > Workgroup Max Size per Dimension: > x 1024(0x400) > y 1024(0x400) > z 1024(0x400) > Grid Max Size: 4294967295(0xffffffff) > Grid Max Size per Dimension: > x 4294967295(0xffffffff) > y 4294967295(0xffffffff) > z 4294967295(0xffffffff) > FBarrier Max Size: 32 > *** Done *** > ``` You have the same GPU like [jusgrave](https://github.com/jusgrave) why do you not check first if your GPU is officially Supported by ROCm?
Author
Owner

@acbp commented on GitHub (Feb 2, 2024):

It's been tricky ! but stable-diffusion works well with rocm5.4.2

my rocminfo

�[37mROCk module is loaded�[0m
=====================    
HSA System Attributes    
=====================    
Runtime Version:         1.1
System Timestamp Freq.:  1000.000000MHz
Sig. Max Wait Duration:  18446744073709551615 (0xFFFFFFFFFFFFFFFF) (timestamp count)
Machine Model:           LARGE                              
System Endianness:       LITTLE                             
Mwaitx:                  DISABLED
DMAbuf Support:          YES

==========               
HSA Agents               
==========               
*******                  
Agent 1                  
*******                  
  Name:                    AMD Ryzen 5 3600 6-Core Processor  
  Uuid:                    CPU-XX                             
  Marketing Name:          AMD Ryzen 5 3600 6-Core Processor  
  Vendor Name:             CPU                                
  Feature:                 None specified                     
  Profile:                 FULL_PROFILE                       
  Float Round Mode:        NEAR                               
  Max Queue Number:        0(0x0)                             
  Queue Min Size:          0(0x0)                             
  Queue Max Size:          0(0x0)                             
  Queue Type:              MULTI                              
  Node:                    0                                  
  Device Type:             CPU                                
  Cache Info:              
    L1:                      32768(0x8000) KB                   
  Chip ID:                 0(0x0)                             
  ASIC Revision:           0(0x0)                             
  Cacheline Size:          64(0x40)                           
  Max Clock Freq. (MHz):   3950                               
  BDFID:                   0                                  
  Internal Node ID:        0                                  
  Compute Unit:            12                                 
  SIMDs per CU:            0                                  
  Shader Engines:          0                                  
  Shader Arrs. per Eng.:   0                                  
  WatchPts on Addr. Ranges:1                                  
  Features:                None
  Pool Info:               
    Pool 1                   
      Segment:                 GLOBAL; FLAGS: FINE GRAINED        
      Size:                    16284588(0xf87bac) KB              
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       TRUE                               
    Pool 2                   
      Segment:                 GLOBAL; FLAGS: KERNARG, FINE GRAINED
      Size:                    16284588(0xf87bac) KB              
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       TRUE                               
    Pool 3                   
      Segment:                 GLOBAL; FLAGS: COARSE GRAINED      
      Size:                    16284588(0xf87bac) KB              
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       TRUE                               
  ISA Info:                
*******                  
Agent 2                  
*******                  
  Name:                    gfx803                             
  Uuid:                    GPU-XX                             
  Marketing Name:          AMD Radeon RX 480 Graphics         
  Vendor Name:             AMD                                
  Feature:                 KERNEL_DISPATCH                    
  Profile:                 BASE_PROFILE                       
  Float Round Mode:        NEAR                               
  Max Queue Number:        128(0x80)                          
  Queue Min Size:          64(0x40)                           
  Queue Max Size:          131072(0x20000)                    
  Queue Type:              MULTI                              
  Node:                    1                                  
  Device Type:             GPU                                
  Cache Info:              
    L1:                      16(0x10) KB                        
  Chip ID:                 26591(0x67df)                      
  ASIC Revision:           1(0x1)                             
  Cacheline Size:          64(0x40)                           
  Max Clock Freq. (MHz):   1279                               
  BDFID:                   1536                               
  Internal Node ID:        1                                  
  Compute Unit:            36                                 
  SIMDs per CU:            4                                  
  Shader Engines:          4                                  
  Shader Arrs. per Eng.:   1                                  
  WatchPts on Addr. Ranges:4                                  
  Features:                KERNEL_DISPATCH 
  Fast F16 Operation:      TRUE                               
  Wavefront Size:          64(0x40)                           
  Workgroup Max Size:      1024(0x400)                        
  Workgroup Max Size per Dimension:
    x                        1024(0x400)                        
    y                        1024(0x400)                        
    z                        1024(0x400)                        
  Max Waves Per CU:        40(0x28)                           
  Max Work-item Per CU:    2560(0xa00)                        
  Grid Max Size:           4294967295(0xffffffff)             
  Grid Max Size per Dimension:
    x                        4294967295(0xffffffff)             
    y                        4294967295(0xffffffff)             
    z                        4294967295(0xffffffff)             
  Max fbarriers/Workgrp:   32                                 
  Packet Processor uCode:: 730                                
  SDMA engine uCode::      58                                 
  IOMMU Support::          None                               
  Pool Info:               
    Pool 1                   
      Segment:                 GLOBAL; FLAGS: COARSE GRAINED      
      Size:                    8388608(0x800000) KB               
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       FALSE                              
    Pool 2                   
      Segment:                 GLOBAL; FLAGS:                     
      Size:                    8388608(0x800000) KB               
      Allocatable:             TRUE                               
      Alloc Granule:           4KB                                
      Alloc Alignment:         4KB                                
      Accessible by all:       FALSE                              
    Pool 3                   
      Segment:                 GROUP                              
      Size:                    64(0x40) KB                        
      Allocatable:             FALSE                              
      Alloc Granule:           0KB                                
      Alloc Alignment:         0KB                                
      Accessible by all:       FALSE                              
  ISA Info:                
    ISA 1                    
      Name:                    amdgcn-amd-amdhsa--gfx803          
      Machine Models:          HSA_MACHINE_MODEL_LARGE            
      Profiles:                HSA_PROFILE_BASE                   
      Default Rounding Mode:   NEAR                               
      Default Rounding Mode:   NEAR                               
      Fast f16:                TRUE                               
      Workgroup Max Size:      1024(0x400)                        
      Workgroup Max Size per Dimension:
        x                        1024(0x400)                        
        y                        1024(0x400)                        
        z                        1024(0x400)                        
      Grid Max Size:           4294967295(0xffffffff)             
      Grid Max Size per Dimension:
        x                        4294967295(0xffffffff)             
        y                        4294967295(0xffffffff)             
        z                        4294967295(0xffffffff)             
      FBarrier Max Size:       32                                 
*** Done ***             

You have the same GPU like jusgrave why do you not check first if your GPU is officially Supported by ROCm?

<!-- gh-comment-id:1924508162 --> @acbp commented on GitHub (Feb 2, 2024): It's been tricky ! but stable-diffusion works well with rocm5.4.2 > > my rocminfo > > ``` > > �[37mROCk module is loaded�[0m > > ===================== > > HSA System Attributes > > ===================== > > Runtime Version: 1.1 > > System Timestamp Freq.: 1000.000000MHz > > Sig. Max Wait Duration: 18446744073709551615 (0xFFFFFFFFFFFFFFFF) (timestamp count) > > Machine Model: LARGE > > System Endianness: LITTLE > > Mwaitx: DISABLED > > DMAbuf Support: YES > > > > ========== > > HSA Agents > > ========== > > ******* > > Agent 1 > > ******* > > Name: AMD Ryzen 5 3600 6-Core Processor > > Uuid: CPU-XX > > Marketing Name: AMD Ryzen 5 3600 6-Core Processor > > Vendor Name: CPU > > Feature: None specified > > Profile: FULL_PROFILE > > Float Round Mode: NEAR > > Max Queue Number: 0(0x0) > > Queue Min Size: 0(0x0) > > Queue Max Size: 0(0x0) > > Queue Type: MULTI > > Node: 0 > > Device Type: CPU > > Cache Info: > > L1: 32768(0x8000) KB > > Chip ID: 0(0x0) > > ASIC Revision: 0(0x0) > > Cacheline Size: 64(0x40) > > Max Clock Freq. (MHz): 3950 > > BDFID: 0 > > Internal Node ID: 0 > > Compute Unit: 12 > > SIMDs per CU: 0 > > Shader Engines: 0 > > Shader Arrs. per Eng.: 0 > > WatchPts on Addr. Ranges:1 > > Features: None > > Pool Info: > > Pool 1 > > Segment: GLOBAL; FLAGS: FINE GRAINED > > Size: 16284588(0xf87bac) KB > > Allocatable: TRUE > > Alloc Granule: 4KB > > Alloc Alignment: 4KB > > Accessible by all: TRUE > > Pool 2 > > Segment: GLOBAL; FLAGS: KERNARG, FINE GRAINED > > Size: 16284588(0xf87bac) KB > > Allocatable: TRUE > > Alloc Granule: 4KB > > Alloc Alignment: 4KB > > Accessible by all: TRUE > > Pool 3 > > Segment: GLOBAL; FLAGS: COARSE GRAINED > > Size: 16284588(0xf87bac) KB > > Allocatable: TRUE > > Alloc Granule: 4KB > > Alloc Alignment: 4KB > > Accessible by all: TRUE > > ISA Info: > > ******* > > Agent 2 > > ******* > > Name: gfx803 > > Uuid: GPU-XX > > Marketing Name: AMD Radeon RX 480 Graphics > > Vendor Name: AMD > > Feature: KERNEL_DISPATCH > > Profile: BASE_PROFILE > > Float Round Mode: NEAR > > Max Queue Number: 128(0x80) > > Queue Min Size: 64(0x40) > > Queue Max Size: 131072(0x20000) > > Queue Type: MULTI > > Node: 1 > > Device Type: GPU > > Cache Info: > > L1: 16(0x10) KB > > Chip ID: 26591(0x67df) > > ASIC Revision: 1(0x1) > > Cacheline Size: 64(0x40) > > Max Clock Freq. (MHz): 1279 > > BDFID: 1536 > > Internal Node ID: 1 > > Compute Unit: 36 > > SIMDs per CU: 4 > > Shader Engines: 4 > > Shader Arrs. per Eng.: 1 > > WatchPts on Addr. Ranges:4 > > Features: KERNEL_DISPATCH > > Fast F16 Operation: TRUE > > Wavefront Size: 64(0x40) > > Workgroup Max Size: 1024(0x400) > > Workgroup Max Size per Dimension: > > x 1024(0x400) > > y 1024(0x400) > > z 1024(0x400) > > Max Waves Per CU: 40(0x28) > > Max Work-item Per CU: 2560(0xa00) > > Grid Max Size: 4294967295(0xffffffff) > > Grid Max Size per Dimension: > > x 4294967295(0xffffffff) > > y 4294967295(0xffffffff) > > z 4294967295(0xffffffff) > > Max fbarriers/Workgrp: 32 > > Packet Processor uCode:: 730 > > SDMA engine uCode:: 58 > > IOMMU Support:: None > > Pool Info: > > Pool 1 > > Segment: GLOBAL; FLAGS: COARSE GRAINED > > Size: 8388608(0x800000) KB > > Allocatable: TRUE > > Alloc Granule: 4KB > > Alloc Alignment: 4KB > > Accessible by all: FALSE > > Pool 2 > > Segment: GLOBAL; FLAGS: > > Size: 8388608(0x800000) KB > > Allocatable: TRUE > > Alloc Granule: 4KB > > Alloc Alignment: 4KB > > Accessible by all: FALSE > > Pool 3 > > Segment: GROUP > > Size: 64(0x40) KB > > Allocatable: FALSE > > Alloc Granule: 0KB > > Alloc Alignment: 0KB > > Accessible by all: FALSE > > ISA Info: > > ISA 1 > > Name: amdgcn-amd-amdhsa--gfx803 > > Machine Models: HSA_MACHINE_MODEL_LARGE > > Profiles: HSA_PROFILE_BASE > > Default Rounding Mode: NEAR > > Default Rounding Mode: NEAR > > Fast f16: TRUE > > Workgroup Max Size: 1024(0x400) > > Workgroup Max Size per Dimension: > > x 1024(0x400) > > y 1024(0x400) > > z 1024(0x400) > > Grid Max Size: 4294967295(0xffffffff) > > Grid Max Size per Dimension: > > x 4294967295(0xffffffff) > > y 4294967295(0xffffffff) > > z 4294967295(0xffffffff) > > FBarrier Max Size: 32 > > *** Done *** > > ``` > > You have the same GPU like [jusgrave](https://github.com/jusgrave) why do you not check first if your GPU is officially Supported by ROCm?
Author
Owner

@jusgrave commented on GitHub (Feb 2, 2024):

@MichaelFomenko sorry about that thanks for your help

<!-- gh-comment-id:1924521045 --> @jusgrave commented on GitHub (Feb 2, 2024): @MichaelFomenko sorry about that thanks for your help
Author
Owner

@MichaelFomenko commented on GitHub (Feb 2, 2024):

@MichaelFomenko sorry about that thanks for your help

no Problem, but hear me out, just use Vulkan Backend in llama.cpp and it will work, because Vulkan is supported by your GPU.

<!-- gh-comment-id:1924535173 --> @MichaelFomenko commented on GitHub (Feb 2, 2024): > @MichaelFomenko sorry about that thanks for your help no Problem, but hear me out, just use Vulkan Backend in llama.cpp and it will work, because Vulkan is supported by your GPU.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#27105