[GH-ISSUE #3156] Unable to load dynamic server library on Mac #27700

Closed
opened 2026-04-22 05:14:27 -05:00 by GiteaMirror · 3 comments
Owner

Originally created by @elewis787 on GitHub (Mar 14, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/3156

Originally assigned to: @dhiltgen on GitHub.

What is the issue?

When using the llm package and calling New the auto-detect dynamic lib fails auto-detect.

This is related to pull request https://github.com/ollama/ollama/pull/2403 and issue https://github.com/ollama/ollama/issues/2386.

The current fix does not set available dynamic libs after auto-detection causing the dynamic lib path to be empty.

availableDynLibs should be checked and used after calling native init.

What did you expect to see?

The expectation is that the dynamic lib will be found

Steps to reproduce

import LLM package and attempt to initialize an LLM using New

Are there any recent changes that introduced the issue?

No response

OS

macOS

Architecture

arm64

Platform

No response

Ollama version

main branch

GPU

Apple

GPU info

No response

CPU

Apple

Other software

No response

Originally created by @elewis787 on GitHub (Mar 14, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/3156 Originally assigned to: @dhiltgen on GitHub. ### What is the issue? When using the llm package and calling New the auto-detect dynamic lib fails auto-detect. This is related to pull request https://github.com/ollama/ollama/pull/2403 and issue https://github.com/ollama/ollama/issues/2386. The current fix does not set available dynamic libs after auto-detection causing the dynamic lib path to be empty. availableDynLibs should be checked and used after calling native init. ### What did you expect to see? The expectation is that the dynamic lib will be found ### Steps to reproduce import LLM package and attempt to initialize an LLM using New ### Are there any recent changes that introduced the issue? _No response_ ### OS macOS ### Architecture arm64 ### Platform _No response_ ### Ollama version main branch ### GPU Apple ### GPU info _No response_ ### CPU Apple ### Other software _No response_
GiteaMirror added the bug label 2026-04-22 05:14:27 -05:00
Author
Owner

@dhiltgen commented on GitHub (Mar 15, 2024):

I think this should be covered by https://github.com/ollama/ollama/pull/3122

<!-- gh-comment-id:2000581032 --> @dhiltgen commented on GitHub (Mar 15, 2024): I think this should be covered by https://github.com/ollama/ollama/pull/3122
Author
Owner

@elewis787 commented on GitHub (Mar 16, 2024):

I think this should be covered by https://github.com/ollama/ollama/pull/3122

I'll pull the changes and test it out. At a first glance I don't know if this solves the empty path for the dynamic libs map but I'll verify.

<!-- gh-comment-id:2001220002 --> @elewis787 commented on GitHub (Mar 16, 2024): > I think this should be covered by https://github.com/ollama/ollama/pull/3122 I'll pull the changes and test it out. At a first glance I don't know if this solves the empty path for the dynamic libs map but I'll verify.
Author
Owner

@dhiltgen commented on GitHub (Apr 12, 2024):

If you're still seeing problems related to tmpdir cleanup, let us know.

<!-- gh-comment-id:2052614297 --> @dhiltgen commented on GitHub (Apr 12, 2024): If you're still seeing problems related to tmpdir cleanup, let us know.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#27700