github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-24 06:31:50 -05:00
Code Issues 16.9k Packages Projects Releases 122 Wiki Activity

[GH-ISSUE #5733] Installation on Linux fails because /usr/share/ollama does not exist. #81249

New Issue
Closed
opened 2026-05-09 10:43:11 -05:00 by GiteaMirror · 5 comments
GiteaMirror commented 2026-05-09 10:43:11 -05:00
Owner
Copy Link

Originally created by @richardstevenhack on GitHub (Jul 16, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/5733

What is the issue?

When you install using the install script on openSUSE Tumbleweed, the script fails because the adduser command with the -m does not create the directory /usr/share/ollama, it merely assigns that directory to the ollama user.

I had Claude Sonnet go over the install script line by line explaining to me what it does. Here is what Claude has to say about that line in response to this query: Correct me if I'm wrong, but this line here: $SUDO useradd -r -s /bin/false -U -m -d /usr/share/ollama ollama creates the account with the home directory at /usr/share/ollams. Where in the script is that directory created?

Claude Sonnet:
Claude 3.5 Sonnet
You're absolutely correct, and I apologize for the oversight in my previous explanation. You've made a very astute observation. Let's clarify this:

The line you mentioned:

bash

Copy code
$SUDO useradd -r -s /bin/false -U -m -d /usr/share/ollama ollama
Indeed creates the 'ollama' user with the home directory set to /usr/share/ollama.

You're right to question where this directory is created. In the original script, there isn't an explicit command to create this directory. The -m option in the useradd command is supposed to create the home directory if it doesn't exist, but it's generally a good practice to ensure the parent directory exists.

To improve this, we should add a line to create the directory before creating the user. Here's how we could modify that section:

bash

Copy code
if ! id ollama >/dev/null 2>&1; then
status "Creating ollama user..."
$SUDO mkdir -p /usr/share/ollama
$SUDO useradd -r -s /bin/false -U -m -d /usr/share/ollama ollama
fi
This change ensures that the /usr/share/ollama directory exists before we try to create the user with that home directory.

Thank you for catching this. It's an important detail that could potentially cause issues if the parent directory /usr/share didn't exist or wasn't writable. Your attention to detail helps improve the robustness of the script.

OS

Linux

GPU

AMD

CPU

AMD

Ollama version

v0.2.5

Originally created by @richardstevenhack on GitHub (Jul 16, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/5733 ### What is the issue? When you install using the install script on openSUSE Tumbleweed, the script fails because the adduser command with the -m does not create the directory /usr/share/ollama, it merely assigns that directory to the ollama user. I had Claude Sonnet go over the install script line by line explaining to me what it does. Here is what Claude has to say about that line in response to this query: Correct me if I'm wrong, but this line here: $SUDO useradd -r -s /bin/false -U -m -d /usr/share/ollama ollama creates the account with the home directory at /usr/share/ollams. Where in the script is that directory created? Claude Sonnet: Claude 3.5 Sonnet You're absolutely correct, and I apologize for the oversight in my previous explanation. You've made a very astute observation. Let's clarify this: The line you mentioned: bash Copy code $SUDO useradd -r -s /bin/false -U -m -d /usr/share/ollama ollama Indeed creates the 'ollama' user with the home directory set to /usr/share/ollama. You're right to question where this directory is created. In the original script, there isn't an explicit command to create this directory. The -m option in the useradd command is supposed to create the home directory if it doesn't exist, but it's generally a good practice to ensure the parent directory exists. To improve this, we should add a line to create the directory before creating the user. Here's how we could modify that section: bash Copy code if ! id ollama >/dev/null 2>&1; then status "Creating ollama user..." $SUDO mkdir -p /usr/share/ollama $SUDO useradd -r -s /bin/false -U -m -d /usr/share/ollama ollama fi This change ensures that the /usr/share/ollama directory exists before we try to create the user with that home directory. Thank you for catching this. It's an important detail that could potentially cause issues if the parent directory /usr/share didn't exist or wasn't writable. Your attention to detail helps improve the robustness of the script. ### OS Linux ### GPU AMD ### CPU AMD ### Ollama version v0.2.5
GiteaMirror added the bug label 2026-05-09 10:43:11 -05:00
GiteaMirror commented 2026-05-09 10:43:13 -05:00
Author
Owner
Copy Link

@richardstevenhack commented on GitHub (Jul 16, 2024):

By the way here is the result of the latest script on openSUSE Tumbleweed:
`rhack@localhost:/Data2/Work> curl -fsSL https://ollama.com/install.sh | sh

Downloading ollama...
######################################################################## 100.0%#=#=#
Installing ollama to /usr/local/bin...
[sudo] password for root:
Adding ollama user to render group...
Adding ollama user to video group...
Adding current user to ollama group...
Creating ollama systemd service...
Enabling and starting ollama service...
Downloading AMD GPU dependencies...
chmod: cannot access '/usr/share/ollama': No such file or directory
rhack@localhost:/Data2/Work>
`

<!-- gh-comment-id:2231907542 --> @richardstevenhack commented on GitHub (Jul 16, 2024): By the way here is the result of the latest script on openSUSE Tumbleweed: `rhack@localhost:/Data2/Work> curl -fsSL https://ollama.com/install.sh | sh >>> Downloading ollama... ######################################################################## 100.0%#=#=# >>> Installing ollama to /usr/local/bin... [sudo] password for root: >>> Adding ollama user to render group... >>> Adding ollama user to video group... >>> Adding current user to ollama group... >>> Creating ollama systemd service... >>> Enabling and starting ollama service... >>> Downloading AMD GPU dependencies... chmod: cannot access '/usr/share/ollama': No such file or directory rhack@localhost:/Data2/Work> `
GiteaMirror commented 2026-05-09 10:43:14 -05:00
Author
Owner
Copy Link

@richardstevenhack commented on GitHub (Jul 16, 2024):

This is what happens after inserting the corrected create directory line in the script and re-executing:
rhack@localhost:/Data2/Work> sudo ./install.sh

Downloading ollama...
######################################################################################################################################################################################################################################################### 100.0%#=#=- # ######################################################################################################################################################################################################################################################### 100.0%
Installing ollama to /usr/bin...
Adding ollama user to render group...
Adding ollama user to video group...
Adding current user to ollama group...
Creating ollama systemd service...
Enabling and starting ollama service...
Downloading AMD GPU dependencies...
chmod: cannot access '/usr/share/ollama': No such file or directory

The problem, it turns out, is that /usr/share/ollama is also referred to in the AMD GPU installation section of the script. Here is is my interaction with Claude on that issue:

However, it appears that where the script fails is not in the create user section, but in the AMD GPU section here:status "Downloading AMD GPU dependencies..."
$SUDO rm -rf /usr/share/ollama/lib
$SUDO chmod o+x /usr/share/ollama
$SUDO install -o ollama -g ollama -m 755 -d /usr/share/ollama/lib/rocm
curl --fail --show-error --location --progress-bar "https://ollama.com/download/ollama-linux-amd64-rocm.tgz${VER_PARAM}"
| $SUDO tar zx --owner ollama --group ollama -C /usr/share/ollama/lib/rocm .
install_success
status "AMD GPU ready."
exit 0

Claude 3.5 Sonnet
Thank you for this clarification. You're right, and I apologize for not catching this earlier. The issue is indeed in the AMD GPU section. Let's analyze and fix this part:

bash

Copy code
status "Downloading AMD GPU dependencies..."
$SUDO rm -rf /usr/share/ollama/lib
$SUDO chmod o+x /usr/share/ollama
$SUDO install -o ollama -g ollama -m 755 -d /usr/share/ollama/lib/rocm
curl --fail --show-error --location --progress-bar "https://ollama.com/download/ollama-linux-amd64-rocm.tgz${VER_PARAM}"
| $SUDO tar zx --owner ollama --group ollama -C /usr/share/ollama/lib/rocm .
The problem here is that this section assumes /usr/share/ollama already exists, which may not be the case. To fix this, we need to ensure the directory exists before performing operations on it. Here's a modified version:

bash

Copy code
status "Downloading AMD GPU dependencies..."
$SUDO mkdir -p /usr/share/ollama
$SUDO chown root:root /usr/share/ollama
$SUDO chmod 755 /usr/share/ollama

$SUDO rm -rf /usr/share/ollama/lib
$SUDO chmod o+x /usr/share/ollama
$SUDO install -o ollama -g ollama -m 755 -d /usr/share/ollama/lib/rocm
curl --fail --show-error --location --progress-bar "https://ollama.com/download/ollama-linux-amd64-rocm.tgz${VER_PARAM}"
| $SUDO tar zx --owner ollama --group ollama -C /usr/share/ollama/lib/rocm .
This modification:

Creates the /usr/share/ollama directory if it doesn't exist.
Sets the correct ownership and permissions for this directory.
Then proceeds with the original operations.
Additionally, to make the script more robust, you might want to add checks before each operation:

bash

Copy code
status "Downloading AMD GPU dependencies..."
$SUDO mkdir -p /usr/share/ollama || error "Failed to create /usr/share/ollama"
$SUDO chown root:root /usr/share/ollama || error "Failed to set ownership of /usr/share/ollama"
$SUDO chmod 755 /usr/share/ollama || error "Failed to set permissions for /usr/share/ollama"

$SUDO rm -rf /usr/share/ollama/lib || error "Failed to remove /usr/share/ollama/lib"
$SUDO chmod o+x /usr/share/ollama || error "Failed to set execute permissions for /usr/share/ollama"
$SUDO install -o ollama -g ollama -m 755 -d /usr/share/ollama/lib/rocm || error "Failed to create /usr/share/ollama/lib/rocm"
curl --fail --show-error --location --progress-bar "https://ollama.com/download/ollama-linux-amd64-rocm.tgz${VER_PARAM}"
| $SUDO tar zx --owner ollama --group ollama -C /usr/share/ollama/lib/rocm . || error "Failed to download and extract AMD GPU dependencies"
These changes should resolve the issue with the AMD GPU section. If you're still encountering problems, it would be helpful to know any specific error messages you're seeing.

You
It seems to me that I can not do this line: $SUDO mkdir -p /usr/share/ollama in two different places in the script, since the directory may have been created earlier in the script, such as when the ollama user was created. How can we fix this?

Claude 3.5 Sonnet
You're absolutely right, and that's a great observation. We should indeed avoid redundant operations and potential conflicts. Here's how we can improve the script to handle this more efficiently:

First, let's create a function to ensure the /usr/share/ollama directory exists and has the correct permissions. We'll put this near the beginning of the script:
bash

Copy code
ensure_ollama_dir() {
if [ ! -d "/usr/share/ollama" ]; then
status "Creating Ollama directory..."
$SUDO mkdir -p /usr/share/ollama || error "Failed to create /usr/share/ollama"
fi
$SUDO chown root:root /usr/share/ollama || error "Failed to set ownership of /usr/share/ollama"
$SUDO chmod 755 /usr/share/ollama || error "Failed to set permissions for /usr/share/ollama"
}
Now, we'll call this function before creating the user:
bash

Copy code
if ! id ollama >/dev/null 2>&1; then
status "Creating ollama user..."
ensure_ollama_dir
$SUDO useradd -r -s /bin/false -U -m -d /usr/share/ollama ollama
fi
In the AMD GPU section, we'll call the function again instead of recreating the directory:
bash

Copy code
status "Downloading AMD GPU dependencies..."
ensure_ollama_dir

$SUDO rm -rf /usr/share/ollama/lib || error "Failed to remove /usr/share/ollama/lib"
$SUDO chmod o+x /usr/share/ollama || error "Failed to set execute permissions for /usr/share/ollama"
$SUDO install -o ollama -g ollama -m 755 -d /usr/share/ollama/lib/rocm || error "Failed to create /usr/share/ollama/lib/rocm"
curl --fail --show-error --location --progress-bar "https://ollama.com/download/ollama-linux-amd64-rocm.tgz${VER_PARAM}"
| $SUDO tar zx --owner ollama --group ollama -C /usr/share/ollama/lib/rocm . || error "Failed to download and extract AMD GPU dependencies"
This approach has several advantages:

It centralizes the logic for creating and setting up the /usr/share/ollama directory.
It avoids redundant mkdir operations.
It ensures consistent permissions and ownership throughout the script.
If the directory already exists, it will just verify and set the correct permissions without causing any errors.
This modification should resolve the issue of potentially creating the same directory multiple times while ensuring that the directory exists with the correct permissions whenever it's needed in the script.

So I made the necessary modifications and reran the script. This time it ran to completion, installed the ollama binary in /usr/bin/ollama, create the /usr/share/ollama directory and installed the AMD GPU ROCm libraries as well in that directory.

<!-- gh-comment-id:2231949300 --> @richardstevenhack commented on GitHub (Jul 16, 2024): This is what happens after inserting the corrected create directory line in the script and re-executing: rhack@localhost:/Data2/Work> sudo ./install.sh >>> Downloading ollama... ######################################################################################################################################################################################################################################################### 100.0%#=#=- # ######################################################################################################################################################################################################################################################### 100.0% >>> Installing ollama to /usr/bin... >>> Adding ollama user to render group... >>> Adding ollama user to video group... >>> Adding current user to ollama group... >>> Creating ollama systemd service... >>> Enabling and starting ollama service... >>> Downloading AMD GPU dependencies... chmod: cannot access '/usr/share/ollama': No such file or directory The problem, it turns out, is that /usr/share/ollama is also referred to in the AMD GPU installation section of the script. Here is is my interaction with Claude on that issue: However, it appears that where the script fails is not in the create user section, but in the AMD GPU section here:status "Downloading AMD GPU dependencies..." $SUDO rm -rf /usr/share/ollama/lib $SUDO chmod o+x /usr/share/ollama $SUDO install -o ollama -g ollama -m 755 -d /usr/share/ollama/lib/rocm curl --fail --show-error --location --progress-bar "https://ollama.com/download/ollama-linux-amd64-rocm.tgz${VER_PARAM}" | $SUDO tar zx --owner ollama --group ollama -C /usr/share/ollama/lib/rocm . install_success status "AMD GPU ready." exit 0 Claude 3.5 Sonnet Thank you for this clarification. You're right, and I apologize for not catching this earlier. The issue is indeed in the AMD GPU section. Let's analyze and fix this part: bash Copy code status "Downloading AMD GPU dependencies..." $SUDO rm -rf /usr/share/ollama/lib $SUDO chmod o+x /usr/share/ollama $SUDO install -o ollama -g ollama -m 755 -d /usr/share/ollama/lib/rocm curl --fail --show-error --location --progress-bar "https://ollama.com/download/ollama-linux-amd64-rocm.tgz${VER_PARAM}" \ | $SUDO tar zx --owner ollama --group ollama -C /usr/share/ollama/lib/rocm . The problem here is that this section assumes /usr/share/ollama already exists, which may not be the case. To fix this, we need to ensure the directory exists before performing operations on it. Here's a modified version: bash Copy code status "Downloading AMD GPU dependencies..." $SUDO mkdir -p /usr/share/ollama $SUDO chown root:root /usr/share/ollama $SUDO chmod 755 /usr/share/ollama $SUDO rm -rf /usr/share/ollama/lib $SUDO chmod o+x /usr/share/ollama $SUDO install -o ollama -g ollama -m 755 -d /usr/share/ollama/lib/rocm curl --fail --show-error --location --progress-bar "https://ollama.com/download/ollama-linux-amd64-rocm.tgz${VER_PARAM}" \ | $SUDO tar zx --owner ollama --group ollama -C /usr/share/ollama/lib/rocm . This modification: Creates the /usr/share/ollama directory if it doesn't exist. Sets the correct ownership and permissions for this directory. Then proceeds with the original operations. Additionally, to make the script more robust, you might want to add checks before each operation: bash Copy code status "Downloading AMD GPU dependencies..." $SUDO mkdir -p /usr/share/ollama || error "Failed to create /usr/share/ollama" $SUDO chown root:root /usr/share/ollama || error "Failed to set ownership of /usr/share/ollama" $SUDO chmod 755 /usr/share/ollama || error "Failed to set permissions for /usr/share/ollama" $SUDO rm -rf /usr/share/ollama/lib || error "Failed to remove /usr/share/ollama/lib" $SUDO chmod o+x /usr/share/ollama || error "Failed to set execute permissions for /usr/share/ollama" $SUDO install -o ollama -g ollama -m 755 -d /usr/share/ollama/lib/rocm || error "Failed to create /usr/share/ollama/lib/rocm" curl --fail --show-error --location --progress-bar "https://ollama.com/download/ollama-linux-amd64-rocm.tgz${VER_PARAM}" \ | $SUDO tar zx --owner ollama --group ollama -C /usr/share/ollama/lib/rocm . || error "Failed to download and extract AMD GPU dependencies" These changes should resolve the issue with the AMD GPU section. If you're still encountering problems, it would be helpful to know any specific error messages you're seeing. You It seems to me that I can not do this line: $SUDO mkdir -p /usr/share/ollama in two different places in the script, since the directory may have been created earlier in the script, such as when the ollama user was created. How can we fix this? Claude 3.5 Sonnet You're absolutely right, and that's a great observation. We should indeed avoid redundant operations and potential conflicts. Here's how we can improve the script to handle this more efficiently: First, let's create a function to ensure the /usr/share/ollama directory exists and has the correct permissions. We'll put this near the beginning of the script: bash Copy code ensure_ollama_dir() { if [ ! -d "/usr/share/ollama" ]; then status "Creating Ollama directory..." $SUDO mkdir -p /usr/share/ollama || error "Failed to create /usr/share/ollama" fi $SUDO chown root:root /usr/share/ollama || error "Failed to set ownership of /usr/share/ollama" $SUDO chmod 755 /usr/share/ollama || error "Failed to set permissions for /usr/share/ollama" } Now, we'll call this function before creating the user: bash Copy code if ! id ollama >/dev/null 2>&1; then status "Creating ollama user..." ensure_ollama_dir $SUDO useradd -r -s /bin/false -U -m -d /usr/share/ollama ollama fi In the AMD GPU section, we'll call the function again instead of recreating the directory: bash Copy code status "Downloading AMD GPU dependencies..." ensure_ollama_dir $SUDO rm -rf /usr/share/ollama/lib || error "Failed to remove /usr/share/ollama/lib" $SUDO chmod o+x /usr/share/ollama || error "Failed to set execute permissions for /usr/share/ollama" $SUDO install -o ollama -g ollama -m 755 -d /usr/share/ollama/lib/rocm || error "Failed to create /usr/share/ollama/lib/rocm" curl --fail --show-error --location --progress-bar "https://ollama.com/download/ollama-linux-amd64-rocm.tgz${VER_PARAM}" \ | $SUDO tar zx --owner ollama --group ollama -C /usr/share/ollama/lib/rocm . || error "Failed to download and extract AMD GPU dependencies" This approach has several advantages: It centralizes the logic for creating and setting up the /usr/share/ollama directory. It avoids redundant mkdir operations. It ensures consistent permissions and ownership throughout the script. If the directory already exists, it will just verify and set the correct permissions without causing any errors. This modification should resolve the issue of potentially creating the same directory multiple times while ensuring that the directory exists with the correct permissions whenever it's needed in the script. So I made the necessary modifications and reran the script. This time it ran to completion, installed the ollama binary in /usr/bin/ollama, create the /usr/share/ollama directory and installed the AMD GPU ROCm libraries as well in that directory.
GiteaMirror commented 2026-05-09 10:43:14 -05:00
Author
Owner
Copy Link

@richardstevenhack commented on GitHub (Jul 16, 2024):

Here is the corrected install script:
`#!/bin/bash

This script installs Ollama on Linux.

It detects the current operating system architecture and installs the appropriate version of Ollama.

set -eu

status() { echo ">>> $" >&2; }
error() { echo "ERROR $"; exit 1; }
warning() { echo "WARNING: $*"; }

TEMP_DIR=$(mktemp -d)
cleanup() { rm -rf $TEMP_DIR; }
trap cleanup EXIT

available() { command -v $1 >/dev/null; }
require() {
local MISSING=''
for TOOL in $*; do
if ! available $TOOL; then
MISSING="$MISSING $TOOL"
fi
done

echo $MISSING

}

[ "$(uname -s)" = "Linux" ] || error 'This script is intended to run on Linux only.'

ARCH=$(uname -m)
case "$ARCH" in
x86_64) ARCH="amd64" ;;
aarch64|arm64) ARCH="arm64" ;;
*) error "Unsupported architecture: $ARCH" ;;
esac

IS_WSL2=false

KERN=$(uname -r)
case "$KERN" in
icrosoftWSL2 | icrosoftwsl2) IS_WSL2=true;;
*icrosoft) error "Microsoft WSL1 is not currently supported. Please upgrade to WSL2 with 'wsl --set-version 2'" ;;
*) ;;
esac

VER_PARAM="${OLLAMA_VERSION:+?version=$OLLAMA_VERSION}"

SUDO=
if [ "$(id -u)" -ne 0 ]; then
# Running as root, no need for sudo
if ! available sudo; then
error "This script requires superuser permissions. Please re-run as root."
fi

SUDO="sudo"

fi

NEEDS=$(require curl awk grep sed tee xargs)
if [ -n "$NEEDS" ]; then
status "ERROR: The following tools are required but missing:"
for NEED in $NEEDS; do
echo " - $NEED"
done
exit 1
fi

status "Downloading ollama..."
curl --fail --show-error --location --progress-bar -o $TEMP_DIR/ollama "https://ollama.com/download/ollama-linux-${ARCH}${VER_PARAM}"

for BINDIR in /usr/local/bin /usr/bin /bin; do
echo $PATH | grep -q $BINDIR && break || continue
done

status "Installing ollama to $BINDIR..."
$SUDO install -o0 -g0 -m755 -d $BINDIR
$SUDO install -o0 -g0 -m755 $TEMP_DIR/ollama $BINDIR/ollama

install_success() {
status 'The Ollama API is now available at 127.0.0.1:11434.'
status 'Install complete. Run "ollama" from the command line.'
}
trap install_success EXIT

Everything from this point onwards is optional.

#This function ensures that the /usr/share/ollama directory is created before it's referenced further in the script.
ensure_ollama_dir() {
if [ ! -d "/usr/share/ollama" ]; then
status "Creating Ollama directory..."
$SUDO mkdir -p /usr/share/ollama || error "Failed to create /usr/share/ollama"
fi
$SUDO chown root:root /usr/share/ollama || error "Failed to set ownership of /usr/share/ollama"
$SUDO chmod 755 /usr/share/ollama || error "Failed to set permissions for /usr/share/ollama"
}

configure_systemd() {
if ! id ollama >/dev/null 2>&1; then
status "Creating ollama user..."
ensure_ollama_dir
$SUDO useradd -r -s /bin/false -U -d /usr/share/ollama ollama
$SUDO chown ollama:ollama /usr/share/ollama
fi
if getent group render >/dev/null 2>&1; then
status "Adding ollama user to render group..."
$SUDO usermod -a -G render ollama
fi
if getent group video >/dev/null 2>&1; then
status "Adding ollama user to video group..."
$SUDO usermod -a -G video ollama
fi

status "Adding current user to ollama group..."
$SUDO usermod -a -G ollama $(whoami)

status "Creating ollama systemd service..."
cat <<EOF | $SUDO tee /etc/systemd/system/ollama.service >/dev/null

[Unit]
Description=Ollama Service
After=network-online.target

[Service]
ExecStart=$BINDIR/ollama serve
User=ollama
Group=ollama
Restart=always
RestartSec=3
Environment="PATH=$PATH"

[Install]
WantedBy=default.target
EOF
SYSTEMCTL_RUNNING="$(systemctl is-system-running || true)"
case $SYSTEMCTL_RUNNING in
running|degraded)
status "Enabling and starting ollama service..."
$SUDO systemctl daemon-reload
$SUDO systemctl enable ollama

        start_service() { $SUDO systemctl restart ollama; }
        trap start_service EXIT
        ;;
esac

}

if available systemctl; then
configure_systemd
fi

WSL2 only supports GPUs via nvidia passthrough

so check for nvidia-smi to determine if GPU is available

if [ "$IS_WSL2" = true ]; then
if available nvidia-smi && [ -n "$(nvidia-smi | grep -o "CUDA Version: [0-9].[0-9]")" ]; then
status "Nvidia GPU detected."
fi
install_success
exit 0
fi

Install GPU dependencies on Linux

if ! available lspci && ! available lshw; then
warning "Unable to detect NVIDIA/AMD GPU. Install lspci or lshw to automatically detect and install GPU dependencies."
exit 0
fi

check_gpu() {
# Look for devices based on vendor ID for NVIDIA and AMD
case $1 in
lspci)
case $2 in
nvidia) available lspci && lspci -d '10de:' | grep -q 'NVIDIA' || return 1 ;;
amdgpu) available lspci && lspci -d '1002:' | grep -q 'AMD' || return 1 ;;
esac ;;
lshw)
case $2 in
nvidia) available lshw && $SUDO lshw -c display -numeric -disable network | grep -q 'vendor: .* [10DE]' || return 1 ;;
amdgpu) available lshw && $SUDO lshw -c display -numeric -disable network | grep -q 'vendor: .* [1002]' || return 1 ;;
esac ;;
nvidia-smi) available nvidia-smi || return 1 ;;
esac
}

if check_gpu nvidia-smi; then
status "NVIDIA GPU installed."
exit 0
fi

if ! check_gpu lspci nvidia && ! check_gpu lshw nvidia && ! check_gpu lspci amdgpu && ! check_gpu lshw amdgpu; then
install_success
warning "No NVIDIA/AMD GPU detected. Ollama will run in CPU-only mode."
exit 0
fi

if check_gpu lspci amdgpu || check_gpu lshw amdgpu; then
# Look for pre-existing ROCm v6 before downloading the dependencies
for search in "${HIP_PATH:-''}" "${ROCM_PATH:-''}" "/opt/rocm" "/usr/lib64"; do
if [ -n "${search}" ] && [ -e "${search}/libhipblas.so.2" -o -e "${search}/lib/libhipblas.so.2" ]; then
status "Compatible AMD GPU ROCm library detected at ${search}"
install_success
exit 0
fi
done

status "Downloading AMD GPU dependencies..."
ensure_ollama_dir
$SUDO rm -rf /usr/share/ollama/lib
$SUDO chmod o+x /usr/share/ollama
$SUDO install -o ollama -g ollama -m 755 -d /usr/share/ollama/lib/rocm
curl --fail --show-error --location --progress-bar "https://ollama.com/download/ollama-linux-amd64-rocm.tgz${VER_PARAM}" \
    | $SUDO tar zx --owner ollama --group ollama -C /usr/share/ollama/lib/rocm .
install_success
status "AMD GPU ready."
exit 0

fi

ref: https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#rhel-7-centos-7

ref: https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#rhel-8-rocky-8

ref: https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#rhel-9-rocky-9

ref: https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#fedora

install_cuda_driver_yum() {
status 'Installing NVIDIA repository...'
case $PACKAGE_MANAGER in
yum)
$SUDO $PACKAGE_MANAGER -y install yum-utils
$SUDO $PACKAGE_MANAGER-config-manager --add-repo https://developer.download.nvidia.com/compute/cuda/repos/$1$2/$(uname -m)/cuda-$1$2.repo
;;
dnf)
$SUDO $PACKAGE_MANAGER config-manager --add-repo https://developer.download.nvidia.com/compute/cuda/repos/$1$2/$(uname -m)/cuda-$1$2.repo
;;
esac

case $1 in
    rhel)
        status 'Installing EPEL repository...'
        # EPEL is required for third-party dependencies such as dkms and libvdpau
        $SUDO $PACKAGE_MANAGER -y install https://dl.fedoraproject.org/pub/epel/epel-release-latest-$2.noarch.rpm || true
        ;;
esac

status 'Installing CUDA driver...'

if [ "$1" = 'centos' ] || [ "$1$2" = 'rhel7' ]; then
    $SUDO $PACKAGE_MANAGER -y install nvidia-driver-latest-dkms
fi

$SUDO $PACKAGE_MANAGER -y install cuda-drivers

}

ref: https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#ubuntu

ref: https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#debian

install_cuda_driver_apt() {
status 'Installing NVIDIA repository...'
curl -fsSL -o $TEMP_DIR/cuda-keyring.deb https://developer.download.nvidia.com/compute/cuda/repos/$1$2/$(uname -m)/cuda-keyring_1.1-1_all.deb

case $1 in
    debian)
        status 'Enabling contrib sources...'
        $SUDO sed 's/main/contrib/' < /etc/apt/sources.list | $SUDO tee /etc/apt/sources.list.d/contrib.list > /dev/null
        if [ -f "/etc/apt/sources.list.d/debian.sources" ]; then
            $SUDO sed 's/main/contrib/' < /etc/apt/sources.list.d/debian.sources | $SUDO tee /etc/apt/sources.list.d/contrib.sources > /dev/null
        fi
        ;;
esac

status 'Installing CUDA driver...'
$SUDO dpkg -i $TEMP_DIR/cuda-keyring.deb
$SUDO apt-get update

[ -n "$SUDO" ] && SUDO_E="$SUDO -E" || SUDO_E=
DEBIAN_FRONTEND=noninteractive $SUDO_E apt-get -y install cuda-drivers -q

}

if [ ! -f "/etc/os-release" ]; then
error "Unknown distribution. Skipping CUDA installation."
fi

. /etc/os-release

OS_NAME=$ID
OS_VERSION=$VERSION_ID

PACKAGE_MANAGER=
for PACKAGE_MANAGER in dnf yum apt-get; do
if available $PACKAGE_MANAGER; then
break
fi
done

if [ -z "$PACKAGE_MANAGER" ]; then
error "Unknown package manager. Skipping CUDA installation."
fi

if ! check_gpu nvidia-smi || [ -z "$(nvidia-smi | grep -o "CUDA Version: [0-9].[0-9]")" ]; then
case $OS_NAME in
centos|rhel) install_cuda_driver_yum 'rhel' $(echo $OS_VERSION | cut -d '.' -f 1) ;;
rocky) install_cuda_driver_yum 'rhel' $(echo $OS_VERSION | cut -c1) ;;
fedora) [ $OS_VERSION -lt '39' ] && install_cuda_driver_yum $OS_NAME $OS_VERSION || install_cuda_driver_yum $OS_NAME '39';;
amzn) install_cuda_driver_yum 'fedora' '37' ;;
debian) install_cuda_driver_apt $OS_NAME $OS_VERSION ;;
ubuntu) install_cuda_driver_apt $OS_NAME $(echo $OS_VERSION | sed 's/.//') ;;
*) exit ;;
esac
fi

if ! lsmod | grep -q nvidia || ! lsmod | grep -q nvidia_uvm; then
KERNEL_RELEASE="$(uname -r)"
case $OS_NAME in
rocky) $SUDO $PACKAGE_MANAGER -y install kernel-devel kernel-headers ;;
centos|rhel|amzn) $SUDO $PACKAGE_MANAGER -y install kernel-devel-$KERNEL_RELEASE kernel-headers-$KERNEL_RELEASE ;;
fedora) $SUDO $PACKAGE_MANAGER -y install kernel-devel-$KERNEL_RELEASE ;;
debian|ubuntu) $SUDO apt-get -y install linux-headers-$KERNEL_RELEASE ;;
*) exit ;;
esac

NVIDIA_CUDA_VERSION=$($SUDO dkms status | awk -F: '/added/ { print $1 }')
if [ -n "$NVIDIA_CUDA_VERSION" ]; then
    $SUDO dkms install $NVIDIA_CUDA_VERSION
fi

if lsmod | grep -q nouveau; then
    status 'Reboot to complete NVIDIA CUDA driver install.'
    exit 0
fi

$SUDO modprobe nvidia
$SUDO modprobe nvidia_uvm

fi

make sure the NVIDIA modules are loaded on boot with nvidia-persistenced

if command -v nvidia-persistenced > /dev/null 2>&1; then
$SUDO touch /etc/modules-load.d/nvidia.conf
MODULES="nvidia nvidia-uvm"
for MODULE in $MODULES; do
if ! grep -qxF "$MODULE" /etc/modules-load.d/nvidia.conf; then
echo "$MODULE" | sudo tee -a /etc/modules-load.d/nvidia.conf > /dev/null
fi
done
fi

status "NVIDIA GPU ready."
install_success
`

<!-- gh-comment-id:2231951091 --> @richardstevenhack commented on GitHub (Jul 16, 2024): Here is the corrected install script: `#!/bin/bash # This script installs Ollama on Linux. # It detects the current operating system architecture and installs the appropriate version of Ollama. set -eu status() { echo ">>> $*" >&2; } error() { echo "ERROR $*"; exit 1; } warning() { echo "WARNING: $*"; } TEMP_DIR=$(mktemp -d) cleanup() { rm -rf $TEMP_DIR; } trap cleanup EXIT available() { command -v $1 >/dev/null; } require() { local MISSING='' for TOOL in $*; do if ! available $TOOL; then MISSING="$MISSING $TOOL" fi done echo $MISSING } [ "$(uname -s)" = "Linux" ] || error 'This script is intended to run on Linux only.' ARCH=$(uname -m) case "$ARCH" in x86_64) ARCH="amd64" ;; aarch64|arm64) ARCH="arm64" ;; *) error "Unsupported architecture: $ARCH" ;; esac IS_WSL2=false KERN=$(uname -r) case "$KERN" in *icrosoft*WSL2 | *icrosoft*wsl2) IS_WSL2=true;; *icrosoft) error "Microsoft WSL1 is not currently supported. Please upgrade to WSL2 with 'wsl --set-version <distro> 2'" ;; *) ;; esac VER_PARAM="${OLLAMA_VERSION:+?version=$OLLAMA_VERSION}" SUDO= if [ "$(id -u)" -ne 0 ]; then # Running as root, no need for sudo if ! available sudo; then error "This script requires superuser permissions. Please re-run as root." fi SUDO="sudo" fi NEEDS=$(require curl awk grep sed tee xargs) if [ -n "$NEEDS" ]; then status "ERROR: The following tools are required but missing:" for NEED in $NEEDS; do echo " - $NEED" done exit 1 fi status "Downloading ollama..." curl --fail --show-error --location --progress-bar -o $TEMP_DIR/ollama "https://ollama.com/download/ollama-linux-${ARCH}${VER_PARAM}" for BINDIR in /usr/local/bin /usr/bin /bin; do echo $PATH | grep -q $BINDIR && break || continue done status "Installing ollama to $BINDIR..." $SUDO install -o0 -g0 -m755 -d $BINDIR $SUDO install -o0 -g0 -m755 $TEMP_DIR/ollama $BINDIR/ollama install_success() { status 'The Ollama API is now available at 127.0.0.1:11434.' status 'Install complete. Run "ollama" from the command line.' } trap install_success EXIT # Everything from this point onwards is optional. #This function ensures that the /usr/share/ollama directory is created before it's referenced further in the script. ensure_ollama_dir() { if [ ! -d "/usr/share/ollama" ]; then status "Creating Ollama directory..." $SUDO mkdir -p /usr/share/ollama || error "Failed to create /usr/share/ollama" fi $SUDO chown root:root /usr/share/ollama || error "Failed to set ownership of /usr/share/ollama" $SUDO chmod 755 /usr/share/ollama || error "Failed to set permissions for /usr/share/ollama" } configure_systemd() { if ! id ollama >/dev/null 2>&1; then status "Creating ollama user..." ensure_ollama_dir $SUDO useradd -r -s /bin/false -U -d /usr/share/ollama ollama $SUDO chown ollama:ollama /usr/share/ollama fi if getent group render >/dev/null 2>&1; then status "Adding ollama user to render group..." $SUDO usermod -a -G render ollama fi if getent group video >/dev/null 2>&1; then status "Adding ollama user to video group..." $SUDO usermod -a -G video ollama fi status "Adding current user to ollama group..." $SUDO usermod -a -G ollama $(whoami) status "Creating ollama systemd service..." cat <<EOF | $SUDO tee /etc/systemd/system/ollama.service >/dev/null [Unit] Description=Ollama Service After=network-online.target [Service] ExecStart=$BINDIR/ollama serve User=ollama Group=ollama Restart=always RestartSec=3 Environment="PATH=$PATH" [Install] WantedBy=default.target EOF SYSTEMCTL_RUNNING="$(systemctl is-system-running || true)" case $SYSTEMCTL_RUNNING in running|degraded) status "Enabling and starting ollama service..." $SUDO systemctl daemon-reload $SUDO systemctl enable ollama start_service() { $SUDO systemctl restart ollama; } trap start_service EXIT ;; esac } if available systemctl; then configure_systemd fi # WSL2 only supports GPUs via nvidia passthrough # so check for nvidia-smi to determine if GPU is available if [ "$IS_WSL2" = true ]; then if available nvidia-smi && [ -n "$(nvidia-smi | grep -o "CUDA Version: [0-9]*\.[0-9]*")" ]; then status "Nvidia GPU detected." fi install_success exit 0 fi # Install GPU dependencies on Linux if ! available lspci && ! available lshw; then warning "Unable to detect NVIDIA/AMD GPU. Install lspci or lshw to automatically detect and install GPU dependencies." exit 0 fi check_gpu() { # Look for devices based on vendor ID for NVIDIA and AMD case $1 in lspci) case $2 in nvidia) available lspci && lspci -d '10de:' | grep -q 'NVIDIA' || return 1 ;; amdgpu) available lspci && lspci -d '1002:' | grep -q 'AMD' || return 1 ;; esac ;; lshw) case $2 in nvidia) available lshw && $SUDO lshw -c display -numeric -disable network | grep -q 'vendor: .* \[10DE\]' || return 1 ;; amdgpu) available lshw && $SUDO lshw -c display -numeric -disable network | grep -q 'vendor: .* \[1002\]' || return 1 ;; esac ;; nvidia-smi) available nvidia-smi || return 1 ;; esac } if check_gpu nvidia-smi; then status "NVIDIA GPU installed." exit 0 fi if ! check_gpu lspci nvidia && ! check_gpu lshw nvidia && ! check_gpu lspci amdgpu && ! check_gpu lshw amdgpu; then install_success warning "No NVIDIA/AMD GPU detected. Ollama will run in CPU-only mode." exit 0 fi if check_gpu lspci amdgpu || check_gpu lshw amdgpu; then # Look for pre-existing ROCm v6 before downloading the dependencies for search in "${HIP_PATH:-''}" "${ROCM_PATH:-''}" "/opt/rocm" "/usr/lib64"; do if [ -n "${search}" ] && [ -e "${search}/libhipblas.so.2" -o -e "${search}/lib/libhipblas.so.2" ]; then status "Compatible AMD GPU ROCm library detected at ${search}" install_success exit 0 fi done status "Downloading AMD GPU dependencies..." ensure_ollama_dir $SUDO rm -rf /usr/share/ollama/lib $SUDO chmod o+x /usr/share/ollama $SUDO install -o ollama -g ollama -m 755 -d /usr/share/ollama/lib/rocm curl --fail --show-error --location --progress-bar "https://ollama.com/download/ollama-linux-amd64-rocm.tgz${VER_PARAM}" \ | $SUDO tar zx --owner ollama --group ollama -C /usr/share/ollama/lib/rocm . install_success status "AMD GPU ready." exit 0 fi # ref: https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#rhel-7-centos-7 # ref: https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#rhel-8-rocky-8 # ref: https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#rhel-9-rocky-9 # ref: https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#fedora install_cuda_driver_yum() { status 'Installing NVIDIA repository...' case $PACKAGE_MANAGER in yum) $SUDO $PACKAGE_MANAGER -y install yum-utils $SUDO $PACKAGE_MANAGER-config-manager --add-repo https://developer.download.nvidia.com/compute/cuda/repos/$1$2/$(uname -m)/cuda-$1$2.repo ;; dnf) $SUDO $PACKAGE_MANAGER config-manager --add-repo https://developer.download.nvidia.com/compute/cuda/repos/$1$2/$(uname -m)/cuda-$1$2.repo ;; esac case $1 in rhel) status 'Installing EPEL repository...' # EPEL is required for third-party dependencies such as dkms and libvdpau $SUDO $PACKAGE_MANAGER -y install https://dl.fedoraproject.org/pub/epel/epel-release-latest-$2.noarch.rpm || true ;; esac status 'Installing CUDA driver...' if [ "$1" = 'centos' ] || [ "$1$2" = 'rhel7' ]; then $SUDO $PACKAGE_MANAGER -y install nvidia-driver-latest-dkms fi $SUDO $PACKAGE_MANAGER -y install cuda-drivers } # ref: https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#ubuntu # ref: https://docs.nvidia.com/cuda/cuda-installation-guide-linux/index.html#debian install_cuda_driver_apt() { status 'Installing NVIDIA repository...' curl -fsSL -o $TEMP_DIR/cuda-keyring.deb https://developer.download.nvidia.com/compute/cuda/repos/$1$2/$(uname -m)/cuda-keyring_1.1-1_all.deb case $1 in debian) status 'Enabling contrib sources...' $SUDO sed 's/main/contrib/' < /etc/apt/sources.list | $SUDO tee /etc/apt/sources.list.d/contrib.list > /dev/null if [ -f "/etc/apt/sources.list.d/debian.sources" ]; then $SUDO sed 's/main/contrib/' < /etc/apt/sources.list.d/debian.sources | $SUDO tee /etc/apt/sources.list.d/contrib.sources > /dev/null fi ;; esac status 'Installing CUDA driver...' $SUDO dpkg -i $TEMP_DIR/cuda-keyring.deb $SUDO apt-get update [ -n "$SUDO" ] && SUDO_E="$SUDO -E" || SUDO_E= DEBIAN_FRONTEND=noninteractive $SUDO_E apt-get -y install cuda-drivers -q } if [ ! -f "/etc/os-release" ]; then error "Unknown distribution. Skipping CUDA installation." fi . /etc/os-release OS_NAME=$ID OS_VERSION=$VERSION_ID PACKAGE_MANAGER= for PACKAGE_MANAGER in dnf yum apt-get; do if available $PACKAGE_MANAGER; then break fi done if [ -z "$PACKAGE_MANAGER" ]; then error "Unknown package manager. Skipping CUDA installation." fi if ! check_gpu nvidia-smi || [ -z "$(nvidia-smi | grep -o "CUDA Version: [0-9]*\.[0-9]*")" ]; then case $OS_NAME in centos|rhel) install_cuda_driver_yum 'rhel' $(echo $OS_VERSION | cut -d '.' -f 1) ;; rocky) install_cuda_driver_yum 'rhel' $(echo $OS_VERSION | cut -c1) ;; fedora) [ $OS_VERSION -lt '39' ] && install_cuda_driver_yum $OS_NAME $OS_VERSION || install_cuda_driver_yum $OS_NAME '39';; amzn) install_cuda_driver_yum 'fedora' '37' ;; debian) install_cuda_driver_apt $OS_NAME $OS_VERSION ;; ubuntu) install_cuda_driver_apt $OS_NAME $(echo $OS_VERSION | sed 's/\.//') ;; *) exit ;; esac fi if ! lsmod | grep -q nvidia || ! lsmod | grep -q nvidia_uvm; then KERNEL_RELEASE="$(uname -r)" case $OS_NAME in rocky) $SUDO $PACKAGE_MANAGER -y install kernel-devel kernel-headers ;; centos|rhel|amzn) $SUDO $PACKAGE_MANAGER -y install kernel-devel-$KERNEL_RELEASE kernel-headers-$KERNEL_RELEASE ;; fedora) $SUDO $PACKAGE_MANAGER -y install kernel-devel-$KERNEL_RELEASE ;; debian|ubuntu) $SUDO apt-get -y install linux-headers-$KERNEL_RELEASE ;; *) exit ;; esac NVIDIA_CUDA_VERSION=$($SUDO dkms status | awk -F: '/added/ { print $1 }') if [ -n "$NVIDIA_CUDA_VERSION" ]; then $SUDO dkms install $NVIDIA_CUDA_VERSION fi if lsmod | grep -q nouveau; then status 'Reboot to complete NVIDIA CUDA driver install.' exit 0 fi $SUDO modprobe nvidia $SUDO modprobe nvidia_uvm fi # make sure the NVIDIA modules are loaded on boot with nvidia-persistenced if command -v nvidia-persistenced > /dev/null 2>&1; then $SUDO touch /etc/modules-load.d/nvidia.conf MODULES="nvidia nvidia-uvm" for MODULE in $MODULES; do if ! grep -qxF "$MODULE" /etc/modules-load.d/nvidia.conf; then echo "$MODULE" | sudo tee -a /etc/modules-load.d/nvidia.conf > /dev/null fi done fi status "NVIDIA GPU ready." install_success `
GiteaMirror commented 2026-05-09 10:43:14 -05:00
Author
Owner
Copy Link

@richardstevenhack commented on GitHub (Jul 16, 2024):

One note: replace the /bin/bash with /bin/sh as in the original script. Not everyone uses bash. I changed it for my use case.

<!-- gh-comment-id:2231952156 --> @richardstevenhack commented on GitHub (Jul 16, 2024): One note: replace the /bin/bash with /bin/sh as in the original script. Not everyone uses bash. I changed it for my use case.
GiteaMirror commented 2026-05-09 10:43:15 -05:00
Author
Owner
Copy Link

@vikyw89 commented on GitHub (Jul 24, 2024):

i had this problem when installing ollama today.

last month I didn't have this problem

i'm on ubuntu 24

<!-- gh-comment-id:2248539892 --> @vikyw89 commented on GitHub (Jul 24, 2024): i had this problem when installing ollama today. last month I didn't have this problem i'm on ubuntu 24
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label bug
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#81249
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?