github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-07 08:30:05 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #6320] Ubuntu based rocm images #29727

New Issue
Closed
opened 2026-04-22 08:54:02 -05:00 by GiteaMirror · 3 comments
GiteaMirror commented 2026-04-22 08:54:02 -05:00
Owner
Copy Link

Originally created by @kunaltyagi on GitHub (Aug 12, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/6320

Currently, rocm image is based on centos. Could we add ubuntu based rocm images as well?

Originally created by @kunaltyagi on GitHub (Aug 12, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/6320 Currently, rocm image is based on centos. Could we add ubuntu based rocm images as well?
GiteaMirror added the feature request label 2026-04-22 08:54:02 -05:00
GiteaMirror commented 2026-04-22 08:54:04 -05:00
Author
Owner
Copy Link

@jmorganca commented on GitHub (Sep 2, 2024):

Hi @kunaltyagi, thanks for the issue!

We built with centos since it has an older and more compatible version of glibc. May I ask why you'd want Ubuntu-based images? They are quite large and so we're hoping to stick to one Docker image – let me know and I can re-open the issue as needed!

<!-- gh-comment-id:2325389107 --> @jmorganca commented on GitHub (Sep 2, 2024): Hi @kunaltyagi, thanks for the issue! We built with centos since it has an older and more compatible version of glibc. May I ask why you'd want Ubuntu-based images? They are quite large and so we're hoping to stick to one Docker image – let me know and I can re-open the issue as needed!
GiteaMirror commented 2026-04-22 08:54:04 -05:00
Author
Owner
Copy Link

@kunaltyagi commented on GitHub (Sep 3, 2024):

I'm not able to use centos image in my docker compose, but using rocm ubuntu base, I was able to set the groups and use the GPU

How should I use the centos rocm images so I can use GPU?

<!-- gh-comment-id:2326235353 --> @kunaltyagi commented on GitHub (Sep 3, 2024): I'm not able to use centos image in my docker compose, but using rocm ubuntu base, I was able to set the groups and use the GPU How should I use the centos rocm images so I can use GPU?
GiteaMirror commented 2026-04-22 08:54:05 -05:00
Author
Owner
Copy Link

@cazlo commented on GitHub (Oct 16, 2024):

There are several compelling reasons to make the switch to Ubuntu Rocm layers away from Centos.

In this case, the Ubuntu layers are actually a little smaller:

Also Centos 7 is EOL, while Ubuntu 24.04 is not. See also https://endoflife.date/centos

Also Ubuntu 24.04 is officially supported by Rocm, while Centos 7 is not. See also https://rocm.docs.amd.com/en/docs-6.2.0/about/release-notes.html#operating-system-and-hardware-support-changes

ROCm 6.2.0 marks the end of support (EoS) for:
...
CentOS 7.9

I'm messing around with a few performance analysis tests now, if I get some time, I'll see if there is an easy migration path to the Ubuntu image.

<!-- gh-comment-id:2417860510 --> @cazlo commented on GitHub (Oct 16, 2024): There are several compelling reasons to make the switch to Ubuntu Rocm layers away from Centos. In this case, the Ubuntu layers are actually a little smaller: - [rocm/dev-ubuntu-24.04:6.2](https://hub.docker.com/r/rocm/dev-ubuntu-24.04/tags) = 1.0 GB (last push 2 months ago) - [rocm/dev-centos-7:6.2](https://hub.docker.com/r/rocm/dev-centos-7/tags) = 1.68 GB (last push 2 months ago) Also Centos 7 is EOL, while Ubuntu 24.04 is not. See also https://endoflife.date/centos Also Ubuntu 24.04 is officially supported by Rocm, while Centos 7 is not. See also https://rocm.docs.amd.com/en/docs-6.2.0/about/release-notes.html#operating-system-and-hardware-support-changes > ROCm 6.2.0 marks the end of support (EoS) for: > ... > CentOS 7.9 I'm messing around with a few performance analysis tests now, if I get some time, I'll see if there is an easy migration path to the Ubuntu image.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#29727
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?