github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-07 00:22:43 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #7254] Support directly running GGUF files without importing #4610

New Issue
Open
opened 2026-04-12 15:31:44 -05:00 by GiteaMirror · 1 comment
GiteaMirror commented 2026-04-12 15:31:44 -05:00
Owner
Copy Link

Originally created by @ahizap on GitHub (Oct 18, 2024).
Original GitHub issue: https://github.com/ollama/ollama/issues/7254

In llama.cpp we can directly run models with llama-cli -m your_model.gguf without having to import the model, It would be great if we can do the same with ollama.

Originally created by @ahizap on GitHub (Oct 18, 2024). Original GitHub issue: https://github.com/ollama/ollama/issues/7254 In llama.cpp we can directly run models with `llama-cli -m your_model.gguf ` without having to import the model, It would be great if we can do the same with ollama.
GiteaMirror added the feature request label 2026-04-12 15:31:44 -05:00
GiteaMirror commented 2026-04-12 15:31:45 -05:00
Author
Owner
Copy Link

@JJones780 commented on GitHub (Dec 17, 2024):

If there was an option to link instead of a copy during import that would be very helpful.

An option to "install" without copying the model files would work as well.

For example, Oogabooga's text-gereation-webui 's download-model.py script has an option--text-onlywhich downloads everything except the model files. Then sneakernet for the win.

<!-- gh-comment-id:2549616598 --> @JJones780 commented on GitHub (Dec 17, 2024): If there was an option to link instead of a copy during import that would be very helpful. An option to "install" without copying the model files would work as well. For example, Oogabooga's text-gereation-webui 's download-model.py script has an option` --text-only `which downloads everything except the model files. Then sneakernet for the win.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label feature request
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#4610
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?