github-starred/ollama
2
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-05-06 16:11:34 -05:00
Code Issues 14.5k Packages Projects Releases 120 Wiki Activity

[GH-ISSUE #1612] Add support for RWKV #26656

New Issue
Open
opened 2026-04-22 03:04:24 -05:00 by GiteaMirror · 11 comments
GiteaMirror commented 2026-04-22 03:04:24 -05:00
Owner
Copy Link

Originally created by @kristianpaul on GitHub (Dec 19, 2023).
Original GitHub issue: https://github.com/ollama/ollama/issues/1612

Not sure if this RNN counts as a LLM, but if so would be nice to have it, let me know what needs to be done with packaging.

https://www.rwkv.com/

Originally created by @kristianpaul on GitHub (Dec 19, 2023). Original GitHub issue: https://github.com/ollama/ollama/issues/1612 Not sure if this RNN counts as a LLM, but if so would be nice to have it, let me know what needs to be done with packaging. https://www.rwkv.com/
GiteaMirror added the model label 2026-04-22 03:04:25 -05:00
GiteaMirror commented 2026-04-22 03:04:30 -05:00
Author
Owner
Copy Link

@technovangelist commented on GitHub (Dec 19, 2023):

Looking at the config file (config.json · RWKV/rwkv-5-world-1b5 at main), it looks like its an architecture not supported by llama.cpp, and thus we are not able to support it yet.

We can leave the issue open to track supporting Rwkv5ForCausalLM

<!-- gh-comment-id:1863330198 --> @technovangelist commented on GitHub (Dec 19, 2023): Looking at the config file ([config.json · RWKV/rwkv-5-world-1b5 at main](https://huggingface.co/RWKV/rwkv-5-world-1b5/blob/main/config.json)), it looks like its an architecture not supported by llama.cpp, and thus we are not able to support it yet. We can leave the issue open to track supporting Rwkv5ForCausalLM
GiteaMirror commented 2026-04-22 03:04:30 -05:00
Author
Owner
Copy Link

@easp commented on GitHub (Dec 21, 2023):

This seems to be where discussion of RWKV support in Lllama.cpp is happening. So far it's really just discussion.

<!-- gh-comment-id:1865307405 --> @easp commented on GitHub (Dec 21, 2023): [This seems to be where discussion of RWKV support in Lllama.cpp is happening](https://github.com/ggerganov/llama.cpp/issues/846). So far it's really just discussion.
GiteaMirror commented 2026-04-22 03:04:30 -05:00
Author
Owner
Copy Link

@sammcj commented on GitHub (Jan 29, 2024):

Especially important now that the 1.0 release (v5) and Eagle 7B is out https://blog.rwkv.com/p/eagle-7b-soaring-past-transformers

<!-- gh-comment-id:1915580755 --> @sammcj commented on GitHub (Jan 29, 2024): Especially important now that the 1.0 release (v5) and Eagle 7B is out https://blog.rwkv.com/p/eagle-7b-soaring-past-transformers
GiteaMirror commented 2026-04-22 03:04:31 -05:00
Author
Owner
Copy Link

@leoforney commented on GitHub (Feb 6, 2024):

Seems like some work has already been done on this https://github.com/RWKV/rwkv.cpp

<!-- gh-comment-id:1930389602 --> @leoforney commented on GitHub (Feb 6, 2024): Seems like some work has already been done on this https://github.com/RWKV/rwkv.cpp
GiteaMirror commented 2026-04-22 03:04:31 -05:00
Author
Owner
Copy Link

@wszgrcy commented on GitHub (Sep 2, 2024):

https://github.com/ggerganov/llama.cpp/pull/8980

<!-- gh-comment-id:2323776303 --> @wszgrcy commented on GitHub (Sep 2, 2024): https://github.com/ggerganov/llama.cpp/pull/8980
GiteaMirror commented 2026-04-22 03:04:31 -05:00
Author
Owner
Copy Link

@mseri commented on GitHub (Sep 4, 2024):

And it is in the llamacpp synced in #6621 :)

<!-- gh-comment-id:2329633625 --> @mseri commented on GitHub (Sep 4, 2024): And it is in the llamacpp synced in #6621 :)
GiteaMirror commented 2026-04-22 03:04:32 -05:00
Author
Owner
Copy Link

@BlinkDL commented on GitHub (Sep 6, 2024):

@technovangelist :) rwkv6 is in llama.cpp now. let me know if you have any issue running it

please check https://github.com/ggerganov/llama.cpp/issues/9315

<!-- gh-comment-id:2334363910 --> @BlinkDL commented on GitHub (Sep 6, 2024): @technovangelist :) rwkv6 is in llama.cpp now. let me know if you have any issue running it please check https://github.com/ggerganov/llama.cpp/issues/9315
GiteaMirror commented 2026-04-22 03:04:32 -05:00
Author
Owner
Copy Link

@someone13574 commented on GitHub (Oct 2, 2024):

Any update on this? What else needs to be done for a model to be added other than llama.cpp support?

<!-- gh-comment-id:2389504762 --> @someone13574 commented on GitHub (Oct 2, 2024): Any update on this? What else needs to be done for a model to be added other than llama.cpp support?
GiteaMirror commented 2026-04-22 03:04:33 -05:00
Author
Owner
Copy Link

@MollySophia commented on GitHub (Oct 23, 2024):

#7313
This should make RWKV v6 support to be in a useable state

<!-- gh-comment-id:2430854954 --> @MollySophia commented on GitHub (Oct 23, 2024): #7313 This should make RWKV v6 support to be in a useable state
GiteaMirror commented 2026-04-22 03:04:34 -05:00
Author
Owner
Copy Link

@Kreijstal commented on GitHub (Feb 8, 2025):

Looking at the config file (config.json · RWKV/rwkv-5-world-1b5 at main), it looks like its an architecture not supported by llama.cpp, and thus we are not able to support it yet.

We can leave the issue open to track supporting Rwkv5ForCausalLM

it is supported now no?
https://github.com/ggerganov/llama.cpp/pull/8980

<!-- gh-comment-id:2644733981 --> @Kreijstal commented on GitHub (Feb 8, 2025): > Looking at the config file ([config.json · RWKV/rwkv-5-world-1b5 at main](https://huggingface.co/RWKV/rwkv-5-world-1b5/blob/main/config.json)), it looks like its an architecture not supported by llama.cpp, and thus we are not able to support it yet. > > We can leave the issue open to track supporting Rwkv5ForCausalLM it is supported now no? https://github.com/ggerganov/llama.cpp/pull/8980
GiteaMirror commented 2026-04-22 03:04:35 -05:00
Author
Owner
Copy Link

@MollySophia commented on GitHub (Feb 8, 2025):

Looking at the config file (config.json · RWKV/rwkv-5-world-1b5 at main), it looks like its an architecture not supported by llama.cpp, and thus we are not able to support it yet.
We can leave the issue open to track supporting Rwkv5ForCausalLM

it is supported now no? ggerganov/llama.cpp#8980

No, we didn't support v5 models.
But you can currently use rwkv v6 with ollama (https://ollama.com/mollysama/rwkv-6-world), and v7 support is coming too

<!-- gh-comment-id:2644734932 --> @MollySophia commented on GitHub (Feb 8, 2025): > > Looking at the config file ([config.json · RWKV/rwkv-5-world-1b5 at main](https://huggingface.co/RWKV/rwkv-5-world-1b5/blob/main/config.json)), it looks like its an architecture not supported by llama.cpp, and thus we are not able to support it yet. > > We can leave the issue open to track supporting Rwkv5ForCausalLM > > it is supported now no? [ggerganov/llama.cpp#8980](https://github.com/ggerganov/llama.cpp/pull/8980) No, we didn't support v5 models. But you can currently use rwkv v6 with ollama (https://ollama.com/mollysama/rwkv-6-world), and v7 support is coming too
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels
amd
api
app
bug
build
cli
cloud
compatibility
context-length
create
docker
documentation
embeddings
feature request
feedback wanted
good first issue
gpt-oss
gpu
harmony
help wanted
image
install
intel
js
launch
linux
macos
memory
mlx
model
needs more info
networking
nvidia
ollama.com
performance
pull-request
Mirrored from GitHub Pull Request
 python
question
registry
rendering
thinking
tools
top
vulkan
windows
wsl
No Label model
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
GiteaMirror ninjasurge
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#26656
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?