[GH-ISSUE #9474] LLaDa and future diffusion LLM (dLLM) support #83859

Open
opened 2026-05-09 19:16:12 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @gotyer on GitHub (Mar 3, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/9474

Since inceptionlabs' new diffusion model, I think we will see many open weights diffusion LLMs even just for their speed advantage, and it would be great if ollama supported them.

Probably quite a lot of ollama's backend would need to be modified to allow diffusion compared to only auto regression.

Here's a dLLM model that could be implemented, both in base or instruct:

https://huggingface.co/GSAI-ML

And here's the project page:

https://github.com/ML-GSAI/LLaDA

Originally created by @gotyer on GitHub (Mar 3, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/9474 Since inceptionlabs' new diffusion model, I think we will see many open weights diffusion LLMs even just for their speed advantage, and it would be great if ollama supported them. Probably quite a lot of ollama's backend would need to be modified to allow diffusion compared to only auto regression. Here's a dLLM model that could be implemented, both in base or instruct: https://huggingface.co/GSAI-ML And here's the project page: https://github.com/ML-GSAI/LLaDA
GiteaMirror added the model label 2026-05-09 19:16:12 -05:00
Author
Owner

@claudiodsf commented on GitHub (Mar 6, 2025):

Does this reply belong to this discussion?

<!-- gh-comment-id:2703480153 --> @claudiodsf commented on GitHub (Mar 6, 2025): Does [this reply](https://github.com/ollama/ollama/issues/9439#issuecomment-2696247452) belong to this discussion?
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#83859