[GH-ISSUE #10212] request: run models directly in the browser #6699

Open
opened 2026-04-12 18:26:03 -05:00 by GiteaMirror · 4 comments
Owner

Originally created by @mcandre on GitHub (Apr 10, 2025).
Original GitHub issue: https://github.com/ollama/ollama/issues/10212

Especially for smaller models, it would be convenient and an amazing demo experience, if the main ollama website were able to cache and execute prompts against selected models, without having to install ollama or fiddle with CLI or REST components.

Perhaps there is a third party site that does this?

Originally created by @mcandre on GitHub (Apr 10, 2025). Original GitHub issue: https://github.com/ollama/ollama/issues/10212 Especially for smaller models, it would be convenient and an amazing demo experience, if the main ollama website were able to cache and execute prompts against selected models, without having to install ollama or fiddle with CLI or REST components. Perhaps there is a third party site that does this?
GiteaMirror added the feature request label 2026-04-12 18:26:03 -05:00
Author
Owner

@JasonHonKL commented on GitHub (Apr 10, 2025):

Ollama is only for backend only.

<!-- gh-comment-id:2791681226 --> @JasonHonKL commented on GitHub (Apr 10, 2025): Ollama is only for backend only.
Author
Owner

@toastloaf commented on GitHub (Apr 10, 2025):

I mean, its possible and has been done before, but Ollama is for backend. WebLLM is probably what you're looking for.

<!-- gh-comment-id:2791694146 --> @toastloaf commented on GitHub (Apr 10, 2025): I mean, its possible and has been done before, but Ollama is for backend. WebLLM is probably what you're looking for.
Author
Owner

@mcandre commented on GitHub (Apr 10, 2025):

seems like a few lines of code would integrate the backend with the frontend

when browsing models i want the option of trying out some test prompts before deciding whether to use them with the CLI client

<!-- gh-comment-id:2793155435 --> @mcandre commented on GitHub (Apr 10, 2025): seems like a few lines of code would integrate the backend with the frontend when browsing models i want the option of trying out some test prompts before deciding whether to use them with the CLI client
Author
Owner

@tool2d commented on GitHub (Apr 11, 2025):

It's possible to convert phi4 to ONNX format and run it on WebGPU. However, Ollama can't do that because it lacks ONNX support.

<!-- gh-comment-id:2795832832 --> @tool2d commented on GitHub (Apr 11, 2025): It's possible to convert phi4 to ONNX format and run it on WebGPU. However, Ollama can't do that because it lacks ONNX support.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#6699