"suffix" request parameter isn't proxied to Ollama instance at /ollama/api/generate endpoint #2743

Closed
opened 2025-11-11 15:13:27 -06:00 by GiteaMirror · 2 comments
Owner

Originally created by @vills on GitHub (Nov 21, 2024).

Bug Report

Environment

  • Open WebUI Version: v.0.3.25
  • Ollama (if applicable): 0.4.2

Description

I came from discussion https://github.com/open-webui/open-webui/discussions/6720#discussion-7426295.

It looks like (by inspecting GenerateCompletionForm class) that Ollama's "suffix" request parameter is ignored at /ollama/api/generate endpoint (Ollama docs.

This cause problems with recent versions of Continue.dev extension for VSCode.

Please make OWUI respect this parameter.

Thanks.

Originally created by @vills on GitHub (Nov 21, 2024). # Bug Report ## Environment - **Open WebUI Version:** v.0.3.25 - **Ollama (if applicable):** 0.4.2 ## Description I came from discussion https://github.com/open-webui/open-webui/discussions/6720#discussion-7426295. It looks like (by inspecting [GenerateCompletionForm](https://github.com/open-webui/open-webui/blob/main/backend/open_webui/apps/ollama/main.py#L837) class) that Ollama's "suffix" request parameter is ignored at `/ollama/api/generate` endpoint ([Ollama docs](https://github.com/ollama/ollama/blob/main/docs/api.md#generate-a-completion). This cause problems with recent versions of Continue.dev extension for VSCode. Please make OWUI respect this parameter. Thanks.
Author
Owner

@tjbck commented on GitHub (Nov 21, 2024):

Added to dev!

@tjbck commented on GitHub (Nov 21, 2024): Added to dev!
Author
Owner

@vills commented on GitHub (Nov 22, 2024):

Thanks a lot! Works well with 0.4.3 release.

@vills commented on GitHub (Nov 22, 2024): Thanks a lot! Works well with 0.4.3 release.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#2743