The openwebup support api usage like [OWEB]/ollama/api/generate for base mode loaded from ollama.
However, if I want to wrapper the base model (for example, the qwen2 model) with certern
system prompt
knowledge base for RAG
The [OWEB]/ollama/api/generate will return status code: 400.
below is a sample that get property result via [OWEB]/ollama/api/generate , the model named qwen2:72b-instruct-q4_0
If I wrapper it in a customGPTs that even with no any extra setting. (we name it qwentest)
The reason for such suggestion.
The [OWEB]/ollama/api/generate is usually for the code completion task. Currently, it barely base on the ability of the base model such as starcode2 or deepseek-code. Enable preset prompt may help to build much more robust code. Moreover, I also wise the code completion can eventully become text completion that for writting as copilot way
Originally created by @veya2ztn on GitHub (Jul 3, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/3609
The openwebup support api usage like `[OWEB]/ollama/api/generate` for base mode loaded from ollama.
However, if I want to wrapper the base model (for example, the `qwen2` model) with certern
- system prompt
- knowledge base for RAG
The `[OWEB]/ollama/api/generate` will return ` status code: 400`.
below is a sample that get property result via `[OWEB]/ollama/api/generate` , the model named `qwen2:72b-instruct-q4_0`
If I wrapper it in a customGPTs that even with no any extra setting. (we name it `qwentest`)
----------
# The reason for such suggestion.
The `[OWEB]/ollama/api/generate` is usually for the `code completion` task. Currently, it barely base on the ability of the base model such as starcode2 or deepseek-code. Enable preset prompt may help to build much more robust code. Moreover, I also wise the `code completion` can eventully become `text completion` that for `writting as copilot way`
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
Originally created by @veya2ztn on GitHub (Jul 3, 2024).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/3609
The openwebup support api usage like
[OWEB]/ollama/api/generatefor base mode loaded from ollama.However, if I want to wrapper the base model (for example, the
qwen2model) with certernThe
[OWEB]/ollama/api/generatewill returnstatus code: 400.below is a sample that get property result via
[OWEB]/ollama/api/generate, the model namedqwen2:72b-instruct-q4_0If I wrapper it in a customGPTs that even with no any extra setting. (we name it
qwentest)The reason for such suggestion.
The
[OWEB]/ollama/api/generateis usually for thecode completiontask. Currently, it barely base on the ability of the base model such as starcode2 or deepseek-code. Enable preset prompt may help to build much more robust code. Moreover, I also wise thecode completioncan eventully becometext completionthat forwritting as copilot way