Importing (some) models from openwebui.com fails #416

Closed
opened 2025-11-11 14:20:43 -06:00 by GiteaMirror · 9 comments
Owner

Originally created by @jmtatsch on GitHub (Mar 5, 2024).

Bug Report

Description

Bug Summary:
Cant download the phi-2-dolphin model. Some others work.

Steps to Reproduce:
I go to
https://openwebui.com/m/c00100011/microsoft-phi-2-dolphin:latest
click get -> import webui -> referred to my local webui -> save & create -> error pull model manifest: file does not exist
click get -> download as a file -> file downloads but has .txt ending and thus is not shown in the file open dialog
one I rename the file to json it shows but still doesn't import as obviously the format is not real json

Expected Behavior:
I expect the model to be created and download the necessary files

Actual Behavior:
nothing, not even a useful error message

Environment

  • Operating System:
  • macOS Sonoma
  • Browser (if applicable):
  • Safari

Reproduction Details

Confirmation:

  • I have read and followed all the instructions provided in the README.md.
  • I have reviewed the troubleshooting.md document.
  • I have included the browser console logs.
  • I have included the Docker container logs.

Logs and Screenshots

Browser Console Logs:
[Include relevant browser console logs, if applicable]

Docker Container Logs:
[Include relevant Docker container logs, if applicable]

Screenshots (if applicable):
[Attach any relevant screenshots to help illustrate the issue]

Installation Method

Docker compose

Note

If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!

Originally created by @jmtatsch on GitHub (Mar 5, 2024). # Bug Report ## Description **Bug Summary:** Cant download the phi-2-dolphin model. Some others work. **Steps to Reproduce:** I go to https://openwebui.com/m/c00100011/microsoft-phi-2-dolphin:latest click get -> import webui -> referred to my local webui -> save & create -> error pull model manifest: file does not exist click get -> download as a file -> file downloads but has .txt ending and thus is not shown in the file open dialog one I rename the file to json it shows but still doesn't import as obviously the format is not real json **Expected Behavior:** I expect the model to be created and download the necessary files **Actual Behavior:** nothing, not even a useful error message ## Environment - **Operating System:** - macOS Sonoma - **Browser (if applicable):** - Safari ## Reproduction Details **Confirmation:** - [ ] I have read and followed all the instructions provided in the README.md. - [ ] I have reviewed the troubleshooting.md document. - [ ] I have included the browser console logs. - [ ] I have included the Docker container logs. ## Logs and Screenshots **Browser Console Logs:** [Include relevant browser console logs, if applicable] **Docker Container Logs:** [Include relevant Docker container logs, if applicable] **Screenshots (if applicable):** [Attach any relevant screenshots to help illustrate the issue] ## Installation Method Docker compose ## Note If the bug report is incomplete or does not follow the provided instructions, it may not be addressed. Please ensure that you have followed the steps outlined in the README.md and troubleshooting.md documents, and provide all necessary information for us to reproduce and address the issue. Thank you!
Author
Owner

@tjbck commented on GitHub (Mar 5, 2024):

Unable to reproduce the issue, could you make sure you're on the latest version?

@tjbck commented on GitHub (Mar 5, 2024): Unable to reproduce the issue, could you make sure you're on the latest version?
Author
Owner

@jmtatsch commented on GitHub (Mar 5, 2024):

Just upgraded to v0.1.108. Problem is still there.
The other phi recipe works https://openwebui.com/m/sukmyfinga/sme-dolphin-phi:latest
So maybe it's just an older recipe that has become incompatible with updates?

@jmtatsch commented on GitHub (Mar 5, 2024): Just upgraded to v0.1.108. Problem is still there. The other phi recipe works https://openwebui.com/m/sukmyfinga/sme-dolphin-phi:latest So maybe it's just an older recipe that has become incompatible with updates?
Author
Owner

@nathanhere commented on GitHub (Mar 6, 2024):

First time user, also getting this error.

Logs:

INFO:   - "POST /api/v1/modelfiles/ HTTP/1.1" 401 Unauthorized
INFO:   - "POST /ollama/api/api/create HTTP/1.1" 500 Internal Server Error

is that "api/api" an accident?

@nathanhere commented on GitHub (Mar 6, 2024): First time user, also getting this error. Logs: ``` INFO: - "POST /api/v1/modelfiles/ HTTP/1.1" 401 Unauthorized INFO: - "POST /ollama/api/api/create HTTP/1.1" 500 Internal Server Error ``` is that "api/api" an accident?
Author
Owner

@justinh-rahb commented on GitHub (Mar 6, 2024):

is that "api/api" an accident?

Nope, long story but we'll just say backwards compatibility.

@justinh-rahb commented on GitHub (Mar 6, 2024): > is that "api/api" an accident? Nope, long story but we'll just say _backwards compatibility_.
Author
Owner

@nathanhere commented on GitHub (Mar 6, 2024):

ok, more info that might be helpful: it looks like using docker compose, this problem goes away. Previously i was using the "docker run" command when I experienced this issue.

Running on latest preview build of Windows 11, latest version of docker desktop.

@nathanhere commented on GitHub (Mar 6, 2024): ok, more info that might be helpful: it looks like using docker compose, this problem goes away. Previously i was using the "docker run" command when I experienced this issue. Running on latest preview build of Windows 11, latest version of docker desktop.
Author
Owner

@justinh-rahb commented on GitHub (Mar 6, 2024):

ok, more info that might be helpful: it looks like using docker compose, this problem goes away. Previously i was using the "docker run" command when I experienced this issue.

Despite seeming unrelated at first glance, there must be a discernible difference in how Docker is being configured or utilized between your docker run command and what Docker Compose generates. This difference is likely the key to understanding why the problem resolves when using Docker Compose. Check what you've got in docker image ls, this might reveal something.

If the solution with Docker Compose is working to your satisfaction, there might not be an immediate need to investigate further. However, it's important to note that there is still a possibility, even if small, that this issue—or another issue related to the difference between the docker run command and Docker Compose's approach—could resurface and cause problems in the future.

@justinh-rahb commented on GitHub (Mar 6, 2024): > ok, more info that might be helpful: it looks like using docker compose, this problem goes away. Previously i was using the "docker run" command when I experienced this issue. Despite seeming unrelated at first glance, there must be a discernible difference in how Docker is being configured or utilized between your `docker run` command and what Docker Compose generates. This difference is likely the key to understanding why the problem resolves when using Docker Compose. Check what you've got in `docker image ls`, this might reveal something. If the solution with Docker Compose is working to your satisfaction, there might not be an immediate need to investigate further. However, it's important to note that there is still a possibility, even if small, that this issue—or another issue related to the difference between the `docker run` command and Docker Compose's approach—could resurface and cause problems in the future.
Author
Owner

@jmtatsch commented on GitHub (Mar 6, 2024):

I run using docker compose and have that issue.
But I think it's an issue with that model file as some other models work as expected.

@jmtatsch commented on GitHub (Mar 6, 2024): I run using docker compose and have that issue. But I think it's an issue with that model file as some other models work as expected.
Author
Owner

@tjbck commented on GitHub (Mar 6, 2024):

Might have something to do with your Ollama version, make sure you're on the latest version of Ollama as well.

@tjbck commented on GitHub (Mar 6, 2024): Might have something to do with your Ollama version, make sure you're on the latest version of Ollama as well.
Author
Owner

@jmtatsch commented on GitHub (Mar 6, 2024):

Looked a bit deeper and turns out there are actually two issues here:

  1. This recipe is just broken https://openwebui.com/m/c00100011/microsoft-phi-2-dolphin:latest - it looks for dolphin-2_6-phi-2.Q6_K.gguf:latest likely on ollama library which simply doesn't exist (anymore?) Thus the no manifest error.
  2. Import of Modelfiles is broken. Likely the filetype filter is set up for json instead of txt.
    image

My ollama version is up to date.

@jmtatsch commented on GitHub (Mar 6, 2024): Looked a bit deeper and turns out there are actually two issues here: 1. This recipe is just broken https://openwebui.com/m/c00100011/microsoft-phi-2-dolphin:latest - it looks for dolphin-2_6-phi-2.Q6_K.gguf:latest likely on ollama library which simply doesn't exist (anymore?) Thus the no manifest error. 2. Import of Modelfiles is broken. Likely the filetype filter is set up for json instead of txt. ![image](https://github.com/open-webui/open-webui/assets/3080674/f5fc86bd-5e76-4363-8dd6-f32405be55f2) My ollama version is up to date.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#416