[GH-ISSUE #18391] issue: MinerU not working in vllm mode #34111

Closed
opened 2026-04-25 08:02:27 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @joasanna2 on GitHub (Oct 17, 2025).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/18391

Check Existing Issues

  • I have searched for any existing and/or related issues.
  • I have searched for any existing and/or related discussions.
  • I am using the latest version of Open WebUI.

Installation Method

Pip Install

Open WebUI Version

v0.6.34

Ollama Version (if applicable)

v0.12.5

Operating System

Ubuntu 24.04.3 LTS

Browser (if applicable)

Chrome

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided every relevant configuration, setting, and environment variable used in my setup.
  • I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
  • I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
  • Start with the initial platform/version/OS and dependencies used,
  • Specify exact install/launch/configure commands,
  • List URLs visited, user input (incl. example values/emails/passwords if needed),
  • Describe all options and toggles enabled or changed,
  • Include any files or environmental changes,
  • Identify the expected and actual result at each stage,
  • Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

MinerU using the "vlm engine"

Image

Actual Behavior

MinerU alwais using the "pipeline" engine

Steps to Reproduce

  1. Install open-webui using pip
  2. git clone https://github.com/opendatalab/MinerU.git
  3. pip install -e ".[core]"
  4. pip install -e ".[vllm]"
  5. mineru-api --host 0.0.0.0 --port 5001
  6. Configure MinerU as document extractor in Open WebUI and set "model_version" parameter to "vlm-vllm-async-engine"
  7. MinerU API does not seem to get the parameters properly

Logs & Screenshots

Image

Additional Information

No response

Originally created by @joasanna2 on GitHub (Oct 17, 2025). Original GitHub issue: https://github.com/open-webui/open-webui/issues/18391 ### Check Existing Issues - [x] I have searched for any existing and/or related issues. - [x] I have searched for any existing and/or related discussions. - [x] I am using the latest version of Open WebUI. ### Installation Method Pip Install ### Open WebUI Version v0.6.34 ### Ollama Version (if applicable) v0.12.5 ### Operating System Ubuntu 24.04.3 LTS ### Browser (if applicable) Chrome ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior MinerU using the "vlm engine" <img width="1538" height="146" alt="Image" src="https://github.com/user-attachments/assets/e1d66a38-9348-479f-9bcd-1c275126f652" /> ### Actual Behavior MinerU alwais using the "pipeline" engine ### Steps to Reproduce 1. Install open-webui using pip 2. git clone https://github.com/opendatalab/MinerU.git 3. pip install -e ".[core]" 4. pip install -e ".[vllm]" 5. mineru-api --host 0.0.0.0 --port 5001 6. Configure MinerU as document extractor in Open WebUI and set "model_version" parameter to "vlm-vllm-async-engine" 7. MinerU API does not seem to get the parameters properly ### Logs & Screenshots <img width="1265" height="352" alt="Image" src="https://github.com/user-attachments/assets/d708f61f-5538-4325-bb49-b1fe2985faba" /> ### Additional Information _No response_
GiteaMirror added the bug label 2026-04-25 08:02:27 -05:00
Author
Owner

@saschacontes commented on GitHub (Oct 17, 2025):

Its not in the code yet, the only options are vlm and pipeline, I am also missing the vlm-http-client option. Guess it would be easier to just pass-through the parameters to MinerU API:

    # Backend/model version (Local API uses "backend" parameter)
    if self.model_version == "vlm":
        form_data["backend"] = "vlm-vllm-engine"
    else:
        form_data["backend"] = "pipeline"
<!-- gh-comment-id:3415866935 --> @saschacontes commented on GitHub (Oct 17, 2025): Its not in the code yet, the only options are vlm and pipeline, I am also missing the vlm-http-client option. Guess it would be easier to just pass-through the parameters to MinerU API: # Backend/model version (Local API uses "backend" parameter) if self.model_version == "vlm": form_data["backend"] = "vlm-vllm-engine" else: form_data["backend"] = "pipeline"
Author
Owner

@tjbck commented on GitHub (Oct 20, 2025):

PR welcome.

<!-- gh-comment-id:3420431201 --> @tjbck commented on GitHub (Oct 20, 2025): PR welcome.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#34111