feat: VLM-MLX Support for Apple Silicon #5893

New Issue

GiteaMirror · 2025-11-11T16:37:32-06:00

GiteaMirror commented

2025-11-11 16:37:32 -06:00

Originally created by @spaxxilein on GitHub (Jul 28, 2025).

Check Existing Issues

I have searched the existing issues and discussions.

Problem Description

I am trying to use docling with MLX-VLM support with Open-webui. I can use it just fine by CLI with

docling https://arxiv.org/pdf/2206.01062 --pipeline vlm --vlm-model smoldocling --output-format markdown

but i have no way to add the options --pipeline and --vlm-model inside Open-Webui. That way i cannot use Hardware Acceleration on Apple Silicon

Desired Solution you'd like

I want you to add the possiblity to add the VLM-Model and Pipeline that should be used when configuring the backend of Open-Webui.

https://github.com/docling-project/docling-serve/blob/main/docs/usage.md

States that i can forward the pipeline to the API while doing the API call.

Alternatives Considered

No response

Additional Context

No response

Originally created by @spaxxilein on GitHub (Jul 28, 2025). ### Check Existing Issues - [x] I have searched the existing issues and discussions. ### Problem Description I am trying to use docling with MLX-VLM support with Open-webui. I can use it just fine by CLI with docling https://arxiv.org/pdf/2206.01062 --pipeline vlm --vlm-model smoldocling --output-format markdown but i have no way to add the options --pipeline and --vlm-model inside Open-Webui. That way i cannot use Hardware Acceleration on Apple Silicon ### Desired Solution you'd like I want you to add the possiblity to add the VLM-Model and Pipeline that should be used when configuring the backend of Open-Webui. https://github.com/docling-project/docling-serve/blob/main/docs/usage.md States that i can forward the pipeline to the API while doing the API call. ### Alternatives Considered _No response_ ### Additional Context _No response_

GiteaMirror closed this issue

2025-11-11 16:37:32 -06:00

GiteaMirror referenced this issue

2026-04-19 20:36:53 -05:00

[GH-ISSUE #5893] Hide RAG References. #14164

GiteaMirror referenced this issue

2026-04-25 04:05:23 -05:00

[GH-ISSUE #5893] Hide RAG References. #29692

GiteaMirror referenced this issue

2026-05-05 13:58:18 -05:00

[GH-ISSUE #5893] Hide RAG References. #52830

Sign in to join this conversation.