feat: gRPC support for Qdrant #4788

New Issue

2025-11-11T16:03:11-06:00

GiteaMirror commented

2025-11-11 16:03:11 -06:00

Originally created by @gaby on GitHub (Apr 10, 2025).

Check Existing Issues

I have searched the existing issues and discussions.

Problem Description

Currently the communication to Qdrant relies on HTTP. You can get higher throughput by using gRPC with Qdrant.

Desired Solution you'd like

This is already supported by the Library used by OpenWebUI. It requires a boolean field and a port.

See here: https://github.com/qdrant/qdrant-client?tab=readme-ov-file#grpc

Related code: https://github.com/open-webui/open-webui/blob/dev/backend/open_webui/retrieval/vector/dbs/qdrant.py#L24

Alternatives Considered

None

Additional Context

No response

Originally created by @gaby on GitHub (Apr 10, 2025). ### Check Existing Issues - [x] I have searched the existing issues and discussions. ### Problem Description Currently the communication to Qdrant relies on HTTP. You can get higher throughput by using gRPC with Qdrant. ### Desired Solution you'd like This is already supported by the Library used by OpenWebUI. It requires a boolean field and a port. See here: https://github.com/qdrant/qdrant-client?tab=readme-ov-file#grpc Related code: https://github.com/open-webui/open-webui/blob/dev/backend/open_webui/retrieval/vector/dbs/qdrant.py#L24 ### Alternatives Considered None ### Additional Context _No response_

GiteaMirror closed this issue

2025-11-11 16:03:12 -06:00

GiteaMirror commented

2025-11-11 16:03:12 -06:00

@gaby commented on GitHub (Apr 10, 2025):

How many config options should be added for this?

QDRANT_GRPC: bool
QDRANT_GRPC_HOST: str
QDRANT_GRPC_PORT: int

Do those make sense?

@gaby commented on GitHub (Apr 10, 2025): How many config options should be added for this? - QDRANT_GRPC: bool - QDRANT_GRPC_HOST: str - QDRANT_GRPC_PORT: int Do those make sense?