mirror of
https://github.com/open-webui/open-webui.git
synced 2026-11-14 05:02:01 -06:00
Classic298andGitHub
d00a02ff23
With Redis enabled, each chat request and each title or tag generation looks up which pipeline filters apply, and every lookup parsed the full model list stored in Redis from scratch. Each worker now keeps the parsed list and parses it again only when the model list changes. The lookup returns the same filters as before, at the cost of about 3 MB of memory per worker for 1000 models. Measured per lookup against a local Redis; the larger list size in each pair comes from models with profile images: | Models | Model list size | Before | After | | --- | --- | --- | --- | | 200 | 0.17 MB | 0.42 ms | 0.05 ms | | 200 | 2.2 MB | 1.16 ms | 0.05 ms | | 1000 | 0.83 MB | 2.43 ms | 0.06 ms | | 1000 | 11 MB | 6.21 ms | 0.10 ms |