Large documents not being processed #1544

New Issue

GiteaMirror · 2025-11-11T14:47:12-06:00

GiteaMirror commented

2025-11-11 14:47:12 -06:00

Originally created by @OM-EL on GitHub (Jul 17, 2024).

Discussed in https://github.com/open-webui/open-webui/discussions/3937

^{Originally posted by OM-EL July 17, 2024}
I am having trouble uploading a 100-page book to OpenWeb UI, as it doesn't work and no error is displayed, even when the General logs level is set to DEBUG.

However, uploading smaller documents, like 1 or 2 pages, works perfectly.

I am using an external ChromaDB, and my OpenWeb UI is connected to Bedrock through LiteLLM.

It seems the request doesn't even reach LiteLLM to call the embedding model.

What could be causing this issue, and how can I resolve it?

embedding model : bedrock/amazon.titan-embed-image-v1

Logs shown on OpenWeb ui when i upload the document , and it does not reach.

INFO:     10.242.16.148:0 - "GET /api/v1/documents/ HTTP/1.1" 200 OK
DEBUG:peewee:('SELECT "t1"."id", "t1"."name", "t1"."email", "t1"."role", "t1"."profile_image_url", "t1"."last_active_at", "t1"."updated_at", "t1"."created_at", "t1"."api_key", "t1"."settings", "t1"."info", "t1"."oauth_sub" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', ['d2a40160-83f9-4530-ae0e-088075022c8b', 1, 0])
DEBUG:peewee:('UPDATE "user" SET "last_active_at" = %s WHERE ("user"."id" = %s)', [1721070201, 'd2a40160-83f9-4530-ae0e-088075022c8b'])
DEBUG:peewee:('SELECT "t1"."id", "t1"."name", "t1"."email", "t1"."role", "t1"."profile_image_url", "t1"."last_active_at", "t1"."updated_at", "t1"."created_at", "t1"."api_key", "t1"."settings", "t1"."info", "t1"."oauth_sub" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', ['d2a40160-83f9-4530-ae0e-088075022c8b', 1, 0])
DEBUG:peewee:('SELECT "t1"."id", "t1"."collection_name", "t1"."name", "t1"."title", "t1"."filename", "t1"."content", "t1"."user_id", "t1"."timestamp" FROM "document" AS "t1"', [])INFO:     10.242.16.148:0 - "GET /api/v1/documents/ HTTP/1.1" 200 OK
```</div>

Originally created by @OM-EL on GitHub (Jul 17, 2024). ### Discussed in https://github.com/open-webui/open-webui/discussions/3937 <div type='discussions-op-text'> <sup>Originally posted by **OM-EL** July 17, 2024</sup> I am having trouble uploading a 100-page book to OpenWeb UI, as it doesn't work and no error is displayed, even when the General logs level is set to DEBUG. However, uploading smaller documents, like 1 or 2 pages, works perfectly. I am using an external ChromaDB, and my OpenWeb UI is connected to Bedrock through LiteLLM. It seems the request doesn't even reach LiteLLM to call the embedding model. What could be causing this issue, and how can I resolve it? embedding model : bedrock/amazon.titan-embed-image-v1 Logs shown on OpenWeb ui when i upload the document , and it does not reach. ``` INFO: 10.242.16.148:0 - "GET /api/v1/documents/ HTTP/1.1" 200 OK DEBUG:peewee:('SELECT "t1"."id", "t1"."name", "t1"."email", "t1"."role", "t1"."profile_image_url", "t1"."last_active_at", "t1"."updated_at", "t1"."created_at", "t1"."api_key", "t1"."settings", "t1"."info", "t1"."oauth_sub" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', ['d2a40160-83f9-4530-ae0e-088075022c8b', 1, 0]) DEBUG:peewee:('UPDATE "user" SET "last_active_at" = %s WHERE ("user"."id" = %s)', [1721070201, 'd2a40160-83f9-4530-ae0e-088075022c8b']) DEBUG:peewee:('SELECT "t1"."id", "t1"."name", "t1"."email", "t1"."role", "t1"."profile_image_url", "t1"."last_active_at", "t1"."updated_at", "t1"."created_at", "t1"."api_key", "t1"."settings", "t1"."info", "t1"."oauth_sub" FROM "user" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', ['d2a40160-83f9-4530-ae0e-088075022c8b', 1, 0]) DEBUG:peewee:('SELECT "t1"."id", "t1"."collection_name", "t1"."name", "t1"."title", "t1"."filename", "t1"."content", "t1"."user_id", "t1"."timestamp" FROM "document" AS "t1"', [])INFO: 10.242.16.148:0 - "GET /api/v1/documents/ HTTP/1.1" 200 OK ```</div>

GiteaMirror closed this issue

2025-11-11 14:47:12 -06:00

GiteaMirror referenced this issue

2025-11-11 17:28:22 -06:00

[PR #1544] [MERGED] feat: human readable Generation Info total #7497

Sign in to join this conversation.

Branches Tags

1 Participants

Notifications

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: github-starred/open-webui#1544