[GH-ISSUE #21166] issue: Unawaited coroutine '_verify_ssl_cert' breaks web retrieval in utils.py #34937

Closed
opened 2026-04-25 09:07:06 -05:00 by GiteaMirror · 2 comments
Owner

Originally created by @TheSpaceGod on GitHub (Feb 4, 2026).
Original GitHub issue: https://github.com/open-webui/open-webui/issues/21166

Check Existing Issues

  • I have searched for any existing and/or related issues.
  • I have searched for any existing and/or related discussions.
  • I have also searched in the CLOSED issues AND CLOSED discussions and found no related items (your issue might already be addressed on the development branch!).
  • I am using the latest version of Open WebUI.

Installation Method

Docker

Open WebUI Version

7.2

Ollama Version (if applicable)

No response

Operating System

Linux

Browser (if applicable)

No response

Confirmation

  • I have read and followed all instructions in README.md.
  • I am using the latest version of both Open WebUI and Ollama.
  • I have included the browser console logs.
  • I have included the Docker container logs.
  • I have provided every relevant configuration, setting, and environment variable used in my setup.
  • I have clearly listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc).
  • I have documented step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation. My steps:
  • Start with the initial platform/version/OS and dependencies used,
  • Specify exact install/launch/configure commands,
  • List URLs visited, user input (incl. example values/emails/passwords if needed),
  • Describe all options and toggles enabled or changed,
  • Include any files or environmental changes,
  • Identify the expected and actual result at each stage,
  • Ensure any reasonably skilled user can follow and hit the same issue.

Expected Behavior

Webpage attachment should grab text based context on webpage via playwrite.

Actual Behavior

Description:
I have identified a blocking bug in open_webui/retrieval/web/utils.py that prevents web retrieval from working correctly. The _verify_ssl_cert function is a coroutine but is called synchronously, resulting in a RuntimeWarning and causing the scraper to abort after fetching only metadata (approx. 3 lines).

Location:
File: /app/backend/open_webui/retrieval/web/utils.py
Line: 177 (approximate, based on logs)

Logs:

/app/backend/open_webui/retrieval/web/utils.py:177: RuntimeWarning: coroutine 'URLProcessingMixin._verify_ssl_cert' was never awaited
  if self.verify_ssl and not self._verify_ssl_cert(url):

Root Cause:
The code attempts to evaluate self._verify_ssl_cert(url) without await.

Proposed Fix:
Change:

if self.verify_ssl and not self._verify_ssl_cert(url):

To:

if self.verify_ssl and not await self._verify_ssl_cert(url):

Environment:

  • Image: `ghcr.io/open-webui/open-webui:main (Latest)
  • Loader: Playwright (and Default)

Steps to Reproduce

  1. Attach webpage to chat to use as context.
  2. Wait for processing to be done.
  3. Open processed text for inspection and mostly see empty text. (example site: https://blog.kagi.com/waiting-dawn-search)

Logs & Screenshots

Image Image Image

Additional Information

No response

Originally created by @TheSpaceGod on GitHub (Feb 4, 2026). Original GitHub issue: https://github.com/open-webui/open-webui/issues/21166 ### Check Existing Issues - [x] I have searched for any existing and/or related issues. - [x] I have searched for any existing and/or related discussions. - [x] I have also searched in the CLOSED issues AND CLOSED discussions and found no related items (your issue might already be addressed on the development branch!). - [x] I am using the latest version of Open WebUI. ### Installation Method Docker ### Open WebUI Version 7.2 ### Ollama Version (if applicable) _No response_ ### Operating System Linux ### Browser (if applicable) _No response_ ### Confirmation - [x] I have read and followed all instructions in `README.md`. - [x] I am using the latest version of **both** Open WebUI and Ollama. - [x] I have included the browser console logs. - [x] I have included the Docker container logs. - [x] I have **provided every relevant configuration, setting, and environment variable used in my setup.** - [x] I have clearly **listed every relevant configuration, custom setting, environment variable, and command-line option that influences my setup** (such as Docker Compose overrides, .env values, browser settings, authentication configurations, etc). - [x] I have documented **step-by-step reproduction instructions that are precise, sequential, and leave nothing to interpretation**. My steps: - Start with the initial platform/version/OS and dependencies used, - Specify exact install/launch/configure commands, - List URLs visited, user input (incl. example values/emails/passwords if needed), - Describe all options and toggles enabled or changed, - Include any files or environmental changes, - Identify the expected and actual result at each stage, - Ensure any reasonably skilled user can follow and hit the same issue. ### Expected Behavior Webpage attachment should grab text based context on webpage via playwrite. ### Actual Behavior **Description:** I have identified a blocking bug in `open_webui/retrieval/web/utils.py` that prevents web retrieval from working correctly. The `_verify_ssl_cert` function is a coroutine but is called synchronously, resulting in a `RuntimeWarning` and causing the scraper to abort after fetching only metadata (approx. 3 lines). **Location:** File: `/app/backend/open_webui/retrieval/web/utils.py` Line: `177` (approximate, based on logs) **Logs:** ```text /app/backend/open_webui/retrieval/web/utils.py:177: RuntimeWarning: coroutine 'URLProcessingMixin._verify_ssl_cert' was never awaited if self.verify_ssl and not self._verify_ssl_cert(url): ``` **Root Cause:** The code attempts to evaluate `self._verify_ssl_cert(url)` without `await`. **Proposed Fix:** Change: ```python if self.verify_ssl and not self._verify_ssl_cert(url): ``` To: ```python if self.verify_ssl and not await self._verify_ssl_cert(url): ``` **Environment:** * **Image:** `ghcr.io/open-webui/open-webui:main (Latest) * **Loader:** Playwright (and Default) ### Steps to Reproduce 1. Attach webpage to chat to use as context. 2. Wait for processing to be done. 3. Open processed text for inspection and mostly see empty text. (example site: https://blog.kagi.com/waiting-dawn-search) ### Logs & Screenshots <img width="1253" height="563" alt="Image" src="https://github.com/user-attachments/assets/0a4af993-e1ee-4fa1-8c3a-3f5055cd0a15" /> <img width="903" height="148" alt="Image" src="https://github.com/user-attachments/assets/95d40cba-8604-4d6a-bf1e-6175a25df69b" /> <img width="962" height="643" alt="Image" src="https://github.com/user-attachments/assets/2fccd48a-4303-4da3-bd54-68db56a11c74" /> ### Additional Information _No response_
GiteaMirror added the bug label 2026-04-25 09:07:06 -05:00
Author
Owner

@owui-terminator[bot] commented on GitHub (Feb 4, 2026):

🔍 Similar Issues Found

I found some existing issues that might be related to this one. Please check if any of these are duplicates or contain helpful solutions:

  1. #20828 issue: OAuth2.1 MCP Tool Server Verification Error - Failed to connect to the tool server: 'coroutine' object is not iterable
    by Lemmons • Jan 20, 2026 • bug

💡 Tips:

  • If this is a duplicate, please consider closing this issue and adding any additional details to the existing one
  • If you found a solution in any of these issues, please share it here to help others

This comment was generated automatically by a bot. Please react with a 👍 if this comment was helpful, or a 👎 if it was not.

<!-- gh-comment-id:3849278558 --> @owui-terminator[bot] commented on GitHub (Feb 4, 2026): 🔍 **Similar Issues Found** I found some existing issues that might be related to this one. Please check if any of these are duplicates or contain helpful solutions: 1. [#20828](https://github.com/open-webui/open-webui/issues/20828) **issue: OAuth2.1 MCP Tool Server Verification Error - Failed to connect to the tool server: 'coroutine' object is not iterable** *by Lemmons • Jan 20, 2026 • `bug`* --- 💡 **Tips:** - If this is a duplicate, please consider closing this issue and adding any additional details to the existing one - If you found a solution in any of these issues, please share it here to help others *This comment was generated automatically by a bot.* Please react with a 👍 if this comment was helpful, or a 👎 if it was not.
Author
Owner

@tjbck commented on GitHub (Feb 5, 2026):

Addressed in dev.

<!-- gh-comment-id:3857005059 --> @tjbck commented on GitHub (Feb 5, 2026): Addressed in dev.
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/open-webui#34937