Slow Response Time for First Prompt When Using Certain Models (e.g., Llama3.1) #2377

New Issue

2025-11-11T15:05:58-06:00

GiteaMirror commented

2025-11-11 15:05:58 -06:00

Originally created by @fatmaT2001 on GitHub (Oct 14, 2024).

Description:
Hello OpenWebUI team,

I’ve noticed that certain models, such as Llama3.1, experience a significant delay in responding to the first prompt, particularly during the GPU connection phase. This issue doesn't seem to affect all models, as others connect and respond much faster during the initial interaction.

Details:

Models experiencing delay: Llama3.1 (and other similar models)
Issue: First prompt response time is considerably slower while connecting to the GPU, but subsequent prompts respond faster.
Behavior: The delay occurs only during the initial prompt, and the system performs normally afterward.

Question:

Could you please provide insight into why certain models, like Llama3.1, take longer to respond during the first prompt while connecting to the GPU, whereas other models don’t exhibit this behavior? Is there a difference in model initialization or other factors causing this delay?

Thank you for your assistance in helping me understand this behavior!

Originally created by @fatmaT2001 on GitHub (Oct 14, 2024). **Description**: Hello OpenWebUI team, I’ve noticed that certain models, such as **Llama3.1**, experience a significant delay in responding to the first prompt, particularly during the GPU connection phase. This issue doesn't seem to affect all models, as others connect and respond much faster during the initial interaction. ### Details: - **Models experiencing delay**: Llama3.1 (and other similar models) - **Issue**: First prompt response time is considerably slower while connecting to the GPU, but subsequent prompts respond faster. - **Behavior**: The delay occurs only during the initial prompt, and the system performs normally afterward. ### Question: Could you please provide insight into why certain models, like Llama3.1, take longer to respond during the first prompt while connecting to the GPU, whereas other models don’t exhibit this behavior? Is there a difference in model initialization or other factors causing this delay? Thank you for your assistance in helping me understand this behavior!

GiteaMirror closed this issue

2025-11-11 15:05:59 -06:00

GiteaMirror referenced this issue

2025-11-11 17:35:38 -06:00

[PR #2377] [CLOSED] fix of 'show username' feat now working when chat bubbles active #7772

GiteaMirror referenced this issue

2026-04-20 03:17:00 -05:00

[PR #2377] [CLOSED] fix of 'show username' feat now working when chat bubbles active #20976

GiteaMirror referenced this issue

2026-04-25 10:24:22 -05:00

[PR #2377] [CLOSED] fix of 'show username' feat now working when chat bubbles active #36606

GiteaMirror referenced this issue