[GH-ISSUE #15934] Server returns constant 503 "Server overloaded" errors #87836

Open
opened 2026-05-10 06:26:15 -05:00 by GiteaMirror · 1 comment
Owner

Originally created by @AccidentalJedi on GitHub (May 2, 2026).
Original GitHub issue: https://github.com/ollama/ollama/issues/15934

What is the issue?

Ollama consistently returns a 503 Service Unavailable error when making requests. The error includes the reference ID: 06d81c91-9772-4081-affc-f122d5523da7.

Error: Ollama error 503 Service Unavailable: {"error":"Server overloaded, please retry shortly (ref: aaa65c70-cfa0-446b-86f1-4ab0e2deb9e4)"}

Error: Ollama error 503 Service Unavailable: {"error":"Server overloaded, please retry shortly (ref: dc579fc6-d03f-4ab9-9284-7664859ed959)"}

Steps to reproduce the behavior:

  1. Run cloud model until it gives a 503 service unavailability.
  2. See error

Ollama should respond successfully, or provide clearer guidance on retry timing/backoff.
Environment:

  • Ollama version: [Latest]

  • Plan: MAX (upgraded yesterday (March 1)

  • OS: [Windows 11]

  • Hardware: [I-7 CPU, 12GB RTX 3060 GPU, 64 GB ram]

  • Model being used: [Multiple Models including Deepseek-v4-pro:cloud]

  • This occurs [intermittently, but VERY frequently]

  • Running [cloud model through local server]

Relevant log output


OS

No response

GPU

No response

CPU

No response

Ollama version

No response

Originally created by @AccidentalJedi on GitHub (May 2, 2026). Original GitHub issue: https://github.com/ollama/ollama/issues/15934 ### What is the issue? Ollama consistently returns a 503 Service Unavailable error when making requests. The error includes the reference ID: `06d81c91-9772-4081-affc-f122d5523da7`. **Error:** Ollama error 503 Service Unavailable: {"error":"Server overloaded, please retry shortly (ref: aaa65c70-cfa0-446b-86f1-4ab0e2deb9e4)"} **Error:** Ollama error 503 Service Unavailable: {"error":"Server overloaded, please retry shortly (ref: dc579fc6-d03f-4ab9-9284-7664859ed959)"} Steps to reproduce the behavior: 1. Run cloud model until it gives a 503 service unavailability. 2. See error Ollama should respond successfully, or provide clearer guidance on retry timing/backoff. **Environment:** - Ollama version: [Latest] - Plan: MAX (upgraded yesterday (March 1) - OS: [Windows 11] - Hardware: [I-7 CPU, 12GB RTX 3060 GPU, 64 GB ram] - Model being used: [Multiple Models including Deepseek-v4-pro:cloud] - This occurs [intermittently, but VERY frequently] - Running [cloud model through local server] ### Relevant log output ```shell ``` ### OS _No response_ ### GPU _No response_ ### CPU _No response_ ### Ollama version _No response_
GiteaMirror added the cloudbug labels 2026-05-10 06:26:15 -05:00
Author
Owner

@Konsilion commented on GitHub (May 7, 2026):

Same problem, too many "Server overloaded, please retry shortly" ... (Pro account)

<!-- gh-comment-id:4395380921 --> @Konsilion commented on GitHub (May 7, 2026): Same problem, too many "Server overloaded, please retry shortly" ... (Pro account)
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/ollama#87836