WFGY ProblemMap is a language- and framework-agnostic debugging checklist for RAG/LLM systems.
It encodes 16 concrete failure modes (retrieval gaps, vector store drift, prompt routing errors, evaluation blind spots, etc.) and maps each one to observable symptoms, typical root causes and step-by-step fixes.
Instead of being yet another RAG framework, it acts as a “semantic firewall” you can place before or around any existing Python stack (LangChain, LlamaIndex, custom pipelines) to quickly localize where the system is failing and what to fix first.
How It Differs
Most existing entries focus on libraries that implement RAG pipelines, evaluation metrics, or vector stores.
WFGY ProblemMap is complementary: it is a failure-mode map and triage playbook rather than a code framework. You can drop it into any codebase, tag logs or incidents with its problem codes, and systematically converge on the real bottleneck before changing infrastructure.
In practice this makes it useful as a shared language between ML engineers, data teams and product owners when debugging complex RAG/LLM systems.
🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.
## 📋 Pull Request Information
**Original PR:** https://github.com/vinta/awesome-python/pull/2929
**Author:** [@onestardao](https://github.com/onestardao)
**Created:** 2/21/2026
**Status:** ❌ Closed
**Base:** `master` ← **Head:** `master`
---
### 📝 Commits (3)
- [`3c74076`](https://github.com/vinta/awesome-python/commit/3c74076c821ff7f9bee27226184c477da6d9c8b1) Add WFGY ProblemMap as a RAG/LLM debugging resource
- [`f55554c`](https://github.com/vinta/awesome-python/commit/f55554c157f44875d5d53dbdb85f6bfcfb740931) Add WFGY ProblemMap as a RAG/LLM debugging resource
- [`11e8d86`](https://github.com/vinta/awesome-python/commit/11e8d86cdecd1eeed260c9251854e72736d03895) Merge branch 'master' into master
### 📊 Changes
**1 file changed** (+1 additions, -0 deletions)
<details>
<summary>View changed files</summary>
📝 `README.md` (+1 -0)
</details>
### 📄 Description
## Project
[WFGY ProblemMap](https://github.com/onestardao/WFGY/blob/main/ProblemMap/README.md)
## Checklist
- [x] One project per PR
- [x] PR title format: `Add WFGY ProblemMap`
- [x] Entry format: `* [project-name](url) - Description ending with period.`
- [x] Description is concise and short
Proposed entry:
* [WFGY ProblemMap](https://github.com/onestardao/WFGY/blob/main/ProblemMap/README.md) - RAG/LLM debugging checklist and failure-mode map.
## Why This Project Is Awesome
Which criterion does it meet? (pick one)
- [ ] **Industry Standard** - The go-to tool for a specific use case
- [ ] **Rising Star** - 5000+ stars in < 2 years, significant adoption
- [x] **Hidden Gem** - Exceptional quality, solves niche problems elegantly
Explain:
WFGY ProblemMap is a language- and framework-agnostic debugging checklist for RAG/LLM systems.
It encodes 16 concrete failure modes (retrieval gaps, vector store drift, prompt routing errors, evaluation blind spots, etc.) and maps each one to observable symptoms, typical root causes and step-by-step fixes.
Instead of being yet another RAG framework, it acts as a “semantic firewall” you can place before or around any existing Python stack (LangChain, LlamaIndex, custom pipelines) to quickly localize where the system is failing and what to fix first.
## How It Differs
Most existing entries focus on libraries that implement RAG pipelines, evaluation metrics, or vector stores.
WFGY ProblemMap is complementary: it is a failure-mode map and triage playbook rather than a code framework. You can drop it into any codebase, tag logs or incidents with its problem codes, and systematically converge on the real bottleneck before changing infrastructure.
In practice this makes it useful as a shared language between ML engineers, data teams and product owners when debugging complex RAG/LLM systems.
---
<sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
Blocking a user prevents them from interacting with repositories, such as opening or commenting on pull requests or issues. Learn more about blocking a user.
📋 Pull Request Information
Original PR: https://github.com/vinta/awesome-python/pull/2929
Author: @onestardao
Created: 2/21/2026
Status: ❌ Closed
Base:
master← Head:master📝 Commits (3)
3c74076Add WFGY ProblemMap as a RAG/LLM debugging resourcef55554cAdd WFGY ProblemMap as a RAG/LLM debugging resource11e8d86Merge branch 'master' into master📊 Changes
1 file changed (+1 additions, -0 deletions)
View changed files
📝
README.md(+1 -0)📄 Description
Project
WFGY ProblemMap
Checklist
Add WFGY ProblemMap* [project-name](url) - Description ending with period.Proposed entry:
Why This Project Is Awesome
Which criterion does it meet? (pick one)
Explain:
WFGY ProblemMap is a language- and framework-agnostic debugging checklist for RAG/LLM systems.
It encodes 16 concrete failure modes (retrieval gaps, vector store drift, prompt routing errors, evaluation blind spots, etc.) and maps each one to observable symptoms, typical root causes and step-by-step fixes.
Instead of being yet another RAG framework, it acts as a “semantic firewall” you can place before or around any existing Python stack (LangChain, LlamaIndex, custom pipelines) to quickly localize where the system is failing and what to fix first.
How It Differs
Most existing entries focus on libraries that implement RAG pipelines, evaluation metrics, or vector stores.
WFGY ProblemMap is complementary: it is a failure-mode map and triage playbook rather than a code framework. You can drop it into any codebase, tag logs or incidents with its problem codes, and systematically converge on the real bottleneck before changing infrastructure.
In practice this makes it useful as a shared language between ML engineers, data teams and product owners when debugging complex RAG/LLM systems.
🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.