mirror of
https://github.com/Shubhamsaboo/awesome-llm-apps.git
synced 2026-03-13 02:25:52 -05:00
[PR #189] [MERGED] Added Agentic RAG Math Tutor Agent (Human-in-the-Loop) #230
No Assignees
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: github-starred/awesome-llm-apps#230
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
📋 Pull Request Information
Original PR: https://github.com/Shubhamsaboo/awesome-llm-apps/pull/189
Author: @sahithi37
Created: 4/25/2025
Status: ✅ Merged
Merged: 5/4/2025
Merged by: @Shubhamsaboo
Base:
main← Head:main📝 Commits (2)
a2f81a4Added Agentic RAG Math Agent submission9400335Rename README.md.txt to README.md📊 Changes
24 files changed (+2220 additions, -0 deletions)
View changed files
➕
starter_ai_agents/agentic_rag_math_agent/README.md(+72 -0)➕
starter_ai_agents/agentic_rag_math_agent/app/__pycache__/benchmark.cpython-311.pyc(+0 -0)➕
starter_ai_agents/agentic_rag_math_agent/app/__pycache__/streamlit.cpython-311.pyc(+0 -0)➕
starter_ai_agents/agentic_rag_math_agent/app/benchmark.py(+51 -0)➕
starter_ai_agents/agentic_rag_math_agent/app/streamlit.py(+120 -0)➕
starter_ai_agents/agentic_rag_math_agent/benchmark/results_math_5.csv(+152 -0)➕
starter_ai_agents/agentic_rag_math_agent/benchmark/results_math_50.csv(+1410 -0)➕
starter_ai_agents/agentic_rag_math_agent/config/.env(+2 -0)➕
starter_ai_agents/agentic_rag_math_agent/data/__pycache__/load_gsm8k_data.cpython-311.pyc(+0 -0)➕
starter_ai_agents/agentic_rag_math_agent/data/load_gsm8k_data.py(+9 -0)➕
starter_ai_agents/agentic_rag_math_agent/logs/feedback_log.json(+67 -0)➕
starter_ai_agents/agentic_rag_math_agent/rag/__pycache__/dspy_guardrails.cpython-311.pyc(+0 -0)➕
starter_ai_agents/agentic_rag_math_agent/rag/__pycache__/guardrails.cpython-311.pyc(+0 -0)➕
starter_ai_agents/agentic_rag_math_agent/rag/__pycache__/query_router.cpython-311.pyc(+0 -0)➕
starter_ai_agents/agentic_rag_math_agent/rag/guardrails.py(+102 -0)➕
starter_ai_agents/agentic_rag_math_agent/rag/query_router.py(+163 -0)➕
starter_ai_agents/agentic_rag_math_agent/rag/vector.py(+54 -0)➕
starter_ai_agents/agentic_rag_math_agent/requirements.txt(+14 -0)➕
starter_ai_agents/agentic_rag_math_agent/storage/default__vector_store.json(+0 -0)➕
starter_ai_agents/agentic_rag_math_agent/storage/docstore.json(+1 -0)...and 4 more files
📄 Description
Summary:
This project implements an Agentic-RAG Math Tutor agent that solves JEE-level math problems step-by-step. It uses a knowledge base (Qdrant + llama-index) for retrieval, OpenAI GPT-3.5 for explanations, Tavily for web fallback, and DSPy guardrails for input/output validation. Human-in-the-loop feedback is collected via the UI.
Main Features:
Vector DB Retrieval (Qdrant)
Web Search Fallback (Tavily API)
GPT-3.5 Step-by-Step Explanation
DSPy Guardrails for Input/Output
Streamlit UI with Feedback Collection
Benchmarking against JEEBench Math Questions
Benchmark:
Achieved 66% accuracy on 50 random JEEBench math questions.
🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.