[PR #943] Extend advisor-orchestrator-worker: Papa tie-break + advisory cost control #14091

Open
opened 2026-07-11 19:32:03 -05:00 by GiteaMirror · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/Shubhamsaboo/awesome-llm-apps/pull/943
Author: @telivity-otaip
Created: 7/10/2026
Status: 🔄 Open

Base: main ← Head: extend-advisor-orchestrator-papa-cost


📝 Commits (4)

  • 1db04cc Extend advisor-orchestrator-worker: Papa routing + pre-flight cost control
  • 446c608 Refine Papa and cost control roles for v1.1
  • 17b6b66 Wire disagreement cost into Papa tie-breaks
  • c9441a2 Remove unused cost_disagreement.sh (superseded by parse_disagreement_cost)

📊 Changes

22 files changed (+1345 additions, -168 deletions)

View changed files

📝 README.md (+1 -1)
➕ SMOKE_TEST.md (+45 -0)
📝 agent_skills/README.md (+1 -1)
📝 agent_skills/advisor-orchestrator-worker/README.md (+65 -29)
📝 agent_skills/advisor-orchestrator-worker/SKILL.md (+98 -96)
➕ agent_skills/advisor-orchestrator-worker/references/cost-control.md (+75 -0)
➕ agent_skills/advisor-orchestrator-worker/references/cost-estimate.md (+49 -0)
➕ agent_skills/advisor-orchestrator-worker/references/disagreement-cost.md (+55 -0)
📝 agent_skills/advisor-orchestrator-worker/references/fallbacks.md (+100 -5)
➕ agent_skills/advisor-orchestrator-worker/references/papa-routing.md (+53 -0)
➕ agent_skills/advisor-orchestrator-worker/references/pricing.json (+38 -0)
➕ agent_skills/advisor-orchestrator-worker/scripts/cost_tracker.sh (+166 -0)
➕ agent_skills/advisor-orchestrator-worker/scripts/parse_disagreement_cost.sh (+38 -0)
➕ agent_skills/advisor-orchestrator-worker/scripts/parse_estimate.sh (+35 -0)
➕ agent_skills/advisor-orchestrator-worker/scripts/parse_papa_route.sh (+26 -0)
📝 agent_skills/evals/advisor-orchestrator-worker/evals.json (+37 -28)
➕ agent_skills/evals/advisor-orchestrator-worker/test_cost_tracker.py (+121 -0)
➕ agent_skills/evals/advisor-orchestrator-worker/test_parse_disagreement_cost.py (+73 -0)
➕ agent_skills/evals/advisor-orchestrator-worker/test_parse_estimate.py (+63 -0)
➕ agent_skills/evals/advisor-orchestrator-worker/test_parse_papa_route.py (+50 -0)

...and 2 more files

📄 Description

Summary

Extends advisor-orchestrator-worker v1.0.0 with two additions:

  • Cost control (Flash estimator + cost_tracker.sh) — pre-flight estimate with token optimizations; advisory spend tracking on a soft target (non-blocking). On deadlock, cost advisory prices orchestrator path vs advisor path and sends that to Papa.
  • Papa (Gemini Pro-tier, different provider than Fable) — tie-breaks only on worker conflicts or advisor–orchestrator disagreement. Receives disagreement material and path costs; weighs merit and spend.

Mandatory Fable advisor at plan review and taste pass unchanged from v1.0.

Architecture

flowchart TD
  Orch[Orchestrator]
  Plan[Plan]
  Est[CostEstimator_Flash]
  Adv[Advisor_Fable]
  Work[Workers_Flash]
  Track[cost_tracker_advisory]
  DCost[Disagreement_cost_Flash]
  Papa[Papa_Pro_tiebreak]

  Orch --> Plan --> Est
  Est --> Adv --> Work
  Work --> Verify --> Synth --> Adv2[Advisor_taste_pass]
  Verify -->|deadlock| DCost
  Adv -->|deadlock| DCost
  Adv2 -->|deadlock| DCost
  DCost -->|orchestrator vs advisor USD| Papa
  Work --> Track
  Adv --> Track
  Papa --> Track

Papa invocation order

  1. State both paths in concrete actions
  2. Flash disagreement cost (references/disagreement-cost.md) → parse_disagreement_cost.sh
  3. Papa brief includes DISAGREEMENT COST: block
  4. Papa tie-break → parse_papa_route.sh

Bar compliance

  • Scripts: cost_tracker.sh, parse_estimate.sh, parse_disagreement_cost.sh, parse_papa_route.sh
  • Repo-side evals: test_cost_tracker.py, test_parse_estimate.py, test_parse_disagreement_cost.py, test_parse_papa_route.py
  • Trigger routing: positives clear near-misses vs project-graveyard

Test plan

  • skill_lint --strict
  • run_trigger_evals.py
  • skill_scanner.py
  • test_cost_tracker.py (12/12)
  • test_parse_estimate.py (4/4)
  • test_parse_disagreement_cost.py (3/3)
  • test_parse_papa_route.py (4/4)
  • Smoke: CI + parsers PASS; live API SKIP (no keys in shell)

Contributor

Dušan Milicevic / Telivity — Papa tie-break + cost-to-Papa wiring; builds on Shubham's original three-tier skill.


🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/Shubhamsaboo/awesome-llm-apps/pull/943 **Author:** [@telivity-otaip](https://github.com/telivity-otaip) **Created:** 7/10/2026 **Status:** 🔄 Open **Base:** `main` ← **Head:** `extend-advisor-orchestrator-papa-cost` --- ### 📝 Commits (4) - [`1db04cc`](https://github.com/Shubhamsaboo/awesome-llm-apps/commit/1db04cce191c7bc43e5e8800800a120e33d4ce54) Extend advisor-orchestrator-worker: Papa routing + pre-flight cost control - [`446c608`](https://github.com/Shubhamsaboo/awesome-llm-apps/commit/446c6086abba5b6077434f03e097b5a9f184c6e8) Refine Papa and cost control roles for v1.1 - [`17b6b66`](https://github.com/Shubhamsaboo/awesome-llm-apps/commit/17b6b66738fee71b9b318f5bc56763042845462c) Wire disagreement cost into Papa tie-breaks - [`c9441a2`](https://github.com/Shubhamsaboo/awesome-llm-apps/commit/c9441a279c257ff0af52d413e5487382453a2075) Remove unused cost_disagreement.sh (superseded by parse_disagreement_cost) ### 📊 Changes **22 files changed** (+1345 additions, -168 deletions) <details> <summary>View changed files</summary> 📝 `README.md` (+1 -1) ➕ `SMOKE_TEST.md` (+45 -0) 📝 `agent_skills/README.md` (+1 -1) 📝 `agent_skills/advisor-orchestrator-worker/README.md` (+65 -29) 📝 `agent_skills/advisor-orchestrator-worker/SKILL.md` (+98 -96) ➕ `agent_skills/advisor-orchestrator-worker/references/cost-control.md` (+75 -0) ➕ `agent_skills/advisor-orchestrator-worker/references/cost-estimate.md` (+49 -0) ➕ `agent_skills/advisor-orchestrator-worker/references/disagreement-cost.md` (+55 -0) 📝 `agent_skills/advisor-orchestrator-worker/references/fallbacks.md` (+100 -5) ➕ `agent_skills/advisor-orchestrator-worker/references/papa-routing.md` (+53 -0) ➕ `agent_skills/advisor-orchestrator-worker/references/pricing.json` (+38 -0) ➕ `agent_skills/advisor-orchestrator-worker/scripts/cost_tracker.sh` (+166 -0) ➕ `agent_skills/advisor-orchestrator-worker/scripts/parse_disagreement_cost.sh` (+38 -0) ➕ `agent_skills/advisor-orchestrator-worker/scripts/parse_estimate.sh` (+35 -0) ➕ `agent_skills/advisor-orchestrator-worker/scripts/parse_papa_route.sh` (+26 -0) 📝 `agent_skills/evals/advisor-orchestrator-worker/evals.json` (+37 -28) ➕ `agent_skills/evals/advisor-orchestrator-worker/test_cost_tracker.py` (+121 -0) ➕ `agent_skills/evals/advisor-orchestrator-worker/test_parse_disagreement_cost.py` (+73 -0) ➕ `agent_skills/evals/advisor-orchestrator-worker/test_parse_estimate.py` (+63 -0) ➕ `agent_skills/evals/advisor-orchestrator-worker/test_parse_papa_route.py` (+50 -0) _...and 2 more files_ </details> ### 📄 Description ## Summary Extends advisor-orchestrator-worker v1.0.0 with two additions: - **Cost control** (Flash estimator + `cost_tracker.sh`) — pre-flight estimate with token optimizations; advisory spend tracking on a soft target (non-blocking). On deadlock, cost advisory prices **orchestrator path vs advisor path** and sends that to Papa. - **Papa** (Gemini Pro-tier, different provider than Fable) — tie-breaks only on worker conflicts or advisor–orchestrator disagreement. Receives disagreement material **and** path costs; weighs merit **and** spend. Mandatory Fable advisor at plan review and taste pass unchanged from v1.0. ## Architecture ```mermaid flowchart TD Orch[Orchestrator] Plan[Plan] Est[CostEstimator_Flash] Adv[Advisor_Fable] Work[Workers_Flash] Track[cost_tracker_advisory] DCost[Disagreement_cost_Flash] Papa[Papa_Pro_tiebreak] Orch --> Plan --> Est Est --> Adv --> Work Work --> Verify --> Synth --> Adv2[Advisor_taste_pass] Verify -->|deadlock| DCost Adv -->|deadlock| DCost Adv2 -->|deadlock| DCost DCost -->|orchestrator vs advisor USD| Papa Work --> Track Adv --> Track Papa --> Track ``` ## Papa invocation order 1. State both paths in concrete actions 2. Flash disagreement cost (`references/disagreement-cost.md`) → `parse_disagreement_cost.sh` 3. Papa brief includes `DISAGREEMENT COST:` block 4. Papa tie-break → `parse_papa_route.sh` ## Bar compliance - Scripts: `cost_tracker.sh`, `parse_estimate.sh`, `parse_disagreement_cost.sh`, `parse_papa_route.sh` - Repo-side evals: `test_cost_tracker.py`, `test_parse_estimate.py`, `test_parse_disagreement_cost.py`, `test_parse_papa_route.py` - Trigger routing: positives clear near-misses vs project-graveyard ## Test plan - [x] `skill_lint --strict` - [x] `run_trigger_evals.py` - [x] `skill_scanner.py` - [x] `test_cost_tracker.py` (12/12) - [x] `test_parse_estimate.py` (4/4) - [x] `test_parse_disagreement_cost.py` (3/3) - [x] `test_parse_papa_route.py` (4/4) - [x] Smoke: CI + parsers PASS; live API SKIP (no keys in shell) ## Contributor Dušan Milicevic / Telivity — Papa tie-break + cost-to-Papa wiring; builds on Shubham's original three-tier skill. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
GiteaMirror added the pull-request label 2026-07-11 19:32:03 -05:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: github-starred/awesome-llm-apps#14091