Agent context infrastructureOpen source · active
Repo2GPT
An MCP, API, and CLI system that lets coding agents inspect a repository, budget context, and recover from oversized or noisy snapshots.
- 3
- MCP tools
- 500 KB
- default file guard
- 10
- GitHub stars
Case studies
Architecture, tradeoffs, measurements, code.
Three projects remain. Each has enough public evidence to discuss the hardest decision, the operating failure path, and what the measurements do and do not prove.
Evaluated retrieval systemOpen source · evaluated
SongCraft RAG
Hybrid retrieval over a 45-document songwriting corpus, with local embeddings, cross-encoder reranking, cited answers, and a committed 83-question golden set.
- 0.952
- document recall@10
- 0.711
- exact chunk recall@5
- 7,370
- unique chunks
LLM evaluation and guardrailsOpen source · calibration stage
Prosody Judge
An eight-rubric LLM-as-a-judge pipeline with async batching, multi-run self-consistency, structured outputs, uncertainty flags, checkpoints, and spend limits.
- $0.067
- four-item calibration
- 24
- judge calls per full item
- 2.0 → 8.7
- authenticity separation