Skip to content

AI Development

The Synthesis Excavation: Recovering 3.5 Years of Lost History

Title slide: The Synthesis Excavation — Recovering 3.5 Years of Lost History, achieving 99.96% knowledge coverage across 4,852 binary files

We build Synthesis — a knowledge indexing tool whose purpose is to make everything in a workspace searchable. We had been running it on our own workspace for months and the coverage number looked excellent: 99.6%. Nearly perfect.

That number was a vanity metric. It told us exactly what we wanted to hear while hiding what we needed to know. The real asset coverage was 15.2%.