C12-034DecidedCorpus and Knowledge ProvenanceCorrection2026-07-17
Reject Unconstrained Conversational Retrieval
Do not rely on the LLM to search Ben’s entire corpus and generate a confident answer without reviewed structure.
#corpus#reject#violin-stand-partner
Capture
Conversational retrieval appears flexible and efficient.
Do not rely on the LLM to search Ben’s entire corpus and generate a confident answer without reviewed structure.
Why
Conversational retrieval appears flexible and efficient.
Why-Not
- source mismatch;
- hallucinated attribution;
- irrelevant segment selection;
- missing timestamps;
- inability to distinguish exact quote from synthesis;
- inconsistent terminology.
Commit
Decision: Do not rely on the LLM to search Ben’s entire corpus and generate a confident answer without reviewed structure.
The decision becomes a constraint on future product behavior and public positioning.
Confidence: Medium-high for public architecture; implementation details remain private and subject to launch evidence.
Timestamp
2026-07-17