How I think about search
-
In regulated domains, the answer is not always the best possible output
Why lawyers, doctors, and auditors need ranked, traceable evidence they can cite and check, and how that reframes the whole architecture.
-
The judge does not score. The judge diagnoses.
Two competent LLM graders can disagree by 20+ points on the same answers. A layered evaluation that gives retrieval, generation, and stability failures each their own verdict.
-
Entity types are a competing set
A schema with no field for a fund's excluded sectors will file the exclusions as investments. A principle from rule-based extraction that decides whether an LLM schema is separable.