RAG Quality as a Distribution, Not a Single Score
A retrieval-augmented answer can look excellent in a demonstration and fail for a reader who asks the same question differently. It can cite a real document while relying on the wrong version.
THE AUTHOR
Developer, entrepreneur and business angel. Writing about AI, software, data and the evidence behind technical decisions.
About the author →THE READING ROOM
A retrieval-augmented answer can look excellent in a demonstration and fail for a reader who asks the same question differently. It can cite a real document while relying on the wrong version.
A real SQL Server fixture successfully refreshes the wrong statistic, rejects the resulting state, and verifies the correct repair. Command success is not the maintenance goal.
A real child process exits after a local receiver commit. Reconciliation preserves one effect while keeping unestablished outcomes explicitly unknown.
When creation gets cheaper, work moves into selection, review, integration and operation. The economic unit should be a maintained outcome.
Typed intent separates language proposals from executable SQL, trusted tenant scope and independently checked aggregate results.
A monitoring system can correctly report that a database is struggling while helping to make it struggle. That is an uncomfortable property of observability: the observer participates in the system it describes.
A real checksummed backup is verified, restored and checked against exact transactions, then the application refuses readiness until its external dependency agrees.
A real ChatClientAgent read-tool roundtrip shows why a fresh conversation can forget history while SQLite preserves the current domain record.
A useful diagnostic produces a reproducible finding and a decision, not just a large dashboard or a list of suggestions.
Separate deployment, runtime and operator authority with actual local JWT checks, then inspect an explicitly undeployed Azure identity mapping.
Engineering judgment is built through specific decisions and feedback. A career strategy should develop that ability without treating technical fluency as disposable.
An exact baseline and a materialized sign-bit candidate index expose where search quality is lost, why update identity matters and why fewer candidates did not always run faster.