Confidence is easy. Calibration is the work.
Notes on AI and data systems, and the reasoning underneath them. Making something work once is the easy part. Showing that it holds, and knowing where it breaks, is what earns trust.
I write about the methods behind that trust: probability and decision science, machine learning concepts and formal verification.
Thoughts
Logic, reasoning and the working-out behind a decision. These are experiences from real builds and how-tos worth sharing.
Read 02Evaluation & quality of AI
Metrics whose assumptions match the problem and assuring quality of the model. Doing the trajectory-level evaluation for agents. While focussing on the underlying data quality
Read 03Context engineering
Getting the right information in front of the model at the right moment, retrieval, grounding and knowledge graphs that turns scattered enterprise data into a queryable source of truth.
Read 04Integration
Wiring AI into the systems around it including use of tools, APIs, MCP and data pipelines. How does the demo scale?
Read 05Open-source & open-weight AI
Building on open models and open-source tooling. Control over cost, privacy and how a system actually behaves transparently.
Read 06Looking ahead
Where this is heading, which trends are worth taking seriously, the ones that aren’t and how the models and the tooling around them are evolving.
Read-
Precision 1.0, recall 1.0, and the artifact was still wrong
A pipeline scored a perfect parity match and failed the artifact anyway. Here is why, and why a confidence score should be arithmetic a person can re-run.
Read -
The SLM scored 0.727, the LLM 0.90, and the comparison was noise
A fine-tuned small model against a large one on the same governance task. The headline gap was inside the error bars. The useful signal was which way each model got things wrong.
Read -
Measuring success of a model - practical case of anomaly detection on financial data
Why ROC AUC flatters rare-event detectors, and why the alert budget ended up mattering more than the model.
Read