Skip to content

AI Engineering

AI and expansion of ambition

AI and expansion of ambition

I keep noticing this new pattern in how I work, think, and make decisions. Recently, it showed up so clearly that I felt it was worth writing down.

I was trained to think economically about software work. Count your operations, mind your memory, justify your complexity — Big-O thinking does not stay in the algorithms course, it shapes how you approach everything: automate and optimise. Now I keep automation and I learn to drop optimising. I have a vision for how I want to build and evaluate, and for the first time the friction is low enough to actually follow it.

Precision is Table Stakes; Recall is the Frontier

In the discussion around Large Language Models, the fear of hallucinations — incorrect information — often dominates the conversation. Achieving 100% precision is a prerequisite for any financial data system; "no garbage in" is a non-negotiable rule. However, for professional-grade extraction with LLMs, the more difficult challenge is recall. If an LLM encounters a complex website structure or a 50-page legal document, it often loses focus, missing critical details buried in the text.

The Decay of Manual Excellence

High-quality data is often a point of pride for any company collecting them. In a recent engagement, the client had built a remarkably reliable database through a rigorous, labor-intensive process where mid-level staff reviewed every entry made by junior analysts. However, even the most meticulous manual process eventually hits a wall: the velocity of information. In the space of e.g. investments, data ages rapidly, and a manual team simply cannot scale their output to keep pace with the market without a linear — and often unsustainable — increase in headcount.

Breaking Up with Jupyter Notebooks: How AI-Powered Apps Revitalized My Workflow

Breaking up with Jupyter Notebooks

So, Jupyter Notebooks. We had some good times, didn't we?

Writing code and seeing the results instantly felt great. But over time, the quirks I once found charming became... less so. Navigating between cells to find code? Frustrating. Forget to run a cell, and dependencies laugh in your face. And the workflow... Each function, each step in an experiment, means executing cells manually, at a time. It felt like trying to bake a cake but having to preheat the oven separately for every ingredient.