AI Engineer (LLM systems)

About this role

## About Refine

A spreadsheet error in one of the most influential economics papers of the decade helped justify austerity across Europe and the US. Millions lived with the consequences. The error was only found years later, by sheer luck, long after the damage was done.

Flawed analysis shapes policy, investment and lending every day, costs billions every year, and mostly goes unnoticed. AI makes it worse: rigorous-looking work is now cheap to produce.

Refine exists to catch these errors before anyone acts on them. We're building the infrastructure that verifies high-stakes work; think CI/CD for everything beyond code. It reviews a document like a team of experts, checking the maths, data, logic and argument, in minutes.

• **The best AI review system.** Refine 5 beats frontier models such as GPT-6 Astra in over 90% of blind head-to-heads across ten fields, from economics to biology. It emulates expert human judgment, coordinating hundreds of calls to frontier models so none of their blind spots get through. We tune it on documents seeded with the errors frontier models miss.
• **The de facto AI reviewer for economics.** Econometrica and the AER run every paper they publish through Refine. It's used at 24 central banks and by researchers at Oxford, MIT, Stanford, Yale and Cambridge; Cambridge, UCLA and NYU provide it to theirs.
• **Beyond academia.** 29,000+ reviews sold at 1,000+ institutions, including litigation consultancies, hedge funds and companies bidding on public tenders.
• **Enterprise-grade.** ISO 27001 certified, SOC 2 Type 1 (Type 2 in progress).

## The role

We build AI systems that beat frontier models at specific tasks. Refine 5 is one of them.

You'll help us design and improve these systems. The job is getting as much as possible out of today's frontier models.

## What matters

• **A very good mental model of what frontier models can and can't do.** The kind you only get from spending a lot of time with them. You should be obsesse...