Research Highlights
How AI systems learn to reason, and how that process can be measured and shaped.
01 Recursive Self-Improvement · MILO
When Search Stalls, the Orchestrator Steps In
An agent is a model plus a harness: the prompts, tools, memory and control flow around it. MILO searches for better harnesses with islands that evolve in parallel, and an orchestrator agent that watches the whole search, diagnoses stalls and intervenes.
Interactive demo from the MILO project page.
02 Test-Time Scaling · Hermes · co-first author
The Model Decides How to Use Each Fresh Context
Spreading test-time compute over many context windows means deciding what each fresh context should do and what it hands back. Hermes leaves those decisions to the model, and Hermes-Learn (SFT, then RL) teaches a 4B model to make them.
Interactive overview from the Hermes project page.
03 On-Policy Distillation · SCOUT
The Teacher Learns to Continue the Student’s Prefixes
In on-policy distillation the student writes the response and a stronger teacher scores every token. But the teacher was trained to continue its own reasoning, and the deeper into a student’s response it reads, the worse it does. SCOUT trains the teacher to continue student-written prefixes.
Interactive method walkthrough from the SCOUT project page.
Publications
At ICML, ICLR, NeurIPS, EMNLP, AAAI, KDD, and other venues. Full list on Google Scholar and Semantic Scholar.