news

May 25, 2026 Two papers accepted at the Failure Modes in Agentic AI (FAGEN) workshop at ICML 2026: SELFDOUBT and Proper Scoring Rules for Agentic Uncertainty Quantification!
May 22, 2026 Proper Scoring Rules for Agentic Uncertainty Quantification was accepted as a poster at the Combining Theory and Benchmarks (CTB) workshop at ICML 2026. See y’all in Seoul!
May 06, 2026 New preprint: Proper Scoring Rules for Agentic Uncertainty Quantification. We introduce the Trajectory Proper Score (TPS), a predictor-agnostic family of strictly proper, trajectory-level scoring rules for evaluating uncertainty in LLM agents.
Apr 07, 2026 New preprint: SELFDOUBT: Uncertainty Quantification for Reasoning LLMs via the Hedge-to-Verify Ratio. We introduce the Hedge-to-Verify Ratio (HVR), a single-pass uncertainty signal for reasoning LLMs that outperforms Semantic Entropy at about 10x lower inference cost.
Apr 05, 2026 New preprint: Don’t Blink: Evidence Collapse during Multimodal Reasoning. We identify evidence collapse, a decay of visual grounding during multimodal reasoning that text-only uncertainty signals cannot detect.
Jan 11, 2026 Published an article on prompt ordering in vision-language models: Why Your VLM Prompts Are Backwards (And How to Fix It)
May 02, 2024 Joined AI @ VFS as lead AI engineer