Selected work
Capability, measured. Failure, reported.
Seven public projects spanning model grounding, verification-aware agents, mission-shift
generalization, drug-discovery decisions, laboratory execution, evidence across agent handoffs,
and safeguard calibration. Each links claims to
inspectable code, data, or result artifacts.
PROJECT 01Grounding
grounding-atlas
A measurement-first map of whether language models ground the content of biological
representations—sequence, structure, identifiers, and numeric predictions—or rely on labels and familiarity.
It connects measured gaps to a practical train, retrieve, or orchestrate decision map.
17 representations studied24 GroundBench tasks9 modalitiesGPU-free output harness
PROJECT 02Verification
Verify-or-Trust
A verifiable-reward benchmark for a central agentic decision: when a biology foundation model may be wrong,
should the agent trust it or spend budget on a real differential-expression assay?
Held-out perturb-seq truthReal DE tool107-panel studyLLM-free baselines
PROJECT 03Space biology
SpaceBio-Bench
Mission-held-out transcriptomics benchmarks for a hard biological generalization question:
can a model trained on one spaceflight study recognize a signal in a mission it has never seen?
NASA OSDR data8 tissuesMission-held-out splitsPublic fold package
PROJECT 04Agent systems
Agentic Drug Discovery System
An auditable clinical and regulatory decision benchmark with callable data adapters,
verifier contracts, an installable scorer, and reproducible clinical-trial decision labels.
Source-derived labelsTool adaptersVerifier contractsInstallable scorer
Current scope: a retrospective benchmark plus one audited end-to-end disease slice—not a finished eight-stage discovery platform.
PROJECT 05Agent evaluation
LabCraft-Eval
An Inspect AI environment that evaluates agents executing benign molecular-microbiology protocols
inside a seeded stochastic simulator, with deterministic four-axis trajectory scoring.
Seeded simulatorTrajectory-level scoringInspect AIProvenance-checked export
PROJECT 06Agent safety
Scientific Agent Verification Cascade
A prespecified test of whether scientific evidence survives handoffs between agents, or whether
the last agent in a chain ends up citing its predecessor instead of the original source, and how
far a structured claim record and a runtime gate recover what is lost.
Prespecified protocolTwo model familiesMatched single-agent controlsStructured claim records
PROJECT 07Safeguard calibration
Safeguard Calibration Study
A controlled study of whether safeguards stay calibrated when the same science changes form,
moving across names, database identifiers, sequences and annotations, and when delivery moves
from a chat window to a tool call. Released with an outcomes-only public dataset.
Matched task controlsCross-version comparisonOutcomes-only public dataDocumented claim reconciliation