Semantic Representation for Agentic Self-Play in Automated Laboratories
Abstract
This technical report introduces a lab controller system designed as the foundational infrastructure for agentic self-driving laboratories. The core challenge in modern biological research is the immense scale of the search spaces, which are too vast for traditional experimental methods. Our solution is a lab controller that bridges the semantic gap between AI reasoning and the physical wet lab by managing a high-fidelity semantic model, or digital twin, of the laboratory workcell. This live, queryable model provides four crucial services to AI agents:
Introspection: Agents can query the lab's real-time state (e.g., reagent volumes, instrument status) to inform their planning and decision-making, grounding their logic in physical reality. Simulation: Agents can safely test experimental protocols in a time-compressed, virtual environment before physical execution. This is achieved via a discrete accounting engine that validates logistical and scientific feasibility, preventing errors, resource waste, and hardware damage. Trace Persistence: The controller records a complete, multimodal history of every experiment into a research dossier. This dataset is processed by a Wet2Dry pipeline into structured trajectories for training agents via imitation learning and offline reinforcement learning, using advanced techniques to compute rewards from noisy data. Safe Execution: The controller translates agent commands into hardware actions within a multi-layered safety architecture inspired by frameworks like Safe-SDL. This uses Verified Operating Domains (ODDs) to enforce pre-verified boundaries and Control Barrier Functions (CBFs) as real-time safety filters to prevent failures and ensure safe operation.
We have validated these services through case studies demonstrating that the controller is essential for: Robust Debugging: The detailed traces allowed us to diagnose subtle physical-world failures (metamerism) that would have corrupted an AI agent's learning process. Pre-emptive Protocol Verification: The simulation service caught critical scientific and logical errors in agent-generated code before they could cause an experiment to fail. End-to-End Automation: The controller successfully orchestrated a complex, multi-instrument workflow driven entirely by a high-level AI agent command.
Looking forward, this lab controller infrastructure enables a new paradigm of research. It allows for large-scale combinatorial assays that can explore thousands of experimental conditions simultaneously. The resulting data closes the loop on agentic ideation, allowing our AI systems to learn and improve with each experimental cycle, moving beyond simple hill-climbing to sophisticated, multi-variable optimization. By providing the tools to navigate these vast search spaces, the lab controller is a foundational step toward solving grand challenges in biology. Our work is guided by a strong commitment to safety and responsible innovation, incorporating a Human-in-the-Loop (HITL) review portal that uses the digital twin for transparent oversight and an automated biosecurity gateway with state-of-the-art, function-based screening to ensure all synthesized materials are safe by design. This report outlines the what of our system, its capabilities and strategic importance, with further technical details on the how reserved for future publications.
Introspection: Agents can query the lab's real-time state (e.g., reagent volumes, instrument status) to inform their planning and decision-making, grounding their logic in physical reality. Simulation: Agents can safely test experimental protocols in a time-compressed, virtual environment before physical execution. This is achieved via a discrete accounting engine that validates logistical and scientific feasibility, preventing errors, resource waste, and hardware damage. Trace Persistence: The controller records a complete, multimodal history of every experiment into a research dossier. This dataset is processed by a Wet2Dry pipeline into structured trajectories for training agents via imitation learning and offline reinforcement learning, using advanced techniques to compute rewards from noisy data. Safe Execution: The controller translates agent commands into hardware actions within a multi-layered safety architecture inspired by frameworks like Safe-SDL. This uses Verified Operating Domains (ODDs) to enforce pre-verified boundaries and Control Barrier Functions (CBFs) as real-time safety filters to prevent failures and ensure safe operation.
We have validated these services through case studies demonstrating that the controller is essential for: Robust Debugging: The detailed traces allowed us to diagnose subtle physical-world failures (metamerism) that would have corrupted an AI agent's learning process. Pre-emptive Protocol Verification: The simulation service caught critical scientific and logical errors in agent-generated code before they could cause an experiment to fail. End-to-End Automation: The controller successfully orchestrated a complex, multi-instrument workflow driven entirely by a high-level AI agent command.
Looking forward, this lab controller infrastructure enables a new paradigm of research. It allows for large-scale combinatorial assays that can explore thousands of experimental conditions simultaneously. The resulting data closes the loop on agentic ideation, allowing our AI systems to learn and improve with each experimental cycle, moving beyond simple hill-climbing to sophisticated, multi-variable optimization. By providing the tools to navigate these vast search spaces, the lab controller is a foundational step toward solving grand challenges in biology. Our work is guided by a strong commitment to safety and responsible innovation, incorporating a Human-in-the-Loop (HITL) review portal that uses the digital twin for transparent oversight and an automated biosecurity gateway with state-of-the-art, function-based screening to ensure all synthesized materials are safe by design. This report outlines the what of our system, its capabilities and strategic importance, with further technical details on the how reserved for future publications.
