Publications
Our teams aspire to make discoveries that impact everyone, and core to our approach is sharing our research and tools to fuel progress in the field.
Our teams aspire to make discoveries that impact everyone, and core to our approach is sharing our research and tools to fuel progress in the field.
Sort By
1 - 15 of 11583 publications
A 3D Scene Graphs Survey: Open Challenges and Future Directions
Dennis Rotondi
Francesco Argenziano
Sebastian Koch
Nathan Hughes
Martin Büchner
Johanna Wald
Lukas Schmid
Daniele Nardi
Abhinav Valada
Liam Paul
Luca Carlone
Kai Arras
Annual Review of Control, Robotics, and Autonomous Systems (ARCRAS), 10 (2027) (to appear)
Preview abstract
3D Scene Graphs (3DSGs) have emerged as a powerful representation for spatial AI by combining geometric grounding with semantic and relational abstractions of the environment. Their expressiveness has made them relevant to a broad range of problems in robotics and computer vision, including mapping, task and motion planning, scene understanding, and many others. However, the field remains fragmented: different communities adopt distinct formulations, construction pipelines, and evaluation protocols, making it difficult to compare methods, identify common assumptions, and assess remaining challenges for robust real- world deployment. This survey provides a unified and critical review of 3DSGs, with particular emphasis on open challenges and future directions. We first formalize 3DSGs under a common definition and analyze the principal modeling choices that characterize existing formulations, including node and edge attributes, hierarchical structure, dynamic scene representations, and affordance-aware extensions. We then review how 3DSGs are constructed from raw sensory observations, covering both learning-oriented and construction-oriented systems. Finally, we examine downstream applications and evaluation strategies, from intrinsic graph quality to task-level performance. To support the community, we also provide a dedicated website that organizes and extends the surveyed works.
View details
When Android Apps Request Location with a Reason: A Developer Study and User Behavior Experiment
May Smith
Aman Jain
Proceedings on Privacy Enhancing Technologies (2027)
Preview abstract
Recent reports have highlighted how mobile apps share user location data with third parties, risking user privacy and platform trust. Although location data is highly sensitive, when users grant apps location access, they may not know the full extent to which it is used. We study how requiring Android apps to show a reason for location access could impact developers, users, and the platform.
We surveyed 323 Android app developers and found most supported such a requirement. The majority said it would have a positive impact on user privacy, trust for apps, and trust for Android, where impact on user trust for Android correlated most strongly with support. Many developers also said the intervention would increase the number of users granting location access. Yet their open-ended comments also revealed consistent concerns, such as apps providing dishonest reasons and platform verification.
To study the impact on user behavior, we conducted a randomized controlled experiment with 2579 US Android users. We tested how users' decisions to grant location access were impacted by app type, whether reasons were included in the requests, and the content of the reasons, including monetization. We did not find the reasons impacted users' decisions; decisions were instead driven by app type and demographics. Yet we did find the reasons could have a positive impact on user perception for the platform when the reasons did not include using data for ads. Our findings provide insights into developers' willingness to implement privacy-enhancing changes, and expose limits to improving user privacy by simply adding information to user interfaces.
View details
Prompt-Level Distillation: A Non-Parametric Alternative to Model Fine-Tuning for Efficient Reasoning
Preview abstract
Advanced reasoning typically requires Chain-of-Thought prompting, which is accurate but incurs prohibitive latency and substantial test-time inference costs. The standard alternative, fine-tuning smaller models, often sacrifices interpretability while introducing significant resource and operational overhead. To address these limitations, we introduce Prompt-Level Distillation (PLD). We extract explicit reasoning patterns from a Teacher model and organize them into a structured list of expressive instructions for the Student model's System Prompt. Evaluated on the StereoSet and Contract-NLI datasets using Gemma-3 4B, PLD improved Macro F1 scores from 57\% to 90.0\% and 67\% to 83\% respectively, enabling this compact model to match frontier performance with negligible latency overhead. These expressive instructions render the decision-making process transparent, allowing for full human verification of logic, making this approach ideal for regulated industries such as law, finance, and content moderation, as well as high-volume use cases and edge devices.
View details
Preview abstract
The management of a hybrid workforce comprising human and autonomous computational agents may be challenged by the use of separate systems for human capital and software assets, which can create a governance gap. A system can provide a unified framework for managing a hybrid workforce. For example, the system may utilize a labor service mesh to analyze and route tasks to either a human intent tier or an agentic execution tier. A potential principle of the system is structural symmetry, where computational agents can be assigned digital identities and managed through a lifecycle process that may parallel human resource functions, such as onboarding, performance evaluation, and structured offboarding. This integrated approach can facilitate a unified system of record and governance model for an organization's intelligence capacity.
View details
Model Checking for Flexible Networking Protocols
Andrew Johnson
Sean Song
Proceedings of the 38th International Conference on Computer Aided Verification (CAV 2026)
Preview abstract
Operating a network is a daunting task. Operating one at a global scale, with stringent service objectives and requirements to be available during maintenance and failures, is even more so. At Google, we operate such a network. This paper details our experience applying formal methods to some of the networking protocols that are developed and maintained by in-house engineers. These protocols centrally route network traffic to respond to changes in demand, react to network failures, and allow for maintenance and upgrades.
We used formal methods to target a class of bugs stemming from unclear specifications, unintended system interactions, and logical errors at the specification level. We show how we modeled our protocols using an off-the-shelf model checker and a custom harness to scale the model horizontally. We were able to recreate several recent bugs and verify that the fixes implemented were correct. Finally, we present a method called state projection that we used to increase confidence in the coverage of our models, which we added to the TLC model checker for TLA+. We created 7 different TLA+ models and showed that they were effective at recreating bugs and verifying our fixes to those bugs.
View details
Online Differentially Private Clustering: Private to Non-Private Reduction
Vadym Doroshenko
Pritish Kamath
Alexander Knop
Ethan Leeman
Adam Sealfon
NeurIPS (2026)
Preview abstract
We study differentially private k-mean/median clustering in the online streaming setting where a point arrive at each time step and we need to output a set of k centers that optimize the k-mean/median objective of all the points so far. We give a generic transformation that turns the sensitive stream into a differentially private stream, which is a semi-coreset of the original stream and allows us to run any (non-private) online clustering algorithm as a post-processing step. Our algorithm is efficient in terms of errors, space and running time compared to existing algorithms (Epasto et al., 2023; Dupr{\'{e}} la Tour, 2024). Furthermore, our reduction allows us to inherit properties of the non-private clustering, such as consistency (Lattanzi and Vassilvitski, 2017), which was not satisfied by previous DP algorithms.
View details
What’s on My Network? Using Large Language Models to Identify Real-World IoT Devices at Scale
Rameen Mahmood
Danny Yuxing Huang
Proceedings of ACM International Conference on Emerging Networking Experiments and Technologies (CoNEXT), Association for Computing Machinery (2026)
VIP-MINGLE: A Corpus for Videoconference and In-Person Multimodal Interaction in Group Language Engagement
Abhinay K Bodi
Wenxin Deng
Junrui Huang
Venu G Kadamba
Sumanth B H Karanam
Dhiwahar A Kennady
David Poeppel
Dustin Freeman
Interspeech (2026)
Preview abstract
Group conversations are a fundamental yet complex form of social interaction central to human cognition and telecommunication technology. While understanding and facilitating these interactions has been a long-standing goal, findings are often isolated within specific in-person or videoconferencing settings due to a scarcity of datasets that bridge the two. We introduce VIP-MINGLE, a multimodal dataset comprising 59 hours of recordings (32 groups, 105 participants), featuring paired within-subject sessions in both settings. The dataset includes raw audio/video, psychometric data, processed multimodal features (e.g., diarized speech, facial expressions, transcriptions), and time-resolved human annotations. Our analysis reveals significant behavioral distribution shifts across multiple modalities between settings, reinforcing the need for a cross-setting corpus. VIP-MINGLE serves as a critical resource for developing robust models of group conversations across settings.
View details
The Perfection Paradox: From Architect to Curator in AI-Assisted API Design
JJ Geewax
David R Karger
Extended Abstracts of the 2026 CHI Conference on Human Factors in Computing Systems (CHI EA '26), ACM, Barcelona, Spain, TBD
Preview abstract
Enterprise API design is often bottlenecked by the tension between rapid feature delivery and the rigorous maintenance of usability standards. We present an industrial case study evaluating an AI-assisted design workflow trained on API Improvement Proposals(AIPs). Through a controlled study with 16 industry experts, we compared AI-generated API specifications against human-authored ones. While quantitative results indicated AI superiority in 10 of 11 usability dimensions and an 87% reduction in authoring time, qualitative analysis revealed a paradox: experts frequently misidentified AI work as human (19% accuracy) yet described the designs as unsettlingly “perfect.” We characterize this as a “Perfection Paradox”—where hyper-consistency signals a lack of pragmatic human judgment. We discuss the implications of this perfection paradox, proposing a shift in the human designer’s role from the “drafter” of specifications to the “curator” of AI-generated patterns.
View details
Improving reanalysis weather for contrail validation by incorporating satellite observations
Susanne Rohs
Roger Teoh
Journal of Environmentally Compatible Air Transport System (JECATS) (2026)
Preview abstract
Aviation-induced condensation trails (contrails) contribute significantly to anthropogenic radiative forcing. While navigational contrail avoidance has been proposed as a strategy to mitigate this climate impact, the operational viability of such maneuvers relies on the ability to verify their efficacy. Current verification methodologies often employ contrail models driven by reanalysis weather data; however, these assessments are limited by the variable fidelity of the underlying meteorological datasets. In this work, we address this uncertainty by leveraging satellite observations to refine reanalysis estimates for specific contrail events. We demonstrate that this approach significantly improves the agreement between reanalysis data and in-situ measurements obtained from the IAGOS program, thereby offering a more robust framework for evaluating avoidance strategies.
View details
Differential Sensitivity of Impedance Plethysmography and Photoplethysmography Sensors to Temperature-Induced Peripheral Vasoconstriction
Seobin Jung
Seamus Thomson
Alexandros Pantelopoulos
Lindsey Sunden
Pete Richards
Shwetak Patel
Sam Sheng
Scientific Reports (2026)
Preview abstract
Impedance plethysmography (IPG) and photoplethysmography (PPG) are non-invasive techniques for measuring blood volume changes. This study investigated the differential responses of IPG and PPG to temperature-mediated vasoconstriction induced by localized cooling. Twenty-one participants underwent control and treatment conditions, with fake or real ice cubes applied to the forearm. Blood pressure remained stable, while heart rate decreased. PPG signal amplitude significantly decreased with cooling (p_adj = 0.004), indicating sensitivity to superficial blood flow changes. In contrast, IPG signal amplitude remained stable (p_adj = 1.0). No statistically significant differences were observed in timing-derived metrics. These findings suggest IPG is less sensitive to superficial changes in blood flow than PPG, and may be more suitable for monitoring deeper blood flow. This study provides insights into the distinct sensitivities of IPG and PPG, with implications for wearable device development and cardiovascular monitoring.
View details
Preview abstract
Ideation, i. e., generating, capturing, organizing, and evaluating ideas, is foundational to creative practices; yet little is known about how blind and low vision ( BLV) creators engage in ideation. We conducted interviews with 20 BLV creators working in different domains including poetry, music production, tactile graphics, digital drawing, and mixed- media arts. Our findings reveal how participants established accessible creative workflows under social and institutional constraints, drew inspiration from diverse physical and digital sources, captured and organized ideas across text, audio, visual, and physical modalities, and evaluated their work through human and AI feedback. We discuss how ableist norms and accessibility breakdowns cascade across ideation pathways, progressively narrowing BLV individuals’ creative possibilities. Finally, we offer design considerations for building accessible ideation support tools that amplify BLV creators’ distinctive practices.
View details
Preview abstract
We study cooperative multi-agent reinforcement learning in the setting of reward-free exploration, where multiple agents jointly explore an unknown MDP in order to learn its dynamics (without observing rewards). We focus on a tabular finite-horizon MDP and adopt a phased learning framework. In each learning phase, multiple agents independently interact with the environment. More specifically, in each learning phase, each agent is assigned a policy, executes it, and observes the resulting trajectory. Our primary goal is to characterize the tradeoff between the number of learning phases and the number of agents, especially when the number of learning phases is small.
Our results identify a regime change governed by the horizon $H$. When the number of learning phases equals $H$, we present a computationally efficient algorithm that uses only $\tilde{O}(S^6 H^6 A / \epsilon^2)$ agents to obtain an $\epsilon$ approximation of the dynamics (i.e., yields an $\epsilon$-optimal policy for any reward function). We complement our algorithm with a lower bound showing that any algorithm restricted to $\rho < H$ phases requires at least $A^{H/\rho}$ agents to achieve constant accuracy.
Thus, we show that having $\Theta(H)$ learning phases is both necessary and sufficient when restricting the number of agents to be polynomial.
View details
Preview abstract
The Agent-to-Agent (A2A) protocol is an open, vendor-neutral standard proposed by Google to enable seamless collaboration between independent AI agents. A2A allows agents to discover each other via standardized Agent Cards, exchange structured Tasks and messages over JSON-RPC/HTTP, and stream updates for long-running work. This paper details the A2A protocol, including its technical building blocks, security model based on OAuth2/OIDC, and contrasts it with existing agent interaction models. We illustrate its utility through real-world multi-agent workflows, demonstrating how A2A, in conjunction with Model Context Protocol (MCP), can form a robust and interoperable ecosystem for scalable, enterprise-grade autonomous processes across different organizations and platforms.
View details
Preview abstract
Context: The cost of frontier large language model inference has fallen by two orders of magnitude since 2023, yet the techno-economic forces governing AI value capture remain poorly understood. No existing work provides a unified, multi-layer framework connecting hardware physics to commercial pricing to actuarial constraints.
Objectives: This survey aims to establish that Generative AI (GenAI) monetization is structurally bound by five interdependent techno-economic layers: (1) the physical constraints of
memory bandwidth and compute, (2) deflationary architectural innovations, (3) the algorithmic
economics of inference-time compute, (4) the verification economics governing outcome-based
pricing, and (5) the macro-legal realities of enterprise liability.
Methods: We conduct a Multivocal Literature Review (MLR) adapting the PRISMA protocol,
synthesizing peer-reviewed and grey literature sources—vendor documentation, SLAs, and API
pricing data (2022–2026). Two reviewers independently screened all records (Cohen’s κ ≥ 0.81
across all decision stages).
Results: We contribute four primary artifacts.
First, the Viability Inequality, an analytical
model formalizing the conditions under which outcome-based AI pricing is economically sustainable.
Second, the Billing Fallacy: aggregate cost growth is driven by Agentic Recursion,
not quadratic attention complexity.
Third, the Verifiability Bifurcation: objective task domains
enable outcome pricing, while subjective domains depend on proxy-based models.
Fourth, the
Multi-Layer Techno-Economic Taxonomy (M-TET), a unified five-layer framework mapping the
full monetization stack from silicon-anchored token pricing through actuarial risk ceilings.
Conclusion: GenAI monetization is not a commercial pricing exercise but a dynamic negotiation across hardware, algorithmic, economic, and actuarial layers. In subjective and hybrid
task domains, the binding constraint on outcome-based pricing is the cost of verification, not
generation. AI value capture depends on engineering low-cost, high-fidelity Verification Engines.
View details
