Publications

Our teams aspire to make discoveries that impact everyone, and core to our approach is sharing our research and tools to fuel progress in the field.

people standing in front of a screen with images and a chipboard

Our teams aspire to make discoveries that impact everyone, and core to our approach is sharing our research and tools to fuel progress in the field.

Sort By
  • Title
  • Title, descending
  • Year
  • Year, descending
1 - 15 of 11927 publications
A Data-Driven Biophotonic Skin Model for Wearable Sensing
Kaiyuan (Kai) Yao
Hamed Vavadi
Biomedical Optics Express (2027) (to appear)
Preview abstract Accurate modeling of light-matter interactions in biological tissue is fundamental to the advancement of biophotonic sensing, in-vivo diagnostics, and the development of next-generation wearable health monitors. While computational methods such as Monte Carlo simulations are powerful tools for virtual prototyping, the reliability of their predictions is strictly limited by the fidelity of the underlying skin model. Current industry-standard models primarily rely on optical parameters derived from ex-vivo tissue samples or dataset with limited size and variabilities in measurement methods, often failing to capture the complex spectral responses and inter-subject variability found in living populations. To address this limitation, we present a data-driven biophotonic skin model rigorously calibrated and validated against extensive in-vivo dataset. Our study utilizes smartwatch data acquired across a broad spectral range (UV to SWIR) and multiple sensor geometries, with subjects covering a diverse range of skin tones. By grounding the standard multilayer skin architecture in experimental data, this work provides a robust, statistically validated foundation for the design, simulation, and optimization of future wearable optical sensors. View details
Who’s Doing the Thinking Now? Reflexivity and Oversight in GenAI-Mediated Decision-Making
Oliver Herrbach
Siddharth Gaurav Majhi
Under review with Information Systems Journal (2027) (to appear)
Preview abstract Generative AI (GenAI) is increasingly embedded in organizational decision-making, reshaping how judgment, oversight, and productivity are enacted in everyday work. While prior research documents performance gains from AI assistance, less is known about how sustained GenAI use affects human reflexivity, i.e., the capacity for critical evaluation, deliberation, and decision override in AI-mediated tasks. This study advances Algorithmic Reflexivity Reallocation Theory (ALERT), which theorizes how repeated algorithmic mediation reallocates cognitive effort away from human judgment through cognitive offloading and automation bias, producing a trade-off between productivity and reflexive oversight. We test ALERT using a three-stage mixed-methods design comprising qualitative grounding interviews, a controlled behavioral experiment, and a large-scale survey-based structural equation model. Behavioral results show that GenAI assistance increases task efficiency but reduces override behavior, particularly when recommendations are plausible yet incorrect. Structural modeling further demonstrates that human–AI trust, task familiarity, and algorithmic structuration predict cognitive offloading, which in turn suppresses override behavior and weakens individual reflexivity while increasing perceived productivity. Transparency emerges as a key design condition that mitigates cognitive offloading and preserves evaluative engagement. By theorizing reflexivity as a reallocatable cognitive and organizational resource, ALERT extends structuration and human–AI interaction research by explaining how productivity gains can coexist with the erosion of reflective judgment under sustained GenAI use. The study contributes a process theory of AI-mediated decision-making with implications for the design and governance of AI-supported work systems. View details
Preview abstract Modern transformers have been scaled up in size, data, training-time compute, and more recently test-time compute based on Chain-of-Thought (CoT), but the consequences of trading off these parameters are unknown. We construct explicit tradeoffs between two of these aspects: the number of layers in a transformer and the number of CoT tokens. Our first result is general: with mild assumptions and a single-token prompt, for any integer k, a transformer using soft attention and SwiGLU MLP layers with L layers and n CoT tokens can be converted to a transformer with at most ckL layers and ⌈n/k⌉ CoT tokens, and vice versa, although with an increase to the size of other parameters. We then a multi-token prompt path following task, finding that additional preprocessing from the multi-token prompt changes the depth-CoT relationship in this case. We construct an attention-only network with L layers and 2^(L−2) heads that can traverse 2^(L−1) − 1 edges along a path with a single CoT token, demonstrating at least an exponential relationship between increases in depth and reductions in the number of CoT tokens needed to traverse the entire path. This relationship for the path following task holds empirically as well, as demonstrated by training networks with up to 5 layers, with the tradeoff between depth and the maximum number of edge traversals in a single CoT token exactly matching our theoretical constructions. View details
The Decision-Accountability Gap: Symbolic Oversight Theory and Pivot to Human-in-the-Accountability-Loop (HIAL)
Sreekumar Hariharan
Amrita George
Shaliet Rose Sebastian
Sent for review (2027) (to appear)
Preview abstract As organizations increasingly deploy agentic artificial intelligence (AI) systems, Human-in-the-Loop (HITL) oversight structures are widely mandated to ensure compliance, ethics, and control. However, the substantive efficacy of these structures remains poorly understood under conditions of AI scale and high operational complexity. This study introduces Symbolic Oversight Theory (SOT), a novel AI governance framework rooted in neo-institutional theory and bounded rationality. We theorize that when AI systems exhibit high epistemic authority under intense operational velocity and regulatory pressures, traditional decision-centric HITL mechanisms decouple from operational realities. This creates a state of "symbolic oversight"—a ritualistic formality where formal review checkpoints persist for institutional legitimacy, but substantive human cognition, reflexivity, and intervention capacity erode, structurally shifting accountability loads onto individuals without true decisional agency. To validate and apply SOT, we employ a rigorous mixed-method research design across three studies: (1) a controlled behavioral experiment tracking heuristic processing and error-detection among finance professionals, (2) a field survey validating the structural relations and psychometric properties of our constructs, and (3) an empirical study integrating anonymized interaction telemetry logs from internal enterprise agentic AI systems with semi-structured, anonymized internal employee interviews. Our findings demonstrate an empirical divergence between nominal and enacted oversight, showing that symbolic HITL suppresses human reflexivity through cognitive offloading and proceduralization, ultimately yielding a systemic decision-accountability gap. To resolve this governance design failure, we present a design-science architecture shifting governance from decision-centric loops to a consequence-centric Human-in-the-Accountability-Loop (HIAL) framework, establishing new metrics for consequence traceability, accountability latency, and auditability-controllability symmetry. View details
Preview abstract Large Language Models (LLMs) are increasingly deployed to automate enterprise recruitment pipelines, yet evaluating their decision consistency and underlying logic remains heavily throttled by a lack of credible, real-world benchmark datasets. Free-form floating-point scoring methods frequently used in recruitment AI suffer from severe numerical calibration drift and mask the models' intermediate reasoning. To address these challenges, we introduce Djinni-CB, a novel, two-tiered evaluation benchmark containing 2,484 real candidate-job pairs spanning 21 diverse job categories, bridged entirely from naturally occurring, anonymized candidate résumés and standardized employer postings. Rather than relying on generic scores, we implement a rigorous 29-question structured questionnaire across 9 diagnostic groups to audit pure deterministic reasoning boundaries. We establish comprehensive baseline results at temperature T=0.0 comparing frontier model architectures: Gemini 4.1m, DeepSeek Pro, GPT-5.4, and Gemini 2.5 Pro. Over 235,000 discrete decision points reveal a distinct dichotomy in the LLM ecosystem: a "Literal Gatekeeper" cluster (DeepSeek Pro and GPT-5.4) that prioritizes strict keyword matching, and a "Holistic" cluster (the Gemini family) that leverages contextual domain inference. Our dataset provides a highly structured resource complete with verbatim natural-language reasoning logs, offering an essential framework for future research into interpretability, factuality, and consistency in automated hiring. View details
Preview abstract Enterprise digital transformation projects are among the most complex and costly initiatives in modern organizations, yet conventional governance frameworks rely predominantly on reactive, lagging indicators of project health. This paper presents an empirical binary classification study applying machine learning to identify high-risk implementations in enterprise digital transformation portfolios. A publicly available dataset of 4,000 project records encoding 49 governance-relevant features is used; an original four-level risk taxonomy is collapsed into two governance-actionable classes: High-Risk and Not High-Risk Implementation. This study proposes a governance-actionable machine learning framework that converts multi-level project risk into binary escalation decisions and combines cross-validated model selection with direct SHAP attribution for enterprise transformation portfolios. Seven classifiers are benchmarked against a majority-class baseline across six metrics. Model selection incorporates five-fold stratified cross-validation and grid-search hyperparameter optimization for the two strongest classifiers. Five-fold stratified cross-validation confirms generalization stability across all models: AdaBoost achieves the highest cross-validation performance—85.85% ± 1.46% accuracy, 85.56% ± 1.32% balanced accuracy, 84.02% ± 1.36% F1-score, and 0.9380 ± 0.0070 ROC-AUC—and also leads on the held-out test set (90.87% accuracy, 90.69% balanced accuracy, 89.76% F1-score, 0.9766 ROC-AUC). All seven classifiers exhibit standard deviations below the 3.0 percentage-point instability threshold, confirming robust generalization without overfitting. SHAP-based explainability, applied directly to the AdaBoost model via TreeExplainer, identifies Complexity_Score, Org_Process_Maturity, and Technology_Familiarity as the primary drivers of high-risk classification, consistent with digital transformation governance literature. Practical integration scenarios for portfolio dashboards and governance escalation workflows are discussed. View details
A 3D Scene Graphs Survey: Open Challenges and Future Directions
Dennis Rotondi
Francesco Argenziano
Sebastian Koch
Nathan Hughes
Martin Büchner
Johanna Wald
Lukas Schmid
Daniele Nardi
Abhinav Valada
Liam Paul
Luca Carlone
Kai Arras
Annual Review of Control, Robotics, and Autonomous Systems (ARCRAS), 10 (2027) (to appear)
Preview abstract 3D Scene Graphs (3DSGs) have emerged as a powerful representation for spatial AI by combining geometric grounding with semantic and relational abstractions of the environment. Their expressiveness has made them relevant to a broad range of problems in robotics and computer vision, including mapping, task and motion planning, scene understanding, and many others. However, the field remains fragmented: different communities adopt distinct formulations, construction pipelines, and evaluation protocols, making it difficult to compare methods, identify common assumptions, and assess remaining challenges for robust real- world deployment. This survey provides a unified and critical review of 3DSGs, with particular emphasis on open challenges and future directions. We first formalize 3DSGs under a common definition and analyze the principal modeling choices that characterize existing formulations, including node and edge attributes, hierarchical structure, dynamic scene representations, and affordance-aware extensions. We then review how 3DSGs are constructed from raw sensory observations, covering both learning-oriented and construction-oriented systems. Finally, we examine downstream applications and evaluation strategies, from intrinsic graph quality to task-level performance. To support the community, we also provide a dedicated website that organizes and extends the surveyed works. View details
Preview abstract Recent reports have highlighted how mobile apps share user location data with third parties, risking user privacy and platform trust. Although location data is highly sensitive, when users grant apps location access, they may not know the full extent to which it is used. We study how requiring Android apps to show a reason for location access could impact developers, users, and the platform. We surveyed 323 Android app developers and found most supported such a requirement. The majority said it would have a positive impact on user privacy, trust for apps, and trust for Android, where impact on user trust for Android correlated most strongly with support. Many developers also said the intervention would increase the number of users granting location access. Yet their open-ended comments also revealed consistent concerns, such as apps providing dishonest reasons and platform verification. To study the impact on user behavior, we conducted a randomized controlled experiment with 2579 US Android users. We tested how users' decisions to grant location access were impacted by app type, whether reasons were included in the requests, and the content of the reasons, including monetization. We did not find the reasons impacted users' decisions; decisions were instead driven by app type and demographics. Yet we did find the reasons could have a positive impact on user perception for the platform when the reasons did not include using data for ads. Our findings provide insights into developers' willingness to implement privacy-enhancing changes, and expose limits to improving user privacy by simply adding information to user interfaces. View details
Hardening Confidential Federated Compute against Side-Channel Attacks
Albert Cheu
Adria Gascon
James Bell-Clark
Theory and Practice of Differential Privacy (2026)
Preview abstract In this work, we identify a set of side-channels in our Confidential Federated Compute platform that a hypothetical insider could exploit to circumvent differential privacy (DP) guarantees. We show how DP can mitigate two of the side-channels, one of which has been implemented in our open-source library. View details
See2Refine: Vision-Language Feedback Improves LLM-Based eHMI Action Designers
Ding Xia
Xinyue Gui
Mark Colley
Fan Gao
Dongyuan Li
Renhe Jiang
Takeo Igarashi
ACL 26 (2026)
Preview abstract Automated vehicles lack natural communication channels with other road users, making external Human-Machine Interfaces (eHMIs) essential for conveying intent and maintaining trust in shared environments. However, most eHMI studies rely on developer-crafted message-action pairs, which are difficult to adapt to diverse and dynamic traffic contexts. A promising alternative is to use Large Language Models (LLMs) as action designers that generate context-conditioned eHMI actions, yet such designers lack perceptual verification and typically depend on fixed prompts or costly human-annotated feedback for improvement. We present See2Refine, a human-free, closed-loop framework that uses vision-language models (VLMs) for perceptual evaluation as automated visual feedback to improve an LLM-based eHMI action designer. Given a driving context and a candidate eHMI action, the VLM evaluates the perceived appropriateness of the action, and this feedback is used to iteratively revise the designer's outputs, enabling systematic refinement without human supervision. We evaluate our framework across three eHMI modalities (lightbar, eyes, and arm) and multiple LLM model sizes. Across settings, our framework consistently outperforms prompt-only LLM designers and manually specified baselines in both VLM-based metrics and human-subject evaluations. Results further indicate that the improvements generalize across modalities and that VLM evaluations are well aligned with human preferences, supporting the robustness and effectiveness of \systemName for scalable action design. View details
Hybrid Consensus with Quantum Sybil Resistance
Dar Gilboa
Sid Jain
Or Sattath
2026
Preview abstract Sybil resistance is a key requirement of decentralized consensus protocols. It is achieved by introducing a scarce resource (such as computational power, monetary stake, disk space, etc.), which prevents participants from costlessly creating multiple fake identities and hijacking the protocol. Quantum states are generically uncloneable, which suggests that they may serve naturally as an unconditionally scarce resource. In particular, uncloneability underlies quantum position based-cryptography, which is unachievable classically. We design a consensus protocol that combines classical hybrid consensus protocols with quantum position verification as the Sybil resistance mechanism, providing security in the standard model, and achieving improved energy efficiency compared to hybrid protocols based on Proof-of-Work. Our protocol inherits the benefits of other hybrid protocols, namely the faster confirmation times compared to pure Proof-of-Work protocols, and resilience against the compounding wealth issue that plagues protocols based on Proof-of-Stake Sybil resistance. We additionally propose a spam prevention mechanism for our protocol in the Random Oracle model. View details
Preview abstract Formal verification of deep tracking buffers (64+ stages) in AI and networking SoCs frequently hits a "Complexity Wall," where traditional Bounded Model Checking (BMC) scales quadratically (O(N2xW)) relative to pipeline depth. As sequential unrolling depth increases, the resulting state space explosion leads to inconclusive timeouts that prevent full architectural sign-off. This paper introduces an AI-assisted framework that shatters this barrier by shifting from deep sequential searching to a 1-cycle inductive proof, effectively achieving linear scalability (O(N xW)). The core innovation is an LLM-driven "Impact Grading" framework that automates the arduous discovery of high-impact inductive invariants. By categorizing candidate properties into a tiered hierarchy (S/A/B), we identify the "Golden Triangle" of invariants—State Mapping, Ingress Consistency, and Control-Path Sync—that bridge the reference model and RTL state. This targeted approach eliminates the traditional manual bottleneck of invariant generation, which historically required weeks of expert engineering effort. Experimental results on a 64-stage tracking buffer demonstrate a paradigm shift: while standard BMC remains inconclusive after 24 hours of computation, our methodology achieves 100% mathematical convergence in approximately 50 minutes. This framework enables comprehensive formal sign-off for high-latency, high-concurrency designs previously deemed "unverifiable," significantly accelerating the development cycle for next-generation hardware architectures. View details
Preview abstract Prior work synthesizes tool-use LLM datasets by first generating a user query, followed by complex tool-use annotations like depth-first search (DFS). This leads to inevitable annotation failures and low efficiency in data generation. We introduce ToolGrad, an agentic framework that inverts this paradigm. ToolGrad first constructs valid tool-use chains through an iterative process guided by textual "gradients", and then synthesizes corresponding user queries. This "answer-first" approach led to ToolGrad-500, a dataset generated with more complex tool use, lower cost, and almost 100% pass rate. Experiments show that ToolGrad models outperform those trained on expensive baseline datasets and proprietary LLMs. View details
Differential Sensitivity of Impedance Plethysmography and Photoplethysmography Sensors to Temperature-Induced Peripheral Vasoconstriction
Seobin Jung
Seamus Thomson
Alexandros Pantelopoulos
Lindsey Sunden
Pete Richards
Shwetak Patel
Sam Sheng
Scientific Reports (2026)
Preview abstract Impedance plethysmography (IPG) and photoplethysmography (PPG) are non-invasive techniques for measuring blood volume changes. This study investigated the differential responses of IPG and PPG to temperature-mediated vasoconstriction induced by localized cooling. Twenty-one participants underwent control and treatment conditions, with fake or real ice cubes applied to the forearm. Blood pressure remained stable, while heart rate decreased. PPG signal amplitude significantly decreased with cooling (p_adj = 0.004), indicating sensitivity to superficial blood flow changes. In contrast, IPG signal amplitude remained stable (p_adj = 1.0). No statistically significant differences were observed in timing-derived metrics. These findings suggest IPG is less sensitive to superficial changes in blood flow than PPG, and may be more suitable for monitoring deeper blood flow. This study provides insights into the distinct sensitivities of IPG and PPG, with implications for wearable device development and cardiovascular monitoring. View details
On-the-Fly OVD Adaptation with FLAME: Few-shot Localization via Active Marginal-Samples Exploration
Yehonathan Refael
Amit Aides
Aviad Barzilai
Vered Silverman
Bolous Jaber
Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) Workshops (2026), pp. 886-894
Preview abstract Open-vocabulary object detection (OVD) models offer remarkable flexibility applications by enabling object detection from arbitrary text queries. Still, the zero-shot performance of the pre-trained models is hampered by the inherent semantic ambiguity of natural language, result to low precision, leading to insufficient crucial downstream applications. For instance, in the remote sensing (RS) domain, a query for "ship" can yield varied and contextually irrelevant results. To address this, for real time applications, we propose a novel cascaded architecture that synergizes the broad capabilities of a large, pre-trained OVD model with a lightweight, few-shot classifier. Our approach utilizes the frozen weights of the zero-shot model to generate initial, high-recall object-embedding proposals, which are then refined by a compact classifier trained in real-time on a handful of user-annotated examples. The core of our contribution is an efficient one step active learning strategy for selecting the most informative samples for user annotation. Our method identifies (extremely) small amount of an uncertain candidates near the theoretical decision boundary using density estimation and then applies clustering to ensure a diverse training set. This targeted sampling enables our cascaded system to elevate performance on standard remote sensing benchmarks. Our work thus presents a practical and resource-efficient framework for adapting foundational models to specific user needs, drastically reducing annotation overhead while achieving high accuracy without costly full-model fine-tuning. View details
×