Publications

Our teams aspire to make discoveries that impact everyone, and core to our approach is sharing our research and tools to fuel progress in the field.

people standing in front of a screen with images and a chipboard

Our teams aspire to make discoveries that impact everyone, and core to our approach is sharing our research and tools to fuel progress in the field.

Sort By
  • Title
  • Title, descending
  • Year
  • Year, descending
1 - 15 of 122 publications
An Empirical Study of Tablet Ergonomics: The Interplay of Temperature, Orientation, and Use Behaviors
Carmen Van Ommen
Mikki Phan
Arun Raghupathy
Daniel Huynh
Barbara Chaparro
Ergonomics in Design: The Quarterly of Human Factors Applications Journal (2026)
Preview abstract To balance computational performance with thermal comfort, this study explores a consolidated hotspot architecture at the top center of a tablet. We tested hotspot (39°C, 43°C, 45°C, 47°C) and ambient temperatures (25°C, 35°C) with 60 participants, measuring perception, action likelihood, and expectation. The hotspot was observed away from high contact areas, with 43°C identified as the threshold for significant discomfort. Discomfort increased with portrait mode use and higher device and ambient temperatures, while active use duration influenced acceptability. The findings underscore the importance of thermal mapping and contextual sensing, with direct applications for software throttling thresholds of coated aluminum enclosures. View details
Preview abstract Config-driven user interface (CDUI), also called server-driven user interface, moves user interface (UI) layout out of the app binary into server responses so teams can update screens without an app store release. Because one schema serves many installed app versions, edits to it can break older apps. We statically compared parsed schema declarations across four open-source runtime CDUI engines (Yandex DivKit, Cash App Redwood, EnsembleUI, and archived Spotify HubFramework) and one inactive comparator compiled at build time (Airbnb Lona). Out of 1447 commits touching schema paths, 730 modify a runtime engine’s schema: 61.4% only add declarations, 38.1% remove or retype declarations, and 0.5% mark deprecations (93% parser accuracy against two-rater human labels). Standalone schema files had a higher share of additive commits than schemas written in code, though across four runtime engines this difference is not statistically significant. By Fisher’s exact test across commit halves, breaking edits fell significantly only in Redwood (73.3% to 25.0%, 𝑝=0.012). Finally, we compare systems across modularity, centralization, and strictness, showing when additions still break older clients (including Redwood throwing by default). View details
Preview abstract As SoC complexity grows, traditional serial JTAG/IJTAG interfaces increasingly become a bottleneck for post-silicon validation and instrument orchestration. This paper details the first-pass ATE bring-up and test experience using Tessent High-Bandwidth IJTAG (HB-IJTAG), a solution that maps IEEE 1687 control sequences directly onto the Streaming Scan Network (SSN) bus fabric View details
Preview abstract Android Bench 2.0 measures coding agents on long Android engineering tasks. It has 30 tasks written by Android developers: new app development from design mocks, library migrations in open-source apps, new features in existing apps, and conversions of Flutter and React Native apps to Jetpack Compose. The human-written solutions change a median of 2,336 lines across 42 files. Each task runs against a live Android emulator. Deterministic tests check behavior and stored data, and an LLM judge compares screenshots and accessibility trees with reference screens. Every run gets a partial score from 0 to 1 as well as pass or fail. Each task has a closed variant, where the tests are hidden, and an open variant, where the agent can run them. The best model on the closed variant, claude-sonnet-5-5, passes 41% of tasks with a mean partial score of 0.85. With tests available, the best pass rate is 84% (claude-fable-5-1). Most failed runs miss a requirement rather than fail to build. View details
Beyond Touchscreens: Dynamic and Multimodal Interaction Needs
Melissa Barnhart Wantland
Mai Kobori
Universal Access in Human-Computer Interaction, Springer-Verlag (2025)
Preview abstract Today’s smartphone interactions are typically designed with one primary preset, accompanied by customization settings that can be manually adjusted. To promote the creation of contextually aware experiences, researchers have highlighted the factors that influence mobile device usage in the ability-based design framework. This paper expands upon existing frameworks and contributes to an empirical understanding of smartphone accessibility. Through a 10-day longitudinal diary study and video interview with 24 individuals who do and do not identify as having a disability, the research also illustrates the reactions of reattempt, adaptation, and avoidance, which were used in response to a lack of smartphone accessibility. Despite experiencing scenarios where accessibility settings could be leveraged, 20 out of 24 participants did not use accessibility settings on their smartphone. A total of 12 out of 24 participants tried accessibility settings on their smartphones, however identifying accessibility was not for them. This work highlights the need to shift current design practices to better serve the accessibility community. View details
Ghost Points Matter: Far-Range Vehicle Detection with a Single mmWave Radar in Tunnel
Chengzhen Meng
Chenming He
Jianmin Ji
Yanyong Zhang
Haojie Ren
Dequan Wang
Rui Xia
MobiCom 2025: The 31th Annual International Conference On Mobile Computing And Networking, ACM
Preview abstract Vehicle detection in tunnels is crucial for traffic monitoring and accident response, yet remains underexplored. In this paper, we develop mmTunnel, a millimeter-wave radar system that achieves far-range vehicle detection in tunnels. The main challenge here is coping with ghost points caused by multi-path reflections, which lead to severe localization errors and false alarms. Instead of merely removing ghost points, we propose correcting them to true vehicle positions by recovering their signal reflection paths, thus reserving more data points and improving detection performance, even in occlusion scenarios. However, recovering complex 3D reflection paths from limited 2D radar points is highly challenging. To address this problem, we develop a multi-path ray tracing algorithm that leverages the ground plane constraint and identifies the most probable reflection path based on signal path loss and spatial distance. We also introduce a curve-to-plane segmentation method to simplify tunnel surface modeling such that we can significantly reduce the computational delay and achieve real-time processing. We have evaluated mmTunnel with comprehensive experiments. In two test tunnels, we conducted controlled experiments in various scenarios with cars and trucks. Our system achieves an average F1 score of 93.7% for vehicle detection while maintaining real-time processing. Even in the challenging occlusion scenarios, the F1 score remains above 91%. Moreover, we collected extensive data from a public tunnel with heavy traffic at times and show our method could achieve an F1 score of 91.5% in real-world traffic conditions. View details
Preview abstract Interactions with Extended Reality Head Mounted Devices (XR HMDs) applications require precise, intuitive and efficient input methods. Current approaches either rely on power-intensive sensors, such as cameras for hand-tracking, or specialized hardware in the form of handheld controllers. As an alternative, past works have explored the use of devices already present with the user, in the form of smartphones and smartwatches as practical input solutions. However, this approach risks interaction overload---how can one determine whether the user’s interaction gestures on the watch-face or phone screen are directed toward control of the mobile device itself or the XR device? To this effect, we propose a novel framework for cross-device input routing and device arbitration by employing Inertial Measurement Units (IMUs) within these devices. We validate our approach in a user study with six participants. By making use of the relative orientation between the headset and the target input device, we can estimate the intended device of interaction with 93.7% accuracy. Our method offers a seamless, energy-efficient alternative for input management in XR, enhancing user experience through natural and ergonomic interactions. View details
Preview abstract We present XDTK, an open-source Unity/Android toolkit for prototyping multi-device interactions in extended reality (XR). With the Unity package and Android app provided in XDTK, data from any number of devices (phones, tablets, or wearables) can be streamed to and surfaced within a Unity-based XR application. ARCore-supported device also provide self-tracked pose data. Devices on the same local network are automatically discovered by the Unity server and their inputs are routed using a custom event framework. We designed XDTK to be modular and easily extendable to enable fast, simple, and effective prototyping of multi-device experiences by both researchers and developers. View details
Ubiquitous and Low-Cost Generation of Elevation Pseudo Ground Control Points
Etienne Le Grand
Moustafa Youssef
14th International Conference on Indoor Positioning and Indoor Navigation (IPIN). Hong Kong, China, 2024.
Preview abstract In this paper, we design a system to generate Pseudo Ground Control Points (PGCPs) using standard low-cost widely available GNSS receivers in a crowd-sourcing manner. We propose a number of GNSS points filters that removes different causes of errors and biases, and design a linear regression height estimator leading to high-accuracy PGCP elevations. Evaluation of our system shows that the PGCPs can achieve a median accuracy of 22.5 cm in 25 metropolitan areas in the USA. View details
See Through Vehicles: Fully Occluded Vehicle Detection with Millimeter Wave Radar
Chenming He
Chengzhen Meng
Chunwang He
Beibei Wang
Yubo Yan
Yanyong Zhang
MobiCom 2024: The 30th Annual International Conference On Mobile Computing And Networking
Preview abstract A crucial task in autonomous driving is to continuously detect nearby vehicles. Problems thus arise when a vehicle is occluded and becomes “unseeable”, which may lead to accidents. In this study, we develop mmOVD, a system that can detect fully occluded vehicles by involving millimeter-wave radars to capture the ground-reflected signals passing beneath the blocking vehicle’s chassis. The foremost challenge here is coping with ghost points caused by frequent multi-path reflections, which highly resemble the true points. We devise a set of features that can efficiently distinguish the ghost points by exploiting the neighbor points’ spatial and velocity distributions. We also design a cumulative clustering algorithm to effectively aggregate the unstable ground reflected radar points over consecutive frames to derive the bounding boxes of the vehicles. We have evaluated mmOVD in both controlled environments and real-world environments. In an underground garage and two campus roads, we conducted controlled experiments in 56 scenes with 8 vehicles, including a minibus and a motorcycle. Our system accurately detects occluded vehicles for the first time, with a 91.1% F1 score for occluded vehicle detection and a 100% success rate for occlusion event detection. More importantly, we drove 324km on crowded roads at a speed up to 70km per hour and show we could achieve an occlusion detection success rate of 92% and a low false alarm rate of 4% with only 10% of the training data in complex real-world environments. View details
APG: Audioplethysmography for Cardiac Monitoring in Hearables
David Pearl
Rich Howard
Longfei Shangguan
Trausti Thormundsson
MobiCom 2023: The 29th Annual International Conference On Mobile Computing And Networking (MobiCom), Association for Computing Machinery (ACM) (to appear)
Preview abstract This paper presents Audioplethysmography (APG), a novel cardiac monitoring modality for active noise cancellation (ANC) headphones. APG sends a low intensity ultrasound probing signal using an ANC headphone's speakers and receives the echoes via the on-board feedback microphones. We observed that, as the volume of ear canals slightly changes with blood vessel deformations, the heartbeats will modulate these ultrasound echoes. We built mathematical models to analyze the underlying physics and propose a multi-tone APG signal processing pipeline to derive the heart rate and heart rate variability in both constrained and unconstrained settings. APG enables robust monitoring of cardiac activities using mass-market ANC headphones in the presence of music playback and body motion such as running. We conducted an eight-month field study with 153 participants to evaluate APG in various conditions. Our studies conform to the (Institutional Review Board) IRB policies from our company. The presented technology, experimental design, and results have been reviewed and further improved by feedback garnered from our internal Health Team, Product Team, User Experience (UX) Team and Legal team. Our results demonstrate that APG achieves consistently high HR (3.21% median error across 153 participants in all scenarios) and HRV (2.70% median error in interbeat interval, IBI) measurement accuracy. Our UX study further shows that APG is resilient to variation in: skin tone, sub-optimal seal conditions, and ear canal size. View details
Design Earable Sensing Systems: Perspectives and Lessons Learned from Industry
Trausti Thormundsson
Adjunct Proceedings of the 2023 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2023 ACM International Symposium on Wearable Computers, ACM (to appear)
Preview abstract Earables computing is an emerging research community as the industry witnesses the soaring of True Wireless Stereo (TWS) Active Noise Canceling (ANC) earbuds in the past ten years. There is an increasing trend of newly initiated earable research spanning across mobile health, user-interfaces, speech processing, and context-awareness. Head-worn devices are anticipated to be the next generation Mobile Computing and Human-Computer Interaction (HCI) platform. In this paper, we share our design experiences and lessons learned in building hearable sensing systems from the industry perspective. We also give our takes on future directions of the earable research. View details
UE Security Reloaded: Developing a 5G Standalone User-Side Security Testing Framework
Aanjhan Ranganathan
Christina Pöpper
Evangelos Bitsikas
Roger Piqueras Jover
Syed Khandker
16th ACM Conference on Security and Privacy in Wireless and Mobile Networks (2023)
Preview abstract Security flaws and vulnerabilities in cellular networks directly lead to severe security threats given the data-plane services, from calls to messaging and Internet access, that are involved. While the 5G Standalone (SA) system is currently being deployed worldwide, practical security testing of user equipment has only been conducted for 4G/LTE and earlier network generations. In this paper, we develop and present the first security testing framework for 5G SA user equipment. To that end, we modify the functionality of open-source suites (Open5GS and srsRAN) and develop a broad set of test cases for 5G NAS and RRC layers. We apply our testing framework in a proof-of-concept manner to 5G SA mobile phones, report identified vulnerabilities, and provide detailed insights from our experiments. View details
Preview abstract Keynote at the srsRAN Project Workshop in October 2023: https://srs.io/srsran-project-workshop-october-23-24/ The talk is a summary of the impact that open-source tools and SW radio have had on cellular security research in academia over the last 15 years. It summarizes 2G security research in ~2008-2012 and how the first OSS tools for LTE (openLTE and srsLTE) were a game changer for the field, enabling a tremendous spike in excellent cellular security research work. View details
Measure by Measure: Resting Heart Rate Across the 24 Hour Cycle
Justin Phillips
Robert Harle
Thomas Arneil
Cathy Speed
Mike McConnell
Alex Wilson
PLOS Digital Health (2023)
Preview abstract Background: The development of photoplethysmography (PPG) sensors, typically found in wrist worn devices, offers the opportunity to continuously monitor heart rate in large populations in real world settings. Resting heart rate (RHR) is known to be an important biomarker of morbidities and mortality, but no universally accepted definition nor criteria for its measurement exist. In this study, we provide a working definition of resting heart rate and examine how heart rate at rest varies across the 24 hour cycle. Methods: 433 healthy subjects wore a wrist device that measured activity and heart rate, day and night, for up to 3 months. Heart rate at rest (sedentary heart rate) was recorded, the duration of rest needed for RHR to stabilize was ascertained, and the true lowest RHRs for the sample population during the day and the night were established. The variation of RHR through the 24 hour cycle was also assessed. The sample was also subdivided according to their daily activity levels for subset analysis. Results: Of the 26,758 days and nights available for measurement in the sample, adequate data was obtained for 19,242 days and 18,520 nights. We define the difference between true resting heart rate and heart rate when measured at rest across the day (sedentary heart rate). We found that heart rate stabilized in most subjects after 3 minutes of rest. Mean (SD) lowest HR at rest for the sample was 54.5 (8.0) bpm during the day and 50.5 (7.6) bpm at night, and values were highest in the least active group. A circadian variation in RHR was confirmed, with the lowest values in the 24 hour cycle being between 3 and 9 am for most subjects. Conclusions: Since RHR is such an important clinical metric, it is important for clinicians and researchers to be clear on the measurement methodology used. RHR as measured using a PPG based devices significantly different at night than in the day. A circadian rhythm of RHR was confirmed. View details
×