Google Research at CHI 2024
Google Research at CHI 2024
The Conference on Human Factors in Computing Systems (CHI 2024), a premier conference on human-computer interaction, is being held this week as a hybrid event in Honolulu, HI. We are proud to be a Champion Sponsor of CHI 2024, where Google researchers are presenting over 30 papers and are actively involved in organizing and hosting a number of different events across workshops, courses, and interactive sessions.
If you’re registered for CHI 2024, we hope you’ll visit the Google booth to learn more about the exciting work across various topics, including language interactions, question answering and more. Visit the @GoogleAI X (formerly Twitter) and Google Research LinkedIn accounts to find out about Google booth activities (e.g., demos and Q&A sessions, which are also listed below).
Continue below to learn more about how Google researchers are engaged at CHI 2024 (Google affiliations highlighted in bold).
All session times are provided in HST.
Quick links
Quick links
Board and Organizing Committee
Accepted papers
A Contextual Inquiry of People with Vision Impairments in Cooking
Franklin Mingzhe Li, Michael Xieyang Liu, Shaun K. Kane, Patrick Carrington
A Design Space for Intelligent and Interactive Writing Assistants
Mina Lee, Katy Ilonka Gero, John Joon Young Chung, Simon Buckingham Shum, Vipul Raheja, Hua Shen, Subhashini Venugopalan, Thiemo Wambsganss, David Zhou, Emad A. Alghamdi, Tal August, Avinash Bhat, Madiha Zahrah Choksi, Senjuti Dutta, Jin L. C. Guo, Md Naimul Hoque, Yewon Kim, Simon Knight, Seyed Parsa Neshaei, Agnia Sergeyuk, Antonette Shibani, Disha Shrivastava, Lila Shroff, Jessi Stark, Sarah Sterman, Sherol Chen, et al.
A Scoping Study of Evaluation Practices for Responsible AI Tools: Steps Towards Effectiveness Evaluations
Glen Berman, Nitesh Goyal, Michael Madaio
Automatic Macro Mining from Interaction Traces at Scale
Forrest Huang, Gang Li, Tao Li, Yang Li
ChatDirector: Enhancing Video Conferencing With Space-Aware Scene Rendering and Speech-Driven Layout Transition
Xun Qian*, Feitong Tan, Yinda Zhang, Brian Moreno Collins, David Kim, Alex Olwal, Karthik Ramani, Ruofei Du
CRTypist: Simulating Touchscreen Typing Behavior via Computational Rationality
Danqing Shi, Jussi P. P. Jokinen, Aini Putkonen, Antti Oulasvirta, Yujun Zhu, Aditya Acharya, Shumin Zhai
Designing a Card-Based Design Tool to Bridge Academic Research & Design Practice for Societal Resilience
Novia Nurain, Chia-Fang Chung, Clara Caldeira, Kay Connelly
Did You Misclick? Reversing 5-Point Satisfaction Scales Causes Unintended Responses
Martin Pielot, Mario Callegaro
Farsight: Fostering Responsible AI Awareness During AI Application Prototyping
Zijie J. Wang*, Chinmay Kulkarni*, Lauren Wilcox*, Michael Terry, Michael Madaio
From Provenance to Aberrations: Image Creator and Screen Reader User Perspectives on Alt Text for AI-Generated Images
Maitraye Das, Alexander J. Fiannaca, Meredith Ringel Morris, Shaun K. Kane, Cynthia L. Bennett
Generating Automatic Feedback on UI Mockups with Large Language Models
Peitong Duan, Jeremy Warner, Yang Li, Bjoern Hartmann
Generative AI in Creative Practice: ML-Artist Folk Theories of T2I Use, Harm, and Harm-Reduction
Renee Shelby, Shalaleh Rismani, Negar Rostamzadeh
How Knowledge Workers Think Generative AI Will (Not) Transform Their Industries
Allison Woodruff, Renee Shelby, Patrick Gage Kelley, Steven Ruosso-Schindler, Jamila Smith-Loud, Lauren Wilcox
Human I/O: Towards a Unified Approach to Detecting Situational Impairments
Xingyu Bruce Liu*, Jiahao Nick Li, David Kim, Xiang “Anthony” Chen, Ruofei Du
Inkeraction: An Interaction Modality Powered by Ink Recognition and Synthesis
Lei Shi, Peggy Chi, Mike Cleron, Chelsey Q Fleming, Philippe Gervais, Tayeb A Karim, Chris Melancon, Claudiu Musat, Xiaoyu Iris Qu, Angad Singh, Rachel Campbell, Maria Cirimele, Kirsten Climer, Ashwin Ganti, Pedro Gonnet, Andrii Maksai, Rob Mickle, Palash Nandy, David Robishaw, Mathangi Venkatesan
Investigating Use Cases of AI-Powered Scene Description Applications for Blind and Low Vision People
Ricardo Gonzalez, Jazmin Collins, Shiri Azenkot, Cynthia Bennett
Meta-Manager: A Tool for Collecting and Exploring Meta Information about Code
Amber Horvath, Andrew Macvean, Brad Myers
Non-Consensual Synthetic Intimate Imagery: Prevalence, Attitudes, and Knowledge in 10 Countries
Rebecca Umbach, Nicola Henry, Gemma Beard, Colleen Berryessa
Rambler: Supporting Writing With Speech via LLM-Assisted Gist Manipulation
Susan Lin, Jeremy Warner, J. D. Zamfirescu-Pereira, Matthew G. Lee, Sauhard Jain, Michael Xuelin Huang, Piyawat Lertvittayakumjorn, Shanqing Cai, Shumin Zhai, Björn Hartmann, Can Liu
Seeking in Cycles: How Users Leverage Personal Information Ecosystems to Find Mental Health Information
Ashlee Milton, Juan F. Maestre, Abhishek Roy, Rebecca Umbach, Stevie Chancellor
Signs of the Smart City: Exploring the Limits and Opportunities of Transparency
Eric Corbett, Graham Dove
The Effects of Perceived AI Use On Content Perceptions
Irene Rae
The Illusion of Artificial Inclusion
William Agnew, A. Stevie Bergman, Jennifer Chien, Mark Díaz, Seliem El-Sayed, Jaylen Pittman, Shakir Mohamed, Kevin R. McKee
“They Only Care to Show Us the Wheelchair”: Disability Representation in Text-to-Image AI Models
Kelly Avery Mack, Remi Denton, Cynthia L Bennett, Rida Qadri, Shaun K. Kane
UI Mobility Control in XR: Switching UI Positionings Between Static, Dynamic, and Self Entities
Siyou Pei*, David Kim, Alex Olwal, Yang Zhang, Ruofei Du
Understanding Documentation Use Through Log Analysis: A Case Study of Four Cloud Services
Daye Nam, Andrew Macvean, Bogdan Vasilescu, Brad Myers
User Experience Design Professionals’ Perceptions of Generative Artificial Intelligence
Jie Li, Hancheng Cao, Laura Lin, Youyang Hou, Ruihao Zhu, Abdallah El Ali
Websites Need Your Permission Too – User Sentiment and Decision-Making on Web Permission Prompts in Desktop Chrome
Marian Harbach
Case studies
-
Mon, 13 May | 4:15 PM - 4:30 PM
Relational Affect in Dyadic InteractionsAuthors: Krishna Somandepalli, Brendan Jou, Oliver Siy
Speaker: Krishna Somandepalli
-
Tue, 14 May | 11:15 AM - 11:30 AM
AI Is Not Enough: A Hybrid Technical Approach to AI Adoption in UI Linting With HeuristicsAuthors: Yuwen Lu*, Tiffany Knearem, Shona Dutta, Jamie Blass, Clara Kliman-Silver, Frank Bentley
-
Tue, 14 May | 2:15 PM - 2:30 PM
Leveraging Virtual Reality to Enhance Diversity, Equity and Inclusion Training at GoogleAuthors: Elie Bursztein, Leonie M Sanderson, Karla J Brown, Patrick Gage Kelley
Speaker: Karla Brown
-
Tue, 14 May | 4:15 PM - 4:30 PM
User Experience Research: Point of View PlaybookAuthors: Huseyin Dogan, Renee M Barsoum, Stephen Giff
Interactive workshops & courses
-
Wed, May 15 | 9:00 AM - 3:20 PM
C07: Human-Computer Interaction and AI: What Practitioners Need to Know to Design and Build Effective AI Systems from a Human PerspectiveAuthors: Daniel M. Russell, Q. Vera Liao, Chinmay Kulkarni, Elena Glassman, Nikolas Martelaro
Organizers: Daniel M. Russell, Chinmay Kulkarni, Elena L. Glassman, Hariharan Subramonyam, Nikolas Martelaro
-
Mon, 13 May | 5:30 PM - 5:35 PM & Tue, 14 May | 10:20 AM - 5:35 PM
Experiencing InstructPipe: Building Multi-Modal AI Pipelines Via Prompting LLMs and Visual ProgrammingAuthors: Zhongyi Zhou*, Vrushank Phadnis, Jun Jiang, Jingtao Zhou, Zheng Xu, Kristen Wright, Mark Sherwood, Alex Olwal, Ram Iyengar, Ruofei Du, Jing Jin, Xiuxiu Yuan, Xun Qian, Yiyi Huang, Yinda Zhang, Jason Mayes, Johnny Lee, David Kim, Na Li
Late Breaking Work Track
-
Tue, 14 May | 11:40 AM - 11:45 AM & 4:40 PM - 4:45 PM
AI-Enhanced API Design: A New Paradigm in Usability and EfficiencyAuthors: Mak Ahmad, Andrew Macvean, David R Karger, Kwan-Liu Ma
-
Wed, 15 May | 10:25 AM - 10:30 AM & 3:25 PM - 3:30 PM
Automatic Histograms: Leveraging Language Models for Text Dataset ExplorationAuthors: Emily Reif, Crystal Qian, James Wexler, Minsuk Kahng
-
Wed, 15 May | 11:15 AM - 11:20 AM & 4:15 PM - 4:20 PM
Believing Anthropomorphism: Examining the Role of Anthropomorphic Cues on Trust in Large Language ModelsAuthors: Michelle Cohn*, Mahima Pushkarna, Gbolahan Olanubi, Joe Moran, Daniel Padgett, Zion Mengesha, Courtney Heldreth
-
Wed, 15 May | 11:10 AM - 11:15 AM & 4:10 PM - 4:15 PM
Beyond ChatBots: ExploreLLM for Structured Thoughts and Personalized Model ResponsesAuthors: Xiao Ma, Swaroop Mishra, Ariel Liu, Sophie Ying Su, Jilin Chen, Chinmay Kulkarni, Heng-Tze Cheng, Quoc Le, Ed Chi
-
Wed, 15 May | 11:10 AM - 11:15 AM & 4:10 PM - 4:15 PM
Conversational AI in health: Design Considerations from a Wizard-of-Oz Dermatology Case Study With Users, Clinicians and a Medical LLMAuthors: Brenna Li, Amy Wang, Patricia Strachan, Julie Anne Séguin, Sami Lachgar, Karyn C Schroeder*, Mathias S Fleck, Renee Wong, Alan Karthikesalingam, Vivek Natarajan, Yossi Matias, Greg S Corrado, Dale Webster, Yun Liu, Naama Hammel, Rory Sayres, Christopher Semturs, Mike Schaekermann
-
Wed, 15 May | 11:20 AM - 11:25 AM & 4:20 PM - 4:25 PM
Designing For Human-Agent Alignment: Understanding What Humans Want From Their AgentsAuthors: Nitesh Goyal, Minsuk Chang, Michael Terry
-
Wed, 15 May | 11:10 AM - 11:15 AM & 4:10 PM - 4:15 PM
Intent-Driven Input Device Arbitration for XRAuthors: Eric J Gonzalez, Ishan Chatterjee, Mar Gonzalez-Franco, Andrea Colaço, Karan Ahuja
-
Wed, 15 May | 10:40 AM - 10:45 AM & 3:40 PM - 3:45 PM
Investigating the Potential of User Interface Shortcuts and Control Panes to Support Mobile Phone Use by People with Mild Dementia – a Diary StudyAuthors: Emma Dixon, Xiang Xiao, Rain Breaw Michaels, Yu Zhong, Ajit Narayanan, Erin Buehler
-
Wed, 15 May | 10:20 AM - 10:25 AM & 3:20 PM - 3:25 PM
LLM Comparator: Visual Analytics for Side-by-Side Evaluation of Large Language ModelsAuthors: Minsuk Kahng, Ian Tenney, Mahima Pushkarna, Michael Xieyang Liu, James Wexler, Emily Reif, Krystal Kallarackal, Minsuk Chang, Michael Terry, Lucas Dixon
-
Wed, 15 May | 10:20 AM - 11:00 AM & 3:20 PM - 4:00 PM
Like-minded, like-bodied: How users (18-26) trust online eating and health informationAuthors: Rachel Xu, Nhu Le, Rebekah Park, Laura Cecilia Murray
-
Wed, 15 May | 11:00 AM - 11:05 AM & 4:00 PM - 4:05 PM
Recourse for Reclamation: Chatting with Generative Language ModelsAuthors: Jennifer Chien, Kevin McKee, Jackie Kay, William Isaac
-
Wed, 15 May | 11:55 AM - 12:00 PM & 4:55 PM - 5:00 PM
Understanding the Dataset Practitioners Behind Large Language ModelsAuthors: Crystal Qian, Emily Reif, Minsuk Kahng
-
Tue, 14 May | 10:25 AM - 10:30 AM & 3:25 PM - 3:30 PM
Virtual Games, Real Interactions: A Look at Cross-Reality Asymmetrical Co-Located Social GamesAuthors: Alexandra Kitson, Sun Joo (Grace) Ahn, Eric J Gonzalez, Payod Panda, Katherine Isbister, Mar Gonzalez-Franco
-
Wed, 15 May | 12:25 PM - 12:30 PM & 5:25 PM - 5:30 PM
"We Need Structured Output": Towards User-Centered Constraints on Large Language Model OutputAuthors: Michael Xieyang Liu, Frederick Liu, Alex Fiannaca, Terry Koo, Lucas Dixon, Michael Terry, Carrie J Cai
Special interest groups (SIG)
-
Wed, 15 May | 11:00 AM - 12:20 PM
DCitizens Roles Unveiled: SIG Navigating Identities in Digital Civics and the Spectrum of Societal ImpactAuthors: Anna R. L. Carter, Kyle Montague, Reem Talhouk, Shaun Lawson, Hugo Nicolau, Ana Cristina Pires, Markus Rohde, Alessio Del Bue, Tiffany Knearem
-
Wed, 15 May | 9:00 AM - 10:20 AM
Implications of Regulations on the Use of AI and Generative AI for Human-Centered Responsible Artificial IntelligenceAuthors: Marios Constantinides, Mohammad Tahaei, Daniele Quercia, Simone Stumpf, Michael Madaio, Sean Kennedy, Lauren Wilcox, Jessica Vitak, Henriette Cramer, Edyta Paulina Bogucka, Ricardo Baeza-Yates, Ewa Luger, Jess Holbrook, Michael Muller, Ilana Golbin Blumenfeld, Giada Pistilli
-
Tue, 14 May | 11:00 AM - 12:20 PM
Transforming HCI Research Cycles using Generative AI and “Large Whatever Models” (LWMs)Authors: Passant ElAgroudy, Jie Li, Kaisa Väänänen, Paul Lukowicz, Hiroshi Ishii, Wendy E. Mackay, Elizabeth F Churchill, Anicia Peters, Antti Oulasvirta, Rui Prada, Alexandra Deining, Giulia Barbareschi, Agnes Gruenerbl, Midori Kawaguchi, Abdallah El Ali, Fiona Draxler, Robin Welsch, Albrecht Schmidt
Workshops
-
Sat, May 11 | 9:00 AM - 5:20 PM
AI and the AfterlifeOrganizer: Meredith Ringel Morris
-
Sun, May 12 | 9:00 AM - 5:20 PM
Computational Methodologies for Understanding, Automating, and Evaluating User InterfacesOrganizers and Speakers: Tiffany Knearem, Clara E Kliman-Silver
-
Sat, May 11 | 9:00 AM - 5:20 PM
Dark Sides: Envisioning, Understanding, and Preventing Harmful Effects of Writing Assistants – The Third Workshop on Intelligent and Interactive Writing AssistantsOrganizer: Minsuk Chang
-
Sat, May 11 | 9:00 AM - 5:20 PM
EmpathiCH: Scrutinizing Empathy-Centric Design Beyond the IndividualOrganizers: Michal Lahav, Tiffanie Horne
-
Sun, May 12 | 9:00 AM - 5:20 PM
Generative AI in User-Generated ContentOrganizer: Yiqing Hua
Speaker: Renee Shelby
-
Sun, May 12 | 9:00 AM - 5:20 PM
Sensemaking: What is it today?Organizers: Nitesh Goyal, Michael Xieyang Liu
-
Sat, May 11 | 9:00 AM - 5:20 PM
Sustaining Scalable Sustainability: Human-Centered Green Technology for Community-Wide Carbon ReductionOrganizer: Elizabeth F Churchill
-
Sat, May 11 | 9:00 AM - 5:20 PM
Unlocking the User Experience of Generative AI Applications: Design Patterns and PrinciplesAuthors: Vinita Tibdewal, Sharoda Paul, Xiaomai Chen, Jennifer Kim, Obinna Anya, Mina Shojaeizadeh, Ilteris Kaplan
Speakers: Vinita Tibdewal, Sharoda Paul
Google Research Booth Demo/Q&A Schedule
*Dates and times may be subject to change. Stop by the Google Research booth for more info.
-
Tuesday, May 14 | starting at 10:20AM
Visual Blocks for ML: Visual Prototyping of AI PipelinesPresenter: Ruofei Du
-
Tuesday, May 14 | starting at 12:20PM
Relay: A Collaborative UI Model for Design HandoffPresenter: Jimmy Lin
-
Tuesday, May 14 | starting at 3:20PM
MakerSuite and AI Studio: Build your Generative AI VisionPresenter: Tesh Goyal
-
Wednesday, May 15 | starting at 10:20AM
InstructPipe: Building Visual Programming Pipelines With Human InstructionsPresenter: Zhongyi Zhou & Ruofei Du
-
Wednesday, May 15 | starting at 12:20PM
Q&A: Working as a UX Researcher in the IndustryPresenter: Clara Kliman-Silver, Tiffany Knearem, Martin Pielot, & Rose Pozos
-
Wednesday, May 15 | starting at 3:20PM
ChatDirector: Enhancing Video Conferencing With Space-Aware Scene Rendering and Speech-Driven Layout TransitionPresenter: Xun Qian
* Work done while at Google
