Mark Díaz
Mark Díaz is a Research Scientist with the Technology, AI, Society, and Culture (TASC) team in Responsible AI. His primary research investigates sociotechnical AI evaluation and documentation, including understanding data annotation and subjective disagreements related to differences in social context and experience. He has most recently begun work on the impacts of anthropomorphic generative AI on user perceptions and what those impacts mean for responsible AI practice.
Mark completed his Ph.D. in Technology & Social Behavior, a joint program in Computer Science and Communication at Northwestern University where he was advised by Darren Gergle. Before completing his doctoral work on age-related biases in sentiment analysis, he worked as a graduate fellow at SMART Chicago, a nonprofit focused on technology access and equity in Chicago. As a graduate fellow he researched perceptions among Black and low-income Chicago residents of city technology policy.
Research Areas
Authored Publications
Sort By
Google
DICES Dataset: Diversity in Conversational AI Evaluation for Safety
Alex Taylor
Chris Homan
Greg Serapio-García
NeurIPS2023 (2023)
Intersecting Demographics: Bayesian Multilevel Models Reveal Age, Gender, and Racial Differences in Safety Perception of Chatbot Conversations
Chris Homan
Greg Serapio-García
Alex Taylor
(2023)
All that Agrees Is Not Gold: Evaluating Ground Truth Labels and Dialogue Content for Safety
Chris Homan
Greg Serapio-García
Alex Taylor
(2023)
Frameworks and Challenges to Participatory AI
Abeba Birhane
William Samuel Isaac
Madeleine Clare Elish
Iason Gabriel
Shakir Mohamed
In Proceeding of the Second Conference on Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO '22), ACM (2022)
CrowdWorkSheets: Accounting for Individual and Collective Identities Underlying Crowdsourced Dataset Annotation
Ian Kivlichan
Dylan Baker
Razvan Adrian Amironesei
Association for Computing Machinery, 2342–2351
LaMDA: Language Models for Dialog Applications
Aaron Daniel Cohen
Alena Butryna
Alicia Jin
Apoorv Kulshreshtha
Ben Zevenbergen
Chung-ching Chang
Cosmo Du
Daniel De Freitas Adiwardana
Dehao Chen
Dmitry (Dima) Lepikhin
Erin Hoffman-John
Igor Krivokon
James Qin
Jamie Hall
Joe Fenton
Johnny Soraker
Kathy Meier-Hellstern
Maarten Paul Bosma
Marc Joseph Pickett
Marcelo Amorim Menegali
Marian Croak
Maxim Krikun
Noam Shazeer
Rachel Bernstein
Ravi Rajakumar
Ray Kurzweil
Romal Thoppilan
Steven Zheng
Taylor Bos
Toju Duke
Tulsee Doshi
Vincent Y. Zhao
Will Rusch
Yuanzhong Xu
Zhifeng Chen
arXiv (2022)
The Reasonable Effectiveness of Diverse Evaluation Data
Christopher Homan
Alex Taylor
Human Evaluation for Generative Models (HEGM) Workshop at NeurIPS2022
Accounting for Offensive Speech as a Practice of Resistance
Razvan Adrian Amironesei
Laura Weidinger
Iason Gabriel
NAACL Workshop on Online Abuse and Harms (WOAH) (2022)
