Publications

Our teams aspire to make discoveries that impact everyone, and core to our approach is sharing our research and tools to fuel progress in the field.

people standing in front of a screen with images and a chipboard

Our teams aspire to make discoveries that impact everyone, and core to our approach is sharing our research and tools to fuel progress in the field.

86 results

Sort By
  • Title
  • Title, descending
  • Year
  • Year, descending
1 - 15 of 19 publications
    Thieves of Sesame Street: Model Extraction on BERT-based APIs
    Kalpesh Krishna
    Gaurav Singh Tomar
    Ankur Parikh
    Nicolas Papernot
    Mohit Iyyer
    ICLR 2020 (2020)
    Ensemble Distillation for BERT-Based Ranking Models
    Honglei Zhuang
    Zhen Qin
    Shuguang Han
    Xuanhui Wang
    Mike Bendersky
    Marc Najork
    Proceedings of the 2021 ACM SIGIR International Conference on the Theory of Information Retrieval (ICTIR ’21)
    PnG BERT: Augmented BERT on Phonemes and Graphemes for Neural TTS
    Ye Jia
    Heiga Zen (Byungha Chun)
    Jonathan Shen
    Yu Zhang
    Yonghui Wu
    Interspeech (2021)
    Improving Prosody of RNN-based English Text-To-Speech Synthesis by Incorporating a BERT model
    Tom Kenter
    Manish Kumar Sharma
    Rob Clark
    INTERSPEECH 2020
    How multilingual is Multilingual BERT?
    Telmo Pires
    Eva Schlinger
    Dan Garrette
    Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics (2019)
    Small and Practical BERT models for Sequence Labeling
    Henry Tsai
    Jason Riesa
    Melvin Johnson
    Naveen Ari
    Xin Li
    Amelia Archer
    EMNLP 2019 (to appear)
    When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer
    Ameet Deshpande
    Partha Pratim Talukdar
    Karthik Narasimhan
    NAACL 2022 (2022) (to appear)
    Sparse Mixers: Combining MoE and Mixing to build a more efficient BERT
    James Patrick Lee-Thorp
    Joshua Ainslie
    Association for Computational Linguistics, Abu Dhabi, United Arab Emirates, 58–75
    What Happens To BERT Embeddings During Fine-tuning?
    Amil Merchant
    Elahe Rahimtoroghi
    Ellie Pavlick
    Ian Tenney
    Proceedings of the 2020 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, Association for Computational Linguistics (to appear)
    The MultiBERTs: BERT Reproductions for Robustness Analysis
    Thibault Sellam
    Steve Yadlowsky
    Ian Tenney
    Jason Wei
    Naomi Saphra
    Alexander Nicholas D'Amour
    Tal Linzen
    Jasmijn Bastings
    Iulia Raluca Turc
    Jacob Eisenstein
    Dipanjan Das
    Ellie Pavlick
    2022
    Assessing ASR Model Quality on Disordered Speech using BERTScore
    Jimmy Tobin
    Qisheng Li
    Subhashini Venugopalan
    Katie Seaver
    Richard Jonathan Noel Cave
    Katrin Tomanek
    Proc. 1st Workshop on Speech for Social Good (S4SG) (2022), pp. 26-30 (to appear)
    BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
    Jacob Devlin
    Ming-Wei Chang
    Kenton Lee
    Kristina N. Toutanova
    NAACL 2019 (2018)
    Large-Scale Differentially Private BERT
    Badih Ghazi
    Pasin Manurangsi
    Ravi Kumar
    Rohan Anil
    Vineet Gupta
    Findings of EMNLP 2022 (to appear)
    Jigsaw @ AMI and HaSpeeDe2: Fine-Tuning a Pre-TrainedComment-Domain BERT Model
    Alyssa Whitlock Lees
    Ian Kivlichan
    Jeffrey Scott Sorensen
    Proceedings of Seventh Evaluation Campaign of Natural Language Processing and Speech Tools for Italian. Final Workshop (EVALITA 2020), CEUR.org, Online (to appear)
    Giving BERT a Calculator: Finding Operations and Arguments with Reading Comprehension
    Daniel Andor
    Emily Pitler
    Kenton Lee
    Luheng He
    EMNLP 2019 (2019) (to appear)
    Search on Google Scholar