Markus Freitag
Research Areas
Authored Publications
Sort By
Google
Findings of the WMT24 General Machine Translation Shared Task: The LLM Era is Here but MT is Not Solved Yet
Tom Kocmi
Eleftherios Avramidis
Rachel Bawden
Ondrej Bojar
Anton Dvorkovich
Christian Federman
Mark Fishel
Thamme Gowda
Roman Grundkiewicz
Barry Haddow
Marzena Karpinska
Philipp Koehn
Benjamin Marie
Christof Monz
Kenton Murray
Masaaki Nagata
Martin Popel
Maja Popovic
Mariya Shmatova
Steinþór Steingrímsson
Vilém Zouhar
2024
Are LLMs Breaking MT Metrics? Results of the WMT24 Metrics Shared Task
Nitika Mathur
Chi-kiu Lo
Eleftherios Avramidis
Ricardo Rei
Brian Thompson
Frédéric Blain
Tom Kocmi
Jiayi Wang
David Adelani
Marianna Buchicchio
Chrysoula Zerva
Alon Lavie
2024
Mitigating metric bias in minimum bayes risk decoding
Proceedings of the Ninth Conference on Machine Translation (2024), pp. 1063-1094
MetricX-23: The Google Submission to the WMT 2023 Metrics Shared Task
Jurik Juraska
Mara Finkelstein
Mahdi Mirzazadeh
Conference on Machine Translation (2023)
There's no Data Like Better Data: Using QE Metrics for MT Data Filtering
Jan-Thorsten Peter
Mara Finkelstein
Jurik Juraska
Proceedings of the Eighth Conference on Machine Translation, Association for Computational Linguistics, Singapore (2023), pp. 561-577
Ties Matter: Meta-Evaluating Modern Metrics with Pairwise Accuracy and Tie Calibration
George Foster
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Singapore, pp. 12914-12929
INSTRUCTSCORE: Towards Explainable Text Generation Evaluation with Automatic Feedback
Wenda Xu
Danqing Wang
Liangming Pan
Zhenqiao Song
William Wang
Lei Li
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, Association for Computational Linguistics, Singapore, pp. 5967-5994
