1

Document-level Translation with LLM Reranking: Team-J at WMT 2024 General Translation Task
We participated in the constrained track for English-Japanese and Japanese-Chinese translations at the WMT 2024 General Machine …
Keito Kudo, Hiroyuki Deguchi, Makoto Morishita, Ryo Fujii, Takumi Ito, Shintaro Ozaki, Koki Natsumi, Kai Sato, Kazuki Yano, Ryosuke Takahashi, Subaru Kimura, Tomomasa Hara, Yusuke Sakai, Jun Suzuki
Cite URL
Investigating the Effectiveness of Multiple Expert Models Collaboration
This paper aims to investigate the effectiveness of several machine translation (MT) models and aggregation methods in a multi-domain …
Ikumi Ito, Takumi Ito, Jun Suzuki, Kentaro Inui
Cite DOI URL
SKIM at WMT 2023 General Translation Task
The SKIM team’s submission used a standard procedure to build ensemble Transformer models, including base-model training, …
Keito Kudo, Takumi Ito, Makoto Morishita, Jun Suzuki
Cite URL
Use of an AI-Powered Rewriting Support Software in Context with Other Tools: A Study of Non-Native English Speakers
Academic writing in English can be challenging for non-native English speakers (NNESs). AI-powered rewriting tools can potentially …
Takumi Ito, Naomi Yamashita, Tatsuki Kuribayashi, Masatoshi Hidaka, Jun Suzuki, Ge Gao, Jack Jamieson, Kentaro Inui
Cite DOI URL
Challenges in Reproducing Human Evaluation Results for Role-Oriented Dialogue Summarization
There is a growing concern regarding the reproducibility of human evaluation studies in NLP. As part of the ReproHum campaign, we …
Takumi Ito, Qixiang Fang, Pablo Mosteiro, Albert Gatt, Kees van Deemter
Cite URL
Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP
We report our efforts in identifying a set of previous human evaluations in NLP that would be suitable for a coordinated study …
Anya Belz, Craig Thomson, Ehud Reiter, Gavin Abercrombie, Jose M. Alonso-Moral, Mohammad Arvan, Anouck Braggaar, Mark Cieliebak, Elizabeth Clark, Kees van Deemter, Tanvi Dinkar, Ondřej Dušek, Steffen Eger, Qixiang Fang, Mingqi Gao, Albert Gatt, Dimitra Gkatzia, Javier González-Corbelle, Dirk Hovy, Manuela Hürlimann, Takumi Ito, John D. Kelleher, Filip Klubicka, Emiel Krahmer, Huiyuan Lai, Chris van der Lee, Yiru Li, Saad Mahamood, Margot Mieskes, Emiel van Miltenburg, Pablo Mosteiro, Malvina Nissim, Natalie Parde, Ondřej Plátek, Verena Rieser, Jie Ruan, Joel Tetreault, Antonio Toral, Xiaojun Wan, Leo Wanner, Lewis Watson, Diyi Yang
Cite URL
Lower Perplexity is Not Always Human-Like
In computational psycholinguistics, various language models have been evaluated against human reading behavior (e.g., eye movement) to …
Tatsuki Kuribayashi, Yohei Oseki, Takumi Ito, Ryo Yoshida, Masayuki Asahara, Kentaro Inui
Cite DOI URL
Tohoku-AIP-NTT at WMT 2020 News Translation Task
In this paper, we describe the submission of Tohoku-AIP-NTT to the WMT′20 news translation task. We participated in this task in two …
Shun Kiyono, Takumi Ito, Ryuto Konno, Makoto Morishita, Jun Suzuki
Cite URL
Langsmith: An Interactive Academic Text Revision System
Despite the current diversity and inclusion initiatives in the academic community, researchers with a non-native command of English …
Takumi Ito, Tatsuki Kuribayashi, Masatoshi Hidaka, Jun Suzuki, Kentaro Inui
Cite DOI URL
Language Models as an Alternative Evaluator of Word Order Hypotheses: A Case Study in Japanese
We examine a methodology using neural language models (LMs) for analyzing the word order of language. This LM-based method has the …
Tatsuki Kuribayashi, Takumi Ito, Jun Suzuki, Kentaro Inui
Cite DOI URL