1

Investigating the Effectiveness of Multiple Expert Models Collaboration
This paper aims to investigate the effectiveness of several machine translation (MT) models and aggregation methods in a multi-domain …
Ikumi Ito, Takumi Ito, Jun Suzuki, Kentaro Inui
Cite DOI URL
Use of an AI-Powered Rewriting Support Software in Context with Other Tools: A Study of Non-Native English Speakers
Academic writing in English can be challenging for non-native English speakers (NNESs). AI-powered rewriting tools can potentially …
Takumi Ito, Naomi Yamashita, Tatsuki Kuribayashi, Masatoshi Hidaka, Jun Suzuki, Ge Gao, Jack Jamieson, Kentaro Inui
Cite DOI URL
Challenges in Reproducing Human Evaluation Results for Role-Oriented Dialogue Summarization
There is a growing concern regarding the reproducibility of human evaluation studies in NLP. As part of the ReproHum campaign, we …
Takumi Ito, Qixiang Fang, Pablo Mosteiro, Albert Gatt, Kees van Deemter
Cite URL
Missing Information, Unresponsive Authors, Experimental Flaws: The Impossibility of Assessing the Reproducibility of Previous Human Evaluations in NLP
We report our efforts in identifying a set of previous human evaluations in NLP that would be suitable for a coordinated study …
Anya Belz, Craig Thomson, Ehud Reiter, Gavin Abercrombie, Jose M. Alonso-Moral, Mohammad Arvan, Anouck Braggaar, Mark Cieliebak, Elizabeth Clark, Kees van Deemter, Tanvi Dinkar, Ondřej Dušek, Steffen Eger, Qixiang Fang, Mingqi Gao, Albert Gatt, Dimitra Gkatzia, Javier González-Corbelle, Dirk Hovy, Manuela Hürlimann, Takumi Ito, John D. Kelleher, Filip Klubicka, Emiel Krahmer, Huiyuan Lai, Chris van der Lee, Yiru Li, Saad Mahamood, Margot Mieskes, Emiel van Miltenburg, Pablo Mosteiro, Malvina Nissim, Natalie Parde, Ondřej Plátek, Verena Rieser, Jie Ruan, Joel Tetreault, Antonio Toral, Xiaojun Wan, Leo Wanner, Lewis Watson, Diyi Yang
Cite URL
Lower Perplexity is Not Always Human-Like
In computational psycholinguistics, various language models have been evaluated against human reading behavior (e.g., eye movement) to …
Tatsuki Kuribayashi, Yohei Oseki, Takumi Ito, Ryo Yoshida, Masayuki Asahara, Kentaro Inui
Cite DOI URL
Tohoku-AIP-NTT at WMT 2020 News Translation Task
In this paper, we describe the submission of Tohoku-AIP-NTT to the WMT′20 news translation task. We participated in this task in two …
Shun Kiyono, Takumi Ito, Ryuto Konno, Makoto Morishita, Jun Suzuki
Cite URL
Langsmith: An Interactive Academic Text Revision System
Despite the current diversity and inclusion initiatives in the academic community, researchers with a non-native command of English …
Takumi Ito, Tatsuki Kuribayashi, Masatoshi Hidaka, Jun Suzuki, Kentaro Inui
Cite DOI URL
Language Models as an Alternative Evaluator of Word Order Hypotheses: A Case Study in Japanese
We examine a methodology using neural language models (LMs) for analyzing the word order of language. This LM-based method has the …
Tatsuki Kuribayashi, Takumi Ito, Jun Suzuki, Kentaro Inui
Cite DOI URL
TEASPN: Framework and Protocol for Integrated Writing Assistance Environments
Language technologies play a key role in assisting people with their writing. Although there has been steady progress in e.g., …
Masato Hagiwara, Takumi Ito, Tatsuki Kuribayashi, Jun Suzuki, Kentaro Inui
Cite DOI URL
Diamonds in the Rough: Generating Fluent Sentences from Early-Stage Drafts for Academic Writing Assistance
The writing process consists of several stages such as drafting, revising, editing, and proofreading. Studies on writing assistance, …
Takumi Ito, Tatsuki Kuribayashi, Hayato Kobayashi, Ana Brassard, Masato Hagiwara, Jun Suzuki, Kentaro Inui
Cite DOI URL