N
Niranjan Ramesh Rao
Publications - 2
Citations - 70
Niranjan Ramesh Rao is an academic researcher. The author has contributed to research in topics: Benchmark (computing) & Natural language generation. The author has an hindex of 2, co-authored 2 publications receiving 50 citations.
Papers
More filters
Posted Content
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics.
Sebastian Gehrmann,Tosin P. Adewumi,Karmanya Aggarwal,Pawan Sasanka Ammanamanchi,Aremu Anuoluwapo,Antoine Bosselut,Khyathi Raghavi Chandu,Miruna Clinciu,Dipanjan Das,Kaustubh Dhole,Wanyu Du,Esin Durmus,Ondřej Dušek,Chris Chinenye Emezue,Varun Gangal,Cristina Garbacea,Tatsunori Hashimoto,Yufang Hou,Yacine Jernite,Harsh Jhamtani,Yangfeng Ji,Shailza Jolly,Mihir Kale,Dhruv Kumar,Faisal Ladhak,Aman Madaan,Mounica Maddela,Khyati Mahajan,Saad Mahamood,Bodhisattwa Prasad Majumder,Pedro Henrique Martins,Angelina McMillan-Major,Simon Mille,Emiel van Miltenburg,Moin Nadeem,Shashi Narayan,Vitaly Nikolaev,Rubungo Andre Niyongabo,Salomey Osei,Ankur P. Parikh,Laura Perez-Beltrachini,Niranjan Ramesh Rao,Vikas Raunak,Juan Diego Rodriguez,Sashank Santhanam,João Sedoc,Thibault Sellam,Samira Shaikh,Anastasia Shimorina,Marco Antonio Sobrevilla Cabezudo,Hendrik Strobelt,Nishant Subramani,Wei Xu,Diyi Yang,Akhila Yerukola,Jiawei Zhou +55 more
TL;DR: GEM as discussed by the authors is a living benchmark for natural language generation (NLG), its Evaluation and Metrics, which provides an environment in which models can easily be applied to a wide set of tasks and in which evaluation strategies can be tested.
Proceedings ArticleDOI
The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics
Sebastian Gehrmann,Tosin P. Adewumi,Karmanya Aggarwal,Pawan Sasanka Ammanamanchi,Anuoluwapo Aremu,Antoine Bosselut,Khyathi Raghavi Chandu,Miruna-Adriana Clinciu,Dipanjan Das,Kaustubh Dhole,Wanyu Du,Esin Durmus,Ondřej Dušek,Chris Chinenye Emezue,Varun Gangal,Cristina Garbacea,Tatsunori Hashimoto,Yufang Hou,Yacine Jernite,Harsh Jhamtani,Yangfeng Ji,Shailza Jolly,Mihir Kale,Dhruv Kumar,Faisal Ladhak,Aman Madaan,Mounica Maddela,Khyati Mahajan,Saad Mahamood,Bodhisattwa Prasad Majumder,Pedro Henrique Martins,Angelina McMillan-Major,Simon Mille,Emiel van Miltenburg,Moin Nadeem,Shashi Narayan,Vitaly Nikolaev,Andre Niyongabo Rubungo,Salomey Osei,Ankur P. Parikh,Laura Perez-Beltrachini,Niranjan Ramesh Rao,Vikas Raunak,Juan Diego Rodriguez,Sashank Santhanam,João Sedoc,Thibault Sellam,Samira Shaikh,Anastasia Shimorina,Marco Antonio Sobrevilla Cabezudo,Hendrik Strobelt,Nishant Subramani,Wei Xu,Diyi Yang,Akhila Yerukola,Jiawei Zhou +55 more
TL;DR: GEM as discussed by the authors is a living benchmark for natural language generation (NLG), its Evaluation and Metrics, which provides an environment in which models can easily be applied to a wide set of tasks and in which evaluation strategies can be tested.