IndicTrans2: Towards High-Quality and Accessible Machine Translation Models for all 22 Scheduled Indian Languages J Gala*, PA Chitale*, R AK, V Gumma, S Doddapaneni, A Kumar, ... Transactions on Machine Learning Research, 2023 | 33* | 2023 |
Are Large Language Model-based Evaluators the Solution to Scaling Up Multilingual Evaluation? R Hada, V Gumma, A de Wynter, H Diddee, M Ahmed, M Choudhury, ... Findings of the Association for Computational Linguistics: EACL 2024 1, 1051 …, 2024 | 22 | 2024 |
MEGAVERSE: benchmarking large language models across languages, modalities, models and tasks S Ahuja, D Aggarwal, V Gumma, I Watts, A Sathe, M Ochieng, R Hada, ... 2024 Annual Conference of the North American Chapter of the Association for …, 2023 | 16 | 2023 |
PAMMELA: Policy Administration Methodology using Machine Learning V Gumma, B Mitra, S Dey, PS Patel*, S Suman*, S Das Proceedings of the 19th International Conference on Security and …, 2022 | 7 | 2022 |
An Empirical Study of Leveraging Knowledge Distillation for Compressing Multilingual Neural Machine Translation Models V Gumma, R Dabre, P Kumar Proceedings of the 24th Annual Conference of the European Association for …, 2023 | 3 | 2023 |
PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data I Watts, V Gumma, A Yadavalli, V Seshadri, M Swaminathan, S Sitaram arXiv preprint arXiv:2406.15053, 2024 | 1 | 2024 |
Akal Badi ya Bias: An Exploratory Study of Gender Bias in Hindi Language Technology R Hada, S Husain, V Gumma, H Diddee, A Yadavalli, A Seth, N Kulkarni, ... ACM Conference on Fairness, Accountability, and Transparency, 2024 | 1 | 2024 |
Beyond Metrics: Evaluating LLMs' Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios M Ochieng, V Gumma, S Sitaram, J Wang, K Ronen, K Bali, J O'Neill arXiv preprint arXiv:2406.00343, 2024 | | 2024 |
METAL: Towards Multilingual Meta-Evaluation R Hada*, V Gumma*, M Ahmed, K Bali, S Sitaram Findings of the Association for Computational Linguistics: NAACL 2024 1, 2024 | | 2024 |
MAFIA: Multi-Adapter Fused Inclusive Language Models P Jain*, A Sathe*, V Gumma, K Ahuja, S Sitaram Proceedings of the 18th Conference of the European Chapter of the …, 2024 | | 2024 |
MunTTS: A Text-to-Speech System for Mundari V Gumma, R Hada, A Yadavalli, P Gogoi, I Mondal, V Seshadri, K Bali Proceedings of the 7th Workshop on the Use of Computational Methods in the …, 2024 | | 2024 |