Publications and Manuscripts

Aya Vision: Advancing the Frontier of Multilingual Multimodality

Saurabh Dash*,  Yiyang Nan*,  John Dang,  Arash Ahmadian,  Shivalika Singh,  Madeline Smith,  Bharat Venkitesh,  Vlad Shmyhlo,  Viraat Aryabumi,  Walter Beller-Morales,  Jeremy Pekmez,  Jason Ozuzu,  Pierre Richemond,  Acyr Locatelli,  Nick Frosst,  Phil Blunsom,  Aidan Gomez,  Ivan Zhang,  Marzieh Fadaee,  Manoj Govindassamy,  Sudip Roy,  Matthias Gallé,  Beyza Ermis,  Ahmet Üstün,  Sara Hooker

arXiv - huggingface

The Leaderboard Illusion

Shivalika Singh,  Yiyang Nan,  Alex Wang,  Daniel D'Souza,  Sayash Kapoor,  Ahmet Üstün,  Sanmi Koyejo,  Yuntian Deng,  Shayne Longpre,  Noah Smith,  Beyza Ermis,  Marzieh Fadaee,  Sara Hooker

arXiv

Learning to Generate Instruction Tuning Datasets for Zero-Shot Task Adaptation

Nihal V. Nayak*,  Yiyang Nan*,  Avi Trost*,  Stephen H. Bach
ACL Findings, 2024

arXiv - code - huggingface - Instruction Tuning Workshop @ NeurIPS, 2023

INCLUDE: Evaluating Multilingual Language Understanding with Regional Knowledge

Angelika Romanou,  Negar Foroutan,  Anna Sotnikova,  Sree Harsha Nelaturu,  Shivalika Singh,  Rishabh Maheshwary,  Micol Altomare,  Zeming Chen,  Mohamed A. Haggag,  Snegha A,  Alfonso Amayuelas,  Azril Hafizi Amirudin,  Danylo Boiko,  Michael Chang,  Jenny Chim,  Gal Cohen,  Aditya Kumar Dalmia,  Abraham Diress,  Sharad Duwal,  Daniil Dzenhaliou,  Daniel Fernando Erazo Florez,  Fabian Farestam,  Joseph Marvin Imperial,  Shayekh Bin Islam,  Perttu Isotalo,  Maral Jabbarishiviari,  Börje F. Karlsson,  Eldar Khalilov,  Christopher Klamm,  Fajri Koto,  Dominik Krzemiński,  Gabriel Adriano de Melo,  Syrielle Montariol,  Yiyang Nan,  Joel Niklaus,  Jekaterina Novikova,  Johan Samir Obando Ceron,  Debjit Paul,  Esther Ploeger,  Jebish Purbey,  Swati Rajwal,  Selvan Sunitha Ravi,  Sara Rydell,  Roshan Santhosh,  Drishti Sharma,  Marjana Prifti Skenduli,  Arshia Soltani Moakhar,  Bardia Soltani Moakhar,  Ayush Kumar Tarun,  Azmine Toushik Wasi,  Thenuka Ovin Weerasinghe,  Serhan Yilmaz,  Mike Zhang,  Imanol Schlag,  Marzieh Fadaee,  Sara Hooker,  Antoine Bosselut
ICLR, 2025 (Spotlight)

arXiv - dataset

Hear Me, See Me, Understand Me: Audio-Visual Autism Behavior Recognition

Shijian Deng,  Erin E. Kosloski,  Siddhi Patel,  Zeke Aharon Barnett,  Yiyang Nan,  Alexander Kaplan,  Sisira Aarukapalli,  William T. Doan,  Matthew Wang,  Harsh Singh,  Pamela R Rollins,  Yapeng Tian
IEEE Transactions on Multimedia, 2024

arXiv - dataset - Sight and Sound Workshop @ CVPR, 2024

SaSR-Net: Source-Aware Semantic Representation Network for Enhancing Audio-Visual Question Answering

Tianyu Yang,  Yiyang Nan,  Lisen Dai,  Zhenwen Liang,  Yapeng Tian,  Xiangliang Zhang
EMNLP Findings, 2024

arXiv

Continual Audio-Visual Sound Separation

Weiguo Pian,  Yiyang Nan,  Shijian Deng,  Shentong Mo,  Yunhui Guo,  Yapeng Tian
NeurIPS, 2024

arXiv - code

Harmonizing across datasets to improve the transferability of drug combination prediction

Hanrui Zhang*,  Ziyan Wang*,  Yiyang Nan*,  Bulat Zagidullin*,  Daiyao Yi,  Jing Tang,  Yuanfang Guan
Communications Biology, 2023

pdf