Running summarizing tools on a new article
Check the paper below, then start its synthesis.
Cross-Lingual Language Modeling for Nepali: Enhancing low Resource NLP
Daniel Soubam (Sharda University), Vivek Gupta (Sharda University), Aparna Sivaraj (Sharda University)
Abstract: This paper looks at improving multilingual language models for Nepali, which is a language with limited resources. We take a two-step approach: first, we train the model using Masked Language Modeling (MLM) on Nepali-only text, then we continue training with Translation Language Modeling (TLM) using English-Nepali parallel texts. Our experiments show that adapting the XLM-R Base model this way helps reduce Nepali perplexity and boosts performance on tasks like machine translation, sentiment analysis, and question answering. We also share our methods and results to support future research on underrepresented South Asian languages.