Tag: multilingual LLMs
Scaling Multilingual LLMs: Mastering Data Balance and Coverage
Discover how optimal data balance and scaling laws revolutionize multilingual LLM training. Learn why proportional sampling fails and how new strategies improve low-resource language performance by up to 95%.
Multilingual LLMs: How Transfer Learning Bridges the Language Gap
Explore how multilingual LLMs use transfer learning to bridge the gap between high-resource languages like English and low-resource ones. We analyze performance disparities, top models like XLM-RoBERTa, and techniques like code-switching to overcome the 'curse of multilinguality.'
