Language, Decoded: What if you could code in your own language?
Quality data for under-resourced languages is hard to acquire. It is even harder to get code in these languages. Through research, it showed that introducing code in training a model has proved to be a well rounded data source to improve performance. How can we utilize non-English code to strengthen the performance of these multilingual models, especially where data scarcity exists? We started with the question:- what if the code you train a language model on was written in a language other than English?