Comparison of Various Models in the Context of Language Identification (Indo Aryan Languages)

Salman Alam

Abstract: Automatic language detection is a text classification task in which language is identified in a given multilingual text by the machine. This paper compares the different models of machine learning algorithm in the context of language identification. The corpus includes five major Indo-Aryan Language which are closely related to each other like Hindi, Bhojpuri, Awadhi, Maghahi and Braj. In this paper I have compared models like Random forest classifier, SVC, SGD Classifier, Multi-nominal logistic Regression, Gaussian Naïve Bayes and Bernoulli Naïve Bayes. Out of these models Multi-nominal Naïve Bayes has attained the best accuracy of 74 %.

Keywords: Hindi, Magahi, Bhojpuri, Braj, Awadhi, SVC, Multinominal NB, RNN, Linear SVC, SGD Classifier, Indo-Aryan

How to Cite?: Salman Alam, "Comparison of Various Models in the Context of Language Identification (Indo Aryan Languages)", Volume 10 Issue 3, March 2021, International Journal of Science and Research (IJSR), Pages: 185-188, https://www.ijsr.net/getabstract.php?paperid=SR21303115028, DOI: https://dx.doi.org/10.21275/SR21303115028

Download Citation: APA | MLA | BibTeX | EndNote | RefMan