Investigate the Impact of Stemming on Mauritanian Dialect Classification using Machine Learning Techniques

Despite the plethora and diversity of research on Natural Language Processing (NLP). As a technique allowing computers to understand, generate, and manipulate human language; It still remains insufficient, especially with regard to the processing of Arabic texts and their dialects which are widely used. The proposed approach focuses on the application of machine learning techniques taking into account evaluation criteria such as training to comments expressed in Mauritanian dialect, published on social media notably Facebook, and compares results generated by three algorithms which we applied such as the Random Forest (RF), Na¨ıve Bayes Multinominal (NBM), and Logistic Regression (LR) algorithm. Additionally, We then study the effect of machine learning techniques when different stemmers are combined with other features such as the tokenizers used to process the dataset. Although major challenges exist such as the morphology of Arabic is completely different from Latin letter languages, and there is no pre-existing dataset or dictionary to train the algorithms, the result we obtained after the experiments carried out on Weka shows that the RF and NBM algorithms are more efficient when applied with ArbicStemmerKhoja giving results respectively 96.37% and 71.40%; However, Logistic gets better performance results with Null Stemme is 81.65%. Results obtained by the three techniques applied with a light Arabic stemmer were more than 70%. This article presents a contribution to NLP based on Machine learning, descript also an important study that can determine the best Arabic classifier.

@article{CHRIF2023,
  title     = {Investigate the Impact of Stemming on Mauritanian Dialect Classification using Machine Learning Techniques},
  journal   = {International Journal of Advanced Computer Science and Applications},
  volume    = {14},
  number    = {10},
  year      = {2023},
  publisher = {The Science and Information Organization},
  author    = {Mohamed El Moustapha El Arby CHRIF and Cheikhane Seyed and Cheikhne Mohamed Mahmoud and EL BENANY Mohamed Mahmoud and Fatimetou Mint Mohamed-Saleck and Moustapha Mohamed Saleck and Omar EL BEQQALI and Mohamedade Farouk NANNE},
  doi       = {10.14569/IJACSA.2023.01410106},
  url       = {https://doi.org/10.14569/IJACSA.2023.01410106}
}