Automatic Hate Speech Detection using Machine Learning: A Comparative Study

The increasing use of social media and information sharing has given major benefits to humanity. However, this has also given rise to a variety of challenges including the spreading and sharing of hate speech messages. Thus, to solve this emerging issue in social media sites, recent studies employed a variety of feature engineering techniques and machine learning algorithms to automatically detect the hate speech messages on different datasets. However, to the best of our knowledge, there is no study to compare the variety of feature engineering techniques and machine learning algorithms to evaluate which feature engineering technique and machine learning algorithm outperform on a standard publicly available dataset. Hence, the aim of this paper is to compare the performance of three feature engineering techniques and eight machine learning algorithms to evaluate their performance on a publicly available dataset having three distinct classes. The experimental results showed that the bigram features when used with the support vector machine algorithm best performed with 79% off overall accuracy. Our study holds practical implication and can be used as a baseline study in the area of detecting automatic hate speech messages. Moreover, the output of different comparisons will be used as state-of-art techniques to compare future researches for existing automated text classification techniques.

@article{Abro2020,
  title     = {Automatic Hate Speech Detection using Machine Learning: A Comparative Study},
  journal   = {International Journal of Advanced Computer Science and Applications},
  volume    = {11},
  number    = {8},
  year      = {2020},
  publisher = {The Science and Information Organization},
  author    = {Sindhu Abro and Sarang Shaikh and Zahid Hussain Khand and Zafar Ali and Sajid Khan and Ghulam Mujtaba},
  doi       = {10.14569/IJACSA.2020.0110861},
  url       = {https://doi.org/10.14569/IJACSA.2020.0110861}
}