Comparison of Machine Learning Algorithms for Sentiment Classification on Fake News Detection

With the wide usage of World Wide Web (WWW) and social media platforms, fake news could become rampant among the users. They tend to create and share the news without knowing the authenticity of it. This would become the most critical issues among the societies due to the dissemination of false information. In that regard, fake news needs to be detected as early as possible to avoid negative influences on people who may rely on such information while making important decisions. The aim of this paper is to develop an automation of sentiment classifier model that could help individuals, or readers to understand the sentiment of the fake news immediately. The Cross-Industry Standard Process for Data Mining (CRISP-DM) process model has been applied for the research methodology. The dataset on fake news detection were collected from Kaggle website. The dataset was trained, tested, and validated with cross-validation and sampling methods. Then, comparison model performance using four machine learning algorithms which are Naïve Bayes, Logistic Regression, Support Vector Machine and Random Forest was constructed to investigate which algorithms has the most efficiency towards sentiment text classification performance. A comparison between 1000 and 2500 instances from the fake news dataset was analyzed using 200 and 500 tokens. The result showed that Random Forest (RF) achieved the highest accuracy compared to other machine learning algorithms.

@article{Mahmud2021,
  title     = {Comparison of Machine Learning Algorithms for Sentiment Classification on Fake News Detection},
  journal   = {International Journal of Advanced Computer Science and Applications},
  volume    = {12},
  number    = {10},
  year      = {2021},
  publisher = {The Science and Information Organization},
  author    = {Yuzi Mahmud and Noor Sakinah Shaeeali and Sofianita Mutalib},
  doi       = {10.14569/IJACSA.2021.0121072},
  url       = {https://doi.org/10.14569/IJACSA.2021.0121072}
}