Abstract: The increasing spread of textual content on social media, driven by the rise of Large Language Models (LLMs), has highlighted the importance of sentiment analysis in detecting threats, racial abuse, violence, and implied warnings. The subtlety and ambiguity of language present challenges in developing effective frameworks for threat detection, particularly within the political security domain. While significant research has explored hate speech and offensive content, few studies focus on detecting threats using sentiment analysis in this context. Leveraging advancements in Natural Language Processing (NLP), this study employs the NRC Emotion Lexicon to label emotions in a political-domain social media dataset. TextBlob is used to extract sentiment polarity, identifying potential threats where anger and fear intensities exceed a threshold alongside negative sentiment. The Bidirectional Encoder Representations from Transformers (BERT) was applied to enhance threat detection accuracy. The proposed framework achieved an Area Under the ROC Curve (AUC) of 87%, with the BERT model achieving 91% accuracy, 90.5% precision, 81.3% recall and F1-score of 91%, outperforming baseline models. These findings demonstrate the effectiveness of sentiment and emotion-based features in improving threat detection accuracy, providing a robust framework for political security applications.

Liyana Safra Zaabar, Adriana Arul Yacob, Mohd Rizal Mohd Isa, Muslihah Wook, Nor Asiakin Abdullah, Suzaimah Ramli and Noor Afiza Mat Razali, “Sentiment and Emotion Analysis with Large Language Models for Political Security Prediction Framework” International Journal of Advanced Computer Science and Applications(IJACSA), 16(1), 2025. http://dx.doi.org/10.14569/IJACSA.2025.0160192

@article{Zaabar2025,
title = {Sentiment and Emotion Analysis with Large Language Models for Political Security Prediction Framework},
journal = {International Journal of Advanced Computer Science and Applications},
doi = {10.14569/IJACSA.2025.0160192},
url = {http://dx.doi.org/10.14569/IJACSA.2025.0160192},
year = {2025},
publisher = {The Science and Information Organization},
volume = {16},
number = {1},
author = {Liyana Safra Zaabar and Adriana Arul Yacob and Mohd Rizal Mohd Isa and Muslihah Wook and Nor Asiakin Abdullah and Suzaimah Ramli and Noor Afiza Mat Razali}
}