Two-Phase Transfer Learning Framework for Automated Depression Classification in the Elderly via Facial Expression Recognition

Abstract: Automatic detection of depression in the elderly through Facial Expression Recognition faces a fundamental challenge in the form of domain shift due to skin deformation and facial structural changes due to aging, such as ptosis and deep wrinkles. This study proposes a Two-Phase Transfer Learning framework that integrates high-density facial landmark point extraction (468 points using MediaPipe) with a hybrid spatiotemporal CNN-BiLSTM-VGG19 architecture to address these challenges. Phase I training was conducted on a standard facial dataset to obtain fundamental feature representations, followed by a fine-tuning process in Phase II using a geriatric facial dataset. Experimental results show that the CNN-BiLSTM-VGG19 architecture is highly robust, exploiting deep facial wrinkles as informative texture features. The model successfully achieved 91.42% accuracy on 70-year-old older adults. Furthermore, hyperparameter evaluation confirmed that the Stochastic Gradient Descent (SGD) optimizer combined with a low learning rate of 0.0005 was the most optimal configuration. This balance effectively prevented catastrophic forgetting during domain adaptation, while also achieving a clinical sensitivity recall rate above 96%. Comprehensively, this study demonstrates that the texture-biased CNN-BiLSTM-VGG19 model offers a robust, non-invasive, and highly efficient depression screening instrument for implementation in elderly care facilities.

Muhammad Daffa Zahrandika Wibisono, Marizuana Mat Daud and Wan Mimi Diyana Wan Zaki. “Two-Phase Transfer Learning Framework for Automated Depression Classification in the Elderly via Facial Expression Recognition”. International Journal of Advanced Computer Science and Applications (IJACSA) 17.4 (2026). http://dx.doi.org/10.14569/IJACSA.2026.0170461

@article{Wibisono2026,
title = {Two-Phase Transfer Learning Framework for Automated Depression Classification in the Elderly via Facial Expression Recognition},
journal = {International Journal of Advanced Computer Science and Applications},
doi = {10.14569/IJACSA.2026.0170461},
url = {http://dx.doi.org/10.14569/IJACSA.2026.0170461},
year = {2026},
publisher = {The Science and Information Organization},
volume = {17},
number = {4},
author = {Muhammad Daffa Zahrandika Wibisono and Marizuana Mat Daud and Wan Mimi Diyana Wan Zaki}
}