Singer Gender Classification using Feature-based and Spectrograms with Deep Convolutional Neural Network

The task of music information retrieval (MIR) is gaining much importance since the digital cloud is growing sparklingly. An important attribute of MIR is the singer-id, which helps effectively during the recommendation process. It is highly difficult to identify a singer in the case of music as the number of signers available in the digital cloud is high. The process of identifying the gender of a singer may simplify the task of singer identification and also helps with the recommendation. Hence, an effort has been made to detect the gender information of a singer. Two different datasets have been considered. Of which, one is collected from Indian cine industries having 20 different singer details of four regional languages. The other dataset is standard Artist20. Various spectral, temporal, and pitch related features have been used to obtain better accuracy. The features considered for this task are Mel-frequency cepstral coefficients (MFCCs), pitch, velocity, and acceleration of MFCCs. The experimentation has been done on various combinations of the mentioned features with the support of artificial neural networks (ANNs) and random forest (RF). Further, the genetic algorithm-based feature selection (GAFS) has been used to select the suitable features out of the best combination obtained. Moreover, we have also utilized the recent popular convolutional neural networks (CNNs) with the support of spectrograms to obtain better accuracy over the traditional feature vector. Average accuracy of 91.70% is obtained for both the Indian and Western clips, which is an improved accuracy of 3% over hand engineering features.

@article{Jitendra2021,
  title     = {Singer Gender Classification using Feature-based and Spectrograms with Deep Convolutional Neural Network},
  journal   = {International Journal of Advanced Computer Science and Applications},
  volume    = {12},
  number    = {2},
  year      = {2021},
  publisher = {The Science and Information Organization},
  author    = {Mukkamala S.N.V. Jitendra and Y. Radhika},
  doi       = {10.14569/IJACSA.2021.0120218},
  url       = {https://doi.org/10.14569/IJACSA.2021.0120218}
}