Back close

Predominant Instruments recognition in Polyphonic music using Convolutional Recurrent Neural Networks

Publication Type : Book Chapter

Source : Proceedings of 15th International Symposium on Computer Music Multidisciplinary Research (CMMR-21), Tokyo, Japan, Nov 15 - 19, 2021, pp 185-194. In: Revised selected papers ,Music in the AI Era,. Lecture Notes in Computer Science, vol13770 . Springer, Cham.

Url : https://link.springer.com/chapter/10.1007/978-3-031-35382-6_17

Campus : Coimbatore

School : School of Artificial Intelligence

Center : Center for Computational Engineering and Networking

Year : 2021

Abstract : Automatic identification of lead instruments is a challenging task in the field of music information retrieval (MIR). In this paper, predominant instrument recognition in polyphonic music is addressed using convolutional recurrent neural networks (CRNN) through Mel-spectrogram, modgdgram, and its fusion. Modgdgram, a visual representation is obtained by stacking modified group delay functions of consecutive frames successively. Convolutional neural networks (CNN) learn the distinctive local characteristics from the visual representation and recurrent neural networks (RNN) integrate the extracted features over time and classify the instrument to the group to which it belongs. The proposed system is systematically evaluated using the IRMAS dataset. A wave-generative adversarial network (WaveGAN) architecture is also employed to generate audio files for data augmentation. We experimented with two CRNN architectures, convolutional long short-term memory (C-LSTM) and convolutional gated recurring unit (C-GRU). The fusion experiment C-GRU reports a micro and macro F1 score of 0.69 and 0.60, respectively. These metrics are 7.81% and 9.09% higher than those obtained by the state-of-the-art Han’s model. The architectural choice of CRNN with score-level fusion on Mel-spectro/modgd-gram has merit in recognizing the predominant instrument in polyphonic music.

Cite this Research Publication : Predominant Instruments recognition in Polyphonic music using Convolutional Recurrent Neural Networks”, in Proceedings of 15th International Symposium on Computer Music Multidisciplinary Research (CMMR-21), Tokyo, Japan, Nov 15 - 19, 2021, pp 185-194. In: Revised selected papers ,Music in the AI Era,. Lecture Notes in Computer Science, vol13770 . Springer, Cham

Admissions Apply Now