Multipitch tracking in music signals using Echo State Networks

Research output: Contribution to book/Conference proceedings/Anthology/ReportConference contributionContributedpeer-review

Contributors

Abstract

Currently, convolutional neural networks (CNNs) define the state of the art for multipitch tracking in music signals. Echo State Networks (ESNs), a recently introduced recurrent neural network architecture, achieved similar results as CNNs for various tasks, such as phoneme or digit recognition. However, they have not yet received much attention in the community of Music Information Retrieval. The core of ESNs is a group of unordered, randomly connected neurons, i.e., the reservoir, by which the low-dimensional input space is non-linearly transformed into a high-dimensional feature space. Because only the weights of the connections between the reservoir and the output are trained using linear regression, ESNs are easier to train than deep neural networks. This paper presents a first exploration of ESNs for the challenging task of multipitch tracking in music signals. The best results presented in this paper were achieved with a bidirectional two-layer ESN with 20 000 neurons in each layer. Although the final F-score of 0.7198 still falls below the state of the art (0.7370), the proposed ESN-based approach serves as a baseline for further investigations of ESNs in audio signal processing in the future.

Details

Original languageEnglish
Title of host publication2020 28th European Signal Processing Conference (EUSIPCO)
PublisherWiley-IEEE Press
Pages126-130
Number of pages5
ISBN (electronic)9789082797053
ISBN (print)978-1-7281-5001-7
Publication statusPublished - 21 Jan 2021
Peer-reviewedYes

Conference

Title2020 28th European Signal Processing Conference (EUSIPCO)
Duration18 - 21 January 2021
LocationAmsterdam, Netherlands

External IDs

Scopus 85099292718
ORCID /0000-0002-8149-2275/work/147142920
ORCID /0000-0003-0167-8123/work/167214854

Keywords

Keywords

  • Multiple signal classification, Music information retrieval, Neurons, Recurrent neural networks, Reservoirs, Signal processing, Task analysis, RNN, MIR, Reservoir Computing, Echo State Network, Multipitch