Publication detail

Using Activation Functions for Improving Measure-Level Audio Synchronization

ÖZER, Y. IŠTVÁNEK, M. ARIFI-MÜLLER, V. MÜLLER, M.

Original Title

Using Activation Functions for Improving Measure-Level Audio Synchronization

Type

article in a collection out of WoS and Scopus

Language

English

Original Abstract

Audio synchronization aims at aligning multiple recordings of the same piece of music. Traditional synchronization approaches are often based on dynamic time warping using chroma features as an input representation. Previous work has shown how one can integrate onset cues into this pipeline for improving the alignment’s temporal accuracy. Furthermore, recent work based on deep neural networks has led to significant improvements for learning onset, beat, and downbeat activation functions. However, for music with soft onsets and abrupt tempo changes, these functions may be unreliable, leading to unstable results. As the main contribution of this paper, we introduce a combined approach that integrates activation functions into the synchronization pipeline. We show that this approach improves the temporal accuracy thanks to the activation cues while inheriting the robustness of the traditional synchronization approach. Conducting experiments based on string quartet recordings, we evaluate our combined approach where we transfer measure annotations from a reference recording to a target recording.

Keywords

audio synchronization; music information retrieval; measure transfer; activation functions; beat tracking

Authors

ÖZER, Y.; IŠTVÁNEK, M.; ARIFI-MÜLLER, V.; MÜLLER, M.

Released

7. 12. 2022

Pages from

750

Pages to

756

Pages count

7

URL

https://ismir2022program.ismir.net/poster_195.html

BibTex

@inproceedings{BUT180267,
  author="Yigitcan {Özer} and Matěj {Ištvánek} and Vlora {Arifi-Müller} and Meinard {Müller}",
  title="Using Activation Functions for Improving Measure-Level Audio Synchronization",
  booktitle="Proceedings of the International Society for Music Information Retrieval Conference (ISMIR)",
  year="2022",
  pages="7",
  url="https://ismir2022program.ismir.net/poster_195.html"
}

Documents

2022_OezerIAM_MusicSync_ISMIR.pdf