Stefan Balke

Stefan Balke

Auto-generated profile, based on publicly available information

Stefan Balke

International Audio Laboratories Erlangen

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 December 2018 in IEEE Signal Processing Magazine
Verified
Journal Article
Closed access
MMMeinard Mueller
Meinard Mueller
AAAndreas Arzt
Andreas Arzt
SBStefan Balke
Stefan Balke
MDMatthias Dorfer
Matthias Dorfer
GWGerhard Widmer
Gerhard Widmer
There has been a rapid growth of digitally available music data, including audio recordings, digitized images of sheet music, album covers and liner notes, and video clips. This huge amount of data calls for retrieval strategies that allow users to explore large music collections in a convenient way. More precisely, there is a need for cross-modal retrieval algorithms that, given a query in one modality (e.g., a short audio excerpt), find corresponding information and entities in other modalities (e.g., the name of the piece and the sheet music). This goes beyond exact audio identification and subsequent retrieval of metainformation as performed by commercial applications like Shazam [1].

1 March 2016
Verified
Conference Paper
Closed access
SBStefan Balke
Stefan Balke
VAVlora Arifi-Muller
Vlora Arifi-Muller
LLLukas Lamprecht
Lukas Lamprecht
MMMeinard Mueller
Meinard Mueller
In 1948, Barlow and Morgenstern released a collection of about 10,000 themes of well-known instrumental pieces from the corpus of Western Classical music [1]. These monophonic themes (usually four bars long) are often the most memorable parts of a piece of music. In this paper, we report on a systematic study considering a cross-modal retrieval scenario. Using a musical theme as a query, the objective is to identify all related music recordings from a given audio collection. By adapting well-known retrieval techniques, our main goal is to get a better understanding of the various challenges including tempo deviations, musical tunings, key transpositions, and differences in the degree of polyphony between the symbolic query and the audio recordings to be retrieved. In particular, we present an oracle fusion approach that indicates upper performance limits achievable by a combination of current retrieval techniques.

7 November 2022 in Transactions of the International Society for Music Information Retrieval
Verified
Journal Article
Open access
PDF file
SBStefan Balke
Stefan Balke
JRJulian Reck
Julian Reck
CWChristof Weiss
Christof Weiss
JAJakob Abesser
Jakob Abesser
MMMeinard Mueller
Meinard Mueller

30 August 2017 in Journal of New Music Research
Verified
Journal Article
Open access
CDChristian Dittmar
Christian Dittmar
MPMartin Pfleiderer
Martin Pfleiderer
SBStefan Balke
Stefan Balke
MMMeinard Mueller
Meinard Mueller
A typical micro-rhythmic trait of jazz performances is their ‘swing feel.’ According to several studies, uneven eighth notes contribute decisively to this perceived quality. In this paper we analyze the swing ratio (beat-upbeat ratio) implied by the drummer on the ride cymbal. Extending previous work, we propose a new method for semi-automatic swing ratio estimation based on pattern recognition in onset sequences. As a main contribution, we introduce a novel time-swing ratio representation called swingogram, which locally captures information related to the swing ratio over time. Based on this representation, we propose to track the most plausible trajectory of the swing ratio of the ride cymbal pattern over time via dynamic programming. We show how this kind of visualization leads to interesting insights into the peculiarities of jazz musicians improvising together.

21 October 2020 in Transactions of the International Society for Music Information Retrieval
Verified
Journal Article
Open access
PDF file
FZFrank Zalkow
Frank Zalkow
SBStefan Balke
Stefan Balke
VAVlora Arifi-Müller
Vlora Arifi-Müller
MMMeinard Mueller
Meinard Mueller
Musical themes are essential elements in Western classical music. In this paper, we present the Musical Theme Dataset (MTD), a multimodal dataset inspired by "A Dictionary of Musical Themes" by Barlow and Morgenstern from 1948. For a subset of 2067 themes of the printed book, we created several digital representations of the musical themes. Beyond graphical sheet music, we provide symbolic music encodings, audio snippets of music recordings, alignments between the symbolic and audio representations, as well as detailed metadata on the composer, work, recording, and musical characteristics of the themes. In addition to the data, we also make several parsers and web-based interfaces available to access and explore the different modalities and their relations through visualizations and sonifications. These interfaces also include computational tools, bridging the gap between the original dictionary and music information retrieval (MIR) research. The dataset is of relevance for various subfields and tasks in MIR, such as cross-modal music retrieval, music alignment, optical music recognition, music transcription, and computational musicology.

20 February 2018 in Frontiers in Digital Humanities
Verified
Journal Article
Open access
SBStefan Balke
Stefan Balke
CDChristian Dittmar
Christian Dittmar
JAJakob Abeßer
Jakob Abeßer
KFKlaus Frieler
Klaus Frieler
MPMartin Pfleiderer
Martin Pfleiderer
MMMeinard Müller
Meinard Müller
Web services allow permanent access to music from all over the world. Especially in the case of web services with user-supplied content, e.g., YouTube(TM), the available metadata is often incomplete or erroneous. On the other hand, a vast amount of high-quality and musically relevant metadata has been annotated in research areas such as Music Information Retrieval (MIR). Although they have great potential, these musical annotations are ofter inaccessible to users outside the academic world. With our contribution, we want to bridge this gap by enriching publicly available multimedia content with musical annotations available in research corpora, while maintaining easy access to the underlying data. Our web-based tools offer researchers and music lovers novel possibilities to interact with and navigate through the content. In this paper, we consider a research corpus called the Weimar Jazz Database (WJD) as an illustrating example scenario. The WJD contains various annotations related to famous jazz solos. First, we establish a link between the WJD annotations and corresponding YouTube videos employing existing retrieval techniques. With these techniques, we were able to identify 988 corresponding YouTube videos for 329 solos out of 456 solos contained in the WJD. We then embed the retrieved videos in a recently developed web-based platform and enrich the videos with solo transcriptions that are part of the WJD. Furthermore, we integrate publicly available data resources from the Semantic Web in order to extend the presented information, for example, with a detailed discography or artists-related information. Our contribution illustrates the potential of modern web-based technologies for the digital humanities, and novel ways for improving access and interaction with digitized multimedia content.