Mark D. Plumbley

Mark D. Plumbley

Top Cited Scholar 2025
Auto-generated profile, based on publicly available information

Mark D. Plumbley

Department of Informatics, Kings College London, London, U.K.

Research Focus & Metrics

Academic Career Length

35Years (1992-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 October 2020 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Closed access
QKQiuqiang Kong
Qiuqiang Kong
YCYin Cao
Yin Cao
TITurab Iqbal
Turab Iqbal
YWYuxuan Wang
Yuxuan Wang
WWWenwu Wang
Wenwu Wang
MPMark D. Plumbley
Mark D. Plumbley
Audio pattern recognition is an important research topic in the machine learning area, and includes several tasks such as audio tagging, acoustic scene classification, music classification, speech emotion classification and sound event detection. Recently, neural networks have been applied to tackle audio pattern recognition problems. However, previous systems are built on specific datasets with limited durations. Recently, in computer vision and natural language processing, systems pretrained on large-scale datasets have generalized well to several tasks. However, there is limited research on pretraining systems on large-scale datasets for audio pattern recognition. In this paper, we propose pretrained audio neural networks (PANNs) trained on the large-scale AudioSet dataset. These PANNs are transferred to other audio related tasks. We investigate the performance and computational complexity of PANNs modeled by a variety of convolutional neural networks. We propose an architecture called Wavegram-Logmel-CNN using both log-mel spectrogram and waveform as input feature. Our best PANN system achieves a state-of-the-art mean average precision (mAP) of 0.439 on AudioSet tagging, outperforming the best previous system of 0.392. We transfer PANNs to six audio pattern recognition tasks, and demonstrate state-of-the-art performance in several of those tasks. We have released the source code and pretrained models of PANNs: https://github.com/qiuqiangkong/audioset_tagging_cnn .

7 January 2014 in PLOS Biology
Verified
Journal Article
Open access
PDF file
GWGreg Wilson
Greg Wilson
DAD. A. Aruliah
D. A. Aruliah
CBC. Titus Brown
C. Titus Brown
NHNeil P. Chue Hong
Neil P. Chue Hong
MDMatt Davis
Matt Davis
PWPaul Wilson
Paul Wilson
We describe a set of best practices for scientific software development, based on research and experience, that will improve scientists' productivity and the reliability of their software.

1 May 2015 in IEEE Transactions on Multimedia
Verified
Journal Article
Open access
DSDan Stowell
Dan Stowell
DGDimitrios Giannoulis
Dimitrios Giannoulis
Emmanouil BenetosEmmanouil Benetos
Emmanouil Benetos
MLMathieu Lagrange
Mathieu Lagrange
MPMark D. Plumbley
Mark D. Plumbley
For intelligent systems to make best use of the audio modality, it is important that they can recognize not just speech and music, which have been researched as specific tasks, but also general sounds in everyday environments. To stimulate research in this field we conducted a public research challenge: the IEEE Audio and Acoustic Signal Processing Technical Committee challenge on Detection and Classification of Acoustic Scenes and Events (DCASE). In this paper, we report on the state of the art in automatically classifying audio scenes, and automatically detecting and classifying audio events. We survey prior work as well as the state of the art represented by the submissions to the challenge from various research groups. We also provide detail on the organization of the challenge, so that our experience as challenge hosts may be useful to those organizing challenges in similar domains. We created new audio datasets and baseline systems for the challenge; these, as well as some submitted systems, are publicly available under open licenses, to serve as benchmarks for further research in general-purpose machine listening.

13 May 2024 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Closed access
HLHaohe Liu
Haohe Liu
YYYi Yuan
Yi Yuan
XLXubo Liu
Xubo Liu
XMXinhao Mei
Xinhao Mei
QKQiuqiang Kong
Qiuqiang Kong
MPMark D. Plumbley
Mark D. Plumbley
Although audio generation shares commonalities across different types of audio, such as speech, music, and sound effects, designing models for each type requires careful consideration of specific objectives and biases that can significantly differ from those of other types. To bring us closer to a unified perspective of audio generation, this paper proposes a holistic framework that utilizes the same learning method for speech, music, and sound effect generation. Our framework utilizes a general representation of audio, called “language of audio” (LOA). Any audio can be translated into LOA based on AudioMAE, a self-supervised pre-trained representation learning model. In the generation process, we translate other modalities into LOA by using a GPT-2 model, and we perform self-supervised audio generation learning with a latent diffusion model conditioned on the LOA of audio in our training set. The proposed framework naturally brings advantages such as reusable self-supervised pretrained latent diffusion models. Experiments on the major benchmarks of text-to-audio, text-to-music, and text-to-speech with three AudioLDM 2 variants demonstrate competitive performance of the AudioLDM 2 framework against previous approaches.

26 June 2024 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Closed access
XMXinhao Mei
Xinhao Mei
CMChutong Meng
Chutong Meng
HLHaohe Liu
Haohe Liu
QKQiuqiang Kong
Qiuqiang Kong
TKTom Ko
Tom Ko
WWWenwu Wang
Wenwu Wang
The advancement of audio-language (AL) multimodal learning tasks has been significant in recent years, yet the limited size of existing audio-language datasets poses challenges for researchers due to the costly and time-consuming collection process. To address this data scarcity issue, we introduce WavCaps, the first large-scale weakly-labelled audio captioning dataset, comprising approximately 400k audio clips with paired captions. We sourced audio clips and their raw descriptions from web sources and a sound event detection dataset. However, the online-harvested raw descriptions are highly noisy and unsuitable for direct use in tasks such as automated audio captioning. To overcome this issue, we propose a three-stage processing pipeline for filtering noisy data and generating high-quality captions, where ChatGPT, a large language model, is leveraged to filter and transform raw descriptions automatically. We conduct a comprehensive analysis of the characteristics of WavCaps dataset and evaluate it on multiple downstream audio-language multimodal learning tasks. The systems trained on WavCaps outperform previous state-of-the-art (SOTA) models by a significant margin. Our aspiration is for the WavCaps dataset we have proposed to facilitate research in audio-language multimodal learning and demonstrate the potential of utilizing large language models (LLMs) to enhance academic research. Our dataset and codes are available at https://github.com/XinhaoMei/WavCaps.

2 April 2015 in IEEE Signal Processing Magazine
Verified
Journal Article
Closed access
DBDaniele Barchiesi
Daniele Barchiesi
DGDimitrios Giannoulis
Dimitrios Giannoulis
DSDan Stowell
Dan Stowell
MPMark D. Plumbley
Mark D. Plumbley
In this article, we present an account of the state of the art in acoustic scene classification (ASC), the task of classifying environments from the sounds they produce. Starting from a historical review of previous research in this area, we define a general framework for ASC and present different implementations of its components. We then describe a range of different algorithms submitted for a data challenge that was held to provide a general and fair benchmark for ASC techniques. The data set recorded for this purpose is presented along with the performance metrics that are used to evaluate the algorithms and statistical significance tests to compare the submitted methods.