Satvik Venkatesh

Mr. Satvik Venkatesh

Interdisciplinary Centre for Computer Music Research - Plymouth University
orcid

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 March 2022 in Applied Sciences
Verified
Journal Article
Open access
PDF file
Satvik VenkateshSatvik Venkatesh
Satvik Venkatesh
David MoffatDavid Moffat
David Moffat
Eduardo Reck MirandaEduardo Reck Miranda
Eduardo Reck Miranda
Audio segmentation and sound event detection are crucial topics in machine listening that aim to detect acoustic classes and their respective boundaries. It is useful for audio-content analysis, speech recognition, audio-indexing, and music information retrieval. In recent years, most research articles adopt segmentation-by-classification. This technique divides audio into small frames and individually performs classification on these frames. In this paper, we present a novel approach called You Only Hear Once (YOHO), which is inspired by the YOLO algorithm popularly adopted in Computer Vision. We convert the detection of acoustic boundaries into a regression problem instead of frame-based classification. This is done by having separate output neurons to detect the presence of an audio class and predict its start and end points. The relative improvement for F-measure of YOHO, compared to the state-of-the-art Convolutional Recurrent Neural Network, ranged from 1% to 6% across multiple datasets for audio segmentation and sound event detection. As the output of YOHO is more end-to-end and has fewer neurons to predict, the speed of inference is at least 6 times faster than segmentation-by-classification. In addition, as this approach predicts acoustic boundaries directly, the post-processing and smoothing is about 7 times faster.

31 March 2021 in Electronics
Verified
Journal Article
Open access
PDF file
Satvik VenkateshSatvik Venkatesh
Satvik Venkatesh
David MoffatDavid Moffat
David Moffat
Eduardo Reck MirandaEduardo Reck Miranda
Eduardo Reck Miranda
Music and speech detection provides us valuable information regarding the nature of content in broadcast audio. It helps detect acoustic regions that contain speech, voice over music, only music, or silence. In recent years, there have been developments in machine learning algorithms to accomplish this task. However, broadcast audio is generally well-mixed and copyrighted, which makes it challenging to share across research groups. In this study, we address the challenges encountered in automatically synthesising data that resembles a radio broadcast. Firstly, we compare state-of-the-art neural network architectures such as CNN, GRU, LSTM, TCN, and CRNN. Later, we investigate how audio ducking of background music impacts the precision and recall of the machine learning algorithm. Thirdly, we examine how the quantity of synthetic training data impacts the results. Finally, we evaluate the effectiveness of synthesised, real-world, and combined approaches for training models, to understand if the synthetic data presents any additional value. Amongst the network architectures, CRNN was the best performing network. Results also show that the minimum level of audio ducking preferred by the machine learning algorithm was similar to that of human listeners. After testing our model on in-house and public datasets, we observe that our proposed synthesis technique outperforms real-world data in some cases and serves as a promising alternative.

11 May 2022 in Electronics
Verified
Journal Article
Open access
PDF file
Eduardo Reck MirandaEduardo Reck Miranda
Eduardo Reck Miranda
José D.José D.
José D.
Satvik VenkateshSatvik Venkatesh
Satvik Venkatesh
CHCarlos Hernani-Morales
Carlos Hernani-Morales
Lucas LamataLucas Lamata
Lucas Lamata
ESEnrique Solano
Enrique Solano
We propose Quantum Brain Networks (QBraiNs) as a new interdisciplinary field integrating knowledge and methods from neurotechnology, artificial intelligence, and quantum computing. The objective is to develop an enhanced connectivity between the human brain and quantum computers for a variety of disruptive applications. We foresee the emergence of hybrid classical-quantum networks of wetware and hardware nodes, mediated by machine learning techniques and brain–machine interfaces. QBraiNs will harness and transform in unprecedented ways arts, science, technologies, and entrepreneurship, in particular activities related to medicine, Internet of Humans, intelligent devices, sensorial experience, gaming, Internet of Things, crypto trading, and business.

11 July 2022 in Assistive Technology
Verified
Journal Article
Open access
Satvik VenkateshSatvik Venkatesh
Satvik Venkatesh
Eduardo Reck MirandaEduardo Reck Miranda
Eduardo Reck Miranda
EBEdward Braund
Edward Braund
In this paper, we present a bespoke brain–computer interface (BCI), which was developed for a person with severe motor-impairments, who was previously a Violinist, to allow performing and composing music at home. It uses steady-state visually evoked potential (SSVEP) and adopts a dry, low-density, and wireless electroencephalogram (EEG) headset. In this study, we investigated two parameters: (1) placement of the EEG headset and (2) inter-stimulus distance and found that the former significantly improved the information transfer rate (ITR). To analyze EEG, we adopted canonical correlation analysis (CCA) without weight-calibration. The BCI for musical performance realized a high ITR of 37.59 ± 9.86 bits min−1 and a mean accuracy of 88.89 ± 10.09%. The BCI for musical composition obtained an ITR of 14.91 ± 2.87 bits min−1 and a mean accuracy of 95.83 ± 6.97%. The BCI was successfully deployed to the person with severe motor-impairments. She regularly uses it for musical composition at home, demonstrating how BCIs can be translated from laboratories to real-world scenarios.

1 September 2018 in Computer Music Journal
Verified
Journal Article
Closed access
Eduardo Reck MirandaEduardo Reck Miranda
Eduardo Reck Miranda
EBEdward Braund
Edward Braund
Satvik VenkateshSatvik Venkatesh
Satvik Venkatesh
Our research concerns the development of biocomputers using electronic components grown out of biological material. This article reports the development of a novel biological memristor and an approach to using such biomemristors to build interactive generative music systems. The memristor is an electronic component regarded as a resistor with memory. After an introduction to harnessing the Physarum polycephalum organism to implement biomemristors, the article presents PhyBox, a biocomputer that uses four biomemristors to generate music interactively. The resistance of a biomemristor varies as a function of the voltage that has passed through it. Music input is represented in terms of voltage transitions and music output is encoded as measurements of the current yielded by the system's memristive behavior. An example of a musical composition using PhyBox is detailed. The article concludes with a short discussion of how the combination between artificial machines and biological organisms is paving the way for the development of new technologies for music based on living processors.

2 November 2022 in Journal of the Audio Engineering Society
Verified
Journal Article
Open access
PDF file
Satvik VenkateshSatvik Venkatesh
Satvik Venkatesh
David MoffatDavid Moffat
David Moffat
Eduardo Reck MirandaEduardo Reck Miranda
Eduardo Reck Miranda
In recent years, machine learning has been widely adopted to automate the audio mixing process. Automatic mixing systems have been applied to various audio effects such as gain adjustment, equalization, and reverberation. These systems can be controlled through visual interfaces, audio examples being provided, usage of knobs, and semantic descriptors. Using semantic descriptors or textual information to control these systems is an effective way for artists to communicate their creative goals....