Jon Francombe

Dr. Jon Francombe

orcid

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
17 January 2018 in IEEE Transactions on Multimedia
Verified
Journal Article
Open access
PCPhilip Coleman
Philip Coleman
AFAndreas Franck
Andreas Franck
JFJon Francombe
Jon Francombe
QLQingju Liu
Qingju Liu
TCTeofilo de Campos
Teofilo de Campos
AHAdrian Hilton
Adrian Hilton
Object-based audio is an emerging representation for audio content, where content is represented in a reproduction-format-agnostic way and, thus, produced once for consumption on many different kinds of devices. This affords new opportunities for immersive, personalized, and interactive listening experiences. This paper introduces an end-to-end object-based spatial audio pipeline, from sound recording to listening. A high-level system architecture is proposed, which includes novel audio-visual interfaces to support object-based capture and listener-tracked rendering, and incorporates a proposed component for objectification, that is, recording content directly into an object-based form. Text-based and extensible metadata enable communication between the system components. An open architecture for object rendering is also proposed. The system's capabilities are evaluated in two parts. First, listener-tracked reproduction of metadata automatically estimated from two moving talkers is evaluated using an objective binaural localization model. Second, object-based scene capture with audio extracted using blind source separation (to remix between two talkers) and beamforming (to remix a recording of a jazz group) is evaluated with perceptually motivated objective and subjective experiments. These experiments demonstrate that the novel components of the system add capabilities beyond the state of the art. Finally, we discuss challenges and future perspectives for object-based audio workflows.

22 July 2023 in Applied Sciences
Verified
Journal Article
Open access
PDF file
JWJoseph Williams
Joseph Williams
JFJon Francombe
Jon Francombe
DMDamian Murphy
Damian Murphy
Camera-based solutions can be a convenient means of collecting physiological measurements indicative of psychological responses to stimuli. However, the low illumination playback conditions commonly associated with viewing screen-based media oppose the bright conditions recommended for accurately recording physiological data with a camera. A study was designed to determine the feasibility of obtaining physiological data, for psychological insight, in illumination conditions representative of real world viewing experiences. In this study, a novel method was applied for testing a first-of-its-kind system for measuring both heart rate and facial actions from video footage recorded with a single discretely placed camera. Results suggest that conditions representative of a bright domestic setting should be maintained when using this technology, despite this being considered a sub-optimal playback condition. Further analyses highlight that even within this bright condition, both the camera-measured facial action and heart rate data contained characteristic errors. In future research, the influence of these performance issues on psychological insights may be mitigated by reducing the temporal resolution of the heart rate measurements and ignoring fast and low-intensity facial movements.

26 July 2022 in Applied Sciences
Verified
Journal Article
Open access
PDF file
DGDavid Geary
David Geary
JFJon Francombe
Jon Francombe
KHKristian Hentschel
Kristian Hentschel
DMDamian Murphy
Damian Murphy
The widespread distribution of mobile computing presents new opportunities for the consumption of interactive and immersive media experiences using multiple connected devices. Tools now exist for the creation of these experiences; however, there is still limited understanding of the best design practices and use cases for the technology, especially in the context of audio experiences. In this study, the application space of co-located multi-device audio experiences is explored and documented through a review of the literature and a survey. Using the obtained information, a set of seven design dimensions that can be used to characterise and compare experiences of this type is proposed; these are synchronisation, context, position, relationship, interactivity, organisation, and distribution. A mapping of the current application space is presented where four categories are identified using the design dimensions, these are public performances, interactive music, augmented broadcasting, and social games. Finally, the overlap between co-located multi-device audio and audio-augmented reality (AAR) experiences is highlighted and discussed. This work will contribute to the wider discussion about the role of multiple devices in audio experiences and provide a source of reference for the design of future multi-device audio experiences.

30 August 2023
Verified
Conference Paper
Open access
DGDavid Geary
David Geary
JFJon Francombe
Jon Francombe
KHKristian Hentschel
Kristian Hentschel
DMDamian Murphy
Damian Murphy
Designing audio experiences for heterogeneous arrays of multiple devices is challenging, and researchers have tried to identify useful design practices. A set of design dimensions have been proposed, providing researchers and creative practitioners with a framework for understanding the different design considerations for multi-device audio; however, they have yet to be used for scoping and developing a new experience. This work investigates the utility of the design dimensions for exploring and prototyping new multi-device audio experiences. Three workshops were conducted with audio professionals to see how the design dimensions could be used to form new ideas. Using the resulting ideas, a multi-device audio system combining loudspeakers and earbuds, and an experience based on that system, were created and demonstrated. The design dimensions were found to be useful for understanding multi-device audio experiences and for quickly forming new ideas. In addition, the dimensions were a helpful reference during experience development for testing different design choices, particularly for audio allocation.

16 August 2024 in Applied Sciences
Verified
Journal Article
Open access
PDF file
JWJoseph Williams
Joseph Williams
JFJon Francombe
Jon Francombe
DMDamian Murphy
Damian Murphy
Audio presentation is often attributed as being capable of influencing a viewer’s feeling of immersion during an audiovisual experience. However, there is limited empirical research supporting this claim. This study aimed to explore this effect by presenting a clip renowned for its immersive soundtrack to two groups of participants with either high-end or basic audio presentation. To measure immersion, a novel method is applied, which utilises a camera instead of an electroencephalogram (ECG) for acquiring a heart rate synchronisation feature. The results of the study showed no difference in the feature, or in the responses to an established immersion questionnaire, between the two groups of participants. However, the camera-sourced HR synchronicity feature correlated with the results of the immersion questionnaire. Moreover, the camera-sourced HR synchronicity feature was found to correlate with an equivalent feature sourced from synchronously recorded ECG data. Hence, this shows the viability of using a camera instead of an ECG sensor to quantify heart rate synchronisation but suggests that audio presentation alone is not capable of eliciting a measurable difference in the feeling of immersion in this context.

18 September 2024
Verified
Conference Paper
Open access
KSKasper Fangel Skov
Kasper Fangel Skov
JFJon Francombe
Jon Francombe
DRDimitrios Raptis
Dimitrios Raptis
JKJesper Kjeldskov
Jesper Kjeldskov
Sound is a pivotal component in creating a sense of place and time in any given environment. Increasing attention to the adverse health effects of noise in society has led to a singular focus on reducing measurable sound levels by means of insulation and isolation strategies. However, recent studies emphasize that acoustic comfort extends beyond mere sound level reduction. The soundscape approach has fostered approaches that go beyond loudness or level to study the broader impact of acoustic environments on humans in specific contexts. The authors identified sound zones in the context of homes to enable multiple people with different preferences to engage with different audio contents within a shared living space. Listening evaluations were conducted in a simulated living room to evaluate the influence of sound zones on individuals’ affective responses to the overall sound environment compared to conventional speakers. Building on the established understanding of soundscape as a subjective and contextual perception, the results indicate that sound zones reduce subjective annoyance associated with unwanted sound in a home context with multiple co-located individuals engaging with personal audio.