Mathias Ciliberto

Mathias Ciliberto

Auto-generated profile, based on publicly available information

Mathias Ciliberto

Department of Computer Science and Technology, University of Cambridge, Cambridge, United Kingdom

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications

1 May 2019
Verified
Conference Paper
Open access
SRSebastien Richoz
Sebastien Richoz
MCMathias Ciliberto
Mathias Ciliberto
LWLin Wang
Lin Wang
PBPhilip Birch
Philip Birch
Hristijan GjoreskiHristijan Gjoreski
Hristijan Gjoreski
DRDaniel Roggen
Daniel Roggen
Computer vision techniques applied on images opportunistically captured from body-worn cameras or mobile phones offer tremendous potential for vision-based context awareness. In this paper, we evaluate the potential to recognise the modes of locomotion and transportation of mobile users, by analysing single images captured by body-worn cameras. We evaluate this with the publicly available Sussex-Huawei Locomotion and Transportation Dataset, which includes 8 transportation and locomotion modes performed over 7 months by 3 users. We present a baseline performance obtained through crowd sourcing using Amazon Mechanical Turk. Humans infered the correct modes of transportations from images with an F1-score of 52%. The performance obtained by five state-of-the-art Deep Neural Networks (VGG16, VGG19, ResNet50, MobileNet and DenseNet169) on the same task was always above 71.3% F1-score. We characterise the effect of partitioning the training data to fine-tune different number of blocks of the deep networks and provide recommendations for mobile implementations.

5 October 2024
Verified
Conference Paper
Open access
LWLin Wang
Lin Wang
MCMathias Ciliberto
Mathias Ciliberto
Hristijan GjoreskiHristijan Gjoreski
Hristijan Gjoreski
PLPaula LAGO
Paula LAGO
Kazuya MuraoKazuya Murao
Kazuya Murao
DRDaniel Roggen
Daniel Roggen
The paper summarizes the contributions of participants to the sixth Sussex-Huawei Locomotion-Transportation (SHL) Recognition Challenge organized at the HASCA Workshop of UbiComp/ISWC 2024. The goal of this machine learning/data science challenge is to recognize eight locomotion and transportation activities (Still, Walk, Run, Bike, Bus, Car, Train, Subway) from the motion (accelerometer, gyroscope, magnetometer) sensor data of a smartphone in a way which is user-independent and smartphone position-independent, and as well robust to data missing during deployment. The training data of a 'train' user is available from smartphones placed at four body positions (Hand, Torso, Bag and Hips). The testing data originates from 'test' users with a smartphone placed at one of three body positions (Torso, Bag or Hips). In addition, the test data has one or multiple sensor modalities randomly missing from each time frame (5 seconds). Such a scenario may occur if a device turns on and off dynamically sensors to save power, or due to limited computational or memory capacity. We introduce the dataset used in the challenge and the protocol of the competition. We present a meta-analysis of the contributions from 7 submissions, their approaches, the software tools used, computational cost and the achieved results. Overall, one submission achieved an F1 score between 70% and 80%, two between 60% and 70%, three between 50% and 60%, and one below 50%. Finally, we present a baseline implementation addressing missing sensor modalities.

10 September 2019
Verified
Book Chapter
Closed access
PDF file
LWLin Wang
Lin Wang
Hristijan GjoreskiHristijan Gjoreski
Hristijan Gjoreski
MCMathias Ciliberto
Mathias Ciliberto
SMSami Mekki
Sami Mekki
SVStefan Valentin
Stefan Valentin
DRDaniel Roggen
Daniel Roggen

5 October 2024
Verified
Conference Paper
Open access
TRTobias Röddiger
Tobias Röddiger
JSJake Stuchbury-Wass
Jake Stuchbury-Wass
MCMathias Ciliberto
Mathias Ciliberto
PLPhilipp Lepold
Philipp Lepold
Michael BeiglMichael Beigl
Michael Beigl
In recent years, earables have emerged as a focal point for exploring novel sensing principles on the ears. OpenEarable, an open reference platform, has been developed to integrate various sensors in and around the ears. However, it has thus far lacked the capability to capture audio both inside the ear canal and outside simultaneously. To address this gap, we introduce a novel earpiece for OpenEarable equipped with two microphones, designed to mimic commercial earbuds like AirPods, which commonly restrict access to internal microphones. This new earpiece utilizes the interchangeable 8-pin connector earpiece concept of OpenEarable, enabling the exploration of algorithms that leverage both internal and external sounds captured at the ears (e.g., noise canceling). By updating the existing app and dashboard, OpenEarable 1.4 seamlessly integrates with the existing suite of devices within the OpenEarable ecosystem. We validate the earpiece by showcasing its abilities to occlude the ear canal and measure the heartbeat of a wearer. The enhancement of OpenEarable facilitates streamlined and large-scale audio data collection, advancing the development of novel earable technologies.

2 December 2025 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Verified
Journal Article
Open access
Qiang YangQiang Yang
Qiang Yang
YLYang Liu
Yang Liu
JSJake Stuchbury-Wass
Jake Stuchbury-Wass
MCMathias Ciliberto
Mathias Ciliberto
TRTobias Röddiger
Tobias Röddiger
CMCecilia Mascolo
Cecilia Mascolo
Excessive tooth brushing force can contribute to oral health issues such as gum recession and bleeding. While some electric toothbrushes offer force feedback, manual toothbrushes remain widely used due to their affordability and accessibility but do not give this sort of information to users. Therefore, they often lack awareness of the force they apply while brushing. In this paper, we introduce HearForce, the first system to estimate tooth brushing force from manual toothbrushing using widely available earbuds. Unlike existing solutions that require significant modifications to toothbrushes, HearForce leverages in-ear microphones on commercial earbuds to capture bone-conducted toothbrushing sound propagating from the oral cavity to the ear canals. Our key insight is that variations in brushing force modulate these toothbrushing sounds due to the friction effect, allowing us to infer force levels through deep learning. However, individual habitual and anatomical differences introduce significant challenges for force estimation. To mitigate this, we propose a self-supervised representation learning network with a cross-attention mechanism to suppress user-dependent variability and a heuristic calibration strategy to adapt the model to different brushing habits. Through extensive evaluation, HearForce demonstrates force estimation capabilities with a Mean Absolute Error (MAE) of 37.3g in user-independent settings, corresponding to 11.4% of the typical force dynamic range. Our study makes the first step in the use of everyday earbuds for manual toothbrushing force monitoring, paving the way for accessible solutions to improve brushing habits for manual toothbrush users globally.