Herbert Woisetschläger

Herbert Woisetschläger

Auto-generated profile, based on publicly available information

Herbert Woisetschläger

Technical University of Munich, Munich, Germany

Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 June 2024
Verified
Conference Paper
Open access
HWHerbert Woisetschläger
Herbert Woisetschläger
AEAlexander Erben
Alexander Erben
SWShiqiang Wang
Shiqiang Wang
RMRuben Mayer
Ruben Mayer
HJHans-Arno Jacobsen
Hans-Arno Jacobsen
With the emergence of AI regulations, such as the EU AI Act, requirements for simple data lineage, enforcement of low data bias, and energy efficiency have become a priority for everyone offering AI services. Being pre-trained on versatile and a vast amount of data, large language models and foundation models (FMs) offer a good basis for building high-quality deep learning pipelines. Fine-tuning can further improve model performance on a specific downstream task, which requires orders of magnitude less data than pre-training. Often, access to high-quality and low-bias data for model fine-tuning is limited due to technical or regulatory requirements. Federated learning (FL), as a distributed and privacy-preserving technique, offers a well-suited approach to significantly expanding data access for model fine-tuning. Yet, this data is often located on the network edge, where energy, computational, and communication resources are significantly more limited than in data centers. In our paper, we conduct an end-to-end evaluation for fine-tuning the FLAN-T5 FM family on the network edge. We study energy efficiency potentials throughout FL systems - on clients, in communication, and on the server. Our analysis introduces energy efficiency as a real-time metric to assess the computational efficiency of an FL system. We show the stark need for further improvements in communication efficiency when working with FMs and demonstrate the importance of adaptive FL optimizers for FM training.

2 December 2024
Verified
Conference Paper
Open access
HWHerbert Woisetschläger
Herbert Woisetschläger
AEAlexander Erben
Alexander Erben
RMRuben Mayer
Ruben Mayer
SWShiqiang Wang
Shiqiang Wang
HJHans-Arno Jacobsen
Hans-Arno Jacobsen
Federated Learning (FL) has become a viable technique for realizing privacy-enhancing distributed deep learning on the network edge. Heterogeneous hardware, unreliable client devices, and energy constraints often characterize edge computing systems. In this paper, we propose FLEdge, which complements existing FL benchmarks by enabling a systematic evaluation of client capabilities. We focus on computational and communication bottlenecks, client behavior, and data security implications. Our experiments with models varying from 14K to 80M trainable parameters are carried out on dedicated hardware with emulated network characteristics and client behavior. We find that state-of-the-art embedded hardware has significant memory bottlenecks, leading to 4× longer processing times than on modern data center GPUs.

20 June 2026
Verified
Conference Paper
Open access
SWShiqiang Wang
Shiqiang Wang
HWHerbert Woisetschläger
Herbert Woisetschläger