The digitization of public services in Germany is always based on a legal basis (e.g., laws). In the digitization process, first relevant entities in law documents (e.g., actors) are detected, then a list of possible process steps of their interactions is derived. The final process is constructed and transformed to a digital service for citizens and companies. Today, the discovery of custom entities in German law documents is still manual high effort work. In our study, we investigate the capabilities of Large Language Models (LLMs) to automate this task, choose five LLMs from 61 evaluated candidates, and perform prompt engineering to create five different prompt variants with differing parts. We examine the automatic annotation by two LLMs (LeoLM and BLOOM CLP German) in detail and find that the inclusion of more information in the prompts as well as an increased number of examples per prompt are beneficial. We report micro F1-scores for the optimal scenario of 0.91 for BLOOM CLP German, and 0.82 for LeoLM, with a higher balanced accuracy for LeoLM. The results indicate that LLMs have a good potential to perform named entity recognition, especially for supporting legal norm analysis in the context of the digitization of public administration.
This paper presents outcomes from the inaugural "EcoHack: AI & LLM Hackathon for Applications in Evidence-based Ecological Research & Practice," which convened participants from across Europe and beyond, culminating in 11 team submissions. These submissions highlighted six broad application areas of AI for ecology: (1) AI-enhanced decision support and automation, (2) scientific search and communication, (3) knowledge extraction and reasoning, (4) AI for ecological modeling, forecasting, and simulation, (5) causal inference and ecological reasoning, and (6) AI for biodiversity monitoring and conservation. Each team’s project is summarized in a consolidated table—complete with links to source code—and described in brief papers in the appendix. Beyond summarizing technical results, this paper offers insights into the hackathon’s hybrid structure, featuring an in-person gathering in Bielefeld, Germany, alongside a global online hub that facilitated both local and virtual engagement. Throughout the event, participants showcased how large language models (LLMs) can serve as both robust tools for diverse machine learning tasks and flexible platforms for rapidly prototyping novel research applications. These efforts underscore the importance of stronger technological bridges among stakeholders in ecology, including practitioners, local farmers, and policymakers. Overall, the EcoHack outcomes highlight the transformative potential of AI in driving scientific discovery and fostering interdisciplinary collaboration in ecology.