AI/ML techniques have been used to solve systems problems, but their applicability to customize solutions on-the-fly has been limited. Traditionally, any customization required manually changing the AI/ML model or modifying the code, configuration parameters, application settings, etc. This incurs too much time and effort, and is very painful. In this paper, we propose a novel technique using Generative Artificial Intelligence (GenAI) technology, wherein instructions can be provided in natural language and actual code to handle any customization is automatically generated, integrated and applied on-the-fly. Such capability is extremely powerful since it makes customization of application settings or solution techniques super easy. Specifically, we propose ECO-LLM (LLM-based Edge Cloud Optimization), which leverages Large Language Models (LLM) to dynamically adjust placement of application tasks across edge and cloud computing tiers, in response to changes in application workload, such that insights are delivered quickly with low cost of operation (systems problem). Our experiments with real-world video analytics applications i.e. face recognition, human attributes detection and license plate recognition show that ECO-LLM is able to automatically generate code on-the-fly and adapt placement of application tasks across edge and cloud computing tiers. We note that the trigger workload (to switch between edge and cloud) for ECO-LLM is exactly the same as the baseline (manual) and actual placement performed by ECO-LLM is only slightly different i.e. on average (across 2 days) only 1.45% difference in human attributes detection and face recognition, and 1.11% difference in license plate recognition. Although we tackle this specific systems problem in this paper, our proposed GenAI-based technique is applicable to solve other systems problems too.

Skilled programmers are in high demand, and a critical obstacle to satisfying this demand is the difficulty of acquiring programming skills. This issue can be addressed with automated assessment, which gives fast feedback to students trying to code, and gamification, which motivates them to intensify their learning efforts. Although some collections of gamified programming exercises are available, producing new ones is very demanding. This paper presents GAMAI, an AI-powered exercise gamifier, enriching the Framework for Gamified Programming Education (FGPE) ecosystem. Leveraging large language models, GAMAI enables teachers to effortlessly apply storytelling to describe a gamified scenario, as GAMAI decorates natural language text with the sentences needed by OpenAI APIs to contextualize the prompt. Once a gamified scenario has been generated, GAMAI automatically produces exercise files in a FGPE-compatible format. According to the presented evaluation results, most gamified exercises generated with AI support were ready to be used, with no or minimum human effort, and were positively assessed by students. The usability of the software was also assessed as high by the users. Our research paves the way for a more efficient and interactive approach to programming education, leveraging the capabilities of advanced language models in conjunction with gamification principles.

The ARGO-USV (Unmanned Surface Vehicle for ARchaeological GeO-application) is a technological project involving a marine drone aimed at devising an innovative methodology for marine geological and geomorphological investigations in shallow areas, usually considered critical areas to be investigated, with the help of traditional vessels. The methodological approach proposed in this paper has been implemented according to a multimodal mapping technique involving the simultaneous and integrated use of both optical and geoacoustic sensors. This approach has been enriched by tools based on artificial intelligence (AI), specifically intended to be installed onboard the ARGO-USV, aimed at the automatic recognition of submerged targets and the physical characterization of the seabed. This technological project is composed of a main command and control system and a series of dedicated sub-systems successfully tested in different operational scenarios. The ARGO drone is capable of acquiring and storing a considerable amount of georeferenced data during surveys lasting a few hours. The transmission of all acquired data in broadcasting allows the cooperation of a multidisciplinary team of specialists able to analyze specific datasets in real time. These features, together with the use of deep-learning-based modules and special attention to green-compliant construction phases, are the particular aspects that make ARGO-USV a modern and innovative project, aiming to improve the knowledge of wide coastal areas while minimizing the impact on these environments. As a proof-of-concept, we present the extensive mapping and characterization of the seabed from a geoarchaeological survey of the underwater Roman harbor of Puteoli in the Gulf of Naples (Italy), demonstrating that deep learning techniques can work synergistically with seabed mapping methods.

Autonomous Surface Vehicles and their management represent one of the significant challenges in coastal and offshore surveying. Although the development of this kind of data acquisition device has skyrocketed in the last few years, line guides and technological solutions still need to come. On the other hand, this kind of robotic vessel's true potential has yet to be explored. This paper presents ArgonautAI, a containerized distributed processing platform for autonomous surface vehicles. The proposed ArgonautAI architecture leverage a cluster of single-board computers with diverse and different characteristics (computing power, CUDA GPUs, FPGAs, GPIOs, PWMs, specialized I/O) orchestrated using Kubernetes and a customized programming interface. Furthermore, the proposed solution introduces two different types of containers: 1) the platform containers hosting the software life support for the platform and 2) the mission containers defined to support the survey mission-specific scopes. The firsts manage the vehicle's instruments (e.g. position, attitude, environment, depth), the data storage, the vessel-to-shore communication, and so on; the latter host mission-specific software components. Finally, as proof of concept of the proposed platform, we present an AI-based marine litter detection application using a hierarchical computer vision approach on heterogenic onboard computing resources.

The request for quickly available forecasts of intense weather and marine events impacting coastal areas is gradually increasing. High-performance computing (HPC) and artificial intelligence techniques are crucial in this application. Risk mitigation and coastal management must design scientific workflow appropriately and maintain them continuously updated and operational. Climate change accelerating increase trend of the past decades impacted on sea-level rise, together with broader factors such as geostatic effects and subsidence, reducing the effectiveness of coastal defenses. Due to this, the support tools, such as Early Warning Systems, have become increasingly more valuable because they can process data promptly and provide valuable indications for mitigation proposals. We developed the Shoreline Alert Model (SAM), an operational Python tool that produces simulation scenarios, ‘what-if’ assumptions, and coastal flooding forecasts to fill this gap in our study area. SAM aims to provide decision-makers, scientists, and engineers with new tools to help forecast significant weather-marine events and support related management or emergency responses. SAM aims to fill the gap between the wind-driven wave models, which produce simulations and forecasts of waves of significant height, period, and direction in deep or mid-water, and the run-up local models, which exstimulate marine ingression in the event of intense weather phenomena. It employs a parallelization scheme that allows users to run it on heterogeneous parallel architectures. It produced results approximately 24 times faster than the baseline when using shared memory with distributed memory, processing roughly 20,000 coastal cross-shore profiles along the coastline of the Campania region (Italy). Increasing the performance of this model and, at the same time, honoring the need for relatively modest HPC resources will enable the local manager and policymakers to enforce fast and effective responses to intense weather phenomena.

The use of hardware accelerators, based on code and data offloading devoted to overcoming the CPU limitations in cores, is one of the main distinctive trends in high-end computing and related applications in the last decade. However, while code offloading is convenient for performance improvement, becoming a commonly used paradigm, memory access and management are a source of bottlenecks due to the need to interact with different address spaces. In this regard, NVidia introduced the CUDA Unified Memory model to avoid explicit memory copies between the machine hosting the accelerator device and the device itself and vice-versa. This paper shows a novel design and implementation of the support to the CUDA Unified Memory in open-source GPGPU virtualization services. The performance evaluation demonstrates that the overhead due to the virtualization and remoting is acceptable considering the possibility of sharing CUDA-enabled GPUs between various and heterogeneous machines hosted at the edge, in cloud infrastructures, or as accelerator nodes in an HPC scenario. A prototype implementation of the proposed solution is available as open-source.