As electric vehicle (EV) adoption grows, efficient and accessible charging infrastructure is essential. This paper introduces a modular simulation environment to evaluate charging point configurations and operational strategies. The simulation incorporates detailed models of electrical consumers and user behaviour, leveraging real-world data to simulate charging scenarios. A rule-based control strategy is applied to assess six configurations for a supermarket parking lot charging point. Key findings include the highest profit being achieved with two fast chargers. In scenarios with a 50 kW grid connection limit, combining fast chargers with stationary battery storage proves effective. Conversely, mobile charging robots generate lower revenue, though grid peak limitations have minimal impact. The study highlights the potential of the simulation environment to optimise charging layouts, refine operational strategies, and develop energy management algorithms. This work demonstrates the utility of the simulation framework for analyzing diverse charging solutions, offering insights into cost efficiency and user satisfaction. The results emphasise the importance of tailored strategies to balance grid constraints, profitability, and user needs, paving the way for intelligent EV charging infrastructure development.
Autonomous navigation is critical for unlocking the full potential of Unmanned Surface Vehicles (USVs) in complex maritime environments. Deep Reinforcement Learning (DRL) has emerged as a powerful paradigm for developing self-learning control policies, yet the design of reward functions to balance conflicting objectives, particularly fast arrival at the target position and collision avoidance, remains a major challenge. The precise, quantitative impact of reward parameterization on a USV's maneuvering behavior and the inherent performance trade-offs have not been thoroughly investigated. Here we demonstrate that by systematically varying reward function weights within a framework relying on the Proximal Policy Optimization (PPO), it is possible to quantitatively map the trade-off between collision avoidance safety and mission time. Our results, derived from simulations, show that agents trained with balanced reward weights achieve target-reaching success rates exceeding 98\% in dynamic multi-obstacle scenarios. Conversely, configurations that disproportionately penalize obstacle proximity lead to overly cautious behavior and mission failure, with success rates dropping to 22\% due to workspace boundary violations. This work provides a data-driven methodological framework for reward function design and parameter selection in safety-critical robotic applications, moving beyond ad-hoc tuning towards a more structured parameter influence analysis.
Autonomous navigation is critical for unlocking the full potential of Unmanned Surface Vehicles (USVs) in complex maritime environments. Deep Reinforcement Learning (DRL) has emerged as a powerful paradigm for developing self-learning control policies, yet the design of reward functions to balance conflicting objectives, particularly fast arrival at the target position and collision avoidance, remains a major challenge. The precise, quantitative impact of reward parameterization on a USV’s maneuvering behavior and the inherent performance trade-offs have not been thoroughly investigated. Here, we demonstrate that by systematically varying reward function weights within a framework relying on the Proximal Policy Optimization (PPO), it is possible to quantitatively map the trade-off between collision avoidance safety and mission time. Our results, derived from simulations, show that agents trained with balanced reward weights achieve target-reaching success rates exceeding 98% in dynamic multi-obstacle scenarios. Conversely, configurations that disproportionately penalize obstacle proximity lead to overly cautious behavior and mission failure, with success rates dropping to 22% due to workspace boundary violations. This work provides a data-driven methodological framework for reward function design and parameter selection in safety-critical robotic applications, moving beyond ad-hoc tuning towards a more structured parameter influence analysis.