YOLO (You Only Look Once) is an extensively utilized object detection algorithm that has found applications in various medical object detection tasks. This has been accompanied by the emergence of numerous novel variants in recent years, such as YOLOv7 and YOLOv8. This study encompasses a systematic exploration of the PubMed database to identify peer-reviewed articles published between 2018 and 2023. The search procedure found 124 relevant studies that employed YOLO for diverse tasks including lesion detection, skin lesion classification, retinal abnormality identification, cardiac abnormality detection, brain tumor segmentation, and personal protective equipment detection. The findings demonstrated the effectiveness of YOLO in outperforming alternative existing methods for these tasks. However, the review also unveiled certain limitations, such as well-balanced and annotated datasets, and the high computational demands. To conclude, the review highlights the identified research gaps and proposes future directions for leveraging the potential of YOLO for medical object detection.
Deep Reinforcement Learning (DRL) has gained significant adoption in diverse fields and applications, mainly due to its proficiency in resolving complicated decision-making problems in spaces with high-dimensional states and actions. Deep Deterministic Policy Gradient (DDPG) is a well-known DRL algorithm that adopts an actor-critic approach, synthesizing the advantages of value-based and policy-based reinforcement learning methods. The aim of this study is to provide a thorough examination of the latest developments, patterns, obstacles, and potential opportunities related to DDPG. A systematic search was conducted using relevant academic databases (Scopus, Web of Science, and ScienceDirect) to identify 85 relevant studies published in the last five years (2018-2023). We provide a comprehensive overview of the key concepts and components of DDPG, including its formulation, implementation, and training. Then, we highlight the various applications and domains of DDPG, including Autonomous Driving, Unmanned Aerial Vehicles, Resource Allocation, Communications and the Internet of Things, Robotics, and Finance. Additionally, we provide an in-depth comparison of DDPG with other DRL algorithms and traditional RL methods, highlighting its strengths and weaknesses. We believe that this review will be an essential resource for researchers, offering them valuable insights into the methods and techniques utilized in the field of DRL and DDPG.
17 October 2025 in Computers in Biology and Medicine
Deep Reinforcement Learning (DRL) allows agents to make decisions in a specific environment based on a reward function, without prior knowledge. Adapting hyperparameters significantly impacts the learning process and time. Precise estimation of hyperparameters during DRL training poses a major challenge. To tackle this problem, this study utilizes Grey Wolf Optimization (GWO), a metaheuristic algorithm, to optimize the hyperparameters of the Deep Deterministic Policy Gradient (DDPG) algorithm for achieving optimal control strategy in two simulated Gymnasium environments provided by OpenAI. The ability to adapt hyperparameters accurately contributes to faster convergence and enhanced learning, ultimately leading to more efficient control strategies. The proposed DDPG-GWO algorithm is evaluated in the 2DRobot and MountainCarContinuous simulation environments, chosen for their ease of implementation. Our experimental results reveal that optimizing the hyperparameters of the DDPG using theGWO algorithm in the Gymnasium environments maximizes the total rewards during testing episodes while ensuring the stability of the learning policy. This is evident in comparing our proposed DDPG-GWO agent with optimized hyperparameters and the original DDPG. In the 2DRobot environment, the original DDPG had rewards ranging from -150 to -50, whereas, in the proposed DDPG-GWO, they ranged from -100 to 100 with a running average between 1 and 800 across 892 episodes. In the MountainCarContinuous environment, the original DDPG struggled with negative rewards, while the proposed DDPG-GWO achieved rewards between 20 and 80 over 218 episodes with a total of 490 timesteps.
Colorectal cancer (CRC) is a prevalent and life-threatening malignancy, demanding early diagnosis and effective treatment for improved patient outcomes. Accurate segmentation of colon cancer in medical images is a challenging task due to the complexity of its morphology and limited annotated data availability. This paper presents an efficient approach for colon cancer segmentation and image synthesis, combining an Attention U-Net and Pix2Pix Generative Adversarial Network (Pix2Pix-GAN) guided by Sine Cosine Algorithm (SCA) for hyperparameter tuning within the GAN framework. The utilization of SCA plays a pivotal role in optimizing the delicate balance between generator and discriminator dynamics, resulting in enhanced convergence and stability. Our method achieved state-of-the-art results with a mean Dice score of 0.9514, mean Intersection over Union of 0.9123, F beta score of 0.9636, and similarity index of 0.9430 outperforming existing methods. Moreover, the Mean Absolute Error reached a minimal value of 0.01583. This proposed approach shows promise in enhancing the accuracy and robustness of colon cancer diagnosis and treatment which could lead to better diagnosis and treatment of colon cancer.