Large Language Models (LLMs) recently demonstrated extraordinary capability, including natural language processing (NLP), language translation, text generation, question answering, etc. Moreover, LLMs are a new and essential part of computerized language processing, having the ability to understand complex verbal patterns and generate coherent and appropriate replies for the situation. Though this success of LLMs has prompted a substantial increase in research contributions, rapid growth has made it difficult to understand the overall impact of these improvements. Since a lot of new research on LLMs is coming out quickly, it is getting tough to get an overview of all of them in a short note. Consequently, the research community would benefit from a short but thorough review of the recent changes in this area. This article thoroughly overviews LLMs, including their history, architectures, transformers, resources, training methods, applications, impacts, challenges, etc. This paper begins by discussing the fundamental concepts of LLMs with its traditional pipeline of the LLMs training phase. It then provides an overview of the existing works, the history of LLMs, their evolution over time, the architecture of transformers in LLMs, the different resources of LLMs, and the different training methods that have been used to train them. It also demonstrated the datasets utilized in the studies. After that, the paper discusses the wide range of applications of LLMs, including biomedical and healthcare, education, social, business, and agriculture. It also illustrates how LLMs create an impact on society and shape the future of AI and how they can be used to solve real-world problems. Then it also explores open issues and challenges to deploying LLMs in real-world scenario. Our review paper aims to help practitioners, researchers, and experts thoroughly understand the evolution of LLMs, pre-trained architectures, applications, challenges, and future goals.

Federated Learning (FL) is a new technology that has been a hot research topic. It enables training an algorithm across multiple decentralized edge devices or servers holding local data samples, without exchanging them. There are many application domains where large amounts of properly labeled and complete data are not available in a centralized location, for example, doctors’ diagnosis from medical image analysis. There are also growing concerns over data and user privacy as Artificial Intelligence is becoming ubiquitous in new application domains. As such, very recently, a lot of research has been conducted in several areas within the nascent field of FL. A variety of surveys on different subtopics exist in current literature, focusing on specific challenges, design aspects and application domains. In this paper, we review existing contemporary works in the related areas in order to understand the challenges and topics that are emphasized by each type of FL surveys. Furthermore, we categorize FL research in terms of challenges, design factors and applications, conducting a holistic review of each and outlining promising research directions.

The rapid advancement of artificial intelligence (AI) has brought significant benefits across various domains, yet it has also led to increased energy consumption and environmental impact. This paper positions Green AI as a crucial direction for future research and development. It proposes a comprehensive framework for understanding, implementing, and advancing sustainable AI practices. We provide an overview of Green AI, highlighting its significance and current state regarding AI’s energy consumption and environmental impact. The paper explores sustainable AI techniques, such as model optimization methods, and the development of efficient algorithms. Additionally, we review energy-efficient hardware alternatives like tensor processing units (TPUs) and field-programmable gate arrays (FPGAs), and discuss strategies for designing and operating energy-efficient data centers. Case studies in natural language processing (NLP) and Computer Vision illustrate successful implementations of Green AI practices. Through these efforts, we aim to balance the performance and resource efficiency of AI technologies, aligning them with global sustainability goals.

Diabetic retinopathy (DR) is a common complication of diabetes mellitus, and retinal blood vessel damage can lead to vision loss and blindness if not recognized at an early stage. Manual DR detection using large fundus image data is time-consuming and error-prone. An effective automatic DR detection system can be significantly faster and potentially more accurate. This study aims to classify fundus images into five DR classes, using deep learning methods, with the highest possible accuracy and the lowest possible computational time. Three distinct DR datasets, APTOS, Messidor2, and IDRiD, are merged, resulting in 5,819 raw images. Before training the model, various image preprocessing techniques are applied to remove artifacts and noise from the images and improve their quality. Three augmentation techniques: geometric, photometric, and elastic deformation, are used to create a balanced dataset. A shallow convolutional neural network (CNN) is developed using three blocks of convolutional layers and maxpool layers with a categorical cross-entropy loss function, Adam optimizer, 0.0001 learning rate, and 64 batch size as a base model, and this is also employed to determine the best data augmentation method for further processing. A study to optimize the performance is then conducted by changing different components and hyperparameters of the base model, resulting in our proposed RetNet-10 model. Six cutting-edge models are employed for comparison. Our proposed RetNet-10 model performed the best, with a testing accuracy of 98.65%. MobileNetV2, VGG16, Xception, VGG19, InceptionV3 and ResNet50 achieved testing accuracies of 91.42%, 90.16%,89.57%, 88.21%, 87.68% and 87.23%, respectively. The model is also trained with several k values to assess its robustness. After image processing and data augmentation, using the combined dataset, and fine-tuning the base model, our proposed RetNet-10 model outperformed other automated methods for DR diagnosis.

Bullying is described as an undesirable behavior by others that harms an individual physically, mentally, or socially. Cyberbullying is a virtual form (e.g., textual or image) of bullying or harassment, also known as online bullying. Cyberbullying detection is a pressing need in today’s world, as the prevalence of cyberbullying is continually growing, resulting in mental health issues. Conventional machine learning models were previously used to identify cyberbullying. However, current research demonstrates that deep learning surpasses traditional machine learning algorithms in identifying cyberbullying for several reasons, including handling extensive data, efficiently classifying text and images, extracting features automatically through hidden layers, and many others. This paper reviews the existing surveys and identifies the gaps in those studies. We also present a deep-learning-based defense ecosystem for cyberbullying detection, including data representation techniques and different deep-learning-based models and frameworks. We have critically analyzed the existing DL-based cyberbullying detection techniques and identified their significant contributions and the future research directions they have presented. We have also summarized the datasets being used, including the DL architecture being used and the tasks that are accomplished for each dataset. Finally, several challenges faced by the existing researchers and the open issues to be addressed in the future have been presented.