The exponential evolution of data in health care has brought a lot of challenges in terms of data transfer, storage, computation and analysis. For healthcare usage and applications, ample patient information and historical data, which enclose rich and significant insights that can be exposed using advanced tools and techniques as well as latest machine learning algorithms. Though, the size and rapidity of such great dimensional data requires new big data analytics framework. This paper introduces the thought of data in healthcare and the results of various surveys to show the impact of big data. Few case studies of big data analytics in healthcare is presented. Last section is about the tools and techniques comprising Hadoop, Storm, Spark and HPCC - big data solution offered to solve big data issues and challenges.
Online analytical processing (OLAP) approach is widely used in business intelligence to cater the multidimensional queries for decades. In this era of cutting-edge technology and the internet, data generation rates have been rising exponentially. Internet of things sensors and social media platforms are some of the major contributors, leading toward the absolute data boom. Storage and speed are the crucial parameters and undoubtedly the burning issues in efficient data handling. The key idea here is to address these two challenges of big data computing in OLAP. In this article, the authors have proposed and implemented OLAP on Hadoop by Indexing (OOHI). OOHI offers a simplified multidimensional model that stores dimensions in the schema server and measures on the Hadoop cluster. Overall setup is divided into various modules, namely: data storage module (DSM), dimension encoding module (DEM), cube segmentation module, segment selection module (SSM), and block selection and process (BSAP) module. Serialization and deserialization concept applied by DSM for storage and retrieval of the data for efficient space utilization. Integer encoding adopted by DEM in dimension hierarchy is selected to escape sparsity problem in multidimensional big data. To reduce search space by chunks of the cube from the queried chunks, SSM plays an important role. Map reduce-based indexing approach and series of seek operations of BSAP module were integrated to achieve parallelism and fault tolerance. Real-time oceanography data and supermarket data sets are applied to demonstrate that OOHI model is data independent. Various test cases are designed to cover the scope of each dimension and volume of data set. Comparative results and performance analytics portray that OOHI outperforms in data storage, dice, slice, and roll-up operations compared with Hadoop based OLAP.
17 November 2023 in Scalable Computing: Practice and Experience
Music recommender system is an area of information retrieval system that suggests customized music recommendations to users based on their previous preferences and experiences with music. While existing systems often overlook the emotional state of the driver, we propose a hybrid music recommendation system - ConCollA to provide a personalized experience based on user emotions. By incorporating facial expression recognition, ConCollA accurately identifies the driver’s emotions using convolution neural network(CNN) model and suggests music tailored to their emotional state. ConCollA combines collaborative filtering, a novel content-based recommendation system named Mood Adjusted Average Similarity (MAAS), and apriori algorithm to generate personalized music recommendations. The performance of ConCollA is assessed using various evaluation parameters. The results show that proposed emotion-aware model outperforms a collaborative-based recommender system.
20 November 2021 in Scalable Computing: Practice and Experience
Big data analytics involve systematic approach to find hidden patterns to help the organization grow from large volume and variety of data. In recent years big data analytics is widely used in the agricultural domain to improve yield. Viticulture (the cultivation of grapes) is one of the most lucrative farming in India. It is a subdivision of horticulture and is the study of wine growing. The demand for Indian Wine is increasing at about 27% each year since the 21st century and thus more and more ways are being developed to improve the quality and quantity of the wine products. In this paper, we focus on a specific agricultural practice as viticulture. Weather forecasting and disease detection are the two main research areas in precision viticulture. Leaf disease detection as a part of plant pathology is the key research area in this paper. It can be applied on vineyards of India where farmers are bereft of the latest technologies. Proposed system architecture comprises four modules: Data collection, data preprocessing, classification and visualization. Database module involve grape leaf dataset, consists of healthy images combined with disease leaves such as Black measles, Black rot, and Leaf blight. Models have been implemented on Apache Hadoop using map reduce programming framework. It apply feature extraction to extract various features of the live images and classification algorithm with reduced computational complexity. Gray Level Co-occurrence Matrix (GLCM) followed by K-Nearest Neighborhood (KNN) algorithm. System also recommends the necessary steps and remedies that the viticulturists can take to assure that the grapes can be salvaged at the right time and in the right manner based on classification results. Overall system will help Indian viticulturists to improve the harvesting process. Accuracy of the model is 72% and it can be increased as a future work by including deep learning with time series grape leaf images.
Alzheimer’s disease (AD) is prevalent dementia that can cause neurological brain disorders, poor decision making, impaired memory, mood swings, unstable emotions, and personality change. Deep neural networks are proficient in classifying Alzheimer's disease based on MRI images. This classification assists human experts in diagnosing AD and predicts its future progression. The paper proposes various Deep Neural Networks (DNN) for early AD detection to save cost and time for doctors, radiologists, and caregivers. A 3330-image-based Kaggle dataset is used to train the DNN, including 52 images of AD, 717 images of Mild Cognitive Impairment (MCI), and the remaining images of Cognitive Normal (CN). Stratified partitioning splits the dataset into 80% and 20% proportions for training and validation datasets. Proposed models include DenseNet169, DenseNet201, and ResNet152 DNNs with additional three fully-connected layers and softmax and Kullback Leibler Divergence (KLD) loss function. These models are trained considering pre-trained, partially pre-trained, and fully re-trained extended base models. The KLD loss function reduces the error and increases accuracy for all models. The partially pre-trained DenseNet201 model outperformed all the other models. DenseNet201 gives the highest accuracy of 99.98% for training, 99.07% for validation, and 95.66% for test datasets. The DenseNet201 model has the highest accuracy in comparison to other state-of-art-methods.