In the realm of e-commerce, personalized recommendations are a crucial component in enhancing user experience and optimizing sales efficiency. To address the inherent sparsity challenge prevalent in collaborative filtering algorithms within personalized recommendation systems, we propose a novel hybrid e-commerce recommendation algorithm based on the User-Nearest-Neighbor model. By integrating the user nearest neighbor model with other recommendation algorithms, this approach effectively mitigates data sparsity and facilitates a more nuanced understanding of the user-product relationship, consequently elevating recommendation quality and enhancing user experience. Taking into account considerations such as data scale and recommendation performance, we conducted experiments utilizing the Spark distributed platform. Empirical findings demonstrate the superiority of our hybrid algorithm over standalone collaborative filtering algorithms across various recommendation indicators.
To address uncertainties in the supply chain, this paper analyzes potential uncertainties by constructing a three-tier supply chain simulation model and proposes an optimized support vector machine algorithm (IJS-SVM) using the improved Jellyfish Search Algorithm to optimize these uncertainties. In comparison to the classical Jellyfish Search Algorithm, the proposed algorithm incorporates Logistic chaotic mapping, Cauchy variation, and inverse learning strategies, with the goal of improving solution efficiency and avoiding local optima. The experimental results indicate that IJS-SVM outperforms the support vector machine optimized by the classical Jellyfish Search Algorithm (JS-SVM), the support vector machine optimized by the genetic algorithm (GA-SVM), the support vector machine optimized by the particle swarm optimization algorithm (PSO-SVM), and the traditional support vector machine (SVM) in terms of classification accuracy. Building on this study, the SHAP explanatory model is employed to interpret IJS-SVM’s prediction results, quantify the specific impact of uncertainty factors on each stage of the supply chain, and input these quantitative results into the simulation system to assess warehouse allocation and identify strategies to enhance warehouse utilization, ultimately minimizing supply chain costs. The experiment demonstrates that the model not only offers valuable practical guidance for CEPC engineering project planning but also has broad applicability and can be extended to uncertainty management and optimization within the tertiary supply chain sector.
In this paper, we propose a new method that combines the parallelism of the Spark-based platform with fast frequent mining, called STB_Apriori. Previous research has shown that traditional frequent itemset mining algorithms have high overhead when faced with large datasets and high-dimensional data computation, and generate a large number of candidate itemsets; at the same time, when faced with diverse user requirements, they often generate very sparse and diverse data. In order to solve the problem of fast mining of massive data, our idea originates from the capability of Spark distributed computing and the common optimisation ideas in Apriori mining, by using the efficient operator BitSet to achieve transaction compression, bit storage and data manipulation by Boolean matrices, and at the same time by parallelising the processing and optimising the algorithmic logic to achieve fast and frequent mining. In experiments on real-world datasets, our model consistently outperforms five widely used methods by a significant margin on very large data and maintains its excellence in the remaining cases, proving its effectiveness on real-world tasks, while further analysis shows that increasing the number of distributed nodes also incrementally and continuously improves performance.
Data is an important source of knowledge discovery, but the existence of similar duplicate data not only increases the redundancy of the database but also affects the subsequent data mining work. Cleaning similar duplicate data is helpful to improve work efficiency. Based on the complexity of the Chinese language and the bottleneck of the single machine system to large-scale data computing performance, this paper proposes a Chinese data cleaning method that combines the BERT model and a k-means clustering algorithm and gives a parallel implementation scheme of the algorithm. In the process of text to vector, the position vector is introduced to obtain the context features of words, and the vector is dynamically adjusted according to the semantics so that the polysemous words can obtain different vector representations in different contexts. At the same time, the parallel implementation of the process is designed based on Hadoop. After that, k-means clustering algorithm is used to cluster similar duplicate data to achieve the purpose of cleaning. Experimental results on a variety of data sets show that the parallel cleaning algorithm proposed in this paper not only has good speedup and scalability but also improves the precision and recall of similar duplicate data cleaning, which will be of great significance for subsequent data mining.
In hybrid mixed-flow workshop scheduling, there are problems such as mass production, mass manufacturing, mass assembly and mass synthesis of products. In order to solve these problems, combined with the Spark platform, a hybrid particle swarm algorithm that will be parallelized is proposed. Compared with the existing intelligent algorithms, the parallel hybrid particle swarm algorithm is more conducive to the realization of the global optimal solution. In the loader manufacturing workshop, the optimization goal is to minimize the maximum completion time and a parallelized hybrid particle swarm algorithm is used. The results show that in the case of relatively large batches, the parallel hybrid particle swarm algorithm can effectively obtain the scheduling plan and avoid falling into the local optimal solution. Compared with algorithm serialization, algorithm parallelization improves algorithm efficiency by 2–4 times. The larger the batches, the more obvious the algorithm parallelization improves computational efficiency.