Machine learning algorithms have been widely used to deal with a variety of practical problems such as computer vision and speech processing. But the performance of machine learning algorithms is primarily affected by their hyper-parameters, as without good hyper-parameter values the performance of these algorithms will be very poor. Unfortunately, for complex machine learning models like deep neural networks, it is very difficult to determine their hyper-parameters. Therefore, it is of great significance to develop an efficient algorithm for hyper-parameter automatic optimization. In this paper, a novel hyper-parameter optimization methodology is presented to combine the advantages of a Genetic Algorithm and Tabu Search to achieve the efficient search for hyper-parameters of learning algorithms. This method is defined as the Tabu_Genetic Algorithm. In order to verify the performance of the proposed algorithm, two sets of contrast experiments are conducted. The Tabu_Genetic Algorithm and other four methods are simultaneously used to search for good values of hyper-parameters of deep convolutional neural networks. Experimental results show that, compared to Random Search and Bayesian optimization methods, the proposed Tabu_Genetic Algorithm finds a better model in less time. Whether in a low-dimensional or high-dimensional space, the Tabu_Genetic Algorithm has better search capabilities as an effective method for finding the hyper-parameters of learning algorithms. The presented method in this paper provides a new solution for solving the hyper-parameters optimization problem of complex machine learning models, which will provide machine learning algorithms with better performance when solving practical problems.
Freeform surfaces exist widely in the stock cutting process of clinical prosthesis preparation, aviation, ship, and other manufacturing industries. The free-form contours of surfaces need to be packed before they are machined from raw materials. The existing methods search a contour position by rotating the contour and translating it to connect other contours for packing. The relative position between two contours will be changed after the rotation as the contour description is lack of geometric invariance. These methods easily miss the best layout position resulting in interspaces in the raw material. Moreover, this result seriously reduces the performance and efficiency of an automatic packing system. Therefore, a new packing algorithm is proposed in this paper by combining the geometric invariant description and coding matching for contours to solve the contour rotating and position connecting problems. The optimal position of a contour can be found directly and then connected by the extracted similar complement features of the contour. Experimental results show that the proposed method can greatly improve quality and efficiency of the layout, especially in the material utilization.
19 September 2024 in Proceedings of the Institution of Mechanical Engineers, Part O: Journal of Risk and Reliability
The performance degradation process of the machine is non-stationary which varies with the operating environment and is reflected as a temporal shift phenomenon. Models or methods that assume the test and training sets have the same distribution will no longer be suitable for solving problems where domain shifts exist. This brings new challenges for accurately evaluating the machine’s remaining useful life (RUL). This paper studies a contrastive adversarial variational recurrent method for machine RUL prediction under different service conditions. In this new approach, the variational recurrent networks are developed to extract distribution features and latent spaces of raw data, meanwhile, the adversarial strategies are applied to enable the learning of domain-invariant features to make the model achieve cross-domain task processing. To supervise the learning process of the model to learn more mutual information between the extracted features and the raw input data, a contrastive loss is also introduced in the proposed method. Sufficient experiments were conducted to verify the feasibility and superiority of the suggested approach, including 12 sets of cross-scenario tests on the turbofan engine dataset C-MAPSS from NASA. Experimental findings confirm that the proposed method performs satisfactorily and competitively even compared to current state-of-the-art works.