Federated learning (FL) is an emerging distributed machine learning (ML) framework that operates under privacy and communication constraints. To mitigate the data heterogeneity underlying FL, clustered FL (CFL) was proposed to learn customized models for different client groups. However, due to the lack of effective client selection strategies, the CFL process is relatively slow, and the model performance is also limited in the presence of nonindependent and identically distributed (non-IID) client data. In this work, for the first time, we propose selecting participating clients for each cluster with active learning (AL) and call our method active client selection for CFL (ACFL). More specifically, in each ACFL round, each cluster filters out a small set of clients, which are the most informative clients according to some AL metrics [e.g., uncertainty sampling, query-by-committee (QBC), loss], and aggregates only its model updates to update the cluster-specific model. We empirically evaluate our ACFL approach on the public MNIST, CIFAR-10, and LEAF synthetic datasets with class-imbalanced settings. Compared with several FL and CFL baselines, the results reveal that ACFL can dramatically speed up the learning process while requiring less client participation and significantly improving model accuracy with a relatively low communication overhead.
Turbulent combustion is one of the key processes in many energy conversion systems in modern life. In order to improve combustion efficiency and suppress emission of pollutants, many efforts have been made by scholars to investigate turbulent flames. In the present study, Artificial neural network (ANN) was first employed for the storage and interpolation of the flamelet library in flamelet generated manifolds (FGM) model, in which Eulerian stochastic field (ESF) model was used to directly consider the probability density function of the control variables. This new model had been implemented in OpenFOAM and was validated by simulation of the Sandia Flame D under consideration of the detailed chemical reaction mechanism. By comparing the results of numerical simulations and experimental measurements of the temperature and the mass fraction of main components, the accuracy of the proposed ANN-ESFFGM model was verified. Through the use of ANNs to characterize the chemical reactions, the flame simulation accuracy of the new model is higher than that of the original ESFFGM model, especially in the prediction of the ignition position. With the increase in the number of stochastic fields, the simulation accuracy of the new turbulent combustion model is continuously improved until a certain value of stochastic fields was reached. Moreover, excessively high FGM table resolution has limited improvement in numerical simulation accuracy.
Target recognition is an important aspect of air traffic management, but the study on automatic aircraft identification is still in the exploratory stage. Rapid aircraft processing and accurate aircraft type recognition remain challenging tasks due to the high-speed movement of the aircraft against complex backgrounds. Active learning, as a promising research topic of machine learning in recent decades, can use less labeled data to obtain the same model accuracy as supervised learning, which greatly reduces the cost of labeling a dataset. Instead of manually developing policies of accessing the labels of desired instances, an improved active learning approach, which can not only learn to classify samples using small supervision but additionally capture a relatively optimal label query strategy, was developed by employing the reinforcement learning in the process of decision-making. The proposed model was first tested with the Amsterdam Library of Object Images (ALOI) dataset and then used to perform aircraft type recognition on one-month real-world flight track data. Our method offers a satisfactory solution for learning new concepts rapidly from a small amount of data, which well meets the needs of aircraft type recognition task in practical application.
26 July 2022 in Journal of Ambient Intelligence and Humanized Computing