Machine learning has been heavily researched and widely used in many disciplines. However, achieving high accuracy requires a large amount of data that is sometimes difficult, expensive, or impractical to obtain. Integrating human knowledge into machine learning can significantly reduce data requirement, increase reliability and robustness of machine learning, and build explainable machine learning systems. This allows leveraging the vast amount of human knowledge and capability of machine learning to achieve functions and performance not available before and will facilitate the interaction between human beings and machine learning systems, making machine learning decisions understandable to humans. This paper gives an overview of the knowledge and its representations that can be integrated into machine learning and the methodology. We cover the fundamentals, current status, and recent progress of the methods, with a focus on popular and new topics. The perspectives on future directions are also discussed.
Topology optimization by optimally distributing materials in a given domain requires non-gradient optimizers to solve highly complicated problems. However, with hundreds of design variables or more involved, solving such problems would require millions of Finite Element Method (FEM) calculations whose computational cost is huge and impractical. Here we report Self-directed Online Learning Optimization (SOLO) which integrates Deep Neural Network (DNN) with FEM calculations. A DNN learns and substitutes the objective as a function of design variables. A small number of training data is generated dynamically based on the DNN’s prediction of the optimum. The DNN adapts to the new training data and gives better prediction in the region of interest until convergence. The optimum predicted by the DNN is proved to converge to the true global optimum through iterations. Our algorithm was tested by four types of problems including compliance minimization, fluid-structure optimization, heat transfer enhancement and truss optimization. It reduced the computational time by 2 ~ 5 orders of magnitude compared with directly using heuristic methods, and outperformed all state-of-the-art algorithms tested in our experiments. This approach enables solving large multi-dimensional optimization problems.
Sodium ion batteries have become popular due to their low cost. Among the possible anode materials for sodium ion batteries, phosphorus has great potential owing to its high theoretical capacity. Previous research that yielded high capacity and long duration for a phosphorus anode used expensive materials such as black phosphorus (BP) and phosphorene. To take advantage of the low cost of sodium ion batteries, we report a simple and low-cost method to fabricate the anode: condensing red phosphorus on carbon xerogel. Even with a large particle size (∼ 50 m) and a high mass loading (2 mg cm−2), the composite cycled at 100 mA g−1 yielded a capacity of 357 mA g−1 or 2498 based on phosphorus after subtracting the contribution of carbon. The average coulombic efficiency is as high as 99.4%. When cycled at 200 mA g−1, it yielded a capacity of 242 mAh g−1 or 1723 with average degradation rate only 0.06% in 80 cycles. Our research provides an innovative approach to synthesize anodes for sodium ion batteries at extremely low cost, with performance exceeding or comparable to state-of-the-art materials, which will promote their commercialization.