Automated, reliable, and objective microstructure inference from micrographs is essential for a comprehensive understanding of process-microstructure-property relations and tailored materials development. However, such inference, with the increasing complexity of microstructures, requires advanced segmentation methodologies. While deep learning offers new opportunities, an intuition about the required data quality/quantity and a methodological guideline for microstructure quantification is still missing. This, along with deep learning’s seemingly intransparent decision-making process, hampers its breakthrough in this field. We apply a multidisciplinary deep learning approach, devoting equal attention to specimen preparation and imaging, and train distinct U-Net architectures with 30–50 micrographs of different imaging modalities and electron backscatter diffraction-informed annotations. On the challenging task of lath-bainite segmentation in complex-phase steel, we achieve accuracies of 90% rivaling expert segmentations. Further, we discuss the impact of image context, pre-training with domain-extrinsic data, and data augmentation. Network visualization techniques demonstrate plausible model decisions based on grain boundary morphology.
Materials’ microstructures are signatures of their alloying composition and processing history. Automated, quantitative analyses of microstructural constituents were lately accomplished through deep learning approaches. However, their shortcomings are poor data efficiency and domain generalizability across data sets, inherently conflicting the expenses associated with annotating data through experts, and extensive materials diversity. To tackle both, we propose to apply a sub-class of transfer learning methods called unsupervised domain adaptation (UDA). UDA addresses the task of finding domain-invariant features when supplied with annotated source data and unannotated target data, such that performance on the latter is optimized. Exemplarily, this study is conducted on a lath-shaped bainite segmentation task in complex phase steel micrographs. Domains to bridge are selected to be different metallographic specimen preparations and distinct imaging modalities. We show that a state-of-the-art UDA approach substantially fosters the transfer between the investigated domains, underlining this technique’s potential to cope with materials variance.
Bainite is an essential constituent of modern high strength steels. In addition to the still great challenge of characterization, the classification of bainite poses difficulties. Challenges when dealing with bainite are the variety and amount of involved phases, the fineness and complexity of the structures and that there is often no consensus among human experts in labeling and classifying those. Therefore, an objective and reproducible characterization and classification is crucial. To achieve this, it is necessary to analyze the substructure of bainite using scanning electron microscope (SEM). This work will present how textural parameters (Haralick features and local binary pattern) calculated from SEM images, taken from specifically produced benchmark samples with defined structures, can be used to distinguish different bainitic microstructures by using machine learning techniques (support vector machine). For the classification task of distinguishing pearlite, granular, degenerate upper, upper and lower bainite as well as martensite a classification accuracy of 91.80% was achieved, by combining Haralick features and local binary pattern.
The foundation of materials science and engineering is the establishment of process–microstructure–property links, which in turn form the basis for materials and process development and optimization. At the heart of this is the characterization and quantification of the material’s microstructure. To date, microstructure quantification has traditionally involved a human deciding what to measure and included labor-intensive manual evaluation. Recent advancements in artificial intelligence (AI) and machine learning (ML) offer exciting new approaches to microstructural quantification, especially classification and semantic segmentation. This promises many benefits, most notably objective, reproducible, and automated analysis, but also quantification of complex microstructures that has not been possible with prior approaches. This review provides an overview of ML applications for microstructure analysis, using complex steel microstructures as examples. Special emphasis is placed on the quantity, quality, and variance of training data, as well as where the ground truth needed for ML comes from, which is usually not sufficiently discussed in the literature. In this context, correlative microscopy plays a key role, as it enables a comprehensive and scale-bridging characterization of complex microstructures, which is necessary to provide an objective and well-founded ground truth and ultimately to implement ML-based approaches.
The microalloying with niobium (Nb) and titanium (Ti) is standardly applied in low carbon steel high-strength low-alloy (HSLA) steels and enables austenite conditioning during thermo-mechanical controlled processing (TMCP), which results in pronounced grain refinement in the finished steel. In that respect, it is important to better understand the precipitation kinetics as well as the precipitation sequence in a typical Nb-Ti-microalloyed steel. Various characterization methods were utilized in this study for tracing microalloy precipitation after simulating different austenite TMCP conditions in a Gleeble thermo-mechanical simulator. Atom probe tomography (APT), scanning transmission electron microscopy in a focused ion beam equipped scanning electron microscope (STEM-on-FIB), and electrical resistivity measurements provided complementary information on the precipitation status and were correlated with each other. It was demonstrated that accurate electrical resistivity measurements of the bulk steel could monitor the general consumption of solute microalloys (Nb) during hot working and were further complemented by APT measurements of the steel matrix. Precipitates that had formed during cooling or isothermal holding could be distinguished from strain-induced precipitates by corroborating STEM measurements with APT results, because APT specifically allowed obtaining detailed information about the chemical composition of precipitates as well as the elemental distribution. The current paper highlights the complementarity of these methods and shows first results within the framework of a larger study on strain-induced precipitation.
With its excellent property combinations and ability to specifically adjust tailor-made microstructures, steel is still the world’s most important engineering and construction material. To fulfill ever-increasing demands and tighter tolerances in today’s steel industry, steel research remains indispensable. The continuous material development leads to more and more complex microstructures, which is especially true for steel designs that include bainitic structures. This poses new challenges for the classification and quantification of these microstructures. Machine learning (ML) based microstructure classification offers exciting potentials in this context. This paper is concerned with the automated, objective, and reproducible classification of the carbon-rich second phase objects in multi-phase steels by using machine learning techniques. For successful applications of ML-based classifications, a holistic approach combining computer science expertise and material science domain knowledge is necessary. Seven microstructure classes are considered: pearlite, martensite, and the bainitic subclasses degenerate pearlite, debris of cementite, incomplete transformation product, and upper and lower bainite, which can all be present simultaneously in one micrograph. Based on SEM images, textural features (Haralick parameters and local binary pattern) and morphological parameters are calculated and classified with a support vector machine. Of all second phase objects, 82.9% are classified correctly. Regarding the total area of these objects, 89.2% are classified correctly. The reported classification can be the basis for an improved, sophisticated microstructure quantification, enabling process–microstructure–property correlations to be established and thereby forming the backbone of further, microstructure-centered material development.