26 October 2018 in IEEE Transactions on Industrial Informatics
Base frame calibration is the foundation for the cooperative work of manipulators. The commonly applied method usually constructed a matrix equation. The contact-mode approach is limited by the insufficient accuracy and efficiency while the high cost impedes the application of methods with the noncontact mode. In this paper, a projection-based method is proposed. All the transformation parameters can be solved based on the geometric constraints. When cooperative manipulators form the closed-chain asynchronously, the topological structure is projected into a particular plane. With the utilization of trigonometric functions. The rotation angle and translation parameters can be determined with a simple calculation process. The greatest novel feature of this analysis is that only two calibration points are required. The experiment result shows that both the accuracy and efficiency can be much better in the asynchronous calibration
19 January 2023 in Advanced Intelligent Systems
In the fabric manufacturing industry, fabric defect detection is a practical yet challenging task, due to the problem of defects with small sizes or unremarkable appearances distributed in fabric images with high resolution. Some deep‐learning‐based solutions try to tackle the aforementioned problem but with limited achievements. Herein, a brand new module called adaptively fused attention module (AFAM) is proposed to improve the detection performance by enabling the network to concentrate more on the small or unremarkable defects in terms of 1) enhancing the feature maps both spatial‐wise and channel‐wise, 2) enhancing the attention information flow between the channel‐attention feature map and the spatial‐attention feature map, and 3) enriching background information. Experiments on the MS‐COCO dataset show that AFAM reaches higher AP than other state‐of‐the‐art (SOTA) attention modules (e.g., squeeze‐and‐excitation network [SE], efficient channel attention [ECA], convolutional block attention module [CBAM]). Meanwhile, on the Smart Diagnosis of Cloth Flaw Dataset (CloF), the Cascade R‐CNN (Resnext101) + AFAM outperforms the SOTA in the official leaderboard of the CloF dataset. Speed‐wisely, the solution achieves a 12.19‐FPS on RTX 3090, thus making it practical to be applied in the industry of fabric defect detection.
16 February 2023 in IEEE Transactions on Visualization and Computer Graphics
We propose a robust and highly realistic clothing modeling method to generate a 3D clothing model with visually consistent clothing style and wrinkles distribution from a single RGB image. Notably, this entire process only takes a few seconds. Our high-quality clothing results benefit from the idea of combining learning and optimization, making it highly robust. First, we use the neural networks to predict the normal map, a clothing mask, and a learning-based clothing model from input images. The predicted normal map can effectively capture high-frequency clothing deformation from image observations. Then, by introducing a normal-guided clothing fitting optimization, the normal maps are used to guide the clothing model to generate realistic wrinkles details. Finally, we utilize a clothing collar adjustment strategy to stylize clothing results using predicted clothing masks. An extended multi-view version of the clothing fitting is naturally developed, which can further improve the realism of the clothing without tedious effort. Extensive experiments have proven that our method achieves state-of-the-art clothing geometric accuracy and visual realism. More importantly, it is highly adaptable and robust to in-the-wild images. Further, our method can be easily extended to multi-view inputs to improve realism. In summary, our method can provide a low-cost and user-friendly solution to achieve realistic clothing modeling.