In this article, we propose Img2CAD, the first approach to our knowledge that uses 2-D image inputs to generate computer-aided design (CAD) models with editable parameters. Unlike existing artificial intelligence (AI) methods for 3-D model generation using text or image inputs often rely on mesh-based representations, which are incompatible with CAD tools and lack editability and fine control, Img2CAD enables seamless integration between AI-based 3-D reconstruction and CAD software. We have identified an innovative intermediate representation called structured visual geometry, characterized by vectorized wireframes extracted from objects. This representation significantly enhances the performance of generating conditioned CAD models. In addition, we introduce two new datasets to further support research in this area: a big cad model dataset (ABC)-mono, the largest known dataset comprising over 200 000 3-D CAD models with rendered images, and KOCAD, the first dataset featuring real-world captured objects alongside their ground truth CAD models, supporting further research in conditioned CAD model generation.
7 August 2024 in International Journal of Human–Computer Interaction
As it is high in value, extra virgin olive oil (EVOO) is frequently blended with inferior vegetable oils. This study presents an optical method for determining the adulteration level of EVOO with soybean oil as well as peanut oil using LED-induced fluorescence spectroscopy. Eight LEDs with central wavelengths from ultra-violet (UV) to blue are tested to induce the fluorescence spectra of EVOO, peanut oil, and soybean oil, and the UV LED of 372 nm is selected for further detection. Samples are prepared by mixing olive oil with different volume fractions of peanut or soybean oil, and their fluorescence spectra are collected. Different pre-processing and regression methods are utilized to build the prediction model, and good linearity is obtained between the predicted and actual adulteration concentration. This result, accompanied by the non-destruction and no pre-treatment characteristics, proves that it is feasible to use LED-induced fluorescence spectroscopy as a way to investigate the EVOO adulteration level, and paves the way for building a hand-hold device that can be applied to real market conditions in the future.
The development of the smartphone and computer vision technique provides customers with a convenient approach to identify tea species, as well as qualities. However, the prediction model may not behave robustly due to changes in illumination conditions. Fluorescence imaging can induce the fluorescence signal from typical components, and thus may improve the prediction accuracy. In this paper, a tea classification method based on fluorescence imaging and convolutional neural networks (CNN) is proposed. Ultra-violet (UV) LEDs with a central wavelength of 370 nm were utilized to induce the fluorescence of tea samples so that the fluorescence images could be captured. Five kinds of tea were included and pre-processed. Two CNN-based classification models, e.g., the VGG16 and ResNet-34, were utilized for model training. Images captured under the conventional fluorescent lamp were also tested for comparison. The results show that the accuracy of the classification model based on fluorescence images is better than those based on the white-light illumination images, and the performance of the VGG16 model is better than the ResNet-34 model in our case. The classification accuracy of fluorescence images reached 97.5%, which proves that the LED-induced fluorescence imaging technique is promising to use in our daily life.
A multi-channel light emitting diode (LED)-induced fluorescence system combined with a convolutional neural network (CNN) analytical method was proposed to classify the varieties of tea leaves. The fluorescence system was developed employing seven LEDs with spectra ranging from ultra-violet (UV) to blue as excitation light sources. The LEDs were lit up sequentially to induce a respective fluorescence spectrum, and their ability to excite fluorescence from components in tea leaves were investigated. All the spectral data were merged together to form a two-dimensional matrix and processed by a CNN model, which is famous for its strong ability in pattern recognition. Principal component analysis combined with k-nearest-neighbor classification was also employed as a baseline for comparison. Six grades of green tea, two types of black tea and one kind of white tea were verified. The result proved a significant improvement in accuracy and showed that the proposed system and methodology provides a fast, compact and robust approach for tea classification.
25 October 2023 in IEEE Transactions on Multimedia
The emerging trend of AR/VR places great demands on 3D content. However, most existing software requires expertise and is difficult for novice users to use. In this paper, we aim to create sketch-based modeling tools for user-friendly 3D modeling. We introduce Reality3DSketch with a novel application of an immersive 3D modeling experience, in which a user can capture the surrounding scene using a monocular RGB camera and can draw a single sketch of an object in the real-time reconstructed 3D scene. A 3D object is generated and placed in the desired location, enabled by our novel neural network with the input of a single sketch. Our neural network can predict the pose of a drawing and can turn a single sketch into a 3D model with view and structural awareness, which addresses the challenge of sparse sketch input and view ambiguity. We conducted extensive experiments synthetic and real-world datasets and achieved state-of-the-art (SOTA) results in both sketch view estimation and 3D modeling performance. According to our user study, our method of performing 3D modeling in a scene is $>$ 5x faster than conventional methods. Users are also more satisfied with the generated 3D model than the results of existing methods.