Technological developments have a positive impact on humans to improve their abilities in line with innovations in the field of education which are increasing day by day. One of them is by increasing intelligence through collaboration between humans and technology called augmented intelligence. In this study augmented intelligence is applied to assist humans in studying human anatomy by utilizing augmented reality technology to perform motion tracking that can control 3D assets to follow it. The anatomy learning platform that was built was named AIVE (Artificial Intelligence on Virtual Education) with an architectural system consisting of a frontend for interface needs and AR platform development, there is also a backend for streaming databases and AI algorithms. Measurement of satisfaction and interest based on the PIECES framework is also carried out to determine the user’s response to the platform being built. The results show a satisfaction level of 4.12 and an interest of 4.10 which means that users are satisfied and interested in the human anatomy tracking platform that is accessed via smartphones.
To enhance user experiences of reaching destinations in large, complex buildings, we have developed a indoor navigation system using Unity and a smartphone called INSUS. It can reset the user location using a quick response (QR) code to reduce the loss of direction of the user during navigation. However, this approach needs a number of QR code sheets to be prepared in the field, causing extra loads at implementation. In this paper, we propose another reset method to reduce loads by recognizing information of naturally installed signs in the field using object detection and Optical Character Recognition (OCR) technologies. A lot of signs exist in a building, containing texts such as room numbers, room names, and floor numbers. In the proposal, the Sign Image is taken with a smartphone, the sign is detected by YOLOv8, the text inside the sign is recognized by PaddleOCR, and it is compared with each record in the Room Database using Levenshtein distance. For evaluations, we applied the proposal in two buildings in Okayama University, Japan. The results show that YOLOv8 achieved mAP@0.5 and mAP@0.5:0.95 , and PaddleOCR could extract text in the sign image accurately with an averaged CER% lower than 10%. The combination of both YOLOv8 and PaddleOCR decreases the execution time by compared to the previous method. The results confirmed the effectiveness of the proposal.
Nowadays, dried Moringa leaves (M. oleifera) are increasingly in demand due to their health benefits. High-quality ones have shown remarkable positive effects as antioxidants, antidiabetics, and anti-inflammatory agents. However, in the industry, the quality classification process into six categories is performed manually by farmers, which is time-consuming and error-prone. Particularly, the two highest categories of Class A and Class B are hard to distinguish, since they are visually similar. In this paper, to automate the classification process, we introduce a new high-resolution dataset, extract color and texture features using the Gray-Level Co-occurrence Matrix (GLCM) method, and present a two-stage classification method using the Light Gradient Boosting Machine (LightGBM) algorithm with them. The experimental results show that the proposal improved classification accuracy from 82% by the baseline algorithm to 90% while maintaining high processing efficiency, demonstrating its potential for real-time and scalable industrial applications in dried Moringa leaves quality grading.
An indoor navigation system helps users seamlessly navigate in complex buildings. Previously, we implemented the Indoor Navigation System using Unity and Smartphones (INSUS), where we employed QR code for accurate user positioning. However, a lot of QR code sheets need to be placed in the designated area to improve accuracy. To solve this problem, text information that is recognized by an Optical Character Recognition (OCR) software, such as room numbers, resident names, and floor levels in buildings can be used to recognize the current user position. In this paper, we propose an OCR-based user positioning method in INSUS. The text information is compared with the reference data stored in the database. To verify the performance of the proposal, we conducted a series of experiments involving various OCR models, view angles, and brightness levels. The results show that PaddleOCR achieves the average accuracy of 90.31% for various brightness levels and of 95% for different viewing angles.
Currently, we are studying a meeting note generation system to automatically make a note from voice records. Previously, we implemented the first function of the system to convert voice records to texts using the Whisper model. However, the current implementation suffers from a lack of coherency due to the vast text from audio. Therefore summary and keywords should be derived from the text to improve comprehension. In this paper, we propose the second function of the system to make summaries and extract keywords from texts. The BART model is used to generate human-like summaries from the semantic idea of texts. The keyword extraction method ranks the importance of each word or phrase in texts. For evaluations, we apply the proposal to three voice records with varied durations and compare the generated summary and keywords with manually made ones. The results show that for the summary, the average ROUGE-1 is 50.02%, ROUGE-2 is 24.04%, and ROUGE-L is 43.14%, and for keywords, the average cosine similarity is 54.09%. Thus, the validity of the proposal is confirmed. In future works, we will focus on incorporating additional methods to extract the memo from audio and text from the documents.
With the increasing use of online meetings, there is a growing need for efficient tools that can automatically generate meeting minutes from recorded sessions. Current solutions often rely on proprietary systems, limiting adaptability and flexibility. This paper investigates whether various open-source models and methods such as audio-to-text conversion, summarization, keyword extraction, and optical character recognition (OCR) can be integrated to create a meeting minutes generation tool for recorded video presentations. For this purpose, a series of evaluations are conducted to identify suitable models. Then, the models are integrated into a system that is modular yet accurate. The utilization of an open-source approach ensures that the tool remains accessible and adaptable to the latest innovations, thereby ensuring continuous improvement over time. Furthermore, this approach also benefits organizations and individuals by providing a cost-effective and flexible alternative. This work contributes to creating a modular and easily extensible open-source framework that integrates several advanced technologies and future new models into a cohesive system. The system was evaluated on ten videos created under controlled conditions, which may not fully represent typical online presentation recordings. It showed strong performance in audio-to-text conversion with a low word-error rate. Summarization and keyword extraction were functional but showed room for improvement in terms of precision and relevance, as gathered from the users’ feedback. These results confirm the system’s effectiveness and efficiency in generating usable meeting minutes from recorded presentation videos, with room for improvement in future works.