Nowadays, a pedestrian navigation system using a smartphone has become popular as a useful tool to reach an unknown destination. When the destination is the office of a person, a detailed map information is necessary on the target area such as the room number and location inside the building. The information can be collected from various sources including Google maps, websites for the building, and images of signs. In this paper, we propose a map information collection tool for a pedestrian navigation system. To improve the accuracy and completeness of information, it works with the four steps: (1) a user captures building and room images manually, (2) an OCR software using Google ML Kit v2 processes them to extract the sign information from images, (3) web scraping using Scrapy (v2.11.0) and crawling with Apache Nutch (v1.19) software collects additional details such as room numbers, facilities, and occupants from relevant websites, and (4) the collected data is stored in the database to be integrated with a pedestrian navigation system. For evaluations of the proposed tool, the map information was collected for 10 buildings at Okayama University, Japan, a representative environment combining complex indoor layouts (e.g., interconnected corridors, multi-floor facilities) and high pedestrian traffic, which are critical for testing real-world navigation challenges. The collected data is assessed in completeness and effectiveness. A university campus was selected as it presents a complex indoor and outdoor environment that can be ideal for testing pedestrian navigations in real-world scenarios. With the obtained map information, 10 users used the navigation system to successfully reach destinations. The System Usability Scale (SUS) results through a questionnaire confirms the high usability.

The Internet of Things (IoT) technology has grown rapidly over the past decade, resulting in deployments of thousands of IoT devices around the world. Then, managing firmware updates for these numerous devices poses significant challenges. Firmware updates face issues such as version rollback, modified firmware files, and potential man-in-the-middle (MITM) attacks, highlighting the need for a secure over-the-air (OTA) firmware update mechanism. In this paper, we propose an automated OTA firmware update mechanism, integrated with continuous integration (CI) and continuous delivery (CD) to ensure trusted sources for firmware origins. It offers security, error handling during firmware updates, and monitoring of the update process. For evaluations, we implemented the proposal with the SEMAR IoT application server that has been implemented in our previous studies. Then, we verified the integrity and authentication, measured the performance and resource utilization, and performed benchmarking tests to assess the efficiency. The results demonstrate that the proposal is sufficiently reliable and efficient.

Nowadays, Internet of Things (IoT) application systems play an essential role in smart cities, industry, healthcare, agriculture, and smart homes. For non-expert users, designing and implementing IoT application systems remains challenging, especially when configuring sensors, edge devices, and server platforms. To support configuration tasks of IoT application systems, we have developed an AI-based setup assistance tool. However, AI models still fail to reliably support newly released or previously unseen devices, sometimes producing incomplete or erroneous outputs that may lead to configuration failures. Incorporating their technical-document information into Retrieval-Augmented Generation (RAG) is an effective way to supplement AI knowledge and improve reliability. In this paper, we propose a generative AI-based technical data extraction tool to address the challenges. It extracts essential technical information using the schema-based extraction from given PDF or HTML datasheets and converts it into a structured format suitable for AI-supported configurations. A local vector database is used to enable semantic similarity retrieval and provide document-grounded evidence for RAG-based answering, ensuring consistent support for previously unseen IoT devices. For evaluations, we applied the proposal to several sensor and device datasheets and compared extracted specifications with ground-truth values to measure accuracy and completeness. Then, we compared end-to-end configuration QA reliability against a commercial baseline (ChatPDF) using the golden benchmark. The results show that the proposed tool reliably acquires key specifications and significantly improves end-to-end configuration QA reliability. Across 960 golden QA pairs, the proposed method improves Recall from 0.636 to 0.926 and Accuracy from 0.595 to 0.807 compared with ChatPDF.

In recent years, Location-Based Augmented Reality (LAR) systems have been increasingly implemented in various applications for tourism, navigation, education, and entertainment. Unfortunately, the LAR content creation using conventional desktop-based authoring tools has become a bottleneck, as it requires time-consuming and skilled work. Previously, we proposed an in-situ mobile authoring tool as an efficient solution to this problem by offering direct authoring interactions in real-world environments using a smartphone. Currently, the evaluation through the comparison between the proposal and conventional ones is not sufficient to show superiority, particularly in terms of interaction, authoring performance, and cognitive workload, where our tool uses 6DoF device movement for spatial input, while desktop ones rely on mouse-pointing. In this paper, we present a comparative study of authoring performances between the tools across three authoring phases: (1) Point of Interest (POI) location acquisition, (2) AR object creation, and (3) AR object registration. For the conventional tool, we adopt Unity and ARCore SDK. As a real-world application, we target the LAR content creation for pedestrian landmark annotation across campus environments at Okayama University, Japan, and Brawijaya University, Indonesia, and identify task-level bottlenecks in both tools. In our experiments, we asked 20 participants aged 22 to 35 with different LAR development experiences to complete equivalent authoring tasks in an outdoor campus environment, creating various LAR contents. We measured task completion time, phase-wise contribution, and cognitive workload using NASA-TLX. The results show that our tool made faster creations with 60% lower cognitive loads, where the desktop tool required higher mental efforts with manual data input and object verifications.

With the rapid growth of online presentations, there has been an increasing need for efficient review of recorded materials. In typical presentations, speakers verbally elaborate on each slide, providing details not captured in the slides themselves. Automatically extracting and embedding these verbal explanations at their corresponding slide locations can greatly enhance the review process for audiences. This paper presents a Slide Annotation System that employs a robust hybrid two-stage detector to identify slide boundaries, extracts slide text through Optical Character Recognition (OCR), transcribes narration, and employs a multimodal Large Language Model (LLM) to generate concise, context-aware annotations that are added to their corresponding slide locations. For evaluations, the technical performance was validated on five recorded presentations, while the user experience was assessed by 37 participants. The results showed that the system achieved a macro-average $F_1$ score of 0.879 ($SD=0.024$, 95% $CI[0.849,0.909]$) for slide segmentation and 90.0% accuracy (95% $CI[74.4\%,96.5\%]$) for annotation alignment. Subjective evaluations revealed high annotation validity and usefulness as rated by presenters, and a high System Usability Scale (SUS) score of 80.5 ($SD=6.7$, 95% $CI[78.3,82.7]$). Qualitative feedback further confirmed that the system effectively streamlined the review process, enabling users to locate key information more efficiently than standard video playback. These findings demonstrate the strong potential of the proposed system as an effective automated annotation system.

Mastering client-side Web programming is essential for the development of responsive and interactive Web applications. To support novice students’ self-study, in this paper, we propose a novel exercise format called the phrase fill-in-blank problem (PFP) in the Web Programming Learning Assistant System (WPLAS). A PFP instance presents a source code with blanked phrases (a set of elements) and corresponding Web page screenshots. Then, it requests the user to fill in the blanks, and the answers are automatically evaluated through string matching with predefined correct answers. By increasing blanks, PFP can come close to writing a code from scratch. To facilitate scalable and context-aware question creation, we implemented the PFP instance generation algorithm in Python using regular expressions. This approach targets meaningful code segments in HTML, CSS, and JavaScript that reflect the interactive behavior of front-end development. For evaluations, we generated 10 PFP instances for basic Web programming topics and 5 instances for video games and assigned them to students at Okayama University, Japan, and the State Polytechnic of Malang, Indonesia. Their solution results show that most students could solve them correctly, indicating the effectiveness and accessibility of the generated instances. In addition, we investigated the ability of generative AI, specifically ChatGPT, to solve the PFP instances. The results show 86.7% accuracy for basic-topic PFP instances. Although it still cannot fully find answers, we must monitor progress carefully. In future work, we will enhance PFP in WPLAS to handle non-unique answers by improving answer validation for flexible recognition of equivalent responses.