Nowadays, Internet of Things (IoT) application systems play an essential role in smart cities, industry, healthcare, agriculture, and smart homes. For non-expert users, designing and implementing IoT application systems remains challenging, especially when configuring sensors, edge devices, and server platforms. To support configuration tasks of IoT application systems, we have developed an AI-based setup assistance tool. However, AI models still fail to reliably support newly released or previously unseen devices, sometimes producing incomplete or erroneous outputs that may lead to configuration failures. Incorporating their technical-document information into Retrieval-Augmented Generation (RAG) is an effective way to supplement AI knowledge and improve reliability. In this paper, we propose a generative AI-based technical data extraction tool to address the challenges. It extracts essential technical information using the schema-based extraction from given PDF or HTML datasheets and converts it into a structured format suitable for AI-supported configurations. A local vector database is used to enable semantic similarity retrieval and provide document-grounded evidence for RAG-based answering, ensuring consistent support for previously unseen IoT devices. For evaluations, we applied the proposal to several sensor and device datasheets and compared extracted specifications with ground-truth values to measure accuracy and completeness. Then, we compared end-to-end configuration QA reliability against a commercial baseline (ChatPDF) using the golden benchmark. The results show that the proposed tool reliably acquires key specifications and significantly improves end-to-end configuration QA reliability. Across 960 golden QA pairs, the proposed method improves Recall from 0.636 to 0.926 and Accuracy from 0.595 to 0.807 compared with ChatPDF.

Presently, Java is a fundamental object-oriented programming language that can be mastered by any student in information technology or computer science. To assist both teachers and students, we developed the Java Programming Learning Assistant System (JPLAS). It offers several types of practice problems with different levels and learning goals for step-by-step self-study, where any answer is automatically marked in the system. One challenge for teachers that is addressed with JPLAS is the generation of proper exercise problems that meet learning requirements. We implemented programs for generating new problems from given source codes, as collecting and evaluating suitable codes remains time-consuming. In this paper, we present an automatic code generation tool using generative AI to solve this challenge. Prompt engineering is used to help generate an appropriate source code, and the quality is controlled by optimizing the prompt based on the outputs. For applications in JPLAS, we implement a web application system to automatically generate an element fill-in-the-blank problem (EFP) in JPLAS. For evaluation, we select the element fill-in-the-blank problem (EFP) as the target type in JPLAS and generate several instances using this tool. The results confirm the validity and effectiveness of the proposed method.

With rapid developments of wireless communication and Internet of Things (IoT) technologies, an increasing number of devices and sensors are interconnected, generating massive amounts of data in real time. Among the underlying protocols, Message Queuing Telemetry Transport (MQTT) has become a widely adopted lightweight publish–subscribe standard due to its simplicity, minimal overhead, and scalability. Then, understanding such protocols is essential for students and engineers engaging in IoT application system designs. However, teaching and learning MQTT remains challenging for them. Its asynchronous architecture, hierarchical topic structure, and constituting concepts such as retained messages, Quality of Service (QoS) levels, and wildcard subscriptions are often difficult for beginners. Moreover, traditional learning resources emphasize theory and provide limited hands-on guidance, leading to a steep learning curve. To address these challenges, we propose an AI-assisted, exercise-based learning platform for MQTT. This platform provides interactive exercises with intelligent feedback to bridge the gap between theory and practice. To lower the barrier for learners, all code examples for executing MQTT communication are implemented in Python for readability, and Docker is used to ensure portable deployments of the MQTT broker and AI assistant. For evaluations, we conducted a usability study using two groups. The first group, who has no prior experience, focused on fundamental concepts with AI-guided exercises. The second group, who has relevant background, engaged in advanced projects to apply and reinforce their knowledge. The results show that the proposed platform supports learners at different levels, reduces frustrations, and improves both engagement and efficiency.

Today, relational databases are widely used in information systems. SQL (structured query language) is taught extensively in universities and professional schools across the globe as a programming language for its data management and accesses. Previously, we have studied a web-based programming learning assistant system (PLAS) to help novice students learn popular programming languages by themselves through solving various types of exercises. For SQL programming, we have implemented the grammar-concept understanding problem (GUP) and the comment insertion problem (CIP) for its initial studies. In this paper, we propose an SQL Query Description Problem (SDP) as a new exercise type for describing the SQL query to a specified request in a MySQL database system. To reduce teachers’ preparation workloads, we integrate a generative AI-assisted SQL query generator to automatically generate a new SDP instance with a given dataset. An SDP instance consists of a table, a set of questions and corresponding queries. Answer correctness is determined by enhanced string matching against an answer module that includes multiple semantically equivalent canonical queries. For evaluation, we generated 11 SDP instances on basic topics using the generator, where we found that Gemini 3.0 Pro exhibited higher pedagogical consistency compared to ChatGPT-5.0, achieving perfect scores in Sensibleness, Topicality, and Readiness metrics. Then, we assigned the generated instances to 32 undergraduate students at the Indonesian Institute of Business and Technology (INSTIKI). The results showed an average correct answer rate of 95.2% and a mean SUS score of 78, which demonstrates strong initial student performance and system acceptance.

Internet of Things (IoT) application systems are increasingly adopted in factories, shops, offices, and governments. However, building such systems using various devices and modules remains difficult for non-experts, because they must confirm specifications, communication interfaces, voltage ranges, and operating conditions from technical datasheets before connecting devices. In previous studies, we have explored a generative AI-based answering tool for datasheet inquiry using Retrieval-Augmented Generation (RAG) for technical guidance of IoT application system deployment. However, the adopted top-kRAG pipeline often retrieves multiple related text chunks, which can cause the AI to confuse technically different specifications, such as power output voltage, signal output voltage, and input voltage range, and produce inaccurate answers. In addition, the AI may generate a hallucinated answer if the datasheet does not provide sufficient source information. In this paper, we propose an AI answer-validation method using agentic RAG for datasheet inquiry for IoT application system deployment. The method organizes datasheet information into structured specification data, including device models, field types, values, units, conditions, and source information. For question-answering, the agent coordinates structured fact query, top-k text retrieval, source checking, and rule-based compatibility comparison according to the question type. Instead of fully relying on the LLM to interpret retrieved chunks, this method adopts structured specifications and deterministic source checks before accepting the final answer. For evaluation, we constructed a dataset from 20 IoT datasheets, including 1000 question-answering tasks with three difficulty levels. Compared with conventional top-k RAG, the proposed method improved the correct answer rate from 0.686 to 0.958 for easy questions, from 0.549 to 0.969 for medium questions, and from 0.273 to 0.613 for hard questions, which confirms the effectiveness of the proposed method.

Nowadays, Python is very popular as the first programming language for novices, including high school students, to learn due to its short code features with rich libraries. Thus, it is important to provide a learning environment supporting studies starting from the fundamentals, since students have no knowledge on how a program runs on a computer. Previously, we have developed a web-based programming learning assistant system (PLAS) to allow the self-study of major programming languages, including Python, by university students. It offers several types of exercise problems that have different learning goals and levels for step-by-step study. Any student answer is automatically marked at the answer interface for quick feedback. However, PLAS has not implemented functions to assist the learning needs of high school-level students. In this paper, we propose a novice-friendly answer interface for a Python programming learning assistant system (PyPLAS) that introduces a code behavior visualization and an AI assistant with learning logs. The visualization allows learners to observe the changes in variable states and the control flow. The assistant provides multi-level hints during learning and reflective feedback after it by analyzing the logs based on engagement, reasoning strategies, learning pace, and tool usage. For evaluation, we implemented the proposed interface using Python Flask for the web platform and Ollama as a locally deployed AI model. A pilot application was conducted with high school students solving introductory Python exercises in PyPLAS. The results showed high task completion, positive questionnaire responses toward embedded visualization and interface usability, and teacher-observed usefulness of the four-dimensional learning analytics for interpreting learner behaviors. These findings provide preliminary evidence for the feasibility and practical value of the proposed interface, while larger controlled studies are required to validate its instructional effectiveness.