Recently, severe environmental changes, such as global warming, climate change and environmental pollution, have become expected, and thus environmental education is becoming essential. The purpose of environmental education is to instill awareness in students to recognize and solve environmental problems. Virtual reality provides students with a spatial and temporal experience similar to reality, and it can increase their understanding of knowledge through immersion and interaction compared to traditional learning. In previous studies, virtual reality for education has mainly focused on experience, but it is difficult to find examples for environmental education. Hence, this research proposed an immersive virtual reality simulation for environmental education based on the virtual ecosystem model. It also presented two applications developed based on this simulation. This research aims at encouraging students’ active participation and motivation to solve the environmental problems while experiencing the results of interaction related to environmental factors in a virtual environment.
Human Action Recognition (HAR) is an important field that identifies human behavior through sensor data. Three-dimensional human skeleton data extracted from the Kinect depth sensor have emerged as a powerful alternative to mitigate the effects of lighting and occlusion of traditional 2D RGB or grayscale image-based HAR. Data augmentation is a key technique to enhance model generalization and robustness in deep learning while suppressing overfitting to training data. In this paper, we conduct a comprehensive study of various data augmentation techniques specific to skeletal data, which aim to improve the accuracy of deep learning models. These augmentation methods include spatial augmentation, which generates augmented samples from the original 3D skeleton sequence, and temporal augmentation, which is designed to capture subtle temporal changes in motion. The evaluation covers two publicly available datasets and a proprietary dataset and employs three neural network models. The results highlight the impact of temporal augmentation on model performance on the skeleton datasets, while exhibiting the nuanced impact of spatial augmentation. The findings underscore the importance of tailoring augmentation strategies to specific dataset characteristics and actions, providing novel perspectives for model selection in skeleton-based human action recognition tasks.
A cultural heritage augmented reality system overlays virtual information onto real-world heritage sites, enabling intuitive exploration and interpretation with spatial and temporal contexts. This study presents the design and implementation of a cognitive Mobile Augmented Reality (MAR) system that integrates KCHDM-based ontologies with large language models (LLMs) to facilitate intelligent exploration of urban heritage. While conventional AR guides often rely on static data, our system introduces a Semantic Retrieval-Augmented Generation (RAG) pipeline anchored in a structured knowledge base modeled after the Korean Cultural Heritage Data Model (KCHDM). This architecture enables the LLM to perform dynamic contextual reasoning, transforming heritage data into adaptive question-answering (Q&A) and interactive knowledge-testing quizzes that are precisely grounded in both historical and spatial contexts. The system supports on-site AR exploration and map-based remote exploration to ensure robust usability and precise spatial alignment of virtual content. To deliver a rich, multisensory experience, the system provides multimodal outputs, integrating text, images, models, and audio narration. Furthermore, the integration of a knowledge sharing repository allows users to review and learn from others’ inquires. This ontology-driven LLM-integrated MAR design enhances semantic accuracy and contextual relevance, demonstrating the potential of MAR for socially enriched urban heritage experiences.
30 July 2010 in The Journal of the Korean Institute of Information and Communication Engineering
Exercise can help to improve health, strengthen vitality and prevent brain disease, especially for the elderly. Exercise games, or exergames, which combine both exercise and video gaming, train people in a fun and competitive manner to lead a healthy lifestyle. Exergames promote more physical effort and have the potential to contribute to physical education. This research presents a full-body virtual reality exercise game called the Chongchong Step Master, which is designed to improve gait and balance function and prevent dementia in the elderly. This system used Kinect sensors to accurately recognize the user’s body movements and the stepping board mat to recognize and guide the user’s walking motion. It aims to help the elderly exercise more easily and independently with the virtual physical trainer.
Extended Reality (XR) is increasingly used to support learning experiences in cultural heritage education, but how learners interact with XR content—rather than the sophistication of the underlying technology—can meaningfully shape the quality of the learning experience. This study investigates the effects of interaction structure on cultural heritage learning in XR. A HoloLens 2 XR application for Gyeongbokgung Palace was developed using three interaction conditions: Information-Presentation (Text+Image), Inquiry-Based Exploration (QA), and Assessment-Participation (Quiz). All content was pre-generated using a Large Language Model (LLM) to hold information constant across conditions, ensuring that any observed differences in user experience could be attributed to interaction structure rather than to content. Participants experienced all three interaction types in a partially counterbalanced order, and their interest, immersion, ease of use, perceived learning comprehension, intention to reuse, and perceived difficulty were assessed. The results revealed distinct strengths for each interaction structure. Quiz generated higher preference for interest and immersion, but was also rated the most cognitively demanding condition. Text+Image achieved the highest ease-of-use ratings. QA received the numerically highest preference for perceived learning comprehension, but the difference across conditions was not statistically significant, indicating that this study did not detect a reliable preference difference on this dimension. Within this single-site, single-device study, these findings indicate that interaction structure was associated with systematically different user experience profiles, even when the underlying content was held constant. The study provides design implications for structuring interaction in cultural heritage XR learning environments.