26 April 2021 in IEEE Open Journal of the Computer Society
Human collaboration has a great impact on the performance of multi-person activities. The analysis of speaker information and speech timing can be used to extract human collaboration data in detail. Some studies have extracted human collaboration data by identifying a speaker with business-card-type sensors. However, it is difficult to realize speaker identification for business-card-type sensors at low cost and high accuracy because of spikes in the measured sound pressure data, ambient noise in the non-speaker sensor, and synchronization errors across each sensor. This study proposes a novel sound pressure sensor and speaker identification algorithm to realize speaker identification for business-card-type sensors. The sensor extracts the user's speech at low cost and high accuracy by employing a peak hold circuit and time synchronization module for spike mitigation and precise time synchronization. The algorithm identifies a speaker with high accuracy by removing ambient noise. The evaluations show that the algorithm accurately identifies a speaker in a multi-person activity considering varying numbers of users, environmental noises, and reverberation conditions as well as long or short utterances. In addition, the peak hold circuit enables accurate extraction of speech and the synchronization error between the sensors is always within ±30 μs, that is, negligible error.
16 November 2022 in IEEE Access
Collaborative learning is an educational approach to teaching and learning that involves groups of learners collaborating to solve a problem, complete a task, or create a product. To enhance the performance of collaborative learning, the studies in [1]–[4] develop an IoT system and quantitatively extract collaboration between learners. The studies acquire sensor data from IoT badges on learners and analyze learning activities with the acquired sensor data on a computer. However, existing studies are not user-friendly for learning analysts who are unfamiliar with information technology owing to complex software installation and command line interface (CLI) operation. Such drawbacks hinder the wide expansion of technology and the exploration of new learning patterns in learning science. Considering high usability for analysts, this paper proposes novel web services named Sensor-based Regulation Profiler Web Services (SRP Web Services) for collaboration analysis with IoT badges. The proposed web application consists of front-end on Next.js and back-end on FastAPI, SQLite, and Python and extracts key points in learning activities for the analysts from the acquired sensor data on a web browser. Experimental evaluations showed that the proposed web services support learning analysts in quantitative analysis of learning activities with high usability. In addition, SRP Web Services are scalable with hundreds of users.
1 January 2022 in Journal of Information Processing
Collaborative learning practices foster the ability to solve creative problems in collaboration with other learners. The collaboration enables learners to learn new ideas from other learners and enhances the social ability of the learners through interaction with other learners. Although the learning science field now uses qualitative analysis to analyze the effects of the collaborative discourse, qualitative analysis requires much human and time costs to analyze the collaborative discourse with dozens of students. This study proposes Sensor-based Regulation Profiler to reduce the analysis costs. The proposed scheme consists of the business card-type sensors that acquire sensor data from each learner with a precise time synchronization as well as learning analysis methods that analyze the collaborative discourse from the acquired sensor data. Experimental evaluations using the proposed scheme showed that the proposed business card-type sensors realized a time synchronization error of 7.7µs on average across the sensors. In addition, the proposed learning analysis could extract and visualize the collaborative activity of each learner in the collaborative discourse through the social graph extraction, learning phase extraction, speaker identification, and activity estimation by using the sensor data from the proposed business card-type sensors.