20 January 2012 in Chinese Journal of Mechanical Engineering
6 June 2023 in IEEE Transactions on Mobile Computing
The “mind-controlling” capability has always been in mankind's fantasy. With the recent advancements in electroencephalograph (EEG) techniques, brain-computer interface (BCI) researchers have explored some solutions to allow individuals to perform various tasks using their minds. However, the commercial off-the-shelf devices to run accurate EEG signal collection are usually expensive and the comparably cheaper devices can only present coarse results, which prevents the practical application of these devices in domestic services. To tackle this challenge, we propose and develop an end-to-end solution that enables fine brain-robot interaction (BRI) through embedded learning of coarse EEG signals from low-cost devices, namely PerBCI, so that people having difficulty moving, such as the elderly, can mind command and control a robot to perform some basic household tasks. Our contributions are three folds: 1) We present a stacked long short-term memory (BiLSTM) structure, along with specific pre-processing techniques to handle the time-dependency of EEG signals and their classification. 2) We propose a personalized design to adaptively capture multiple features and achieve accurate recognition of individual EEG signals by enhancing the signal interpretation of BiLSTM with an attention mechanism. 3) We develop a low-cost, real-time and end-to-end BRI system that can run our PerBCI models and algorithms in the embedded robot platform to perform more than one type of domestic task based on the users' EEG signal inputs. Our real-world experiments with elderly participants of diverse backgrounds in a home setting and system comparison with other approaches show that the proposed end-to-end solution with low cost can achieve satisfactory run-time speed, accuracy and energy-efficiency.
7 November 2024 in Proceedings of the ACM on Human-Computer Interaction
Collaboration can amalgamate diverse ideas, styles, and visual elements, fostering creativity and innovation among different designers. In collaborative design, sketches play a pivotal role as a means of expressing design creativity. However, designers often tend to not openly share these meticulously crafted sketches. This phenomenon of data island in the design area hinders its digital transformation under the third wave of AI. In this paper, we introduce a Federated Generative Artificial Intelligence Clothing system, namely StyleWe, employing federated learning to aid in sketch design. StyleWe is committed to establishing an ecosystem wherein designers can exchange sketch styles among themselves. Through StyleWe, designers can generate sketches that incorporate various designers' styles from their peers, drawing inspiration from collaboration without the need for data disclosure or upload. Extensive performance evaluations and user studies indicate that our StyleWe system can produce multi-styled sketches of comparable quality to human-designed ones while significantly enhancing efficiency compared to hand-drawn sketches.
1 July 1998 in Chinese Physics Letters
1 November 2026 in IEEE Transactions on Artificial Intelligence