Mental health problems are an increasingly common social issue severely affecting health and well-being. Multimedia processing technologies via facial expression show appealing prospects in the consumer field for mental health monitoring, while still suffer from intensive computation and low energy efficiency. This paper proposes an energy-efficiency memristive sequencer network (EMSN) for human emotion classification, which offers an environmentally friendly approach for consumers with low cost and easily deployable hardware. Firstly, two-dimensional (2D) materials are employed to construct an eco-friendly memristor, the efficacy and reliability of which are confirmed through performance testing. Then, a sequencer block is proposed using memristive circuits. Notably, it is a core component of the EMSN, consisting of a bidirectional long short-term memory circuit, normalisation circuit module, and multi-layer perception module. After combining some necessary function modules, the EMSN can be achieved. Furthermore, the proposed EMSN is applied for human emotion classification. The experimental results demonstrate that the proposed EMSN has advantages in computational efficiency and classification accuracy compared to existing mainstream methods, indicating an advancement in consumer health monitoring.

Video sentiment analysis can effectively establish the relationship between the emotion state and the multimodal information, while still suffer from intensive computation and low efficiency, due to the von Neumann computing architecture. Here, we present a brain-inspired hierarchical interactive in-memory computing (IMC) system, which can efficiently solve ‘von Neumann bottleneck’, enabling cross-modal interactions and semantic gap elimination. First, a 1T1M synapse array is fabricated using cost-effective, highly stable, flexible, and eco-friendly carbon materials, offering efficient analog multiply-accumulate operations. To illustrate the complexity of the proposed brain-inspired hierarchical interactive IMC system, three modules are proposed: 1) unimodal extraction module, 2) hierarchical interactive module, 3) output module. Furthermore, the proposed system is validated by applying it to video sentiment analysis. The experimental results demonstrate that the proposed system outperforms the existing state-of-the-art methods with high computational efficiency and good robustness. This work opens up a new way to achieve the deep integration of nanomaterials, deep learning, and modern electronics into IMC.

Accuracy and speed of Lithium-ion battery state of charge (SOC) estimation determine the reliability and stability of electric vehicle (EV), as well as promoting the development of smart home energy management system. Existing SOC estimation approaches embedded in commercial EVs still suffer from limitations of low precision, effectiveness, and relatively low robustness. To address these issues, we propose an internal cascaded neuromorphic computing system (ICNCS) via memristor circuits for EV SOC estimation. Specifically, we use three circuit modules to facilitate the design of the proposed ICNCS. Firstly, a bidirectional gated recurrent unit (Bi-GRU) circuit module is designed, enabling adequate feature extraction from the time-contextual battery information. Secondly, an attention circuit module is proposed to distinguish the useful and unimportant information related to SOC estimation. Thirdly, the Kalman filter module is constructed to eliminate the random noise caused by data transmission and processing. Finally, a series of experiments and analysis demonstrate that the proposed ICNCS has good performances in terms of accuracy (the lowest achievable RMSE and MAE are 0.853 and 0.711, respectively), time efficiency (approximately 16 20 times), and robustness (anti-noise capacity), indicating an advancement in consumer electronics applications.

Traffic sign detection is of great significance to the development of the Intelligent Transportation System (ITS) as a database for environmental awareness. The main challenges of existing traffic sign detection method are inaccurate small object detection, difficult mobile deployment, and complex working environment. Based on these, a vehicle-mounted adaptive traffic sign detector (VATSD) for small-sized signs in multiple working conditions is proposed in this paper. First, the Backbone of the detector is optimized. A feature tight fusion structure is designed to constitute a new feature extraction module, DCSP, which improves the feature extraction capability and the detection accuracy of small objects with negligible additional parameters. Second, an image enhancement network IENet with an adaptive joint filtering strategy is proposed. The IENet enables the dynamic selection of filters and thus adaptively optimizes low-quality images under multiple conditions to improve the accuracy of subsequent detection tasks. The proposed method has experimented on three traffic sign datasets and the detection accuracy increased by up to 7.6% compared to the original. The proposed detector demonstrates superiority over other state-of-the-art (SOTA) methods in terms of small object detection accuracy, detection speed, and environmental adaptability. Further, we deployed VATSD to Jetson Xavier NX and achieved a detection speed of 21.6 FPS, meeting real-time requirements.

We present a circuit design of the hierarchical attention network for multimodal affective computing, which can be used in mental health monitoring. Specifically, a kind of cost-effective memristor is fabricated using the albumen protein, and the corresponding testing performance is conducted to ensure its efficiency and stability. Then, considering the hierarchical mechanism inspired by the human limbic system, the nanoscale memristors arranged in a crossbar array configuration are further applied to construct a compact hierarchical attention network that can perform the multimodal affective computing. Furthermore, based on the wearable technology and flexible electronics technology, a mental health monitoring system with low privacy invasiveness, low energy consumption, and low fabrication cost can be designed. Based on the mapping relationship between the multimodal affective computing and mental health, the mental health state of the current user can be monitored. This study is expected to help achieving the deep integration of neuromorphic electronics and mental health monitoring system, further promoting the development of next-generation consumer healthcare technology in smart city.

With the rapid adoption of Internet of Things (IoT) and artificial intelligence (AI), lithium-ion battery state-of-health (SOH) estimation plays an important role in guaranteeing the secure and stable functioning of various domains. However, the majority of the existing methods are constrained by factors, such as transmission latency, computational energy, and computing speed. To address these challenges, we develop a time-frequency hybrid neuromorphic computing architecture for battery SOH estimation. Specifically, an eco-friendly, biodegradable memristor crossbar array is designed, enabling high-energy efficiency and high-performance density in the proposed system. To improve the understanding of the designed time-frequency hybrid neuromorphic computing system, a local information extraction module, a time-frequency feature fusion module, and a global information perception module are proposed. Furthermore, the proposed system is validated on two publicly available battery ageing data sets (i.e., the CALCE-CS2 data set and the National Aeronautics and Space Administration data set). The experimental results show that the system exhibits superior performance to that of the state-of-the-art (SOTA) methods in terms of estimation accuracy (highest estimation accuracy), time consumption (approximately 8–12 times faster), and transmission latency (approximately 10 times faster). This study is expected to promote the advancement and evolution of next-generation computing systems, enabling the realization of low-power consumption and high-density information processing in IoT scenarios.