With the rapid development of artificial intelligence (AI) theory, particularly deep learning neural networks, robot vacuums equipped with AI power can automatically clean indoor floors by using intelligent programming and vacuuming services. To date, several deep AI models have been proposed to distinguish indoor objects between cleanable litter and noncleanable hazardous obstacles. Unfortunately, these existing deep AI models focus entirely on the accuracy enhancement of object classification, and little effort has been made to minimize the memory size and implementation cost of AI models. As a result, these existing deep AI models require far more memory space than a typical robot vacuum can provide. To address this shortcoming, this paper aims to study and find an efficient deep AI model that can achieve a good balance between classification accuracy and memory usage (i.e., implementation cost). In this work, we propose a weight-quantized SqueezeNet model for robot vacuums. This model can classify indoor cleanable litters from noncleanable hazardous obstacles based on the image or video captures from robot vacuums. Furthermore, we collect videos or pictures captured by built-in cameras of robot vacuums and use them to construct a diverse dataset. The dataset contains 20,000 images with a ground-view perspective of dining rooms, kitchens and living rooms for various houses under different lighting conditions. Experimental results show that the proposed deep AI model can achieve comparable object classification accuracy of around 93% while reducing memory usage by at least 22.5 times. More importantly, the memory footprint required by our AI model is only 0.8 MB, indicating that this model can run smoothly on resource-constrained robot vacuums, where low-end processors or microcontrollers are dedicated to running AI algorithms.

Demand-driven HVAC (heating, ventilation, and air conditioning) operation is essential in occupant-oriented smart buildings, where the levels of heating, cooling, and ventilation are intelligently regulated to avoid energy waste. Despite the great potential of building energy efficiency, one of the remaining technical challenges is how to accurately estimate building occupancy information in real time. In this paper, this design challenge is addressed. An advanced audio-processing technique is adopted that minimizes the impacts of environmental sounds on the recorded voice sounds of humans. Adopted mathematical modeling and signal processing procedures are elaborated in this work. Experimental studies show that our proposed audio processing with background sound cancellation algorithm improves the estimation accuracy of room occupancy quantity by approximately 11–12%, which results in an averaged ventilation energy reduction of 3.54% compared to the case of not applying background sound cancellation. The proposed audio-processing technique is promising to achieve non-intrusive, cost-effective, robust, and accurate solutions for building occupancy estimation.

Journal of Information Technology in Construction

According to the U.S. Department of Energy, a significant portion of energy used in buildings is wasted. If the occupancy quantity in a pre-determined thermal zone is aware, a building automation system (BAS) is able to intelligently adjust the building operation to provide “just-enough” heating, cooling, and ventilation capacities to building users. Therefore, an occupancy counting device that can be widely deployed at low prices with low failure rate, small form-factor, good usability, and conserved user privacy is highly desirable. Existing occupancy detection or recognition sensors (e.g., passive infrared, camera, acoustic, RFID, CO2) cannot meet all these above system requirements. In this work, we present an IoT (Internet of Things) prototype that collects room occupancy information to assist in the operation of energy-efficient buildings. The proposed IoT prototype consists of Lattice iCE40-HX1K stick FPGA boards and Raspberry Pi modules. Two pairs of our prototypes are installed at a door frame. When a person walks through this door frame, blocking of active infrared streams between both pairs of IoT prototypes is detected. The direction of human movement is obtained through comparing occurrence time instances of two obstructive events. Thus, the change in occupancy quantity of a thermal zone is calculated and updated. Besides, an open-source application user interface is developed to allow anonymous users or building automation systems to easily acquire room occupancy information. We carry out a three-month random test of human entry and exit of a thermal zone, and find that the occupancy counting accuracy is 97%. The proposed design is completely made of off-the-shelf electronic components and the estimated cost is less than $160. To investigate the impact on building energy savings, we conduct a building energy simulation using EnergyPlus and find the payback period is approximately 4 months. In summary, the proposed design is miniature, non-intrusive, ease of use, low failure rate, and cost-effective for smart buildings.

Artificial intelligence (AI) plays a critical role in the operation of robot vacuum cleaners, enabling them to intelligently navigate to clean and avoid indoor obstacles. Due to limited computational resources, manufacturers must balance performance and cost. This necessitates the development of lightweight AI models that can achieve high performance. Traditional uniform weight quantization assigns the same number of levels to all weights, regardless of their distribution or importance. Consequently, this lack of adaptability may lead to sub-optimal quantization results, as the quantization levels do not align with the statistical properties of the weights. To address this challenge, in this work, we propose a new technique called low bitwidth strong non-uniform quantization, which largely reduces the memory footprint of AI models while maintaining high accuracy. Our proposed non-uniform quantization method, as opposed to traditional uniform quantization, aims to align with the actual weight distribution of well-trained neural network models. The proposed quantization scheme builds upon the observation of weight distribution characteristics in AI models and aims to leverage this knowledge to enhance the efficiency of neural network implementations. Additionally, we adjust the input image size to reduce the computational and memory demands of AI models. The goal is to identify an appropriate image size and its corresponding AI models that can be used in resource-constrained robot vacuum cleaners while still achieving acceptable accuracy on the object classification task. Experimental results indicate that when compared to the state-of-the-art AI models in the literature, the proposed AI model achieves a 2-fold decrease in memory usage from 15.51 MB down to 7.68 MB while maintaining the same accuracy of around 93%. In addition, the proposed non-uniform quantization model reduces memory usage by 20 times (from 15.51 MB down to 0.78 MB) with a slight accuracy drop of 3.11% (the classification accuracy is still above 90%). Thus, our proposed high-performance and lightweight AI model strikes an excellent balance between model complexity, classification accuracy, and computational resources for robot vacuum cleaners.

An Intelligent Internet of Things (IoT) Sensor System for Building Environmental Monitoring