22 July 2013 in IEEE Intelligent Transportation Systems Magazine
Automated vehicle classification based on static images is highly practical and directly applicable for various operations such as traffic related investigations. An integrated vehicle detection and classification system is proposed in this paper. A multi-resolution vehicle detection scheme is introduced as an improvement over the cascade boosted classifiers proposed recently by Negri et al. 2008 in the literature. Building on solutions from previous works from Negri et al, the implementation of a new decision strategy renders current detection method to be robust to environmental changes. The vehicle classification is based on the Classified Vector Quantization (CVQ) proposed earlier by Zhang et al. 2009. The justification of choosing CVQ is its advantages in providing classification confidence by incorporating rejection option. The significance of rejection in enhancing the system?s reliability is emphasized and evaluated. A database composed of more than 2800 images of four types of vehicles (cars, vans, light trucks and buses) was created using police surveillance cameras. The proposed scheme offers a performance accuracy of over 95% with a rejection rate of 8%, and reliability over 98% with a rejection rate of 20%. This exhibits promising potentials for implementations into real-world applications.
11 November 2024 in IEEE Transactions on Mobile Computing
Various characteristics of mobile applications (apps) and associated in-app services can reveal potentially-sensitive user information; however, privacy concerns have prompted third-party apps to restrict access to data related to mobile app usage. This paper outlines a novel approach to extracting detailed app usage information by analyzing electromagnetic (EM) signals emitted from mobile devices during app-related tasks. The proposed system, MagSpy, recovers user privacy information from magnetometer readings that do not require access permissions. This EM leakage becomes complex when multiple apps are used simultaneously and is subject to interference from geomagnetic signals generated by device movement. To address these challenges, MagSpy employs multiple techniques to extract and identify signals related to app usage. Specifically, the geomagnetic offset signal is canceled using accelerometer and gyroscope sensor data, and a Cascade-LSTM algorithm is used to classify apps and in-app services. MagSpy also uses CWT-based peak detection and a Random Forest classifier to detect PIN inputs. A prototype system was evaluated on over 50 popular mobile apps with 30 devices. Extensive evaluation results demonstrate the efficacy of MagSpy in identifying in-app services (96% accuracy), apps (93.5% accuracy), and extracting PIN input information (96% top-3 accuracy).
13 May 2024 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
With the growing popularity of smart speakers, numerous novel acoustic sensing applications have been proposed for low-frequency human speech and high-frequency inaudible sounds. Spatial information plays a crucial role in these acoustic applications, enabling various location-based services. However, typically commercial microphone arrays face limitations in spatial perception of inaudible sounds due to their sparse array geometries optimized for low-frequency speech. In this paper, we introduce MetaAng, a system designed to augment microphone arrays by enabling wideband spatial perception across both speech signals and inaudible sounds by leveraging the spatial encoding capabilities of acoustic metasurfaces. Our design is grounded in the fact that, while sensitive to high-frequency signals, acoustic metasurfaces are almost non-responsive to low-frequency speech due to significant wavelength discrepancy. This observation allows us to integrate acoustic metasurfaces with sparse array geometry, simultaneously enhancing the spatial perception of high-frequency and low-frequency acoustic signals. To achieve this, we first utilize acoustic metasurfaces and a configuration optimization algorithm to encode the unique features for each incident angle. Then, we propose an unrolling soft thresholding network that employs neural-enhanced priors and compressive sensing for high-accuracy, high-resolution multi-source angle estimation. We implement a prototype, and experimental results demonstrate that MetaAng maintains robustness across various scenarios, facilitating multiple applications, including localization and tracking.