Various characteristics of mobile applications (apps) and associated in-app services can reveal potentially-sensitive user information; however, privacy concerns have prompted third-party apps to restrict access to data related to mobile app usage. This paper outlines a novel approach to extracting detailed app usage information by analyzing electromagnetic (EM) signals emitted from mobile devices during app-related tasks. The proposed system, MagSpy, recovers user privacy information from magnetometer readings that do not require access permissions. This EM leakage becomes complex when multiple apps are used simultaneously and is subject to interference from geomagnetic signals generated by device movement. To address these challenges, MagSpy employs multiple techniques to extract and identify signals related to app usage. Specifically, the geomagnetic offset signal is canceled using accelerometer and gyroscope sensor data, and a Cascade-LSTM algorithm is used to classify apps and in-app services. MagSpy also uses CWT-based peak detection and a Random Forest classifier to detect PIN inputs. A prototype system was evaluated on over 50 popular mobile apps with 30 devices. Extensive evaluation results demonstrate the efficacy of MagSpy in identifying in-app services (96% accuracy), apps (93.5% accuracy), and extracting PIN input information (96% top-3 accuracy).
9 September 2022 in IEEE/ACM Transactions on Networking
Quick response (QR) codes have been widely used in mobile applications, especially mobile payments, such as Alipay, WeChat, PayPal, etc due to their convenience and the pervasive built-in cameras on smartphones. Recently, however, attacks against QR codes have been reported and attackers can capture a QR code of the victim and replay it to achieve a fraudulent transaction or intercept private information, just before the original QR code is scanned. In this study, we enhance the security of a QR code by identifying its authenticity. We propose, which embeds a QR code with information of the screen which displays it, thereby the QR code can reveal whether it is reproduced by an adversary or not. In, PWM frequency of screens is exploited as the unique screen fingerprint. To improve the estimation accuracy of PWM frequency, incorporates a model for the interaction between the camera and screen in the temporal and spatial domains. Extensive experiments demonstrate that can differentiate screens of different models, types, and manufacturers and thus improve the security of QR codes.
4 February 2022 in IEEE Transactions on Mobile Computing
The efficiency of human-computer interaction is greatly hindered by the small size of the touch screens on mobile devices, such as smart phones and watches. This has prompted widespread interest in handwriting recognition systems, which can be divided into active and passive systems. Active systems require additional hardware devices to perceive movements of handwriting or the tracking accuracy is not adequate for handwriting recognition. Passive methods use the acoustic signal of pen rubbing and are susceptible to environmental noise (above 60 $dB$ ). This paper presents a novel handwriting recognition system based on vibration signals detected by the built-in accelerometer of smartphones. The proposed scheme is implemented in three stages: signal segmentation, signal recognition, and word suggestion. VibWriter is highly resistant to interferences since the normal environmental noise (below 70 $dB$ ) will not cause the vibration of the accelerometer. Extensive experiments demonstrated the efficacy of the system in terms of accuracy in letter recognition (75.3%), word recognition (86.4%) and number recognition (79%) in a variety of writing positions under a variety of environmental conditions.
In recent years, fire disasters caused by charging electric bicycles/moped (e-bikes) have been increasing, causing catastrophic loss of life and property; Worse still, existing fire warning systems are costly to install and maintain, and they work after the accident occurs. Some existing works propose using power meters or similar sensors in the power grid to monitor e-bike charging health. However, the use of additional equipment makes them challenging to deploy. Others can use the sound or electromagnetic signals emitted by e-bikes for monitoring, but they suffer from limited monitoring distance. To solve this problem, we propose SingMonitor, a scheme to remotely monitor e-bike charging status using mobile devices’ microphones. The charging e-bike generates a unique current signal, which is then transmitted through the power grid and drives the mobile devices’ power supply to generate sound, which is then captured by a microphone. Based on this principle and the proposed template matching method, SingMonitor can identify the e-bike charging status. Experiments show SingMonitor achieves an F1 score of 0.94 in identifying 10 e-bikes’ charging status, with a detection distance of 9m+.