Tiantian Liu

Tiantian Liu

Auto-generated profile, based on publicly available information

Tiantian Liu

Department of Information and Communication Engineering, Xiamen University, Xiamen, China

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
2 May 2022
Verified
Conference Paper
Closed access
CWChao Wang
Chao Wang
Feng LinFeng Lin
Feng Lin
TLTiantian Liu
Tiantian Liu
ZLZiwei Liu
Ziwei Liu
YSYijie Shen
Yijie Shen
KRKui Ren
Kui Ren
More and more people turn to online voice communication with loudspeaker-equipped devices due to its convenience. To prevent speech leakage, soundproof rooms are often adopted. This paper presents mmPhone, a novel acoustic eavesdropping system that recovers loudspeaker speech protected by soundproof environments. The key idea is that properties of piezoelectric films in mmWave band can change with sound pressure due to the piezoelectric effect. If the property changes are acquired by an adversary (i.e., characterizing the piezoelectric effect with mmWaves), speech leakage can happen. More importantly, the piezoelectric film can work without a power supply. Base on this, we proposed a methodology using mmWaves to sense the film and decoding the speech from mmWaves, which turns the film into a passive "microphone". To recover intelligible speech, we further develop an enhancement scheme based on a denoising neural network, multi-channel augmentation, and speech synthesis, to compensate for the propagation and penetration loss of mmWaves. We perform extensive experiments to evaluate mmPhone and conduct digit recognition with over 93% accuracy. The results indicate mmPhone can recover high-quality and intelligible speech from a distance over 5m and is resilient to incident angles of sound waves (within 55 degrees) and different types of loudspeakers.

29 October 2023
Verified
Conference Paper
Open access
TLTiantian Liu
Tiantian Liu
Feng LinFeng Lin
Feng Lin
CWChao Wang
Chao Wang
CXChenhan Xu
Chenhan Xu
XZXiaoyu Zhang
Xiaoyu Zhang
KRKui Ren
Kui Ren
With the increasing deployment of voice-controlled devices in homes and enterprises, there is an urgent demand for voice identification to prevent unauthorized access to sensitive information and property loss. However, due to the broadcast nature of sound wave, a voice-only system is vulnerable to adverse conditions and malicious attacks. We observe that the cooperation of millimeter waves (mmWave) and voice signals can significantly improve the effectiveness and security of user identification. Based on the properties, we propose a multi-modal user identification system (named WavoID) by fusing the uniqueness of mmWave-sensed vocal vibration and mic-recorded voice of users. To estimate fine-grained waveforms, WavoID splits signals and adaptively combines useful decomposed signals according to correlative contents in both mmWave and voice. An elaborated anti-spoofing module in WavoID comprising biometric bimodal information defend against attacks. WavoID produces and fuses the response maps of mmWave and voice to improve the representation power of fused features, benefiting accurate identification, even facing adverse circumstances. We evaluate WavoID using commercial sensors on extensive experiments. WavoID has significant performance on user identification with over 98% accuracy on 100 user datasets.

11 May 2024 in ACM Transactions on Sensor Networks
Verified
Journal Article
Open access
TLTiantian Liu
Tiantian Liu
CWChao Wang
Chao Wang
ZLZhengxiong Li
Zhengxiong Li
MHMing-Chun Huang
Ming-Chun Huang
Wenyao XuWenyao Xu
Wenyao Xu
Feng LinFeng Lin
Feng Lin
As automatic speech recognition evolves, deployment of the voice user interface (VUI) has boomingly expanded. Especially since the COVID-19 pandemic, the VUI has gained more attention in online communication owing to its non-contact property. However, the VUI struggles to be applied in public scenes due to the degradation of received audio signals caused by various ambient noises. In this article, we propose Wavoice , the first noise-resistant multi-modal speech recognition system that fuses two distinct voices sensing modalities (i.e., millimeter-wave signals and audio signals from a microphone) together. One key contribution is to model the inherent correlation between millimeter-wave and audio signals. Based on it, Wavoice facilitates the real-time noise-resistant voice activity detection and user targeting from multiple speakers. Additionally, we elaborate on two novel modules for multi-modal fusion embedded into the neural network, leading to accurate speech recognition. Extensive experiments prove the effectiveness of Wavoice under adverse conditions—that is, the character recognition error rate below 1% in a range of 7 m. In terms of robustness and accuracy, Wavoice considerably outperforms existing audio-only speech recognition methods with lower character error and word error rates.

5 October 2023 in IEEE Transactions on Dependable and Secure Computing
Verified
Journal Article
Closed access
Feng LinFeng Lin
Feng Lin
CWChao Wang
Chao Wang
TLTiantian Liu
Tiantian Liu
ZLZiwei Liu
Ziwei Liu
YSYijie Shen
Yijie Shen
KRKui Ren
Kui Ren
Online voice communications are widely used nowadays. To protect speech from leakage, people tend to initiate the talk in sound-isolated environments. In this paper, we reveal a novel attack that recovers high-quality speech from outside soundproof zones. The rationale of the attack is to leverage sound-sensitive characteristics of piezoelectric materials, i.e., a piezo film that can change the phase of reflected mmWaves when placed in a sound field. If the attacker transmits mmWaves and analyzes reflected signals from the piezo film, the speech information can be compromised. More importantly, the piezo film is paper-like and works without a power supply. We propose a new speech recovery methodology to transform sound waves into wireless signals and build an end-to-end eavesdropping system working as a through-wall “microphone” to recover high-quality speech stealthily. To combat signal attenuation and improve speech quality, we develop a speech-enhancement scheme based on generative adversarial networks and propose to use multi-antenna information for intelligible speech reconstruction. We conduct extensive experiments to evaluate the system. The results indicate that the system achieves over 98% accuracy for digit recognition and works well over 5m away through the wall. We also test the system under complex scenarios and give countermeasures.

7 March 2023 in IEEE Transactions on Dependable and Secure Computing
Verified
Journal Article
Closed access
YSYijie Shen
Yijie Shen
Feng LinFeng Lin
Feng Lin
CWChao Wang
Chao Wang
TLTiantian Liu
Tiantian Liu
ZBZhongjie Ba
Zhongjie Ba
KRKui Ren
Kui Ren
Device fingerprints can satisfy the high-security requirement of modern mobile applications (e.g., mobile payments) by guaranteeing the operation is performed on a trusted device. However, existing works on device fingerprints are weak to leakage, which leads to an irreversible failure of the device fingerprint authentication system after suffering from fingerprint theft attacks. The vulnerability drives us to propose a reconfigurable device fingerprint, i.e., MotoPrint , that can recover the system after suffering from such attacks. MotoPrint stems from the motor vibration that can represent in both signals of the accelerometer and the gyroscope (i.e., they are homologous motion signals). Therefore, we designed a two-path feature extracting network and a sensor-independent training strategy to eliminate sensor noise that can decline authentication performance. In addition, MotoPrint has a complete reconfiguration mechanism to cope with fingerprint leakage, which brings the damaged authentication system back to health. The evaluation of 80 stand-alone vibration motors and 20 in-built ones shows that MotoPrint can achieve high authentication accuracy of 98.5%. Meanwhile, we also demonstrate the reconfigured MotoPrint , which can also effectively indicate the device's uniqueness with over 98% accuracy, is independent of MotoPrint s under other stimulating codes.

22 December 2025 in IEEE Transactions on Information Forensics and Security
Verified
Journal Article
Closed access
TWTong Wu
Tong Wu
Feng LinFeng Lin
Feng Lin
GWGaojian Wang
Gaojian Wang
TLTiantian Liu
Tiantian Liu
ZWZhibo Wang
Zhibo Wang
KRKui Ren
Kui Ren
Multimodal language models (LMs) have shown significant potential for applications across various domains but remain vulnerable to adversarial attacks. Current research in white-box or black-box settings generally struggles with unrealistic attack assumptions and limited efficacy of targeted attacks. This paper introduces CoGA, a novel gray-box collaborative adversarial attack method for multimodal LMs. Under our gray-box settings, attackers have access only to the victim model’s input encoders. With the guidance of different modalities, we perturb the embedding representations from encoders to disrupt the semantic alignment across modalities, ultimately causing inaccurate outputs on various downstream tasks. Specifically, we integrate text embeddings into the loss calculations of the image attack and utilize image embeddings to guide the ranking of vulnerable words and the selection of final samples. Extensive experiments demonstrate that our method achieves superior attack performance across diverse models and tasks, suggesting the shared vulnerability of multimodal LMs in confronting adversarial challenges. Our work provides new insights into the security of multimodal LMs, facilitating the deployment of more robust and secure models in practical applications.