Weiwei Sun

Weiwei Sun

Auto-generated profile, based on publicly available information

Weiwei Sun

Alibaba Inc., Hangzhou, China

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
4 January 2018 in ACM Transactions on Multimedia Computing, Communications, and Applications
Verified
Journal Article
Open access
WSWeiwei Sun
Weiwei Sun
JZJiantao Zhou
Jiantao Zhou
SZShuyuan Zhu
Shuyuan Zhu
YTYuan Yan Tang
Yuan Yan Tang
Sharing images online has become extremely easy and popular due to the ever-increasing adoption of mobile devices and online social networks (OSNs). The privacy issues arising from image sharing over OSNs have received significant attention in recent years. In this article, we consider the problem of designing a secure, robust, high-fidelity, storage-efficient image-sharing scheme over Facebook, a representative OSN that is widely accessed. To accomplish this goal, we first conduct an in-depth investigation on the manipulations that Facebook performs to the uploaded images. Assisted by such knowledge, we propose a DCT-domain image encryption/decryption framework that is robust against these lossy operations. As verified theoretically and experimentally, superior performance in terms of data privacy, quality of the reconstructed images, and storage cost can be achieved.

7 July 2021 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
WSWeiwei Sun
Weiwei Sun
JZJiantao Zhou
Jiantao Zhou
LDLi Dong
Li Dong
JTJinyu Tian
Jinyu Tian
JLJun Liu
Jun Liu
Online Social Networks (OSNs) have attracted a huge number of users, who store and share various images on a daily basis. As a well-known fact, most OSN platforms apply a series of lossy operations on the uploaded images, which could severely degrade the quality of the shared images, negatively affecting the user experiences. In this work, we consider the problem of significantly improving OSN-shared images through applying an optimal pre-filtering prior to image sharing, without any cooperation from the OSN platform itself. Facebook, as one of the most popular and representative OSNs, is chosen as the platform to present our designed pre-filtering strategy. We first treat Facebook as a black box, and thoroughly recover its mechanism of processing color images. Based on the precise knowledge on the image processing pipeline on Facebook, we design the pre-filter under an optimization framework, minimizing the end-to-end distortion between the shared image and the original one. Compared with the directly shared images, our proposed pre-filtering-then-sharing strategy brings significant improvements in terms of both quantitative and qualitative metrics. Extensive experimental results are provided to show the superiority of our proposed method. Finally, we discuss the strategy on how to extend our proposed technique to other OSN platforms.

25 September 2023 in IEEE Transactions on Information Forensics and Security
Verified
Journal Article
Closed access
HWHaiwei Wu
Haiwei Wu
JZJiantao Zhou
Jiantao Zhou
XZXinyu Zhang
Xinyu Zhang
JTJinyu Tian
Jinyu Tian
WSWeiwei Sun
Weiwei Sun
Camera model identification (CMI) can be widely used in image forensics such as authenticity determination, copyright protection, forgery detection, etc. Meanwhile, with the vigorous development of the Internet, online social networks (OSNs) have become the dominant channels for image sharing and transmission. However, the inevitable lossy operations on OSNs, such as compression and post-processing, impose great challenges to the existing CMI schemes, as they severely destroy the camera traces left in the images under investigation. In this work, we propose a novel CMI method that is robust against the lossy operations of various OSN platforms. Specifically, it is observed that a camera trace extractor can be easily trained on a single degradation scenario (e.g., one specific OSN platform); while much more difficult on mixed degradation scenarios (e.g., multiple OSN platforms). Inspired by this observation, we design a new multi-scenario learning (MSL) strategy, enabling us to extract robust camera traces across different OSNs. Furthermore, noticing that image smooth regions incur less distortions by OSN and less interference by image signal itself, we suggest a SmooThness-Aware Trace Extractor (STATE) that can adaptively extract camera traces according to the smoothness of the input image. The superiority of our method is verified by comparative experiments with four state-of-the-art methods, especially under various OSN transmission scenarios. Particularly, for the open-set camera model verification task, we greatly surpass the second-place by 15.30% in AUC on the FODB dataset; while for the close-set camera model classification task, we are significantly ahead of the second-place by 34.51% in F1 on the SIHDR dataset. The code of our proposed method is available at https://github.com/HighwayWu/CameraTraceOSN .

24 January 2024 in IEEE Transactions on Consumer Electronics
Verified
Journal Article
Closed access
YLYuanman Li
Yuanman Li
JYJiaxiong Ye
Jiaxiong Ye
LZLimin Zeng
Limin Zeng
RLRongqin Liang
Rongqin Liang
XZXianwei Zheng
Xianwei Zheng
Na WangNa Wang
Na Wang
As a prevalent form of multimodal data, video data plays a crucial role in numerous applications, offering various benefits. Meanwhile, video integrity and source issues also pose security risks. Video data is multimodal, containing a container describing video coding and packaging, along with a video data stream featuring visual and audio information. Many works on video integrity and source analysis focus on video containers, and they overlook the fact that a malicious user can readily manipulate these traces within the containers by reconstructing them without transcoding. In our research, we propose a hierarchical fingerprint learning framework through multi-level fusion for video integrity and source analysis. Our approach integrates video encoding attributes, extracting multi-level features from both decoded video key frames and reference frames. We model the dependencies between these features based on encoding characteristics, effectively revealing hidden clues in spatial and temporal domains related to various video processing techniques. Additionally, we introduce a hierarchical framework to fuse multiple clues from different groups of pictures (GOPs), facilitating collaborative feature learning across multiple GOPs. Extensive experiments on publicly available datasets validate the effectiveness of our method in tasks related to video integrity verification and source identification. Our approach provides support for ensuring the credibility and traceability of video content in consumer applications.

16 May 2024 in ACM Transactions on Multimedia Computing, Communications, and Applications
Verified
Journal Article
Open access
JLJun Liu
Jun Liu
JZJiantao Zhou
Jiantao Zhou
JTJinyu Tian
Jinyu Tian
WSWeiwei Sun
Weiwei Sun
With the increasing prevalence of cloud computing platforms, ensuring data privacy during the cloud-based image-related services such as classification has become crucial. In this study, we propose a novel privacy-preserving image classification scheme that enables the direct application of classifiers trained in the plaintext domain to classify encrypted images without the need of retraining a dedicated classifier. Moreover, encrypted images can be decrypted back into their original form with high fidelity (recoverable) using a secret key. Specifically, our proposed scheme involves utilizing a feature extractor and an encoder to mask the plaintext image through a newly designed Noise-like Adversarial Example (NAE). Such an NAE not only introduces a noise-like visual appearance to the encrypted image but also compels the target classifier to predict the ciphertext as the same label as the original plaintext image. At the decoding phase, we adopt a Symmetric Residual Learning (SRL) framework for restoring the plaintext image with minimal degradation. Extensive experiments demonstrate that (1) the classification accuracy of the classifier trained in the plaintext domain remains the same in both the ciphertext and plaintext domains; (2) the encrypted images can be recovered into their original form with an average PSNR of up to 51+ dB for the SVHN dataset and 48+ dB for the VGGFace2 dataset; (3) our system exhibits satisfactory generalization capability on the encryption, decryption, and classification tasks across datasets that are different from the training one; and (4) a high-level of security is achieved against three potential threat models. The code is available at https://github.com/csjunjun/RIC.git .

11 December 2023 in ACM Transactions on Multimedia Computing, Communications, and Applications
Verified
Journal Article
Open access
JLJun Liu
Jun Liu
JZJiantao Zhou
Jiantao Zhou
HWHaiwei Wu
Haiwei Wu
WSWeiwei Sun
Weiwei Sun
JTJinyu Tian
Jinyu Tian
Online Social Networks (OSNs) have blossomed into prevailing transmission channels for images in the modern era. Adversarial examples (AEs) deliberately designed to mislead deep neural networks (DNNs) are found to be fragile against the inevitable lossy operations conducted by OSNs. As a result, the AEs would lose their attack capabilities after being transmitted over OSNs. In this work, we aim to design a new framework for generating robust AEs that can survive the OSN transmission; namely, the AEs before and after the OSN transmission both possess strong attack capabilities. To this end, we first propose a differentiable network termed SImulated OSN (SIO) to simulate the various operations conducted by an OSN. Specifically, the SIO network consists of two modules: (1) a differentiable JPEG layer for approximating the ubiquitous JPEG compression and (2) an encoder-decoder subnetwork for mimicking the remaining operations. Based upon the SIO network, we then formulate an optimization framework to generate robust AEs by enforcing model outputs with and without passing through the SIO to be both misled. Extensive experiments conducted over Facebook, WeChat and QQ demonstrate that our attack methods produce more robust AEs than existing approaches, especially under small distortion constraints; the performance gain in terms of Attack Success Rate (ASR) could be more than 60%. Furthermore, we build a public dataset containing more than 10,000 pairs of AEs processed by Facebook, WeChat or QQ, facilitating future research in the robust AEs generation. The dataset and code are available at https://github.com/csjunjun/RobustOSNAttack.git .