Zhongyi Zhou

Zhongyi Zhou

Auto-generated profile, based on publicly available information

Zhongyi Zhou

The University of Tokyo, Tokyo, Japan

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 April 2025
Verified
Conference Paper
Open access
YHYongquan ‘oWen’ Hu
Yongquan ‘oWen’ Hu
JTJingyu Tang
Jingyu Tang
XGXinya Gong
Xinya Gong
ZZZhongyi Zhou
Zhongyi Zhou
SZShuning Zhang
Shuning Zhang
AQAaron Quigley
Aaron Quigley

27 March 2023
Verified
Conference Paper
Open access
AXAnran Xu
Anran Xu
ZZZhongyi Zhou
Zhongyi Zhou
KMKakeru Miyazaki
Kakeru Miyazaki
RYRyo Yoshikawa
Ryo Yoshikawa
SHSimo Hosio
Simo Hosio
KYKoji Yatani
Koji Yatani
Image privacy protection is an important topic in Human-Computer Interaction and usable security. Researchers have examined different aspects of image privacy by collecting samples by themselves. However, there does not exist a publicly-available dataset on image privacy, which prevents these efforts from sharing common technical foundations. We introduce DIPA, an open source dataset that provides content-level annotations that specifically focus on image privacy. We include 1,495 images from two existing datasets in DIPA, and augment them with 5,671 annotations. Each annotation includes reasons why the associated visual content can be privacy-threatening, a rating of how informative annotators thought the associated content is to threaten privacy, and another rating of how broadly the image could be shared. We also collected annotations from people living in Japan and UK to enable researchers and developers to perform analysis from the perspective of cultural differences. In this paper, we present the construction procedure of DIPA and report high-level statistics of the data we obtained. We hope that DIPA would accelerate various future research, including quantitative understandings of cultural differences on perceptions of image privacy and the development of robust recognition models for image privacy protection.

19 December 2023 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Verified
Journal Article
Open access
AXAnran Xu
Anran Xu
ZZZhongyi Zhou
Zhongyi Zhou
KMKakeru Miyazaki
Kakeru Miyazaki
RYRyo Yoshikawa
Ryo Yoshikawa
SHSimo Hosio
Simo Hosio
KYKoji Yatani
Koji Yatani
The world today is increasingly visual. Many of the most popular online social networking services are largely powered by images, making image privacy protection a critical research topic in the fields of ubiquitous computing, usable security, and human-computer interaction (HCI). One topical issue is understanding privacy-threatening content in images that are shared online. This dataset article introduces DIPA2, an open-sourced image dataset that offers object-level annotations with high-level reasoning properties to show perceptions of privacy among different cultures. DIPA2 provides 5,897 annotations describing perceived privacy risks of 3,347 objects in 1,304 images. The annotations contain the type of the object and four additional privacy metrics: 1) information type indicating what kind of information may leak if the image containing the object is shared, 2) a 7-point Likert item estimating the perceived severity of privacy leakages, and 3) intended recipient scopes when annotators assume they are either image owners or allowing others to repost the image. Our dataset contains unique data from two cultures: We recruited annotators from both Japan and the U.K. to demonstrate the impact of culture on object-level privacy perceptions. In this paper, we first illustrate how we designed and performed the construction of DIPA2, along with data analysis of the collected annotations. Second, we provide two machine-learning baselines to demonstrate how DIPA2 challenges the current image privacy recognition task. DIPA2 facilitates various types of research on image privacy, including machine learning methods inferring privacy threats in complex scenarios, quantitative analysis of cultural influences on privacy preferences, understanding of image sharing behaviors, and promotion of cyber hygiene for general user populations.

25 April 2025
Verified
Conference Paper
Open access
ZZZhongyi Zhou
Zhongyi Zhou
JJJing Jin
Jing Jin
VPVrushank Phadnis
Vrushank Phadnis
XYXiuxiu Yuan
Xiuxiu Yuan
JJJun Jiang
Jun Jiang
RDRuofei Du
Ruofei Du

11 May 2024
Verified
Conference Paper
Open access
ZZZhongyi Zhou
Zhongyi Zhou
JJJing Jin
Jing Jin
VPVrushank Phadnis
Vrushank Phadnis
XYXiuxiu Yuan
Xiuxiu Yuan
JJJun Jiang
Jun Jiang
RDRuofei Du
Ruofei Du
Foundational multi-modal models have democratized AI access, yet the construction of complex, customizable machine learning pipelines by novice users remains a grand challenge. This paper demonstrates a visual programming system that allows novices to rapidly prototype multimodal AI pipelines. We first conducted a formative study with 58 contributors and collected 236 proposals of multimodal AI pipelines that served various practical needs. We then distilled our findings into a design matrix of primitive nodes for prototyping multimodal AI visual programming pipelines, and implemented a system with 65 nodes. To support users’ rapid prototyping experience, we built InstructPipe, an AI assistant based on large language models (LLMs) that allows users to generate a pipeline by writing text-based instructions. We believe InstructPipe enhances novice users onboarding experience of visual programming and the controllability of LLMs by offering non-experts a platform to easily update the generation.

29 October 2023
Verified
Conference Paper
Open access
RDRuofei Du
Ruofei Du
NLNa Li
Na Li
JJJing Jin
Jing Jin
MCMichelle Carney
Michelle Carney
XYXiuxiu Yuan
Xiuxiu Yuan
AOAlex Olwal
Alex Olwal
We demonstrate Visual Blocks for ML, a visual programming platform that facilitates rapid prototyping of ML-based multimedia applications. As the public version of Rapsai [3], we further integrated large language models and custom APIs into the platform. In this demonstration, we will showcase how to build interactive AI pipelines in a few drag-and-drops, how to perform interactive data augmentation, and how to integrate pipelines into Colabs. In addition, we demonstrate a wide range of community-contributed pipelines in Visual Blocks for ML, covering various aspects including interactive graphics, chains of large language models, computer vision, and multi-modal applications. Finally, we encourage students, designers, and ML practitioners to contribute ML pipelines through https://github.com/google/visualblocks/tree/main/pipelines to inspire creative use cases. Visual Blocks for ML is available at http://visualblocks.withgoogle.com.