Zheng Ning

Zheng Ning

Auto-generated profile, based on publicly available information

Zheng Ning

University of Notre Dame Notre Dame Indiana USA

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 July 2024
Verified
Conference Paper
Open access
SWSitong Wang
Sitong Wang
ZNZheng Ning
Zheng Ning
ATAnh Truong
Anh Truong
MDMira Dontcheva
Mira Dontcheva
DLDingzeyu Li
Dingzeyu Li
LCLydia B Chilton
Lydia B Chilton
Video podcast teasers are short videos that can be shared on social media platforms to capture interest in full episodes of a video podcast. These teasers enable long-form podcasters to reach new audiences and gain more followers. However, creating a compelling teaser from an hour-long episode can be challenging. Selecting interesting clips requires significant mental effort; editing the chosen clips into a cohesive, well-produced teaser is time-consuming. To support the creation of video podcast teasers, we first investigated what makes a good teaser. We combined insights from audience comments and creator interviews to identify key ingredients. We also identified a common workflow used by creators during this process. Based on these findings, we developed a human-AI co-creative tool called PodReels to assist video podcasters in crafting teasers. Our user study demonstrated that PodReels significantly reduces creators’ mental demand and improves their efficiency in producing video podcast teasers.


27 March 2023
Verified
Conference Paper
Open access
ZNZheng Ning
Zheng Ning
ZZZheng Zhang
Zheng Zhang
TSTianyi Sun
Tianyi Sun
YTYuan Tian
Yuan Tian
TZTianyi Zhang
Tianyi Zhang
TLToby Jia-Jun Li
Toby Jia-Jun Li
Recent advances in machine learning (ML) and natural language processing (NLP) have led to significant improvement in natural language interfaces for structured databases (NL2SQL). Despite the great strides, the overall accuracy of NL2SQL models is still far from being perfect (∼ 75% on the Spider benchmark). In practice, this requires users to discern incorrect SQL queries generated by a model and manually fix them when using NL2SQL models. Currently, there is a lack of comprehensive understanding about the common errors in auto-generated SQLs and the effective strategies to recognize and fix such errors. To bridge the gap, we (1) performed an in-depth analysis of errors made by three state-of-the-art NL2SQL models; (2) distilled a taxonomy of NL2SQL model errors; and (3) conducted a within-subjects user study with 26 participants to investigate the effectiveness of three representative interactive mechanisms for error discovery and repair in NL2SQL. Findings from this paper shed light on the design of future error discovery and repair strategies for natural language data query interfaces.

1 January 2023
Verified
Conference Paper
Open access
PDF file
YTYuan Tian
Yuan Tian
ZZZheng Zhang
Zheng Zhang
ZNZheng Ning
Zheng Ning
TLToby Li
Toby Li
JKJonathan Kummerfeld
Jonathan Kummerfeld
TZTianyi Zhang
Tianyi Zhang
Yuan Tian, Zheng Zhang, Zheng Ning, Toby Li, Jonathan Kummerfeld, Tianyi Zhang. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. 2023.

17 December 2024 in ACM Transactions on Interactive Intelligent Systems
Verified
Journal Article
Open access
ZNZheng Ning
Zheng Ning
YTYuan Tian
Yuan Tian
ZZZheng Zhang
Zheng Zhang
TZTianyi Zhang
Tianyi Zhang
TLToby Jia-Jun Li
Toby Jia-Jun Li
Querying structured databases with natural language (NL2SQL) has remained a difficult problem for years. Recently, the advancement of machine learning (ML), natural language processing (NLP), and large language models (LLM) have led to significant improvements in performance, with the best model achieving ∼85% percent accuracy on the benchmark Spider dataset. However, there is a lack of a systematic understanding of the types, causes, and effectiveness of error-handling mechanisms of errors for erroneous queries nowadays. To bridge the gap, a taxonomy of errors made by four representative NL2SQL models was built in this work, along with an in-depth analysis of the errors. Second, the causes of model errors were explored by analyzing the model-human attention alignment to the natural language query. Last, a within-subjects user study with 26 participants was conducted to investigate the effectiveness of three interactive error-handling mechanisms in NL2SQL. Findings from this article shed light on the design of model structure and error discovery and repair strategies for natural language data query interfaces in the future.

23 June 2024
Verified
Conference Paper
Open access
ZNZheng Ning
Zheng Ning
ZZZheng Zhang
Zheng Zhang
JBJerrick Ban
Jerrick Ban
KJKaiwen Jiang
Kaiwen Jiang
RGRuohong Gan
Ruohong Gan
TLToby Jia-Jun Li
Toby Jia-Jun Li