Shizhe Diao

Shizhe Diao

Auto-generated profile, based on publicly available information

Shizhe Diao

The Hong Kong University of Science and Technology, Hong Kong SAR

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 May 2024
Verified
Conference Paper
Open access
XLXu Liu
Xu Liu
JHJunfeng Hu
Junfeng Hu
YLYuan Li
Yuan Li
SDShizhe Diao
Shizhe Diao
YLYuxuan Liang
Yuxuan Liang
RZRoger Zimmermann
Roger Zimmermann
Multivariate time series forecasting plays a pivotal role in contemporary web technologies. In contrast to conventional methods that involve creating dedicated models for specific time series application domains, this research advocates for a unified model paradigm that transcends domain boundaries. However, learning an effective cross-domain model presents the following challenges. First, various domains exhibit disparities in data characteristics, e.g., the number of variables, posing hurdles for existing models that impose inflexible constraints on these factors. Second, the model may encounter difficulties in distinguishing data from various domains, leading to suboptimal performance in our assessments. Third, the diverse convergence rates of time series domains can also result in compromised empirical performance. To address these issues, we propose UniTime for effective cross-domain time series learning. Concretely, UniTime can flexibly adapt to data with varying characteristics. It also uses domain instructions and a Language-TS Transformer to offer identification information and align two modalities. In addition, UniTime employs masking to alleviate domain convergence speed imbalance issues. Our extensive experiments demonstrate the effectiveness of UniTime in advancing state-of-the-art forecasting performance and zero-shot transferability.

30 April 2023
Verified
Conference Paper
Open access
SDShizhe Diao
Shizhe Diao
SKSedrick Scott Keh
Sedrick Scott Keh
LPLiangming Pan
Liangming Pan
ZTZhiliang Tian
Zhiliang Tian
YSYan Song
Yan Song
TZTong Zhang
Tong Zhang
Social media classification tasks (e.g., tweet sentiment analysis, tweet stance detection) are challenging because social media posts are typically short, informal, and ambiguous. Thus, training on tweets is challenging and demands large-scale human-annotated labels, which are time-consuming and costly to obtain. In this paper, we find that providing hashtags to social media tweets can help alleviate this issue because hashtags can enrich short and ambiguous tweets in terms of various information, such as topic, sentiment, and stance. This motivates us to propose a novel Hashtag-guided Tweet Classification model (HashTation), which automatically generates meaningful hashtags for the input tweet to provide useful auxiliary signals for tweet classification. To generate high-quality and insightful hashtags, our hashtag generation model retrieves and encodes the post-level and entity-level information across the whole corpus. Experiments show that HashTation achieves significant improvements on seven low-resource tweet classification tasks, in which only a limited amount of training data is provided, showing that automatically enriching tweets with model-generated hashtags could significantly reduce the demand for large-scale human-labeled data. Further analysis demonstrates that HashTation is able to generate high-quality hashtags that are consistent with the tweets and their labels. The code is available at https://github.com/shizhediao/HashTation.


29 October 2025 in ACM Transactions on Intelligent Systems and Technology
Verified
Journal Article
Open access
JZJipeng Zhang
Jipeng Zhang
RPRui Pan
Rui Pan
YHYuzheng Hu
Yuzheng Hu
KSKashun Shum
Kashun Shum
GYGuanyu Yao
Guanyu Yao
TZTong Zhang
Tong Zhang
The AI community has witnessed the emergence of various chat-style Large Language Models (LLMs) since the advent of ChatGPT. Despite significant progress in this area, evaluating these models remains a substantial challenge. The evaluations provided by humans or GPT-4 oracles are often taken as the gold standard, but they are neither automatic nor scalable. More recently, a series of (open-source) LLM-based judge models have been introduced, yet they often exhibit model-specific biases, e.g., a LLaMA-family judge favors a LLaMA-family model. On the other hand, autoregressive evaluation metrics, which holds the potential to address the aforementioned issues, remains underexplored. Among them, likelihood-based metrics such as perplexity and negative log-likelihood (NLL) are widely adopted and has proven effective in tracking the pretraining progress of LLMs. However, they struggle to evaluate the generation capabilities of fine-tuned models due to exposure bias , a phenomenon where the distribution of the model’s output gradually deviates from the ground-truth during inference. To address this key issue, in this paper, we propose a novel autoregressive metric, Normalized Discounted Cumulative Gain (NDCG), to improve the evaluation of fine-tuned LLMs. Our experimental results demonstrate that NDCG significantly outperforms likelihood-based metrics: it shows over 45% improvement in both Spearman and Kendall’s tau correlation coefficients for commonsense QA tasks, and aligns more closely with GPT-4 Elo rankings for instruction-tuned models.