Xiaoyong Du

Xiaoyong Du

Auto-generated profile, based on publicly available information

Xiaoyong Du

Renmin University of China

Research Focus & Metrics

Academic Career Length

22Years (2005-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
6 April 2013 in Frontiers of Computer Science
Verified
Journal Article
Closed access
PDF file
JCJinchuan Chen
Jinchuan Chen
YCYueguo Chen
Yueguo Chen
XDXiaoyong Du
Xiaoyong Du
CLCuiping Li
Cuiping Li
JLJiaheng Lu
Jiaheng Lu
XZXuan Zhou
Xuan Zhou

13 June 2023 in Proceedings of the ACM on Management of Data
Verified
Journal Article
Open access
ZGZihui Gu
Zihui Gu
JFJu Fan
Ju Fan
NTNan Tang
Nan Tang
LCLei Cao
Lei Cao
BJBowen Jia
Bowen Jia
XDXiaoyong Du
Xiaoyong Du
A common problem with adopting Text-to-SQL translation in database systems is poor generalization. Specifically, when there is limited training data on new datasets, existing few-shot Text-to-SQL techniques, even with carefully designed textual prompts on pre-trained language models (PLMs), tend to be ineffective. In this paper, we present a divide-and-conquer framework to better support few-shot Text-to-SQL translation, which divides Text-to-SQL translation into two stages (or sub-tasks), such that each sub-task is simpler to be tackled. The first stage, called the structure stage, steers a PLM to generate an SQL structure (including SQL commands such as SELECT, FROM, WHERE and SQL operators such as <", ?>") with placeholders for missing identifiers. The second stage, called the content stage, guides a PLM to populate the placeholders in the generated SQL structure with concrete values (including SQL identifies such as table names, column names, and constant values). We propose a hybrid prompt strategy that combines learnable vectors and fixed vectors (i.e., word embeddings of textual prompts), such that the hybrid prompt can learn contextual information to better guide PLMs for prediction in both stages. In addition, we design keyword constrained decoding to ensure the validity of generated SQL structures, and structure guided decoding to guarantee the model to fill correct content. Extensive experiments, by comparing with ten state-of-the-art Text-to-SQL solutions at the time of writing, show that SC-Prompt significantly outperforms them in the few-shot scenario. In particular, on the widely-adopted Spider dataset, given less than 500 labeled training examples (5% of the official training set), SC-Prompt outperforms the previous SOTA methods by around 5% on accuracy.

9 April 2025 in IEEE Transactions on Cloud Computing
Verified
Journal Article
Closed access
FZFeng Zhang
Feng Zhang
CZChenyang Zhang
Chenyang Zhang
JGJiawei Guan
Jiawei Guan
QZQiangjun Zhou
Qiangjun Zhou
KCKuangyu Chen
Kuangyu Chen
XDXiaoyong Du
Xiaoyong Du
Edge computing has gained widespread attention in cloud computing due to the increasing demands of AIoT applications and the evolution of edge architectures. One prevalent application in this domain is neural network inference on edge for computing and processing. This article presents an in-depth exploration of inference on integrated edge devices and introduces EdgeNN, a groundbreaking solution for inference specifically designed for CPU-GPU integrated edge devices. EdgeNN offers three key innovations. First, EdgeNN adaptively employs zero-copy optimization by harnessing unified physical memory. Second, EdgeNN introduces an innovative approach to CPU-GPU hybrid execution tailored for inference tasks. This technique enables concurrent CPU and GPU operation, effectively leveraging edge platforms’ computational capabilities. Third, EdgeNN adopts a finely tuned adaptive inference tuning technique that analyzes complex inference structures. It divides computations into sub-tasks, intelligently assigning them to the two processors for better performance. Experimental results demonstrate EdgeNN's superiority across six popular neural network inference processing. EdgeNN delivers average speed improvements of 3.97×, 4.10×, 3.12×, and 8.80× when compared to inference on four distinct edge CPUs. Furthermore, EdgeNN achieves significant time advantages compared to the direct execution of original programs. This improvement is attributed to better unified memory utilization (44.37%) and the innovative CPU-GPU hybrid execution approach (17.91%). Additionally, EdgeNN exhibits superior energy efficiency, providing 29.14× higher energy efficiency than edge CPUs and 5.70× higher energy efficiency than discrete GPUs. EdgeNN is now open source at https://github.com/ChenyangZhang-cs/EdgeNN.

19 September 2020 in The VLDB Journal
Verified
Journal Article
Closed access
PDF file
FZFeng Zhang
Feng Zhang
JZJidong Zhai
Jidong Zhai
XSXipeng Shen
Xipeng Shen
DWDalin Wang
Dalin Wang
ZCZheng Chen
Zheng Chen
XDXiaoyong Du
Xiaoyong Du

26 May 2023 in Proceedings of the ACM on Management of Data
Verified
Journal Article
Open access
JTJianhong Tu
Jianhong Tu
JFJu Fan
Ju Fan
NTNan Tang
Nan Tang
PWPeng Wang
Peng Wang
Guoliang LiGuoliang Li
Guoliang Li
SGSong Gao
Song Gao
Data matching - which decides whether two data elements (e.g., string, tuple, column, or knowledge graph entity) are the "same" (a.k.a. a match) - is a key concept in data integration, such as entity matching and schema matching. The widely used practice is to build task-specific or even dataset-specific solutions, which are hard to generalize and disable the opportunities of knowledge sharing that can be learned from different datasets and multiple tasks. In this paper, we propose Unicorn, a unified model for generally supporting common data matching tasks. Unicorn can enable knowledge sharing by learning from multiple tasks and multiple datasets, and can also support zero-shot prediction for new tasks with zero labeled matching/non-matching pairs. However, building such a unified model is challenging due to heterogeneous formats of input data elements and various matching semantics of multiple tasks. To address the challenges, Unicorn employs one generic Encoder that converts any pair of data elements (a, b) into a learned representation, and uses a Matcher, which is a binary classifier, to decide whether a matches b. To align matching semantics of multiple tasks, Unicorn adopts a mixture-of-experts model that enhances the learned representation into a better representation. We conduct extensive experiments using 20 datasets on seven well-studied data matching tasks, and find that our unified model can achieve better performance on most tasks and on average, compared with the state-of-the-art specific models trained for ad-hoc tasks and datasets separately. Moreover, Unicorn can also well serve new matching tasks with zero-shot learning.

25 June 2019 in Data Science and Engineering
Verified
Journal Article
Open access
PDF file
BLBofang Li
Bofang Li
ADAleksandr Drozd
Aleksandr Drozd
YGYuhe Guo
Yuhe Guo
TLTao Liu
Tao Liu
SMSatoshi Matsuoka
Satoshi Matsuoka
XDXiaoyong Du
Xiaoyong Du
Word embedding has been well accepted as an important feature in the area of natural language processing (NLP). Specifically, the Word2Vec model learns high-quality word embeddings and is widely used in various NLP tasks. The training of Word2Vec is sequential on a CPU due to strong dependencies between word–context pairs. In this paper, we target to scale Word2Vec on a GPU cluster. To do this, one main challenge is reducing dependencies inside a large training batch. We heuristically design a variation of Word2Vec, which ensures that each word–context pair contains a non-dependent word and a uniformly sampled contextual word. During batch training, we “freeze” the context part and update only on the non-dependent part to reduce conflicts. This variation also directly controls the training iterations by fixing the number of samples and treats high-frequency and low-frequency words equally. We conduct extensive experiments over a range of NLP tasks. The results show that our proposed model achieves a 7.5 times acceleration on 16 GPUs without accuracy drop. Moreover, by using high-level Chainer deep learning framework, we can easily implement Word2Vec variations such as CNN-based subword-level models and achieves similar scaling results.