Xiangdong Huang

Dr. Xiangdong Huang

orcid

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 June 2023 in Proceedings of the ACM on Management of Data
Verified
Journal Article
Open access
CWChen Wang
Chen Wang
JQJialin Qiao
Jialin Qiao
XHXiangdong Huang
Xiangdong Huang
SSShaoxu Song
Shaoxu Song
HHHaonan Hou
Haonan Hou
JSJiaguang Sun
Jiaguang Sun
A typical industrial scenario encounters thousands of devices with millions of sensors, consistently generating billions of data points. It poses new requirements of time series data management, not well addressed in existing solutions, including (1) device-defined ever-evolving schema, (2) mostly periodical data collection, (3) strongly correlated series, (4) variously delayed data arrival, and (5) highly concurrent data ingestion. In this paper, we present a time series database management system, Apache IoTDB. It consists of (i) a time series native file format, TsFile, with specially designed data encoding, and (ii) an IoTDB engine for efficiently handling delayed data arrivals and processing queries. The system achieves a throughput of 10 million inserted values per second. Queries such as 1-day data selection of 0.1 million points and 3-year data aggregation over 10 million points can be processed in 100 ms. Comparisons with InfluxDB, TimescaleDB, KairosDB, Parquet and ORC over real world data loads demonstrate the superiority of IoTDB and TsFile.

14 November 2023 in Advanced Engineering Informatics
Verified
Journal Article
Closed access
LZLing-Zhe Zhang
Ling-Zhe Zhang
XHXiangdong Huang
Xiangdong Huang
YWYan-Kai Wang
Yan-Kai Wang
JQJia-Lin Qiao
Jia-Lin Qiao
SSShao-Xu Song
Shao-Xu Song
JWJian-Min Wang
Jian-Min Wang

14 May 2025 in ACM Transactions on Database Systems
Verified
Journal Article
Open access
CWChen Wang
Chen Wang
JQJialin Qiao
Jialin Qiao
XHXiangdong Huang
Xiangdong Huang
SSShaoxu Song
Shaoxu Song
HHHaonan Hou
Haonan Hou
JSJiaguang Sun
Jiaguang Sun
A typical industrial scenario encounters thousands of devices with millions of sensors, consistently generating billions of data points. It poses new requirements of time series data management, not well addressed in existing solutions, including (1) device-defined ever-evolving schema, (2) mostly periodical data collection, (3) strongly correlated series, (4) variously delayed data arrival, and (5) highly concurrent data ingestion. In this paper, we present a time series database management system, Apache IoTDB. It consists of (i) a time series native file format, TsFile, with specially designed data encoding, and (ii) an IoTDB engine for efficiently handling delayed data arrivals and processing queries. We introduce a native distributed solution with distributed queries optimized by parallel operators. We also explore efficient TsFile synchronization mechanisms, ensuring seamless data integration without the need for ETL processes. The system achieves a throughput of 10 million inserted values per second. Queries such as 1-day data selection of 0.1 million points and 3-year data aggregation over 10 million points can be processed in 100 ms. Comparisons with InfluxDB, TimescaleDB, KairosDB, Parquet and ORC over real world data loads demonstrate the superiority of IoTDB and TsFile.

26 May 2023 in Proceedings of the ACM on Management of Data
Verified
Journal Article
Open access
CFChenguang Fang
Chenguang Fang
SSShaoxu Song
Shaoxu Song
HGHaoquan Guan
Haoquan Guan
XHXiangdong Huang
Xiangdong Huang
CWChen Wang
Chen Wang
JWJianmin Wang
Jianmin Wang
Columnar storage is now an industry standard design in most open-source or commercial time series database products, making them HTAP systems. The time column of a time series serves as the key for identifying the other value column, namely single-column storage scheme. When multiple time series share a similar set of timestamps, very likely in a module of multiple sensors, it is natural to group them together, i.e., one time column identifies multiple value columns in a single-group storage scheme. While multiple value columns sharing the same time column reduce the space cost of repeating timestamps, it may introduce extra space cost for recording null values. The reason is that time series may not be exactly aligned on each timestamp, owing to missing values, distinct data collection frequencies, unsynchronized clocks and so on. The columngroups storage scheme is thus to divide columns into multiple groups, within which the value columns share the same time column. Unfortunately, the problem of finding the optimal column groups for the minimum space cost is highly challenging, NP-hard according to our analysis. Thereby, we propose a heuristic algorithm for automatically grouping time series for efficient columnar storage. The column groups storage has been deployed in Apache IoTDB, an open-source time series database. The extensive performance analysis, over real-world data from our industrial partners, demonstrates that the proposed column groups achieve near optimal storage, more concise than the storage of single-column or single-group schemes. Interestingly, both the flushing and querying time costs of column groups are comparable to those of single-column or singlegroup, i.e., without incurring extra time cost.

20 September 2015 in Concurrency and Computation: Practice and Experience
Verified
Journal Article
Closed access
PDF file
XHXiangdong Huang
Xiangdong Huang
JWJianmin Wang
Jianmin Wang
YZYu Zhong
Yu Zhong
SSShaoxu Song
Shaoxu Song
PYPhilip S. Yu
Philip S. Yu

12 February 2024 in The VLDB Journal
Verified
Journal Article
Closed access
PDF file
TXTianrui Xia
Tianrui Xia
JXJinzhao Xiao
Jinzhao Xiao
YHYuxiang Huang
Yuxiang Huang
CHChangyu Hu
Changyu Hu
SSShaoxu Song
Shaoxu Song
JWJianmin Wang
Jianmin Wang