Zhiwu Xie

Zhiwu Xie

Auto-generated profile, based on publicly available information

Zhiwu Xie

Virginia Polytechnic Institute and State University, Blacksburg, VA, USA

Research Focus & Metrics

Academic Career Length

26Years (2001-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 November 2017 in Information Services and Use
Verified
Journal Article
Open access
PDF file
ZXZhiwu Xie
Zhiwu Xie
EFEdward A. Fox
Edward A. Fox
Data-intensive science presents new opportunities as well as challenges to research libraries. The cyberinfrastructural challenge, although chiefly technological, also involves social-economic and human factors, therefore requires a deep understandin

7 July 2023 in Automation in Construction
Verified
Journal Article
Closed access
NVNatasha Vipond
Natasha Vipond
AKAbhinav Kumar
Abhinav Kumar
JJJoseph James
Joseph James
Frederick PaigeFrederick Paige
Frederick Paige
RSRodrigo Sarlo
Rodrigo Sarlo
ZXZhiwu Xie
Zhiwu Xie

1 August 2020
Verified
Conference Paper
Open access
XWXinyue Wang
Xinyue Wang
ZXZhiwu Xie
Zhiwu Xie
The WARC file format is widely used by web archives to preserve collected web content for future use. With the rapid growth of web archives and the increasing interest to reuse these archives as big data sources for statistical and analytical research, the speed to turn these data into insights becomes critical. In this paper we show that the WARC format carries significant performance penalties for batch processing workload. We trace the root cause of these penalties to its data structure, encoding, and addressing method. We then run controlled experiments to illustrate how severe these problems can be. Indeed, performance gain of one to two orders of magnitude can be achieved simply by reformatting WARC files into Parquet or Avro formats. While these results do not necessarily constitute an endorsement for Avro or Parquet, the time has come for the web archiving community to consider replacing WARC with more efficient web archival formats.

21 June 2015
Verified
Conference Paper
Open access
ZXZhiwu Xie
Zhiwu Xie
YCYinlin Chen
Yinlin Chen
JSJulie Speer
Julie Speer
TWTyler Walters
Tyler Walters
PTPablo Alberto Tarazaga
Pablo Alberto Tarazaga
MKMary Kasarda
Mary Kasarda
We propose a use and reuse driven big data management approach that fuses the data repository and data processing capabilities in a co-located, public cloud. It answers to the urgent data management needs from the growing number of researchers who don't fit in the big science/small science dichotomy. This approach will allow researchers to more easily use, manage, and collaborate around big data sets, as well as give librarians the opportunity to work alongside the researchers to preserve and curate data while it is still fresh and being actively used. This also provides the technological foundation to foster a sharing culture more aligned with the open source software development paradigm than the lone-wolf, gift-exchanging small science sharing or the top-down, highly structured big science sharing. To materialize this vision, we provide a system architecture consisting of a scalable digital repository system coupled with the co-located cloud storage and cloud computing, as well as a job scheduler and a deployment management system. Motivated by Virginia Tech's Goodwin Hall instrumentation project, we implemented and evaluated a prototype. The results show not only sufficient capacities for this particular case, but also near perfect linear storage and data processing scalabilities under moderately high workload.

1 January 2001 in Applied Thermal Engineering
Verified
Journal Article
Closed access
ZXZhiwu Xie
Zhiwu Xie
MSMing Su
Ming Su
SWShilie Weng
Shilie Weng

15 November 2016
Verified
Book Chapter
Closed access
ZXZhiwu Xie
Zhiwu Xie
JSJulie Speer
Julie Speer
YCYinlin Chen
Yinlin Chen
TJTingting Jiang
Tingting Jiang
CBCollin Brittle
Collin Brittle
PMPaul Mather
Paul Mather