Kai Liu

Kai Liu

Auto-generated profile, based on publicly available information

Kai Liu

Spatiotemporal Innovation Center, George Mason University, Fairfax, VA 22030, USA

Research Focus & Metrics

Academic Career Length

13Years (2014-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
Verified
Journal Article
Open access
PDF file
Zhenlong LiZhenlong Li
Zhenlong Li
CYChaowei Yang
Chaowei Yang
KLKai Liu
Kai Liu
FHFei Hu
Fei Hu
BJBaoxuan Jin
Baoxuan Jin
Efficient processing of big geospatial data is crucial for tackling global and regional challenges such as climate change and natural disasters, but it is challenging not only due to the massive data volume but also due to the intrinsic complexity and high dimensions of the geospatial datasets. While traditional computing infrastructure does not scale well with the rapidly increasing data volume, Hadoop has attracted increasing attention in geoscience communities for handling big geospatial data. Recently, many studies were carried out to investigate adopting Hadoop for processing big geospatial data, but how to adjust the computing resources to efficiently handle the dynamic geoprocessing workload was barely explored. To bridge this gap, we propose a novel framework to automatically scale the Hadoop cluster in the cloud environment to allocate the right amount of computing resources based on the dynamic geoprocessing workload. The framework and auto-scaling algorithms are introduced, and a prototype system was developed to demonstrate the feasibility and efficiency of the proposed scaling mechanism using Digital Elevation Model (DEM) interpolation as an example. Experimental results show that this auto-scaling framework could (1) significantly reduce the computing resource utilization (by 80% in our example) while delivering similar performance as a full-powered cluster; and (2) effectively handle the spike processing workload by automatically increasing the computing resources to ensure the processing is finished within an acceptable time. Such an auto-scaling approach provides a valuable reference to optimize the performance of geospatial applications to address data- and computational-intensity challenges in GIScience in a more cost-efficient manner.

20 June 2014
Verified
Book Chapter
Closed access
PDF file
CYChaowei Yang
Chaowei Yang
MSMin Sun
Min Sun
KLKai Liu
Kai Liu
QHQunying Huang
Qunying Huang
ZLZhenlong Li
Zhenlong Li
NZNanying Zhou
Nanying Zhou