Liting Hu

Liting Hu

Auto-generated profile, based on publicly available information

Liting Hu

Computing and Information Sciences, Florida International University, Miami, Florida United States

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 September 2018 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Closed access
Qingyang WangQingyang Wang
Qingyang Wang
HCHui Chen
Hui Chen
SZShungeng Zhang
Shungeng Zhang
LHLiting Hu
Liting Hu
BPBalaji Palanisamy
Balaji Palanisamy
Scaling complex distributed systems such as e-commerce is an importance practice to simultaneously achieve high performance and high resource efficiency in the cloud. Most previous research focuses on hardware resource scaling to handle runtime workload variation. Through extensive experiments using a representative n-tier web application benchmark (RUBBoS), we demonstrate that scaling an n-tier system by adding or removing VMs without appropriately re-allocating soft resources (e.g., server threads and connections) may lead to significant performance degradation resulting from implicit change of request processing concurrency in the system, causing either over- or under-utilization of the critical hardware resource in the system. We build a concurrency-aware model that determines a near optimal soft resource allocation of each tier by combining some operational queuing laws and the fine-grained online measurement data of the system. We then develop a dynamic concurrency management (DCM) framework that integrates the concurrency-aware model to intelligently reallocate soft resources in the system during the system scaling process. We compare DCM with Amazon EC2-AutoScale, the state-of-the-art hardware only scaling management solution using six real-world bursty workload traces. The experimental results show that DCM achieves significantly shorter tail latency and higher throughput compared to Amazon EC2-AutoScale under all the workload traces.

5 September 2019 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Closed access
SZShungeng Zhang
Shungeng Zhang
Qingyang WangQingyang Wang
Qingyang Wang
YKYasuhiko Kanemasa
Yasuhiko Kanemasa
HSHuasong Shan
Huasong Shan
LHLiting Hu
Liting Hu
Asynchronous event-driven server architecture has been considered as a superior alternative to the thread-based counterpart due to reduced multithreading overhead. In this paper, we conduct empirical research on the efficiency of asynchronous Internet servers, showing that an asynchronous server may perform significantly worse than a thread-based one due to two design deficiencies. The first one is the widely adopted one-event-one-handler event processing model in current asynchronous Internet servers, which could generate frequent unnecessary context switches between event handlers, leading to significant CPU overhead of the server. The second one is a write-spin problem (i.e., repeatedly making unnecessary I/O system calls) in asynchronous servers due to some specific runtime workload and network conditions (e.g., large response size and non-trivial network latency). To address these two design deficiencies, we present a hybrid solution by exploiting the merits of different asynchronous architectures so that the server is able to adapt to dynamic runtime workload and network conditions in the cloud. Concretely, our hybrid solution applies a lightweight runtime request checking and seeks for the most efficient path to process each request from clients. Our results show that the hybrid solution can achieve from 10% to 90% higher throughput than all the other types of servers under the various realistic workload and network conditions in the cloud.

14 June 2019
Verified
Book Chapter
Closed access
PDF file
HXHailu Xu
Hailu Xu
LHLiting Hu
Liting Hu
PLPinchao Liu
Pinchao Liu
BGBoyuan Guan
Boyuan Guan