Hyogi Sim

Mr. Hyogi Sim

orcid

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 November 2017
Verified
Conference Paper
Open access
HSHyogi Sim
Hyogi Sim
YKYoungjae Kim
Youngjae Kim
SVSudharshan S. Vazhkudai
Sudharshan S. Vazhkudai
GVGeoffroy R. Vallée
Geoffroy R. Vallée
SLSeung-Hwan Lim
Seung-Hwan Lim
ABAli R. Butt
Ali R. Butt
Data services such as search, discovery, and management in scalable distributed environments have traditionally been decoupled from the underlying file systems, and are often deployed using external databases and indexing services. However, modern data production rates, looming data movement costs, and the lack of metadata, entail revisiting the decoupled file system-data services design philosophy. In this paper, we present TagIt, a scalable data management service framework aimed at scientific datasets, which is tightly integrated into a shared-nothing distributed file system. A key feature of TagIt is a scalable, distributed metadata indexing framework, using which we implement a flexible tagging capability to support data discovery. The tags can also be associated with an active operator, for pre-processing, filtering, or automatic metadata extraction, which we seamlessly offload to file servers in a load-aware fashion. Our evaluation shows that TagIt can expedite data search by up to 10X over the extant decoupled approach.

12 November 2017
Verified
Conference Paper
Open access
SLSeung-Hwan Lim
Seung-Hwan Lim
HSHyogi Sim
Hyogi Sim
RGRaghul Gunasekaran
Raghul Gunasekaran
SVSudharshan S. Vazhkudai
Sudharshan S. Vazhkudai

27 April 2020 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Closed access
HSHyogi Sim
Hyogi Sim
AKAwais Khan
Awais Khan
SVSudharshan S. Vazhkudai
Sudharshan S. Vazhkudai
SLSeung-Hwan Lim
Seung-Hwan Lim
ABAli R. Butt
Ali R. Butt
YKYoungjae Kim
Youngjae Kim
Data services such as search, discovery, and management in scalable distributed environments have traditionally been decoupled from the underlying file systems, and are often deployed using external databases and indexing services. However, modern data production rates, looming data movement costs, and the lack of metadata, entail revisiting the decoupled file system-data services design philosophy. In this article, we present TagIt, a scalable data management service framework aimed at scientific datasets, which can be integrated into prevalent distributed file system architectures. A key feature of TagIt is a scalable, distributed metadata indexing framework, which facilitates a flexible tagging capability to support data discovery. Furthermore, the tags can also be associated with an active operator, for pre-processing, filtering, or automatic metadata extraction, which we seamlessly offload to file servers in a load-aware fashion. We have integrated TagIt into two popular distributed file systems, i.e., GlusterFS and CephFS. Our evaluation demonstrates that TagIt can expedite data search operation by up to 10× over the extant decoupled approach.

8 June 2021 in IEEE Access
Verified
Journal Article
Open access
AKAwais Khan
Awais Khan
HSHyogi Sim
Hyogi Sim
SVSudharshan S. Vazhkudai
Sudharshan S. Vazhkudai
YKYoungjae Kim
Youngjae Kim
Scientific applications often require high-bandwidth shared storage to perform joint simulations and collaborative data analytics. Shared memory pools provide a chance to satisfy such needs. Recently, a high-speed network such as Gen-Z utilizing persistent memory (PM) offers an opportunity to create a shared memory pool connected to compute nodes. However, there are several challenges to use scientific applications on the shared memory pool directly such as scalability, failure-atomicity, and lack of scientific metadata-based search and query. In this paper, we propose MOSIQS, a persistent memory object storage framework with metadata indexing and querying for scientific computing. We design MOSIQS based on the key idea that memory objects on PM pool can live beyond the application lifetime and can become the sharing currency for applications and scientists. MOSIQS provides an aggregate memory pool atop an array of persistent memory devices to store and access memory objects to accelerate scientific computing. MOSIQS uses a lightweight persistent memory key-value store to manage the metadata of memory objects, which enables memory object sharing. To facilitate metadata search and query over millions of memory objects resident on memory pool, we introduce Group Split and Merge (GSM), a novel persistent index data structure designed primarily for scientific datasets. GSM splits and merges dynamically to minimize the query search space and maintains low query processing time while overcoming the index storage overhead. MOSIQS is implemented on top of PMDK. We evaluate the proposed approach on many-core server with an array of real PM devices. Experimental results show that MOSIQS gains a 100% write performance improvement and executes multi-attribute queries efficiently with 2.7× less index storage overhead offering significant potential to speed up scientific computing applications.

12 November 2017
Verified
Conference Paper
Open access
FWFeiyi Wang
Feiyi Wang
HSHyogi Sim
Hyogi Sim
CHCameron Harr
Cameron Harr
SOSarp Oral
Sarp Oral

30 March 2020 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Closed access
AAAli Anwar
Ali Anwar
YCYue Cheng
Yue Cheng
HHHai Huang
Hai Huang
JHJingoo Han
Jingoo Han
HSHyogi Sim
Hyogi Sim
ABAli R. Butt
Ali R. Butt
Enterprise KV stores are often not well suited for HPC applications, and thus cumbersome end-to-end KV design customization is required to meet the needs of modern HPC applications. To this end, in this article we present bespoKV, an adaptive, extensible, and scale-out KV store framework. bespoKV decouples the KV store design into the control plane for distributed management and the data plane for local data store. For the control plane, bespoKVprovides pre-built modules, called controlets, supporting common distributed functionalities (e.g., replication, consistency, and topology) and their various combinations. This decoupling allows bespoKV to take a user-provided single-server KV store, called a datalet, and transparently enables a scalable and fault-tolerant distributed KV store service. The resulting distributed stores are also adaptive to consistency or topology requirement changes and can be easily extended for new types of services. Such specializations enable innovative uses of KV stores in HPC applications, especially for emerging applications that utilize KV-friendly workloads. We evaluate bespoKV in a local testbed as well as in a public cloud settings. Experiments show that bespoKV-enabled distributed KV stores scale horizontally to a large number of nodes, and performs comparably and sometimes 1.2× to 2.6× better than the state-of-the-art systems.