Junchao Zhang

Junchao Zhang

Auto-generated profile, based on publicly available information

Junchao Zhang

Argonne National Laboratory, Lemont, IL, USA

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 May 2021 in IEEE Transactions on Parallel and Distributed Systems
Verified
Journal Article
Closed access
JZJunchao Zhang
Junchao Zhang
JBJed Brown
Jed Brown
SBSatish Balay
Satish Balay
JFJacob Faibussowitsch
Jacob Faibussowitsch
MKMatthew Knepley
Matthew Knepley
SZStefano Zampini
Stefano Zampini
PetscSF, the communication component of the Portable, Extensible Toolkit for Scientific Computation (PETSc), is designed to provide PETSc's communication infrastructure suitable for exascale computers that utilize GPUs and other accelerators. PetscSF provides a simple application programming interface (API) for managing common communication patterns in scientific computations by using a star-forest graph representation. PetscSF supports several implementations based on MPI and NVSHMEM, whose selection is based on the characteristics of the application or the target architecture. An efficient and portable model for network and intra-node communication is essential for implementing large-scale applications. The Message Passing Interface, which has been the de facto standard for distributed memory systems, has developed into a large complex API that does not yet provide high performance on the emerging heterogeneous CPU-GPU-based exascale systems. In this article, we discuss the design of PetscSF, how it can overcome some difficulties of working directly with MPI on GPUs, and we demonstrate its performance, scalability, and novel features.

18 January 2025 in The International Journal of High Performance Computing Applications
Verified
Journal Article
Closed access
RMRichard Tran Mills
Richard Tran Mills
MAMark F. Adams
Mark F. Adams
SBSatish Balay
Satish Balay
JBJed Brown
Jed Brown
JFJacob Faibussowitsch
Jacob Faibussowitsch
JZJunchao Zhang
Junchao Zhang
The Portable Extensible Toolkit for Scientific Computation (PETSc) library provides scalable solvers for nonlinear time-dependent differential and algebraic equations and for numerical optimization via the Toolkit for Advanced Optimization (TAO). PETSc is used in dozens of scientific fields and is an important building block for many simulation codes. During the U.S. Department of Energy’s Exascale Computing Project, the PETSc team has made substantial efforts to enable efficient utilization of the massive fine-grain parallelism present within exascale compute nodes and to enable performance portability across exascale architectures. We recap some of the challenges that designers of numerical libraries face in such an endeavor, and then discuss the many developments we have made, which include the addition of new GPU backends, features supporting efficient on-device matrix assembly, better support for asynchronicity and GPU kernel concurrency, and new communication infrastructure. We evaluate the performance of these developments on some pre-exascale systems as well as the early exascale systems Frontier and Aurora, using compute kernel, communication layer, solver, and mini-application benchmark studies, and then close with a few observations drawn from our experiences on the tension between portable performance and other goals of numerical libraries.

11 September 2023
Verified
Conference Paper
Open access
HZHui Zhou
Hui Zhou
KRKen Raffenetti
Ken Raffenetti
JZJunchao Zhang
Junchao Zhang
YGYanfei Guo
Yanfei Guo
RTRajeev Thakur
Rajeev Thakur
MPI + Threads, embodied by the MPI/OpenMP hybrid programming model, is a parallel programming paradigm where threads are used for on-node shared-memory parallelization and MPI is used for multi-node distributed-memory parallelization. OpenMP provides an incremental approach to parallelize code, while MPI, with its isolated address space and explicit messaging API, affords straightforward paths to obtain good parallel performance. However, MPI + Threads is not an ideal solution. Since MPI is unaware of the thread context, it cannot be used for interthread communication. This results in duplicated efforts to create separate and sometimes nested solutions for similar parallel tasks. In addition, because the MPI library is required to obey message-ordering semantics, mixing threads and MPI via MPI_THREAD_MULTIPLE can easily result in miserable performance due to accidental serializations. We propose a new MPI extension, MPIX Thread Communicator (threadcomm), that allows threads to be assigned distinct MPI ranks within thread parallel regions. The threadcomm extension combines both MPI processes and OpenMP threads to form a unified parallel environment. We show that this MPI × Threads (MPI Multiply Threads) paradigm allows OpenMP and MPI to work together in a complementary way to achieve both cleaner codes and better performance.

8 September 2025
Verified
Conference Paper
Open access
BSBarry Smith
Barry Smith
JZJunchao Zhang
Junchao Zhang
HZHong Zhang
Hong Zhang
LMLois Curfman McInnes
Lois Curfman McInnes
MKMurat Keçeli
Murat Keçeli
VVVenkatram Vishwanath
Venkatram Vishwanath

26 July 2026
Verified
Conference Paper
Open access
BSBarry Smith
Barry Smith
HZHong Zhang
Hong Zhang
JZJunchao Zhang
Junchao Zhang
SBSatish Balay
Satish Balay
LCLe Chen
Le Chen
LMLois Curfman McInnes
Lois Curfman McInnes
Scientific computing software such as PETSc embodies deep expertise in numerical methods, solver configuration, and scalable implementation, yet this knowledge remains difficult for both users and large language models (LLMs) to access and apply effectively. As a result, even experienced researchers spend significant time selecting solvers, debugging configurations, and validating results. In this work, we present initial experiences in developing an AI-assisted, agent-based ecosystem to improve PETSc usability and productivity for scientific applications. Our approach integrates retrieval-augmented generation (RAG), grounded in PETSc manual pages and curated documentation, with modular services for code generation, compilation, execution, and validation, all exposed through lightweight agent interfaces. We position PETSc as a domain-aware component in multi-step AI workflows that span question answering, code development, execution, and verification. We describe the infrastructure and prototype services that support these capabilities and outline their potential to enable more effective, reliable, and scalable AI-assisted workflows in scientific computing.

18 September 2025 in ACM Transactions on Mathematical Software
Verified
Journal Article
Open access
BSBarry Smith
Barry Smith
MBMarsha Berger
Marsha Berger
JZJunchao Zhang
Junchao Zhang
HZHui Zhou
Hui Zhou
A chasm exists between mathematical software libraries written for MPI-based applications and those written for OpenMP applications. Recently, however, PETSc enables the simple use of its MPI-based linear solvers from OpenMP applications. Separately, the MPICH MPI development team has started a new project to allow almost seamless MPI use in OpenMP applications. Both proposed approaches would result in a similar user experience. We discuss the reasons for these projects and their potential for providing more numerical library choices for OpenMP applications, including the unlimited assortment of linear solvers available in PETSc. In addition, we present the performance of an application using the first approach, demonstrating its efficacy.