Jialin Zhang

Prof. Jialin Zhang

orcid

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
12 May 2022 in Entropy
Verified
Journal Article
Open access
PDF file
JZJialin Zhang
Jialin Zhang
JSJingyi Shi
Jingyi Shi
Shannon’s entropy is one of the building blocks of information theory and an essential aspect of Machine Learning (ML) methods (e.g., Random Forests). Yet, it is only finitely defined for distributions with fast decaying tails on a countable alphabet. The unboundedness of Shannon’s entropy over the general class of all distributions on an alphabet prevents its potential utility from being fully realized. To fill the void in the foundation of information theory, Zhang (2020) proposed generalized Shannon’s entropy, which is finitely defined everywhere. The plug-in estimator, adopted in almost all entropy-based ML method packages, is one of the most popular approaches to estimating Shannon’s entropy. The asymptotic distribution for Shannon’s entropy’s plug-in estimator was well studied in the existing literature. This paper studies the asymptotic properties for the plug-in estimator of generalized Shannon’s entropy on countable alphabets. The developed asymptotic properties require no assumptions on the original distribution. The proposed asymptotic properties allow for interval estimation and statistical tests with generalized Shannon’s entropy.

Verified
Journal Article
Open access
PDF file
JZJialin Zhang
Jialin Zhang
The demands for machine learning and knowledge extraction methods have been booming due to the unprecedented surge in data volume and data quality. Nevertheless, challenges arise amid the emerging data complexity as significant chunks of information and knowledge lie within the non-ordinal realm of data. To address the challenges, researchers developed considerable machine learning and knowledge extraction methods regarding various domain-specific challenges. To characterize and extract information from non-ordinal data, all the developed methods pointed to the subject of Information Theory, established following Shannon’s landmark paper in 1948. This article reviews recent developments in entropic statistics, including estimation of Shannon’s entropy and its functionals (such as mutual information and Kullback–Leibler divergence), concepts of entropic basis, generalized Shannon’s entropy (and its functionals), and their estimations and potential applications in machine learning and knowledge extraction. With the knowledge of recent development in entropic statistics, researchers can customize existing machine learning and knowledge extraction methods for better performance or develop new approaches to address emerging domain-specific challenges.

22 March 2024 in Statistics & Probability Letters
Verified
Journal Article
Closed access
JZJialin Zhang
Jialin Zhang
ZZZhiyi Zhang
Zhiyi Zhang

17 May 2018 in Entropy
Verified
Journal Article
Open access
PDF file
CCChen Chen
Chen Chen
MGMichael Grabchak
Michael Grabchak
ASAnn Stewart
Ann Stewart
JZJialin Zhang
Jialin Zhang
ZZZhiyi Zhang
Zhiyi Zhang
This paper offers sufficient conditions for the Miller–Madow estimator and the jackknife estimator of entropy to have respective asymptotic normalities on countably infinite alphabets.

17 January 2020 in Communications in Statistics - Theory and Methods
Verified
Journal Article
Closed access
ZZZhiyi Zhang
Zhiyi Zhang
CCChen Chen
Chen Chen
JZJialin Zhang
Jialin Zhang
Nonparametric estimation of population size is a long standing and difficult problem. It is difficult because, particularly from a likelihood perspective, the underlying distribution could vary greatly and many small probability events may not be observed in a sample. However if approached from an entropic standpoint, certain trends can be exploited. This article proposes several estimators based on an entropic representation of population size, and establishes their consistency. Simulation results of the proposed estimators are also reported in comparison with a well-known estimator, and the advantages are noted. Two examples with real data are also included.

5 January 2025 in Nutrition
Verified
Journal Article
Closed access
MSMohammad K Shushari
Mohammad K Shushari
TWTianlan Wei
Tianlan Wei
JZJialin Zhang
Jialin Zhang
DTDiane K. Tidwell
Diane K. Tidwell
ACAmanda G Conrad
Amanda G Conrad
TTTerezie Tolar-Peterson
Terezie Tolar-Peterson