Velimir Ilic

Dr. Velimir Ilic


Research Focus & Metrics

Academic Career Length

20Years (2007-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
21 November 2017 in Proceedings
Verified
Conference Paper
Open access
PDF file
VIVelimir Ilic
Velimir Ilic
Ivan B. DjordjevicIvan B. Djordjevic
Ivan B. Djordjevic
Miomir StankovicMiomir Stankovic
Miomir Stankovic
In recent decades, different definitions of conditional Rényi entropy (CRE) have been introduced. Thus, Arimoto proposed a definition that found an application in information theory, Jizba and Arimitsu proposed a definition that found an application in time series analysis and Renner-Wolf, Hayashi and Cachin proposed definitions that are suitable for cryptographic applications. However, there is still no a commonly accepted definition, nor a general treatment of the CRE-s, which can essentially and intuitively be represented as an average uncertainty about a random variable X if a random variable Y is given. In this paper we fill the gap and propose a three-parameter CRE, which contains all of the previous definitions as special cases that can be obtained by a proper choice of the parameters. Moreover, it satisfies all of the properties that are simultaneously satisfied by the previous definitions, so that it can successfully be used in aforementioned applications. Thus, we show that the proposed CRE is positive, continuous, symmetric, permutation invariant, equal to Rényi entropy for independent X and Y, equal to zero for X = Y and monotonic. In addition, as an example for the further usage, we discuss the properties of generalized mutual information, which is defined using proposed CRE.

1 June 2021 in Entropy
Verified
Journal Article
Open access
PDF file
VIVelimir Ilic
Velimir Ilic
Ivan B. DjordjevicIvan B. Djordjevic
Ivan B. Djordjevic
The measures of information transfer which correspond to non-additive entropies have intensively been studied in previous decades. The majority of the work includes the ones belonging to the Sharma–Mittal entropy class, such as the Rényi, the Tsallis, the Landsberg–Vedral and the Gaussian entropies. All of the considerations follow the same approach, mimicking some of the various and mutually equivalent definitions of Shannon information measures, and the information transfer is quantified by an appropriately defined measure of mutual information, while the maximal information transfer is considered as a generalized channel capacity. However, all of the previous approaches fail to satisfy at least one of the ineluctable properties which a measure of (maximal) information transfer should satisfy, leading to counterintuitive conclusions and predicting nonphysical behavior even in the case of very simple communication channels. This paper fills the gap by proposing two parameter measures named the α-q-mutual information and the α-q-capacity. In addition to standard Shannon approaches, special cases of these measures include the α-mutual information and the α-capacity, which are well established in the information theory literature as measures of additive Rényi information transfer, while the cases of the Tsallis, the Landsberg–Vedral and the Gaussian entropies can also be accessed by special choices of the parameters α and q. It is shown that, unlike the previous definition, the α-q-mutual information and the α-q-capacity satisfy the set of properties, which are stated as axioms, by which they reduce to zero in the case of totally destructive channels and to the (maximal) input Sharma–Mittal entropy in the case of perfect transmission, which is consistent with the maximum likelihood detection error. In addition, they are non-negative and less than or equal to the input and the output Sharma–Mittal entropies, in general. Thus, unlike the previous approaches, the proposed (maximal) information transfer measures do not manifest nonphysical behaviors such as sub-capacitance or super-capacitance, which could qualify them as appropriate measures of the Sharma–Mittal information transfer.

26 December 2019 in Physical Review E
Verified
Journal Article
Closed access
PDF file
VIVelimir Ilic
Velimir Ilic
Antonio Maria ScarfoneAntonio Maria Scarfone
Antonio Maria Scarfone
TWTatsuaki Wada
Tatsuaki Wada
The class of strongly pseudoadditive (SPA) entropies, which can be represented as an increasing continuous transformation of Shannon and Rényi entropies, have intensively been studied in previous decades. Although their mathematical structure has thoroughly been explored and established by generalized Shannon-Khinchin axioms, the analysis of their thermostatistical properties have mostly been limited to special cases which belong to two parameter Sharma-Mittal entropy class, such as Tsallis, Renyi and Gaussian entropies. In this paper we present a general analysis of the strongly pseudoadditive entropies thermostatistics by taking into account both linear and escort constraints on internal energy. We develop two types of dualities between the thermostatistics formalisms. By the first one, the formalism of Rényi entropy is transformed in the formalism of SPA entropy under general energy constraint and, by the second one, the generalized thermostatistics which corresponds to the linear constraint is transformed into the one which corresponds to the escort constraint. Thus, we establish the equivalence between four different thermostatistics formalisms based on Rényi and SPA entropies coupled with linear and escort constraints and we provide the transformation formulas. In this way we obtain a general framework which is applicable to the wide class of entropies and constraints previously discussed in the literature. As an example, we rederive maximum entropy distributions for Sharma-Mittal entropy and we establish new relationships between the corresponding thermodynamic potentials. We obtain, as special cases, previously developed expressions for maximum entropy distributions and thermodynamic quantities for Tsallis, Rényi, and Gaussian entropies. In addition, the results are applied for derivation of thermostatistical relationships for supraextensive entropy, which has not previously been considered.

1 September 2007
Verified
Conference Paper
Closed access
Zoran PerićZoran Perić
Zoran Perić
VIVelimir Ilic
Velimir Ilic
Jelena NikolićJelena Nikolić
Jelena Nikolić
In this paper we propose new model of vector quantizers which combines two classical models of quantizers. Particularly, the proposed model, denoted as hybrid, combines the compandor model and the general Lloyd-Max's model of vector quantizers. The performance analizes of these models are caried out for the Gaussian input signals. It is demonstrated that for a fixed number of quantizaton cells vector quantizers designed according to the hybrid model provides quantizer's performance very close to the optimal that corresponds to the Lloyd-Max's quantizers.

1 September 2016 in arXiv
Verified
Preprint
Open access
PDF file
VIVelimir Ilic
Velimir Ilic
Miomir StankovicMiomir Stankovic
Miomir Stankovic
Recently, in [P. Jizba and J. Korbel, Physica A 444, 2016, 808-827], four generalized Shannon-Khinchin [GSK] axioms have been proposed and a generalized entropy which uniquely satisfies the GSK axioms has been derived. In this comment, we show that the unique class of the entropies derived in the aforementioned paper is not correct, as it violates the fourth GSK axiom, and we derive the correct one. Nevertheless, the class of entropies proposed in the commented paper still can serve as a basis for generalized statistical mechanics. We propose a new axiomatic system which characterizes the class of entropies.

2 November 2013 in arXiv
Verified
Preprint
Open access
PDF file
VIVelimir Ilic
Velimir Ilic
Miomir StankovicMiomir Stankovic
Miomir Stankovic
We present the characterization of the Nath, R\'enyi and Havrda-Charv\'at-Tsallis entropies under the assumption that they are analytic function with respect to the distribution dimension, unlike the the previous characterizations, which supposes that they are expandable maximized for uniform distribution.