the Shannon entropy
How well do practical information measures estimate the Shannon entropy?
... LZ-78 is an O(N log N) algorithm permitting faster complexity measurement suitable for longer strings. Fig- ure 3 shows that LZ-78 also severely overestimates lower entropies, even if the sample string size is increased ...
5
Shannon entropy in generalized order statistics from Pareto-type distributions
... of entropy was first discussed by Shannon [13] in the twentieth ...The Shannon entropy of a random variable X is a mathematical measure of information which measures the average reduction of ...
13
Continuous Controller Design for Quantum Shannon Entropy
... the Shannon entropy takes its maximum value ln n ...the entropy takes its minimum value 0. We can also regard the entropy as the superposition of the uncertainties ...
11
Predicting Shear Stress Distribution in Rectangular Channels Using Entropy Concept
... The entropy concept provides an excellent vehicle for introducing probability into hydraulics, making dealing with uncertainties inherent in hydraulic processes possible and helping to develop sampling schemes in ...
8
Application of Shannon Entropy in the Construction of a Paraconsistent Model of the Atom
... used in the equations of the degrees of certainty. The quantum phenomenon of the superposition of states is explicitly expressed through the equations and the representation in which two observers are active. This ...
38
DENOISING OF 1-D SIGNAL USING DISCRETE WAVELET TRANSFORMS
... In the context of signal processing cost function M measures how many coefficients are negligible (that is below threshold) in a transformed signal and how many are important. The basis that concentrate the signal energy ...
8
Some New Inequalities for Hermite-Hadamard Divergence in Information Theory
... RAO, On the convexity of some divergence measures based on entropy function, IEEE Trans.. LIN, Divergence measures based on the Shannon entropy, IEEE Trans.[r] ...
11
Color Image Segmentation Based on PCNN
... the Shannon entropy of the binary image of R, G and B increases first and then decreases with the iteration of the algorithm, when the iteration is more than 45 times, the Shannon entropy ...
13
The general solutions of a functional equation related to information theory
... The general solutions of a functional equation, containing two unknown functions, and related to a functional equation characterizing the Shannon entropy and the entropy of degree α , ar[r] ...
24
Existence and Uniqueness of Proper Scoring Rules
... define entropy functions on interiors of positive ...the Shannon entropy, the Hyv¨ arinen entropy, and in principle, the entropies associated with the proper local scoring rules of arbitrary ...
24
Gray Level Image Threshold Using Neutrosophic Shannon Entropy
... the Shannon entropy in order to determine ad- equate threshold ...the entropy of each pixel is as minimal as ...neutrosophic entropy of an image has demonstrated performance in multilevel ...
9
Choosing Technology by Using a Combined ANP and DEMATEL in Cellulose Industry (A Case Study: Tissue Paper Manufacturing Technologies)
... the Shannon Entropy, the DEMATEL, and the ANP in section 4 present a combined method to select a technology among technology alternatives for tissue production technology related to cellulose industry and ...
19
Shannon Entropy And Tracking Dynamic Systems Over Noisy Channels
... the Shannon capacity in terms of the rate of expansion of the Shannon entropy would be necessary and sucient for uniform almost sure asymptotic zero estimation ...
15
Two-faced processes and existence of RNG with proven properties
... the Shannon entropy of this process is 1 per letter, whereas for any other stationary process with binary alphabet the Shannon entopy is stricly less than ...the entropy of the PRNG output ...
14
Bayesian System Identification of MDOF Nonlinear Systems using Highly Informative Training Data
... the Shannon entropy is used as a measure of information content such that, by analysing the information content of the posterior parameter distribution, one is able to select and utilise a relatively small ...
10
Shannon Entropy in Distributed Scientific Calculations on Mobiles Ad Hoc Networks (MANETs)
... (DST). Shannon Entropy will be the formal mechanism by which the con- flict in the scenarios proposed in this paper will be ...the Shannon Entropy, after which the corresponding conclusions ...
7
Fuzzy Shannon Entropy for Face Recognition
... The Shannon entropy can also be applied to a face ...The entropy will be lower if the image contains no variation in the ...the entropy will be higher, if there is large variation in the ...
5
A novel entropy-based graph signature from the average mixing matrix
... which is able to capture the structural information of graphs better than existing entropic signatures. With respect to existing quantum walk graph kernels, we propose to use the average mixing matrix [14] to summarize ...
7
On Clausius, Boltzmann and Shannon Notions of Entropy
... Boltzmann's entropy is quite a lot general and its idea has been used to introduce others no- tions of entropy in mathematics and computation ...C. Shannon (see [10]) to be able to measure the ...
9
Measuring Urban Growth of Silchar Town Using Shannon Entropy Estimation
... through Shannon Entropy, the entire study area was divided into multiple buffer rings of 500 m interval from the city centre and the growth patterns have been studied based on urban built up density with ...
7