Browse > Article
http://dx.doi.org/10.1633/JISTaP.2016.4.4.5

Characterization of New Two Parametric Generalized Useful Information Measure  

Bhat, Ashiq Hussain (Post Graduate Department of Statistics University of Kashmir)
Baig, M. A. K. (Post Graduate Department of Statistics University of Kashmir)
Publication Information
Journal of Information Science Theory and Practice / v.4, no.4, 2016 , pp. 64-74 More about this Journal
Abstract
In this paper we define a two parametric new generalized useful average code-word length $L_{\alpha}^{\beta}$(P;U) and its relationship with two parametric new generalized useful information measure $H_{\alpha}^{\beta}$(P;U) has been discussed. The lower and upper bound of $L_{\alpha}^{\beta}$(P;U), in terms of $H_{\alpha}^{\beta}$(P;U) are derived for a discrete noiseless channel. The measures defined in this communication are not only new but some well known measures are the particular cases of our proposed measures that already exist in the literature of useful information theory. The noiseless coding theorems for discrete channel proved in this paper are verified by considering Huffman and Shannon-Fano coding schemes on taking empirical data. Also we study the monotonic behavior of $H_{\alpha}^{\beta}$(P;U) with respect to parameters ${\alpha}$ and ${\beta}$. The important properties of $H_{{\alpha}}^{{\beta}}$(P;U) have also been studied.
Keywords
Shannon's entropy; codeword length; useful information measure; Kraft inequality; Holder's inequality; Huffman codes; Shannon-Fano codes; Noiseless coding theorem;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Belis, M., & Guiasu S. (1968). A quantitative-qualitative measure of information in cybernetic System. IEEE Transaction on Information Theory, 14, 593-594.   DOI
2 Bhaker, U.S., & Hooda, D.S. (1993). Mean value characterization of 'useful' information measure. Tamkang Journal of Mathematics, 24, 283-294.
3 Bhat, A. H., & Baig, M. A. K. (2016). Some coding theorems on generalized Renyi's entropy of order α and type $\beta$. International Journal of Applied Mathematics and Information Sciences Letters, 5, 1-5.   DOI
4 Campbell L. L. (1965). A coding theorem and Renyi's entropy. Information and Control, 8, 423-429.   DOI
5 Guiasu, S., & Picard, C. F. (1971). Borne inferieure de la longueur de certain codes (pp. 248-251). Paris: C.R. Academic Sciences, t. 273.
6 Gurdial, P. F. (1977). On useful Information of order $\alpha$. Journal of Combinatorics Information and System Sciences, 2, 158-162.
7 Hartley, R. V. L. (1928). Transmission of information. Bell System Technical Journal, 7,535-563.   DOI
8 Hooda, D. S., & Bhaker, U. S. (1997). A generalized 'useful' information measure and coding theorems. Soochow Journal of Mathematics, 23, 53-62.
9 Jain P., & Tuteja, R. K. (1989). On coding theorem connected with 'useful' entropy of order $\beta$.International Journal of Mathematics and Mathematical Sciences, 12, 193-198.   DOI
10 Khan, A. B., Bhat, B. A., & Pirzada, S. (2005). Some results on a generalized 'useful' information measure. Journal of Inequalities in Pure and Applied Mathematics, 6, 117.
11 Longo G. (1976). A noiseless coding theorem for source having utilities. SIAM Journal of Applied Mathematics, 30, 739-748.   DOI
12 Mitter, J., & Mathur, Y. D. (1972). Comparison of entropies of power distributions. ZAMM, 52, 239-240.
13 Nyquist, H. (1924). Certain factors affecting telegraph speed. Bell System Technical Journal, 3, 324-346.   DOI
14 Nyquist, H. (1928). Certain topics in telegraphy transmission theory. Journal of the American Institute of Electrical Engineers, 47, 617.   DOI
15 Renyi, A. (1961). On measure of entropy and information. Proceedings Fourth Berkeley Symposium on Mathematical Statistics and Probability, University of California Press, 1, 547-561.
16 Kraft, L. G. (1949). A device for quantizing grouping and coding amplitude modulates pulses (M. S. thesis). Department of Electrical Engineering, MIT, Cambridge.
17 Shannon, C. E. A mathematical theory of communication. Bell System Technical Journal, 27, 379-423, 623-659.
18 Sharma, B. D, Mohan, M., & Mitter, J. On measure of 'useful' information. Information and Control, 39, 323-336.
19 Taneja, H. C., Hooda, D. S., & Tuteja, R. K. Coding theorems on a generalized 'useful' information. Soochow Journal of Mathematics, 11, 123-131.