|
信息论中信源关系的分析与启示
|
Abstract:
随着现代信息技术的发展,信息论作为通信理论和方法论得到了广泛的研究和应用,发挥着重要作用。理解信源之间的关系,可以更好地掌握信息论的基本概念和内涵,理解信息论方法。针对目前各种教材中关于信源关系论述不充分的问题,本文采用事件间关系的维恩图表示法,系统分析了信源的联合、条件和交互三种关系,及其对应的信息熵,重点阐述了其在通信系统中的各种含义和启示。
With the development of modern information technology, information theory, as a communication theory and methodology, has been widely studied and applied, playing an important role. Under-standing the relationship between information sources can better grasp the basic concepts and connotations of information theory, and understand its methods. In response to the insufficient discussion of information source relationships in various textbooks, this article adopts the Venn di-agram representation of event to event relationships, systematically analyzes the three relation-ships of information sources: union, condition, and interaction, as well as their corresponding in-formation entropy. It focuses on explaining their various meanings and inspirations in communica-tion systems.
[1] | Togneri, R. and de Silva, C.J.S. (2006) Fundamentals of Information Theory and Coding Design. CRC Press, Boca Ra-ton. |
[2] | 鲍宗博, 高莹, 刘建伟. 从Venn图看信息论中各信息量之间的关系[J]. 高等数学研究, 2020, 23(1): 69-72+75. |
[3] | 贺志强, 吴伟陵. 信息处理与编码(第三版) [M]. 北京: 人民邮电出版社, 2012. |
[4] | 王育民, 李晖. 信息论与编码理论[M]. 北京: 高等教育出版社, 2013. |
[5] | 田宝玉, 杨洁, 贺志强, 许文俊. 信息论基础[M]. 北京: 人民邮电出版社, 2016. |
[6] | 于秀兰, 王永, 陈前斌. 信息论与编码[M]. 北京: 人民邮电出版社, 2014. |
[7] | 姚善化, 许恒迎, 许耀华, 苏静明. 信息理论与编码[M]. 北京: 人民邮电出版社, 2015. |