信息论基础(张能明）

课程编号：34008154

课程名称（中文）：信息论基础

课程名称（英文）：Information Theory

学分数/学时数：4/72

开课单位/开课学期：数学与计算科学学院数学系/4

课程类别：指定选修课

面向专业：软件工程（信息技术）

课程负责人：张能明

课程内容简介（中文）： 本课程讲授信息论和编码的基本理论。信息论采用概率论和遍历理论的方法研究数据和通信系统的统计特性， 编码论主要使用代数和几何等工具为各种应用环境设计有效的编码。课程的内容包括：信息论的基本概念（熵、交互信息、信道容量、信息率、Shannon无噪声编码定理和Shannon基本编码定理）、 信源模型（无记忆模型和Markov模型）、信息信道模型（BSC 和 BEC模型、信息的可加性和级联信道）， 紧致信源编码设计（Kraft不等式，紧致编码，Huffman 和LZW压缩编码）以及差错控制信道码的设计与分析（海明距离，二元线性码，奇偶校验矩阵，海明码，校验和，循环码，生成多项式和CRC码 ）。

课程内容简介（英文）： This course introduces the information theory, which employs probability and ergodic theory to study the statistical characteristics of data and communication systems, and the coding theory, which uses mainly algebraic and geometric tools to contrive efficient codes for various situations. The topics covered include the basic concepts of information theory--entropy, mutual information, channel capacity, information rate, Shannon's noiseless coding theorem and Shannon's fundamental coding theorem; modeling of information sources--zero-memory and Markov models; modeling of information channels--BSC and BEC channels, additivity of information and cascaded channels; construction of compact source codes--Kraft inequality, compact codes, Huffman and LZW compression codes; and analysis and design of error-control channel codes--Hamming distance, binary linear codes and the parity-check matrix, Hamming codes, checksum codes, cyclic codes and the generator polynomial and CRC codes.