ABSTRACT

In this chapter, the ideas associated with information and entropy are considered and related to probability defined in terms of incomplete knowledge. Mutual and self information are introduced, and these concepts are applied to various models for communications channels.