Natural Computation and Self-Organization:
The Physics of Information Processing in Complex Systems

Jim Crutchfield
chaos@csc.ucdavis.edu; http://csc.ucdavis.edu/~chaos

PHY 28A
Winter
WWW: http://csc.ucdavis.edu/~chaos/courses/poci/

Lecture 15: Information in Processes I

Reading: EIT, Sec. 5-5.4 and 7.1-7.7.

Topics:

  1. Review last lecture.
  2. Communication channels
  3. Codes
  4. Kraft Inequality
  5. Data Compression Theorem
  6. Redundancy
  7. Noisy Channels
  8. Equivocation
  9. Channel Capacity
  10. Channel Coding Theorem