PHY 28A
Natural Computation and Self-Organization:
The Physics of Information Processing in Complex Systems

Jim Crutchfield
chaos@ucdavis.edu; http://csc.ucdavis.edu/~chaos

Winter
WWW: http://csc.ucdavis.edu/~chaos/courses/poci/

Lecture 19: Information Measures and Information Diagrams

Reading: CMR articles Yeung and Anatomy.

Topics:

  1. Recall One- and Two-Variable Informations
  2. Algebra of Shannon Information Measures
  3. Information Diagrams
  4. Process I-Diagram
  5. Three random variables
  6. Negative Mutual Information
  7. Multivariate Mutual Informations
  8. Multivariate Informations