Natural Computation and Self-Organization:
The Physics of Information Processing in Complex Systems

Jim Crutchfield
chaos@csc.ucdavis.edu; http://csc.ucdavis.edu/~chaos

PHY 28A
Winter
WWW: http://csc.ucdavis.edu/~chaos/courses/poci/

Lecture 16: Information in Processes II

Reading: EIT Chapter 4.

Topics:

  1. Entropies for times series
  2. Entropy growth
  3. Entropy rates for Markov chains
  4. Connection to dynamics
    1. Partitioning revisited
    2. Ergodicity and mixing
    3. Metric and topological entropies
    4. Entropy rate and LCEs