Computational Mechanics:Preliminaries www.santafe.edu/projects/CompMech

• Observations: s_ = s_ s_

Past _ Future: Ö s-Ls-L+1Ös-1s0|s1Ös L-1sL Ö

Probabilities: Pr(s_), Pr(s_), Pr(s_)

• Uncertainty: Entropy

H[P] = -_i pi log pi [bits]

• Prediction error: Entropy Rate

  h_ = H[Pr(si|si-1si-2si-3Ö)]
  

• Information transmitted to future: Excess Entropy

E = H[Pr(s_)/ (Pr(s_)Pr(s_))]

Measure of independence: Is Pr(s_)=Pr(s_)Pr(s_)?

Describes information in ìrawî sequence blocks

Previous slide

Next slide

Back to first slide

View graphic version