Infinite Excess Entropy Processes with Countable-State Generators

Nicholas F. Travers and James P. Crutchfield

Complexity Sciences Center
Mathematics Department
Physics Department
University of California at Davis
Davis, CA 95616

ABSTRACT: We present two examples of finite-alphabet, infinite excess entropy processes generated by invariant hidden Markov models (HMMs) with countable state sets. The first, simpler example is not ergodic, but the second is. It appears these are the first constructions of processes of this type in the literature. Previous examples of infinite excess entropy processes over finite alphabets admit only invariant HMM presentations with uncountable state sets.


Nicholas F. Travers and James P. Crutchfield, "Infinite Excess Entropy Processes with Countable-State Generators", Entropy 16 (2014) 1396-1413. doi:10.3390/e16031396.
[pdf] 554 KB
Santa Fe Institute Working Paper 11-11-052.
arXiv:1111.3393 [math.PR].