Semantics and Thermodynamics

James P. Crutchfield
Physics Department
University of California
Berkeley, California 94720, USA

ABSTRACT: Inferring models from given data leads through many different changes in representation. Most are subtle and profitably ignored. Nonetheless, any such change affects the semantic content of the resulting model and so, ultimately, its utility. A model's semantic structure determines what its elements mean to an observer that has built and uses it. In the search for an understanding of how large-scale thermodynamic systems might themselves take up the task of modeling and so evolve semantics from syntax, the present paper lays out a constructive approach to modeling nonlinear processes based on computation theory. It progresses from the microscopic level of the instrument and individual measurements, to a mesoscopic scale at which models are built, and concludes with a macroscopic view of their thermodynamic properties. Once the computational structure of the model is brought into the analysis it becomes clear how a thermodynamic system can support semantic information processing.


J. P. Crutchfield, "Semantics and Thermodynamics", in Nonlinear Modeling and Forecasting, SFI Studies in the Sciences of Complexity, Proc. Vol. XII, M. Casdagli and S. Eubank, editors, Addison-Wesley, Reading, Massachusetts (1992) 317-360.
Santa Fe Institute Working Paper 91-09-033.

Complete: [pdf] 680kb.

Original pieces:
Main portion: [ps.gz]= 200kb [ps]= 764kb [pdf]= 591kb
Figure 4: [ps.gz]= 4kb [ps]= 15kb [pdf]= 8kb
Figure 8: [ps.gz]= 3kb [ps]= 8kb [pdf]= 5kb
Figure 9: [ps.gz]= 7kb [ps]= 23kb [pdf]= 9kb
Figure 10: [ps.gz]= 7kb [ps]= 20kb [pdf]= 10kb

NOTE: Based on a talk given at the NATO Advanced Study Institute on Nonlinear Modeling and Forecasting, Santa Fe Institute, Santa Fe, New Mexico, September 1990.