Roadmap for Physics of Information and Physics of Computation

Click on Headings below—Lectures, Readings, Homeworks, Labs—for details.

Lecture material provided in several formats:

Note: If (20XX) appears below, then linked material updated in year 20XX.

Physics of Computation, Physics 256B, Spring (Chronological):

Classes Lectures Readings Homeworks Labs Comments
Week Date  #(#)  Topic Outline Slides Video
10 4 Apr  1(21)  Overview—What's Wrong with Information Theory? HTML PDF
HTML
POCI Channel CMR articles RURO (Introduction), CAO, & ROIC. HW 10 assigned Properties of Joint Distributions
6 Apr  2(22)  The Learning Channel HTML PDF HTML POCI Channel CMR articles BOAC & CMPPSS (first sections).
11 11 Apr  3(23)  ε-Machine Reconstruction HTML PDF HTML POCI Channel Lecture Slides. HW 11 assigned, HW 10 due Parse Trees and Future Morphs
13 Apr  4(24)  ε-Machine Optimalities HTML PDF HTML POCI Channel CMR article CMPPSS.
12 18 Apr  5(25)  Measures of Structural Complexity HTML PDF HTML POCI Channel CMR articles CMPPSS and RURO. HW 12 assigned, HW 11 due Parse Trees and Future Morphs
20 Apr  6(26)  Information Diagrams for Processes HTML PDF HTML POCI Channel CMR articles TBA, PRATISP, IACP.
13 25 Apr  7(27)  States of States of Knowledge I HTML PDF HTML POCI Channel CMR articles TBA and Yeung. HW 13 Assigned Mixed State Presentations
27 Apr  8(28)  States of States of Knowledge II HTML PDF HTML POCI Channel CMR articles TBA, PRATISP, IACP.
14 2 May  9(29)  Directional Computational Mechanics I HTML PDF HTML POCI Channel CMR articles TBA and Yeung. HW 14 Assigned Bidirectional Processes & Machines
4 May  10(30)  Directional Computational Mechanics II HTML PDF HTML POCI Channel CMR articles TBA, PRATISP, IACP.
15 9 May  11(31)  Length Scales in Complex Time Series: Markov & Cryptic Orders HTML PDF HTML POCI Channel CMR articles MRS and SAC. HW 15 Assigned
Last one!
Markov Cryptic Information Ryan James
11 May  12(32)  Role of the Future in Analyzing Chaotic Dynamical Systems HTML PDF HTML POCI Channel CMR articles Anatomy and CFR. Ryan James
16 16 May  13(33)  Bayesian Inference for Known Model Structures HTML PDF HTML POCI Channel CMR articles IMC and OIMNC. Project! Lab 1: Bayesian Inference for Epsilon-machines Chris Strelioff
18 May  14(34)  Bayesian Structural Inference HTML PDF HTML POCI Channel CMR article BSI. Project! Lab 2: Bayesian Inference for Epsilon-machines Chris Strelioff
17 23 May  1A(41)  Spectral Decomposition of Intrinsic Computation I HTML PDF (2015) POCI Channel CMR article EC. Project! Lab 1: Canonical Matrix Forms and Process Architecture, Lab 2: Spectral Decompositions of Complexity Paul Riechers
25 May  1B(42)  Spectral Decomposition of Intrinsic Computation II HTML PDF POCI Channel CMR article EC. Project! Lab 3: Spectral Decomposition of Intrinsic Computation Paul Riechers
18 30 May  37a  Information Thermodynamics, Part I HTML PDF (2020) POCI Channel CMR article IRatchet. Project! Alec Boyd
1 June  37b  Information Thermodynamics, Part II HTML PDF (2018) POCI Channel CMR article IRatchet. Project! Alec Boyd
19 6 June Project Presentations I Schedule Students
8 June Project Presentations II Schedule Students
20 15 June Project Reports Due: End of Day Email to chaos@ucdavis.edu
At Your Leisure Afterword What We Didn't Cover: The Present and Future HTML PDF HTML POCI Channel
At Your Leisure  2A(50)  Quantum Complexity I HTML PDF HTML 2016 Stream Download CMR articles OQS and EQC. John Mahoney
At Your Leisure  2B(51)  Quantum Complexity II HTML PDF HTML 2016 Stream Download CMR articles OQS and EQC. John Mahoney
At Your Leisure  35  Power Spectra and ε-Machine Spectral Reconstruction HTML PDF HTML POCI Channel CMR articles BTFM1 and BTFM2. Dowman Varn
At Your Leisure  36  Intrinsic Computation in Complex Materials HTML PDF HTML POCI Channel CMR articles BTFM1 and BTFM2. Dowman Varn
TO COMMENT OUT ALL REMAINNG WEEKS OF 256B MOVE THESE FOUR LINES DOWN AFTER THE LAST WEEK TO SHOW END COMMENT OUT ALL 256B

Physics of Information, Physics 256A, Winter (Chronological):

Classes Lectures Readings Homeworks Labs Comments
Week Date  #  Topic Outline Slides Video
0 10 Jan  1  Overview HTML PDF HTML (2022) POCI Channel Chaos, Scientific American, and Odds, Stanislaw Lem. HW 0 Assigned HW Guidelines, Typesetting Math
12 Jan  2  The Big Picture HTML PDF HTML POCI Channel NDAC Chaps. 1 & 2; reference materials here and Python tutorials.
1 17 Jan  3  Example Dynamical Systems HTML PDF HTML POCI Channel NDAC Secs. 5.0-5.2, 6.0-6.4, 7.0-7.3, and 9.0-9.4. HW 0 due,
HW 1 Assigned
Prep Lab 1, Linear Algebra and ODEs, Favorite Flows
19 Jan  4  The Big, Big Picture I HTML PDF HTML
POCI Channel NDAC Chapter 3.
2 24 Jan  5  The Big, Big Picture II HTML PDF HTML POCI Channel NDAC Chapter 8 and Sec. 10.0-10.4. HW 1 due,
HW 2 Assigned
Prep Lab 2, Cellular Automata
26 Jan  6  Mechanisms of Chaos—Stable Instability HTML PDF HTML
POCI Channel NDAC Secs. 12.0-12.3, 9.3, and 10.5.
3 31 Jan  7  Example Chaotic Maps (that you can analyze) HTML PDF HTML POCI Channel NDAC Sections 10.5-10.7. HW 2 due,
HW 3 Assigned
Prep Lab 3
2 Feb  8  Pattern Formation I: Deterministic
(Part I, Cellular Automata)
HTML PDF HTML
POCI Channel Lecture Slides.
4 7 Feb 9 Pattern Formation I: Deterministic
(Part II, Map Lattices)
See above. See above. POCI Channel Lecture Slides. HW 3 due,
HW 4 Assigned
Prep Lab 4, 1D Map Evolution of Distributions, One- and Two-Dimensional Maps
9 Feb  10  Probability Theory of Dynamical Systems HTML PDF HTML
POCI Channel Lecture Slides.
5 14 Feb 11 Stochastic Processes HTML PDF HTML POCI Channel Lecture Slides. HW 4 due,
Take-home Midterm Exam on CMPy Cloud
Symbolic Dynamics and Partitions Lab
16 Feb 12 Measurement Theory I HTML PDF HTML POCI Channel Lecture Slides and CMR Alice (Gilmore/Lefranc Chap. 2).
6 21 Feb 13 Measurement Theory II HTML PDF HTML POCI Channel Lecture Slides and CMR Alice (Gilmore/Lefranc Chap. 2). Midterm due,
HW 6 Assigned
Processes, Word Distributions, and Models; Information Theory and Communication Channels
23 Feb 14 Entropies HTML PDF HTML POCI Channel EIT Chapters 1 and 2.
7 28 Feb 15 Information in Processes I HTML PDF HTML POCI Channel EIT Sections 5.1-5.4 and 7.1-7.7. HW 6 due,
HW 7 Assigned
Multivariate Information Lab and Information in Processes Lab I
2 Mar 16 Information in Processes II HTML PDF HTML POCI Channel EIT Chapter 4 and CMR MET.
8 7 Mar 17 Memory in Processes I HTML PDF HTML POCI Channel CMR article RURO. HW 7 due,
HW 8 Assigned
Information in Processes Lab 2
9 Mar 18 Memory in Processes II HTML PDF HTML POCI Channel CMR article RURO.
9 14 Mar 19 Information Measures and Information Diagrams HTML PDF HTML POCI Channel CMR article Yeung. HW 8 due,
Final Exam (HW 9) Assigned
Information Diagrams Lab
16 Mar 20 Anatomy of a Bit HTML PDF HTML POCI Channel CMR article Anatomy.
TO COMMENT OUT ALL REMAINNG WEEKS OF 256A MOVE THESE FOUR LINES AFTER THE LAST WEEK TO SHOW END COMMENT OUT ALL 256B

All materials © James P. Crutchfield 2006-2023