Roadmap for Physics of Information and Physics of Computation

Click on Headings below—Lectures, Readings, Homeworks—for full details.

Lecture material provided in several formats:

Note: If the year (20XX) appears below, then the linked material was updated in year 20XX.

Physics of Computation, Physics 256B, Spring (Chronological):

Classes Lectures Readings Homeworks Labs Comments
Week Date  #  Topic Outline Slides Video
10 3 Apr  21  Overview—What's Wrong with Information Theory? HTML PDF HTML Slides+Voiceover Stream
Download
CMR articles RURO (Introduction), CAO, & ROIC. HW 10 assigned Properties of Joint Distributions
5 Apr  22  The Learning Channel HTML PDF HTML Slides+Voiceover Stream
Download
CMR articles BOAC & CMPPSS (first sections).
11 10 Apr  23  ε-Machine Reconstruction HTML PDF HTML Slides+Voiceover Stream Download Lecture Notes. HW 11 assigned, HW 10 due Parse Trees and Future Morphs
12 Apr  24  ε-Machine Optimalities HTML PDF HTML Slides+Voiceover Stream Download CMR article CMPPSS.
12 17 Apr  25  Measures of Structural Complexity HTML PDF HTML Slides+Voiceover Stream Download CMR articles CMPPSS and RURO. HW 12 assigned, HW 11 due Parse Trees and Future Morphs
19 Apr  26  Information Diagrams for Processes HTML PDF HTML Slides+Voiceover Stream Download CMR articles TBA, PRATISP, IACP.
13 24 Apr  27  States of States of Knowledge I HTML PDF HTML Slides+Voiceover Stream Download CMR articles TBA and Yeung. HW 13 Assigned Mixed State Presentations
26 Apr  28  States of States of Knowledge II HTML PDF HTML Slides+Voiceover Stream Download CMR articles TBA, PRATISP, IACP.
14 1 May  29  Directional Computational Mechanics I HTML PDF HTML Slides+Voiceover Stream Download CMR articles TBA and Yeung. HW 14 Assigned Bidirectional Processes & Machines
3 May  30  Directional Computational Mechanics II HTML PDF HTML Slides+Voiceover Stream Download CMR articles TBA, PRATISP, IACP.
15 8 May  31  Length Scales in Complex Time Series: Markov & Cryptic Orders HTML PDF HTML Slides+Voiceover Stream Download CMR articles MRS and SAC. HW 15 Assigned
Last one!
Markov Cryptic Information Ryan James
10 May  32  Role of the Future in Analyzing Chaotic Dynamical Systems HTML PDF HTML Slides+Voiceover Stream Download CMR articles Anatomy and CFR. Ryan James
16 15 May  33  Bayesian Inference for Known Model Structures HTML PDF HTML Slides+Voiceover Stream Download CMR articles IMC and OIMNC. Project! Lab 1: Bayesian Inference for Epsilon-machines Chris Strelioff
18 May  34  Bayesian Structural Inference HTML PDF HTML Slides+Voiceover Stream Download CMR article BSI. Project! Lab 2: Bayesian Inference for Epsilon-machines Chris Strelioff
17 22 May  41  Spectral Decomposition of Intrinsic Computation I HTML PDF (2015) Stream Download CMR article EC. Project! Lab 1: Canonical Matrix Forms and Process Architecture, Lab 2: Spectral Decompositions of Complexity Paul Riechers
24 May  42  Spectral Decomposition of Intrinsic Computation II HTML PDF Stream Download CMR article EC. Project! Lab 3: Spectral Decomposition of Intrinsic Computation Paul Riechers
18 29 May  37a  Thermodynamics of Information, Part I HTML PDF (2018) Stream Download CMR article IRatchet. Project! Alec Boyd
31 May  37b  Thermodynamics of Information, Part II HTML PDF (2018) Stream Download CMR article IRatchet. Project! Alec Boyd
20 5 June Project Presentations I Schedule Students
7 June Project Presentations II Schedule Students
Afterword What We Didn't Cover: The Present and Future HTML PDF HTML Slides+Voiceover Stream Download

Physics of Information, Physics 256A, Winter (Chronological):

Classes Lectures Readings Homeworks Comments
Week Date  #  Topic Outline Slides Video
0 9 Jan  1  Overview HTML PDF (2018) HTML (2018) Slides+Voiceover Stream
Download
Chaos, Scientific American, and Odds, Stanislaw Lem HW 0 Assigned
11 Jan  2  The Big Picture HTML PDF HTML Slides+Voiceover Stream Download NDAC Chaps. 1 & 2; Sage tutorial and Python tutorials.
1 16 Jan  3  Example Dynamical Systems HTML PDF HTML Slides+Voiceover Stream Download NDAC Secs. 5.0-5.2, 6.0-6.4, 7.0-7.3, and 9.0-9.4. HW 0 due,
HW 1 Assigned
18 Jan  4  The Big, Big Picture I HTML PDF HTML
Skype Webcast
Stream Download NDAC Chapter 3.
2 23 Jan  5  The Big, Big Picture II HTML PDF HTML Slides+Voiceover Stream Download NDAC Chapter 8 and Sec. 10.0-10.4. HW 1 due,
HW 2 Assigned
25 Jan  6  Mechanisms of Chaos—Stable Instability HTML PDF HTML
Slides+Voiceover
Stream: Part 1 Part 2
Download: Part 1 Part 2
NDAC Secs. 12.0-12.3, 9.3, and 10.5.
3 30 Jan  7  Example Chaotic Maps (that you can analyze) HTML PDF HTML Slides+Voiceover Stream Download NDAC Sections 10.5-10.7. HW 2 due,
HW 3 Assigned
1 Feb  8  Pattern Formation I: Deterministic
(Part I, Cellular Automata)
HTML PDF HTML
Slides+Voiceover
Stream Download Lecture Notes.
4 6 Feb 8 Pattern Formation I: Deterministic
(Part II, Map Lattices)
See above. See above. Stream Download Lecture Notes HW 3 due,
HW 4 Assigned
8 Feb  10  Probability Theory of Dynamical Systems HTML PDF HTML
Slides+Voiceover
Stream Download Lecture Notes
5 13 Feb 11 Stochastic Processes HTML PDF HTML Slides+Voiceover Stream Download Lecture Notes HW 4 due,
Midterm Exam Assigned on Sage server
15 Feb 12 Measurement Theory I HTML PDF HTML Slides+Voiceover Stream Download Lecture Notes and CMR Alice (Gilmore/Lefranc Chap. 2)
6 20 Feb 13 Measurement Theory II HTML PDF HTML Skype webcast Stream Download Lecture Notes and CMR Alice (Gilmore/Lefranc Chap. 2) Midterm due,
HW 6 Assigned
22 Feb 14 Entropies HTML PDF HTML Slides+Voiceover Stream Download EIT Chapters 1 and 2
7 27 Feb 15 Information in Processes I HTML PDF HTML Slides+Voiceover Stream Download EIT Sections 5.1-5.4 and 7.1-7.7 HW 6 due,
HW 7 Assigned
1 Mar 16 Information in Processes II HTML PDF HTML Slides+Voiceover Stream Download EIT Chapter 4 and CMR MET
8 6 Mar 17 Memory in Processes I HTML PDF HTML Skype webcast Stream Download CMR article RURO HW 7 due,
HW 8 Assigned
8 Mar 18 Memory in Processes II HTML PDF HTML Slides+Voiceover Stream Download CMR article RURO
9 13 Mar 19 Information Measures and Information Diagrams HTML PDF HTML Slides+Voiceover Stream Download CMR article Yeung HW 8 due,
Final Exam (HW 9) Assigned on Sage server
15 Mar 20 Anatomy of a Bit HTML PDF HTML Slides+Voiceover Stream Download CMR article Anatomy

All materials © James P. Crutchfield 2006-2018