lectures – Entropy and Information: Concepts and Applications<br><span style="font-size:12pt;"><b>CMPLXSYS 445</b> Fall 2025, University of Michigan</span>

Note - This course website is still under construction, check back in fall 2025 for a fully updated version!

Entropy and Information: Concepts and Applications
CMPLXSYS 445 Fall 2025, University of Michigan

Syllabus
Schedule
Lectures
Assignments
Gradescope
- Submit an assignment
- Using gradescope
Q & A

Lectures

1. Introduction & Motivation

Slides
Optional readings

2. Probability Theory I

Notes
References: Gardiner Chapter 2

2. Probability Theory II

Notes
Textbook chapters
Random walk demonstration

3. Entropy

Notes
Textbook chapters
Optional readings

4. Relative Entropy

Notes
Textbook chapters
Optional readings

3. Mutual Information

Notes
Textbook chapters
Optional readings