Note - This course website is still under construction, check back in fall 2025 for a fully updated version!

Entropy and Information: Concepts and Applications
CMPLXSYS 445   Fall 2025, University of Michigan
  • Syllabus
  • Schedule
  • Lectures
  • Assignments
  • Announcements
  • Gradescope
    • Submit an assignment
    • Using gradescope
  • Q & A

Schedule

# Day Date Topic Reference
1 M Aug 25 Introduction & Motivation -
2 W Aug 27 Probability Theory Gardiner Ch. 2
M Sep 1 Labor Day - NO CLASS
3 W Sep 3 Entropy - I Cover & Thomas Ch. 2
4 M Sep 8 Entropy - II Cover & Thomas Ch. 2
5 W Sep 10 Thermodynamics Parrondo/Horowitz/Sagawa
6 M Sep 15 Asymptotic Equipartition Theorem Cover & Thomas Ch. 3
7 W Sep 17 Coding & Data Compression Cover & Thomas Ch. 5
8 M Sep 22 Phase Transitions Vogel/Saravia/Cortez
9 W Sep 24 Relative Entropy Cover & Thomas Ch. 2
10 M Sep 29 Suboptimal Codes Cover & Thomas Ch. 5
11 W Oct 1 Mutual Information Cover & Thomas Ch. 2
12 M Oct 6 Sufficient Statistics Cover & Thomas Ch. 2
13 W Oct 8 Channels & Channel Coding Cover & Thomas Ch. 7
M Oct 13 Study Break - NO CLASS
14 W Oct 15 Midterm - NO CLASS (Take-home, 10:00am Oct 15 to 10:00am Oct 16)
15 M Oct 20 Horse racing & Natural selection Cover & Thomas Ch. 6 Rivoire/Leibler
16 W Oct 22 Differential Entropy Cover & Thomas Ch. 8, 9
17 M Oct 27 Biological Signal Transduction Bialek
18 W Oct 29 Rate-Distortion Theory Cover & Thomas Ch. 10
19 M Nov 3 MaxEnt Cover & Thomas Ch. 12
20 W Nov 5 Stochastic Processes Cover & Thomas Ch. 4
21 M Nov 10 Random Graph Models Fronczak
22 W Nov 12 Advanced topics TBD
23 M Nov 17 Advanced topics TBD
24 W Nov 19 Advanced topics TBD
25 M Nov 24 Advanced topics TBD
W Nov 26 Thanksgiving Break - NO CLASS
26 M Dec 1 Final Presentations Pt 1
27 W Dec 3 Final Presentations Pt 2
28 M Dec 8 Presentations Overflow
- M Dec 15 Final Exam (4-6pm)

Add to my calendar