Entropy and Information: Concepts and Applications
CMPLXSYS 445   Fall 2025, University of Michigan
  • Syllabus
  • Schedule
  • Lectures
  • Assignments
  • Announcements
  • Gradescope
    • Submit an assignment
    • Using gradescope
  • Q & A

Schedule

# Day Date Topic Reference
1 M Aug 25 Introduction & Motivation -
2 W Aug 27 Probability Theory I Gardiner Ch. 2
M Sep 1 Labor Day - NO CLASS
3 W Sep 3 Probability Theory II Gardiner Ch. 2
4 M Sep 8 Entropy Cover & Thomas Ch. 2
5 W Sep 10 Applications of Entropy I Cover & Thomas Ch. 2 + Parrondo/Horowitz/Sagawa
6 M Sep 15 Applications of Entropy II Parrondo/Horowitz/Sagawa + Cover & Thomas Ch. 3
7 W Sep 17 Applications of Entropy III Cover & Thomas Ch. 3, 5
8 M Sep 22 Applications of Entropy IV Cover & Thomas Ch. 5 + Vogel/Saravia/Cortez
9 W Sep 24 Relative Entropy Cover & Thomas Ch. 2
10 M Sep 29 Applications of Relative Entropy Parrondo/Horowitz/Sagawa + Cover & Thomas Ch. 5
11 W Oct 1 Mutual Information Cover & Thomas Ch. 2
12 M Oct 6 Channel Coding I Cover & Thomas Ch. 7
13 M Oct 8 Channel Coding II Cover & Thomas Ch. 7
M Oct 13 Study Break - NO CLASS
W Oct 15 Midterm (Online) - NO CLASS
14 M Oct 20 Horse Racing Cover & Thomas Ch. 6
15 W Oct 22 Natural Selection Cover & Thomas Ch. 6 + Rivoire/Leibler
16 M Oct 27 Natural Selection & Continuous Random Variables Rivoire/Leibler + Cover & Thomas Ch. 8
17 W Oct 29 Differential Entropy Cover & Thomas Ch. 8
18 M Nov 3 Analong Communication Cover & Thomas Ch. 9
19 W Nov 5 Biological Signal Transduction Bialek Ch. 6 (6.4)
20 M Nov 10 Maximum Entropy Estimates Cover & Thomas Ch. 12
21 W Nov 12 Exponential Random Graph Models & Stochastic Processes Fronczak 1210.7828 & Cover & Thomas Ch. 4
22 M Nov 17 Stochastic Processes Cover & Thomas Ch. 4
W Nov 19 NO CLASS
M Nov 24 NO CLASS
W Nov 26 Thanksgiving Break - **NO_CLASS*
23 M Dec 1 Presentations Day 1 Groups
24 W Dec 3 Presentations Day 2 Groups
25 M Dec 8 Presentations Day 3 Groups
M Dec 15 Final Exam (Online)

Add to my calendar