We will update this page with additional resources. We encourage you to share other relevant resources that you have found useful and we will add to this list.
Text books
There will be no required text books for the class. Some of the class material, however, will be based on content from the following books (none of which you are required to purchase):
-
Richard Duda, Peter Hart and David Stork, Pattern Classification, 2nd ed. John Wiley & Sons, 2001.
-
Tom Mitchell, Machine Learning. McGraw-Hill, 1997. 1st edition.
-
Christopher Bishop, Pattern Recognition and Machine Learning. Springer 2007.
-
Hal Daumé, A Course in Machine Learning
-
Shai Shalev-Shwartz and Shai Ben-David, Understanding Machine Learning: From Theory to Algorithms
-
Moritz Hardt and Benjamin Recht, Patterns, Predictions, and Actions: A story about machine learning
Linear algebra resources
-
Linear Algebra Review and Reference from Stanford
-
The Linear Algebra chapter in the Deep Learning textbook.
Probability resources
-
David Blei’s review of probability
-
A review of probability theory from Stanford
-
The Probability and Information Theory chapter in the Deep Learning textbook.
Other topics
Propositional logic: It may be useful to know about propositional logic to follow certain lectures. Here are some refreshers about propositional logic:
-
Chapter 7 of Stuart Russel and Peter Norvig’s Artifical Intelligence: A Modern Approach gives a good background on propositional logic
-
A lecture on propositional logic in CMU’s program verification class
-
An archive of CS 103 at Stanford, which talks about the mathematical foundations of computing. Look at lectures 8,9 and 10.
-
The propositional logic lecture in the class Logic in Computer Science at the University of Liverpool.
Information Theory:
- The first two chapters of Information Theory, Inference, and Learning Algorithms introduce the basic concepts in information theory like entropy.
LaTeX
LaTeX is extremely useful for writing mathematics. While teaching LaTeX is beyond the scope of this course, there are some online resources that can help. Overleaf is an online LaTeX editor and has well written documentation on getting started with LaTeX.
-
Overleaf documentation has a collection of “new to LaTeX” articles.