coursemapLoading course
School of Computing · ANU College of Systems and Society
Information theory studies the fundamental limits of the representation and transmission of information. This course provides an introduction to information theory, studying fundamental concepts such as probability, information, and entropy and examining their applications in the areas of data compression, coding, communications, pattern recognition and probabilistic inference.
Assignment 1
Learning outcomes 1, 7
Assignment 2
Learning outcomes 1, 3, 5, 6
Assignment 3
Learning outcomes 2, 4, 6, 7
Final Exam
Learning outcomes 1, 2, 3, 4, 5, 6, 7
Lectures and tutorial sessions plus self study to a total of 130 hours.
David MacKay, ``Information Theory, Inference, and Learning Algorithms'', Cambridge University press, (primary text; available free http://www.inference.org.uk/mackay/itila ) Additional reading: Elements of Information Theory by Cover and Thomas, 2nd Edition, New York, Wiley, 2006.