Information Theory

Subject 431-689 (2009)

Note: This is an archived Handbook entry from 2009. Search for this in the current handbook

Credit Points: 12.50
Level: 9 (Graduate/Postgraduate)
Dates & Locations:

This subject has the following teaching availabilities in 2009:

Semester 2, - Taught on campus.
Pre-teaching Period Start not applicable
Teaching Period not applicable
Assessment Period End not applicable
Last date to Self-Enrol not applicable
Census Date not applicable
Last date to Withdraw without fail not applicable

Timetable can be viewed here. For information about these dates, click here.
Time Commitment: Contact Hours: 24 hours; Non-contact time commitment: 96 hours
Total Time Commitment: Not available
Prerequisites: None
Corequisites: None
Recommended Background Knowledge: None
Non Allowed Subjects: None
Core Participation Requirements:

For the purposes of considering request for Reasonable Adjustments under the Disability Standards for Education (Cwth 2005), and Student Support and Engagement Policy, academic requirements for this subject are articulated in the Subject Overview, Learning Outcomes, Assessment and Generic Skills sections of this entry.

It is University policy to take all reasonable steps to minimise the impact of disability upon academic study, and reasonable adjustments will be made to enhance a student's participation in the University's programs. Students who feel their disability may impact on meeting the requirements of this subject are encouraged to discuss this matter with a Faculty Student Adviser and Student Equity and Disability Support:


Dr Marcus Nathan Brazil
Subject Overview: Topics include: data compression and channel capacity, including Shannon's celebrated source coding theorem, and noisy channel coding theorem. Other topics are to be selected from coding theory, rate distortion theory, network information theory, and other applications to communications theory and statistical inference, data compression and channel capacity, including Shannon's celebrated source coding theorem, and noisy channel coding theorem.
Objectives: The aim of this subject is to give students a rigorous introduction to the basic, fundamental theorems and proofs of the subject.
Assessment: Continuous assessment (40%) to the equivalent of 3-hours writing time. Final Exam 3 hours worth 60%. Students are required to pass the final examination in order to pass the subject as a whole.
Prescribed Texts: None
Breadth Options:

This subject is not available as a breadth subject.

Fees Information: Subject EFTSL, Level, Discipline & Census Date
Generic Skills: 1. ability to apply knowledge of basic science and engineering fundamentals;

2. in-depth technical competence in at least one engineering discipline
ability to undertake problem identification, formulation and solution;

3. ability to utilise a systems approach to design and operational performance

4. expectation of the need to undertake lifelong learning, capacity to do so

5. capacity for independent critical thought, rational inquiry and self-directed learning

6. intellectual curiosity and creativity, including understanding of the philosophical and methodological bases of research activity

7. openness to new ideas and unconventional critiques of received wisdom

8. profound respect for truth and intellectual integrity, and for the ethics of scholarship
Related Course(s): Ph.D.- Engineering

Download PDF version.