Handbook home
Information Theory (ELEN90030)
Graduate courseworkPoints: 12.5On Campus (Parkville)
About this subject
- Overview
- Eligibility and requirements
- Assessment
- Dates and times
- Further information
- Timetable(opens in new window)
Contact information
Semester 2
Email: gnair@unimelb.edu.au
Overview
Availability | Semester 2 |
---|---|
Fees | Look up fees |
AIMS
Information Theory is the fundamental backbone of reliable communications, reliable data storage, and data compression. This subject provides the rigorous basis of `information', showing it to have deep links to the ability to reduce data to its essence, and to the ultimate limits to communication.
INDICATIVE CONTENT
This subject is aimed at postgraduate (research) students. The subject material covers the core topics of Information Theory including: Shannon entropy, Mutual Information, lossless and lossy source coding, Shannon's celebrated channel capacity and channel coding theorem, differential entropy and the Gaussian channel. Technically the subject combines probabilistic models of idealised communication and the mathematics of applied probability.
Intended learning outcomes
INTENDED LEARNING OUTCOMES (ILOs)
Having completed this subject it is expected that the student be able to:
- Understand and apply the Shannon notion of entropy to model data coding and communication situations
- Manipulate Information Theoretic identities and to understand their intuitive meanings
- Analyse and understand the classic channel models and their capacity analysis in particular discrete memoryless channels, the Gaussian channel, and the critical ideas of random coding and joint typicality
- Understand the limits to data compression and be able to design codes which can approach the ultimate Shannon limit
Generic skills
On completion of this subject, students will have developed the following skills:
- Ability to apply knowledge of basic science and engineering fundamentals;
- In-depth technical competence in at least one engineering discipline;
- Ability to undertake problem identification, formulation and solution;
- Ability to utilise a systems approach to design and operational performance;
- Expectation of the need to undertake lifelong learning, capacity to do so;
- Capacity for independent critical thought, rational inquiry and self-directed learning;
- Intellectual curiosity and creativity, including understanding of the philosophical and methodological bases of research activity;
- Openness to new ideas and unconventional critiques of received wisdom;
- Profound respect for truth and intellectual integrity, and for the ethics of scholarship.
Last updated: 3 November 2022
Eligibility and requirements
Prerequisites
Enrolment in a research higher degree (MPhil or PhD) in Engineering.
Corequisites
None
Non-allowed subjects
None
Inherent requirements (core participation requirements)
The University of Melbourne is committed to providing students with reasonable adjustments to assessment and participation under the Disability Standards for Education (2005), and the Assessment and Results Policy (MPF1326). Students are expected to meet the core participation requirements for their course. These can be viewed under Entry and Participation Requirements for the course outlines in the Handbook.
Further details on how to seek academic adjustments can be found on the Student Equity and Disability Support website: http://services.unimelb.edu.au/student-equity/home
Last updated: 3 November 2022
Assessment
Additional details
- Continuous assessment in the form of two homework assignments (worth 20% each), not exceeding 30 pages in total over the semester (approximately 55-60 hours of work), worth 40% (addressing ILOs 1-4);
- One written examination not exceeding three hours at the end of semester, worth 60% (addressing ILOs 1-4).
Hurdle requirement: Students must pass the written exam to pass the subject.
Last updated: 3 November 2022
Dates & times
- Semester 2
Principal coordinator Girish Nair Mode of delivery On Campus (Parkville) Contact hours 200 hours Total time commitment 200 hours Teaching period 29 July 2019 to 27 October 2019 Last self-enrol date 9 August 2019 Census date 31 August 2019 Last date to withdraw without fail 27 September 2019 Assessment period ends 22 November 2019 Semester 2 contact information
Email: gnair@unimelb.edu.au
Time commitment details
200 hours
Last updated: 3 November 2022
Further information
- Texts
Prescribed texts
None
- Subject notes
LEARNING AND TEACHING METHODS
The subject is delivered through lectures and homework assignments.
INDICATIVE KEY LEARNING RESOURCES
Students are provided with lecture notes, including worked examples, assignment problems, and recommended reading lists comprising textbooks and journal articles.
CAREERS / INDUSTRY LINKS
Exposure to research literature and the rigour expected at the level of postgraduate study.
- Related Handbook entries
This subject contributes to the following:
Type Name Course Doctor of Philosophy - Engineering Course Master of Philosophy - Engineering Course Ph.D.- Engineering - Available through the Community Access Program
About the Community Access Program (CAP)
This subject is available through the Community Access Program (also called Single Subject Studies) which allows you to enrol in single subjects offered by the University of Melbourne, without the commitment required to complete a whole degree.
Entry requirements including prerequisites may apply. Please refer to the CAP applications page for further information.
Additional information for this subject
Subject coordinator approval required
- Available to Study Abroad and/or Study Exchange Students
This subject is available to students studying at the University from eligible overseas institutions on exchange and study abroad. Students are required to satisfy any listed requirements, such as pre- and co-requisites, for enrolment in the subject.
Last updated: 3 November 2022