1. Handbook
  2. Subjects
  3. Elements of Data Processing

Elements of Data Processing (COMP20008)

Undergraduate level 2Points: 12.5On Campus (Parkville)

You’re viewing the 2017 Handbook:
Or view archived Handbooks
You’re currently viewing the 2017 version of this subject

Overview

Availability
Semester 1
FeesLook up fees

AIMS

Data processing is fundamental to computing and data science. This subject gives an introduction to various aspects of data processing including database management, representation and analysis of data, information retrieval, visualisation and reporting, and cloud computing. This subject introduces students to the area, with an emphasis on both tools and underlying foundations.

INDICATIVE CONTENT

The subject's focus is on the data pipeline, and activities known colloquially as 'data wrangling'. Indicative topics covered include:

  • Capturing data (data ingress)
  • Data representation and storage
  • Cleaning, normalization and filling in missing data (imputation)
  • Combing multiple sources of data (data integration)
  • Query languages and processing
  • Scripting to support the data pipeline
  • Distributing a database over multiple nodes (sharding), cloud computing file systems

Visualisation and presentation

Intended learning outcomes

INTENDED LEARNING OUTCOME (ILO)


Having completed this subject the student is expected to:



  • Be familiar with the relationship of the data pipeline to data science
  • Be able to develop and critically evaluate alternative approaches to components of typical data pipelines
  • Apply data processing methodologies to preparing data while managing data quality, system scalability, and usability for decision making

Generic skills

On completion of this subject, students should have developed the following generic skills:

  • An ability to apply knowledge of basic science and engineering fundamentals
  • An ability to undertake problem identification, formulation and solution
  • The capacity to solve problems, including the collection and evaluation of information
  • The capacity for critical and independent thought and reflection
  • Profound respect for truth and intellectual integrity, and for the ethics of scholarship

An expectation of the need to undertake lifelong learning, and the capacity to do so.

Last updated: 3 November 2022