FIT5202 - Data processing for big data - 2017

6 points, SCA Band 2, 0.125 EFTSL

Postgraduate - Unit

Refer to the specific census and withdrawal dates for the semester(s) in which this unit is offered.

Faculty

Information Technology

Unit guides

Offered

Caulfield

  • Second semester 2017 (Day)

Monash Online

  • Teaching Period 4 2017 (Online)

Notes

Monash Online offerings are only available to students enrolled in the Graduate Diploma in Data ScienceGraduate Diploma in Data Science (http://online.monash.edu/course/graduate-diploma-data-science/?Access_Code=MON-GDDS-SEO2&utm_source=seo2&utm_medium=referral&utm_campaign=MON-GDDS-SEO2) via Monash Online.

Synopsis

This unit teaches about working with different kinds of data, documents, graphs, spatial data. Distributed processing is introduced using Hadoop and Spark technologies, including streaming, graph processing and using NoSQL. Programming assignments are generally done in Spark, Linux, and similar shell-like environments.

Outcomes

Upon successful completion of this unit, students should be able to:

  1. compare the use of data streaming methods such as sampling, sketching and hashing;
  2. apply spatial data methods such as nearest neighbour and search on trees;
  3. apply large scale graph, vector and document processing methods;
  4. apply distributed processing using the Hadoop and Spark technologies;
  5. evaluate the suitability of different distributed technologies for big data processing;
  6. explain the workings of a typical cloud computing environment.

Assessment

In-semester assessment: 100%

Workload requirements

Minimum total expected workload equals 144 hours per semester comprising:

  1. Contact hours for on-campus students:
    • Two hours/week lectures
    • Two hours/week laboratories
  2. Contact hours for Monash Online students:
    • Two hours/week online group sessions.

    Online students generally do not attend lecture, tutorial and laboratory sessions, however should plan to spend equivalent time working through resources and participating in discussions.

  3. Additional requirements (all students):
    • A minimum of 8 hours per week of personal study (22 hours per week for Monash online students) for completing lab/tutorial activities, assignments, private study and revision, and for online students, participating in discussions.

See also Unit timetable information

Chief examiner(s)

This unit applies to the following area(s) of study

Prerequisites

(FIT9131 or FIT9133) and FIT9132

A working knowledge of Java and Python.