FIT5148 - Big data management and processing - 2018

6 points, SCA Band 2, 0.125 EFTSL

Postgraduate - Unit

Refer to the specific census and withdrawal dates for the semester(s) in which this unit is offered.


Information Technology

Chief examiner(s)

Associate Professor David Taniar

Unit guides



  • First semester 2018 (On-campus)


  • First semester 2018 (Evening)

Monash Online

  • Teaching Period 5 2018 (Online)


(FIT9131 or FIT9133) and FIT9132

Students should have an introductory understanding of database concepts and SQL and some programming background.




Monash Online offerings are only available to students enrolled in the Graduate Diploma in Data ScienceGraduate Diploma in Data Science ( via Monash Online.


Data engineering is about developing the software (and hardware) infrastructure to support data science. This unit introduces software tools and techniques for data engineering, but not hardware. It will cover:

  • introduction to big data processing, covering volume, variety, and velocity;
  • large volume data processing using parallel technologies;
  • variety data formats, including unstructured and semi-structured data, using NoSQL databases;
  • velocity data processing, covering data streaming;


On successful completion of this unit, students should be able to:

  1. identify and assess big data concepts and technologies;
  2. write and interpret parallel database processing algorithms and methods;
  3. use big data processing frameworks and technologies;
  4. describe and compare NoSQL technologies;
  5. use and evaluate streaming methods in big data processing;
  6. use big data streaming technologies.


For Monash Online: In-semester assessment: 100%

On-campus: Examination (2 hours): 50%; In-semester assessment: 50%

Workload requirements

Minimum total expected workload equals 144 hours per semester comprising:

  1. Contact hours for on-campus students:
    • Two hours/week lectures
    • Two hours/week laboratories
  2. Contact hours for Monash Online students:
    • Two hours/week online group sessions.
    • Online students generally do not attend lecture, tutorial and laboratory sessions, however should plan to spend equivalent time working through resources and participating in discussions.
  3. Additional requirements (all students):
    • A minimum of 8 hours per week of personal study (22 hours per week for Monash Online students) for completing lab/tutorial activities, assignments, private study and revision, and for online students, participating in discussions.

See also Unit timetable information

This unit applies to the following area(s) of study

Advanced data analytics

Data science

Additional information on this unit is available from the faculty at: