CSL607: Multimedia Systems
Semester II, 2017-18

 

Course Information Lectures/Calendar Assignments Labs

Course Information

Lectures (H7): Tue-3:50 PM, Wed-4:45 PM
Labs (Lab 2, NIELIT): Mon 9:00 AM - 12:35 PM

Objectives

This course lays the foundation for students to build multimedia systems. Multimedia systems involve automated analysis and fusion of multiple types of data such as text, images, video, audio, social networks, and various sensors. The course covers state-of-the-art tools and techniques for multimedia content processing, compression, fusion, summarization, search and retrieval applicable to different areas such as social media, homeland surveillance and privacy. The objective of this course is to prepare students to develop systems using multi-source information commonly and readily available in the form of Big Data in Internet of Things and Smart Cities paradigms.

Outcomes

By taking this course, the students will be able to find answer to the following questions:
  • How to capture, analyse, and compress multimedia (text, audio, and video) data?
  • How fuse multimedia data data to build multimedia systems?
  • How to design multimedia systems for surveillance, summarisation, and visual analytics?
  • Prerequisite

    CSL201 (Data Structures) and Basic knowledge of image processing.

    Course Requirements

    Student are required to attend two lectures per week and appear in two exams. In addition, there will be weekly lab sessions. During lab sessions, the students are required to solve and implement programming assignments.

    Grading Policy

    There will be lab exercises, homework assignments, quizzes, a mid-semester exam, a final exam and project. The tentative grade distribution is as follows:

    Quizzes (top 2): 10%
    Homework Assignments: 15%
    Lab Exercises: 20%
    Mid-semester exam: 10%
    Final exam: 15%
    Project: 30%
    A student must score at least 40% marks to pass the course.

    Attendance Requirement

    There is no attendence requirement; however, students with more than 75% attendance would be considered punctual for future recommendations. During lectures :
  • BE SHARP ON TIME
  • STAY THROUGH THE LECTURE (DON'T LEAVE IN-BETWEEN THE LECTURE)
  • It is advised to not indulge in any activity during the lecture that might disturb other students or the instructor.

    Code of Ethics & Professional Responsibility

    It is expected that students who are taking this course will demonstrate a keen interest in learning and not mere fulfilling the requirement towards their degree. Discussions that help the student understand a concept or a problem is encouraged. However, each student must turn in original work. Plagiarism/copying of any form, will be dealt with strict disciplinary action. This involves, copying from the internet, textbooks and any other material for which you do not own the copyright. Copying part of the code will be considered plagiarism. Lending the code to others will be considered plagiarism too, for it is difficult to investigate who copied whose code. Students who violate this policy will directly receive a failing grade in the course. Remember - Your partial submission can fetch you some points, but submitting other's work as your own can result in you failing the course. Please talk to the instructor if you have questions about this policy. All academic integrity issues will be handled in accordance with institute regulations.

    Textbooks

    Primary Textbook

    There is no single textbook for the course. We will rely heavily on the web sources for the content. Few possible reference books are given below:

    Reference Books

    1. Fundamentals of Multimedia, Authors: Li, Ze-Nian, Drew, Mark S., Liu, Jiangchuan, Publisher: Springer, Year 2014. [Link].

    Language/Tools

    For lab exercises we will primarily use Matlab. For homework and projects students are free to use any language.

    Teaching Assistant

    Suchi Jain (Email: suchi.jain@iitrpr.ac.in)

    Contact Me

    By appointment at
    Room No. 358, Academic Building, IIT Ropar

    Feedback Form

    Lectures and Calendar

     

    Tentative Schedule and List of Topics*

    Week
    Dates
    Topic/Slides Readings/Comments
    1
    Jan9-Jan12
    Introduction  
    2
    Jan15-Jan19
    Audio capture and compression L1, Fundamentals of Multimedia - Chapter 6, 13
    3
    Jan22-Jan26
    Audio Analysis - STE, MFCC L2, Introduction to Audio Analysis Chapter 2, 4
    4
    Jan29-Feb2
    Audio Analysis - pitch detection, ML Refresher L3, Machine Learning for Audio, Image and Video Analysis , Chapter 2.1, 2.2
    5
    Feb5-Feb9
    Audio Analysis-Speaker recognition, fingerprinting No Lab
    6
    Feb12-Feb16
    Text Analysis - Bag of Words Assignment 1 guidelines,Text Analysis Resources, Text Data Management and Analysis- A Practical Introduction- Chapter 6, Additional Slides on BoW
    7
    Feb19-Feb23
    Text Document Clustering L4, Text Data Management and Analysis- A Practical Introduction- Chapter 14,
    8
    Feb26-Mar2
    Mid-semester exam  
    9
    Mar5-Mar9
    Topic and Sentiments, Image No lab (Assignment 2)
    10
    Mar12-Mar16
    HoG Features A2 Presentations on 12th March (During firat 1.5 hours of Lab), L5, Project proposal due on 16th March
    11
    Mar19-Mar23
    SIFT Features Motion Vectors L6
    12
    Mar26-Mar30
    Adaptive Background Modeling L7
    13
    Apr2-Apr6
    Particle Filter Based Tracking A3 presentations
    14
    Apr9-Apr13
    Data Compression-Text Project presentation
    15
    Apr16-Apr20
    MP3 Compression, JPEG Compression Project presentation
    16
    Apr23-Apr27
    Video Compression, Fusion Project presentation
    17
    Apr30-May4
    Case study Final project demo

    *This is a tentative list of topics that will be covered during the semester. The topics and schedule can change according to the need at the discretion of the instructor.

    Scroll to top

    Assignments

    Programming Assignment 1 - Deadline 10th Feb
    Programming Assignment 2 - Deadline 10th March
    Programming Assignment 3 - Deadline 30th March

    Quizzes

    Quiz 1 - 19th Feb
    Quiz 2 - 19th March
    Quiz 3 - 16th April

    Lab Exercises

    Every week (top n-1 will be considered)