CS507: Multimedia Systems
Semester I, 2019-20

 

Course Information Lectures/Calendar Assignments Labs

Course Information

Lectures (CS2): Mon - 12:00 PM, Tue - 9:00 AM
Labs (Lab 2): Tue 1:50 PM - 5:40 PM [TENTATIVE]

Objectives

This course lays the foundation for students to build multimedia systems. Multimedia systems involve automated analysis and fusion of multiple types of data such as text, images, video, audio, social networks, and various sensors. The course covers state-of-the-art tools and techniques for multimedia content processing, compression, fusion, summarization, search and retrieval applicable to different areas such as social media, homeland surveillance and privacy. The objective of this course is to prepare students to develop systems using multi-source information commonly and readily available in the form of Big Data in Internet of Things and Smart Cities paradigms.

Outcomes

By taking this course, the students will be able to find answer to the following questions:
  • How to capture, analyse, and compress multimedia (text, audio, and video) data?
  • How fuse multimedia data data to build multimedia systems?
  • How to design multimedia systems for surveillance, summarisation, and visual analytics?
  • Prerequisite

    CSL201 (Data Structures) for CSE B. Tech Students

    Course Requirements

    Student are required to attend two lectures per week and appear in two exams. In addition, there will be weekly lab sessions. During lab sessions, the students are required to solve and implement programming assignments.

    Grading Policy

    There will be lab exercises, homework assignments, quizzes, a mid-semester exam, a final exam and project. The tentative grade distribution is as follows:

    Quizzes (top 2): 10%
    Homework Assignments: 15%
    Lab Exercises (top n-1): 20%
    Mid-semester exam: 10%
    Final exam: 15%
    Project: 30%
    A student must score at least 40% marks to pass the course.

    Attendance Requirement

    There is no attendence requirement; however, students with more than 75% attendance would be considered punctual for future recommendations. During lectures :
  • BE SHARP ON TIME
  • STAY THROUGH THE LECTURE (DON'T LEAVE IN-BETWEEN THE LECTURE)
  • It is advised to not indulge in any activity during the lecture that might disturb other students or the instructor.

    Code of Ethics & Professional Responsibility

    It is expected that students who are taking this course will demonstrate a keen interest in learning and not mere fulfilling the requirement towards their degree. Discussions that help the student understand a concept or a problem is encouraged. However, each student must turn in original work. Plagiarism/copying of any form, will be dealt with strict disciplinary action. This involves, copying from the internet, textbooks and any other material for which you do not own the copyright. Copying part of the code will be considered plagiarism. Lending the code to others will be considered plagiarism too, for it is difficult to investigate who copied whose code. Students who violate this policy will directly receive a failing grade in the course. Remember - Your partial submission can fetch you some points, but submitting other's work as your own can result in you failing the course. Please talk to the instructor if you have questions about this policy. All academic integrity issues will be handled in accordance with institute regulations.

    Textbooks

    Primary Textbook

    There is no single textbook for the course. We will rely heavily on the web sources for the content. Few possible reference books are given below:

    Reference Books

    1. Fundamentals of Multimedia, Authors: Li, Ze-Nian, Drew, Mark S., Liu, Jiangchuan, Publisher: Springer, Year 2014. [Link].

    Language/Tools

    For lab exercises we will primarily use Matlab and Python. For homework and projects, students are free to use any language.

    Teaching Assistant

    Pratibha Kumari (2017csz0006@iitrpr.ac.in), Ranjan Kumar (2018csm1018@iitrpr.ac.in)

    Contact Me

    By appointment at
    Room No. 303, S. Ramanujan Block, Permanent Campus, IIT Ropar

    Tentative Topics

    • Audio representation, analysis, compression [3 weeks]
    • Text representation, analysis, compression [3 weeks]
    • Video/Image representation, analysis, compression [4 weeks]
    • Information Fusion/Case Studies [4 weeks]

    Assignments

    Programming Assignment 1 - Deadline 16th Sep, 11:59 PM
    Programming Assignment 2 - Deadline 10th Oct,11:59 PM

    Quizzes

    Quiz 1 - Week of Sep 9-16, CS2
    Quiz 2 - TBA
    Quiz 3 - TBA

    Projects

    Projects are to be done individually or in a group of two. The end application of the project should be in one of the following application areas: Surveillance, Safety, Education, Agriculture, Sports, Public Transportation, Movie making from mobile videos. Project requirements:
    • You need to use at least two sources of information (for example audio and video). You need clearly to justify and demonstrate advantage of using two sources over using any individual source.
    • The reports must be prepafed in ACM Multimedia LaTeX format. Good quality English is expected in the report.
    • The code should be submitted through GitHub or Bitbucket repository. You can make a private repository and show me with your login. I will observe the activities on repository (commits, etc.) to check the progress.
    • Dataset can be submitted through Pen Drive of Google Drive.
    • You are free to use resources (code) available on the Internet with proper references. However, during evaluation you need to explicitly mention parts with your work.
    • There will be marks for creativity in the project.
    • There will be 5 to 6 evaluations of the project.

    Lectures and Calendar

    Lectures Dates Topics Readings Events
    L1-2 Aug 5- Aug 6 Introduction [LINK] Lab 1 [LINK]
    L3-4 Aug 13 - Aug 14 (Oct 28 lecture moved to Aug 14, 10:00 AM, CS2) Sampling and Quantization [LINK] Fundamentals of Multimedia - Chapter 6 Lab 2 [LINK]
    Aug 19 - Aug 20 FLOOD
    Aug 26 - Aug 27 FLOOD
    L5-6-7 Sep 3 - Sep 4 (Nov 16 lecture moved to Sep 4, 10:00 AM, CS2), Sep 7 Lab 3, Lab 4
    L8-9 Sep 9, Sep 11 (Nov 18 lecture moved to Sep 11, 10:00 AM, CS2) Quiz 1, Lab 5
    L10-11-12-13 Sep 16, Sep 17, Sep 20, Sep 21 Assignment 1 Submission on 16th Sep
    L14-15 Sep 23 - Sep 24
    Sep 25 - Sep 29 Mid-semester examination
    L16 Oct 1 Lab 6
    L17-18 Oct 7, Oct 9 (Nov 19 lecture moved to Oct 9, 10:00 AM, CS2) Lab 7, Project Proposal due on Oct 10th Oct
    L19-20 Oct 14 - Oct 15 Lab 8, Assignment 2 due on 14th Oct
    L21-22 Oct 21 - Oct 22 Project Evaluation 1
    L23-24 Oct 30 (Oct 29 lecture moved to Oct 30, and Oct 28 lecture moved to Aug 14), Nov 2 Project Evaluation 2, Quiz 2
    L25-26-27 Nov 4 - Nov 5, Nov 7 Project Evaluation 3, Quiz 3 on Nov 6 10:00 AM, CS2
    L28 - 29 Nov 11, Nov 13 Project exhibition/demo on November 16, 1:50 PM to 5:40 PM
    Nov 24 - Dec 02 END semester exam

    *This is a tentative schedule. The schedule can change according to the need at the discretion of the instructor.

    Scroll to top

    Lab Exercises

    Every week