Course Information

Lectures (CS2): Mon - 12:00 PM, Tue - 9:00 AM
Labs (Lab 2): Tue 1:50 PM - 5:40 PM [TENTATIVE]

Objectives

This course lays the foundation for students to build multimedia systems. Multimedia systems involve automated analysis and fusion of multiple types of data such as text, images, video, audio, social networks, and various sensors. The course covers state-of-the-art tools and techniques for multimedia content processing, compression, fusion, summarization, search and retrieval applicable to different areas such as social media, homeland surveillance and privacy. The objective of this course is to prepare students to develop systems using multi-source information commonly and readily available in the form of Big Data in Internet of Things and Smart Cities paradigms.

Outcomes

By taking this course, the students will be able to find answer to the following questions:

How to capture, analyse, and compress multimedia (text, audio, and video) data?

How fuse multimedia data data to build multimedia systems?

How to design multimedia systems for surveillance, summarisation, and visual analytics?

Prerequisite

CSL201 (Data Structures) for CSE B. Tech Students

Course Requirements

Student are required to attend two lectures per week and appear in two exams. In addition, there will be weekly lab sessions. During lab sessions, the students are required to solve and implement programming assignments.

Grading Policy

There will be lab exercises, homework assignments, quizzes, a mid-semester exam, a final exam and project. The tentative grade distribution is as follows:

Quizzes (top 2): 10%
Homework Assignments: 15%
Lab Exercises (top n-1): 20%
Mid-semester exam: 10%
Final exam: 15%
Project: 30%
A student must score at least 40% marks to pass the course.

Attendance Requirement

There is no attendence requirement; however, students with more than 75% attendance would be considered punctual for future recommendations. During lectures :

BE SHARP ON TIME

STAY THROUGH THE LECTURE (DON'T LEAVE IN-BETWEEN THE LECTURE)

It is advised to not indulge in any activity during the lecture that might disturb other students or the instructor.

Code of Ethics & Professional Responsibility

It is expected that students who are taking this course will demonstrate a keen interest in learning and not mere fulfilling the requirement towards their degree. Discussions that help the student understand a concept or a problem is encouraged. However, each student must turn in original work. Plagiarism/copying of any form, will be dealt with strict disciplinary action. This involves, copying from the internet, textbooks and any other material for which you do not own the copyright. Copying part of the code will be considered plagiarism. Lending the code to others will be considered plagiarism too, for it is difficult to investigate who copied whose code. Students who violate this policy will directly receive a failing grade in the course. Remember - Your partial submission can fetch you some points, but submitting other's work as your own can result in you failing the course. Please talk to the instructor if you have questions about this policy. All academic integrity issues will be handled in accordance with institute regulations.

Textbooks

Primary Textbook

There is no single textbook for the course. We will rely heavily on the web sources for the content. Few possible reference books are given below:

Reference Books

1. Fundamentals of Multimedia, Authors: Li, Ze-Nian, Drew, Mark S., Liu, Jiangchuan, Publisher: Springer, Year 2014. [Link].

Language/Tools

For lab exercises we will primarily use Matlab and Python. For homework and projects, students are free to use any language.

Teaching Assistant

Pratibha Kumari (2017csz0006@iitrpr.ac.in), Ranjan Kumar (2018csm1018@iitrpr.ac.in)

Contact Me

By appointment at
Room No. 303, S. Ramanujan Block, Permanent Campus, IIT Ropar

Tentative Topics

• Audio representation, analysis, compression [3 weeks]
• Text representation, analysis, compression [3 weeks]
• Video/Image representation, analysis, compression [4 weeks]
• Information Fusion/Case Studies [4 weeks]

Assignments

Programming Assignment 1 - Deadline 16th Sep, 11:59 PM
Programming Assignment 2 - Deadline 10th Oct,11:59 PM

Quizzes

Quiz 1 - Week of Sep 9-16, CS2
Quiz 2 - TBA
Quiz 3 - TBA

Projects

Projects are to be done individually or in a group of two. The end application of the project should be in one of the following application areas: Surveillance, Safety, Education, Agriculture, Sports, Public Transportation, Movie making from mobile videos. Project requirements:

• You need to use at least two sources of information (for example audio and video). You need clearly to justify and demonstrate advantage of using two sources over using any individual source.
• The reports must be prepafed in ACM Multimedia LaTeX format. Good quality English is expected in the report.
• The code should be submitted through GitHub or Bitbucket repository. You can make a private repository and show me with your login. I will observe the activities on repository (commits, etc.) to check the progress.
• Dataset can be submitted through Pen Drive of Google Drive.
• You are free to use resources (code) available on the Internet with proper references. However, during evaluation you need to explicitly mention parts with your work.
• There will be marks for creativity in the project.
• There will be 5 to 6 evaluations of the project.