COL380/COL730 Introduction to Parallel & Distributed Programming

General Information

Co-Instructor: Subodh Sharma (email: svs at cse.iitd.ac.in)
Semester: II, 2022-2023
Timings: Mon/Tue/Fri 12:00-12:50
Class Venue: LH 108

Honour Code

• All students are expected to follow the highest ethical standards.
• Collaborations and discussions are encouraged. However, all students are required to write up all solutions entirely on their own. Any collaboration, or help taken, must be declared.
• Students are encouraged to refer to books, papers and internet resources. They may even consult other individuals. However, the source must be clearly cited if any part of the solution (or even an idea) is taken from such a source.
• Plagiarism is viewed very seriously. Any case of copying (or allowing to copy) of written text or code would immediately be awarded:
  • Negative of the the total of the assessment in which cheating was caught and a letter-grade drop
  • Referral to the Departmental DISCO
• All written/programming tasks are to performed on your own, other than when group-work is explicitly specified.

Learning Outcomes

• Write correct and efficient parallel programs; Programming Models
  • OpenMP, CUDA, MPI; Profilers and Debuggers
• Measure parallel performance and analyse correctness
  • Cost and Performance models
• Exposure to parallel algorithms and data structures
  • Map-reduce, fork-join, …
• Common distributed systems concepts
  • Synchronisations, Logical clocks, Consensus, …

References

• Ananth Grama, Georg Karypis, Vipin Kumar and Anshul Gupta (GKKG): Introduction to Parallel Computing
• Peter S. Pacheco (PP): An Introduction to Parallel Programming
• Maurice Herlihy and Nir Shavit (HS): The Art of Multiprocessor Programming
• M J Quinn (MJQ): Parallel Programming in C with MPI and OpenMP
• Subodh Kumar (SK): Introduction to Parallel Programming

Administrative Information and Grading Policy

Grading Policy:

• Transcribing: 05
• In-class Quizzes (2): 10 (Detailed split-up: TBA)
• Lab Assignments: 28 (Detailed split-up: TBA)
• Lab Exam(1): 12
• Minor, Major: 25, 30

Late submission policy

10% penalty for each day over the deadline. Maximum of 2 days allowed after which summary zero will be awarded (unless there is a medical emergency – for which you will have to provide a letter from the doctor).

Other Policies:

• Attendance: The Institute requires a mandatory 75% attendance for all students, which includes time lost due to illness. The course mandates 75% pre-minor required for reminor, 75% in semester for remajor.

• Illness: In sickness or ill-health, a Medical Certificate from the Institute Sick Bay, or a doctor from an Institute-recognised hospital is necessary, especially if you request for a make-up test. Only in the case of serious illnesses will I consider giving an extension on assignments.

Class notes and Programs developed in the class