Parallel Computing
Instructor: Dr. Chandresh Kumar Maurya
Lecture : Online (over Google meet, see calendar invite)
Time : Mon: 12-12:50 pm, Thu: 12-12:50 pm , lab: Thu 2-5 pm, tutorial: 9-9:50 am
Office : 415 in POD A building
Meeting hours: 16:00-17:00 PM
TA : PANKAJ CHAUDHARY phd2001201004@iiti.ac.in, Rajesh Dwivedi phd2101101003@iiti.ac.in
Text Books:
- Ananth Grama, George Karypis, Vipin Kumar, Anshul Gupta - Introduction to parallel computing-Addison Wesley (2003)
- Peter Pacheco - An Introduction to Parallel Programming-Morgan Kaufmann (2011)
- (Undergraduate Topics in Computer Science) Roman Trobec, Boštjan Slivnik, Patricio Bulić, Borut Robič - Introduction to Parallel Computing_ From Algorithms to Programming on State-of-the-Art Platforms
Grading policy: As announced in the class
Projects(10 marks+ 5 bonus mark)
- Make a group of 4 and start reading paper from ICPP 2021/2020 conference (link: https://dl.acm.org/conference/icpp).
- CR will share an excel sheet where you put the group leader’s name, the topic of the paper, link to the paper you are reading.
- Your task is to read one paper, understand it and implement it.
- Extra marks will be given to those who beat the result given in the paper.
- Upload on LMS the code+documentation.
- PPT will be held before the end-sem to present your findings.
Lecture Slides
| Date | Topics | Reading/References | Slides/Papers/demo |
|---|---|---|---|
| Aug 10 | Introduction to parallel computing | chapter 1 from ref. 2 and 3 | PDF video |
| Aug 12 | Introduction to parallel computing | chapter 1 from ref. 2 and 3 | PDF video |
| Aug 12 | parallel computing plateforms | chapter 2 from ref. 1,2 and 3 | PDF video |
| Aug 19 | parallel computing plateforms: pipelining and superscalar muliprocessor | chapter 2 from ref. 1,2 and 3 | PDF video video |
| Aug 19 | parallel computing plateforms: vector processor, GPUS | see slides | PDF video(short video due to recording issue) |
| Aug 23 | parallel computing plateforms: interconnection network | see slides | PDF video |
| Aug 26 | parallel computing plateforms: interconnection network. | Reading notes and see slides | PDF video |
| Aug 30 | Topology | see slides and videos | PDF video |
| Sep 2 | Buffer and flow control | see slides and videos | PDF video |
| Sep 3 | Massge passing fundamentals | see slides and videos | PDF video |
| Sep 6 | Massge passing fundamentals: MPI intro | see slides and videos | PDF PDF video |
| Sep 9 | MPI Advanced concepts: gather, scatter, etc. | see slides and videos | PDF video |
| Sep 13 | Parallel Computing Parformance metrics | see slides and videos | PDF video |
| Sep 16 | Parallel Computing Paraformance metrics | see slides and videos | PDF video |
| Sep 18 | Parallel Algo design principles | see slides and videos | PDF video |
| Sep 20 | Parallel Algo design principles: decomposition techniques | see slides and videos | PDF video |
| Oct 4 | Parallel Algo design principles: Charactristic of tasks and interaction | see slides and videos | PDF video |
| Oct 11 | Parallel Algo design principles: Mapping techniques, block cyclic decomposition | see slides and videos | PDF,PDF video |
| Oct 18 | Parallel Algo design principles: mapping techniques, Parallel algo models | see slides and videos | PDF video |
| Oct 21 | td>Introduction to shared memory programming: pthread | see slides and videos | PDF video |
| Oct 25 | td>Introduction to shared memory programming: pthread | see slides and videos | PDF video |
| Oct 28 | td>Introduction to openMP | see slides and videos | PDF video |
| Oct 28 | td>Introduction to openMP: workshaing, loops, synchronization construct etc. | see slides and videos | PDF1, PDF2 video |
| Nov 11 | td>Introduction to openMP: data sharing clause | see slides and videos | PDF video |
| Nov 11 | td>Introduction to openMP: tasks | see slides and videos | PDF1 video |
| Nov 15 | td>Introduction to openMP: tasks, flush | see slides and videos | PDF1 video |
Tutorials
| Date | Topics | Reading/References | Slides/Papers/demo |
|---|---|---|---|
| Aug 14 | Basics of OS | see slides | video |
| Aug 21 | processes | see slides | slides video |
| Sep 11 | Cannon's algo | see slides | slides video |
| Oct 9 | Intro to OpenMP | see slides | slides video |
| Oct 23 | Intro to CUDA | see slides | slides video |
| Oct 30 | Intro to CUDA | see slides | slides video |
| Nov 6 | OpenCL | see slides | slides video |
Labs
| Date | Topics | Reading/References | Slides/Papers/demo |
|---|---|---|---|
| Aug 26 | Basics of MPI | see slides | slides video |
| Sep 8 | Basics of MPI | see slides | slides video (passowrd: fWG732gN) |
