Instructor
Gary M. Zoppetti, Ph.D.
Office: Roddy 134
Office Hours and Contact Info: cs.millersville.edu/~gzoppetti

Final
Section 01: Wed, 05/06; 12:30 – 02:30 pm

Syllabus and Assignments

• Syllabus
• Unless otherwise specified, a due date of X means the assignment is due by 11:59 pm on day X. Times are strictly enforced by the grading system, and there are NO grace days! Only the LATEST submission will be graded. Consult How to Submit to submit your work.
• Reading
  • Intro (1)
  • Parallel Hardware and Software (2)
  • Shared Memory Programming with C++ and Pthreads (4)
  • Distributed-Memory Programming with MPI (3)
  • Shared Memory Programming with OpenMP (5)
  • GPU Programming with CUDA (6)
• Assignments
  • Always follow the Formatting Requirements. Place my .clang-format in your home directory (~/.clang-format) or the root of your workspace (~/476/.clang-format) and install the official clangd extension in VS Code. You likely also want my .clangd file.

  • Assignment 0: Reductio Add Unum (Reductions, Parallel Patterns); due Fri, 01/30. Assignment 0.

  • Assignment 1: May the Forks be with You (Process Parallelism, Reductions, IPC, Fork); due Wed, 02/11. Assignment 1.

  • Assignment 1b: A Template in Time Saves Nine (Refactoring, Granularity, Concepts, Reductions); due Tue, 02/17. Assignment 1b.

  • Assignment 2: Cache Me Inside, Howbow Dah (Matrix Multiplication, Caching, Blocking, Loop Dependencies); due Wed, 02/25. Assignment 2.

  • Assignment 2b: The Matrix Reloaded (C++ Unit Testing, Testing, Move Semantics); due Tue, 03/03. Assignment 2b.

  • Assignment 3: A Tale of Two Threads (Thread-level Parallelism, C++ Threads, Parallel STL); due Sun, 03/08. Assignment 3.

Useful Links

• Lecture Notes.
• My Code Samples.

  ---

• Top500 Supercomputer Site.
• perf Examples.
• Intel 64 and IA-32 Optimizations Manual.
• Caching. Cache tutorial with partitioner and simulator.
• Latency, Throughput, and Port Usage for x86.
• Searchable Linux Syscall Table.
• Browsable glibc source code.

  ---

• C++ Threads.
• C Threads.
• Intel oneAPI Threading Building Blocks (TBB).
• POSIX Threads (Pthreads).
• Rust Concurrency.
• D.
• .NET Threading.
• Java Concurrency Lesson.
• Pthreads Tutorial. From Lawrence Livermore National Lab.
• OpenMP.

  ---

• MPI Tutorial. From Lawrence Livermore National Lab.
• Open MPI: Open Source MPI Implementation.
• Open MPI Documentation (version 5.0.x).
• MPI Forum.

  ---

• OpenCL.
• CUDA.
• CUDA Tutorial.

  ---

• Resources. Other helpful resources.