Instructor
Gary M. Zoppetti, Ph.D.
Office: Roddy 134
Office Hours and Contact Info: cs.millersville.edu/~gzoppetti

Final
Section 01: Wed, 05/06; 12:30 – 02:30 pm

Syllabus and Assignments

• Syllabus
• Unless otherwise specified, a due date of X means the assignment is due by 11:59 pm on day X. Times are strictly enforced by the grading system, and there are NO grace days! Only the LATEST submission will be graded. Consult How to Submit to submit your work.
• Reading
  • Intro (1)
  • Parallel Hardware and Software (2)
  • Shared Memory Programming with C++ and Pthreads (4)
  • Distributed-Memory Programming with MPI (3)
  • Shared Memory Programming with OpenMP (5)
  • GPU Programming with CUDA (6)
• Assignments
  • Always follow the Formatting Requirements. Place my .clang-format in your home directory (~/.clang-format) or the root of your workspace (~/476/.clang-format) and install the official clangd extension in VS Code.

  • Assignment 0: Reductio Add Unum (Reductions, Parallel Patterns); due Fri, 01/30. Assignment 0.

Useful Links

• Lecture Notes.
• My Code Samples.

  ---

• Top500 Supercomputer Site.
• perf Examples.
• Intel 64 and IA-32 Optimizations Manual.
• Caching. Cache tutorial with partitioner and simulator.
• Latency, Throughput, and Port Usage for x86.

  ---

• C++ Threads.
• C Threads.
• Intel oneAPI Threading Building Blocks (TBB).
• POSIX Threads (Pthreads).
• Rust Concurrency.
• D.
• .NET Threading.
• Java Concurrency Lesson.
• Pthreads Tutorial. From Lawrence Livermore National Lab.
• OpenMP.

  ---

• MPI Tutorial. From Lawrence Livermore National Lab.
• Open MPI: Open Source MPI Implementation.
• Open MPI Documentation (version 5.0.x).
• MPI Forum.

  ---

• OpenCL.
• CUDA.
• CUDA Tutorial.

  ---

• Resources. Other helpful resources.