342.295, KV Parallel Computing, Armin Biere / Wolfgang Schreiner, 2020S

Topic outline

• Select topic Parallel Computing (SS 2020)

  Parallel Computing (SS 2020)

  Collapse all Expand all

  342.295, Time: Tuesday, 8:30-11:00 (March 24 and 31, May 12: 8:00-10:00), Start: March 3
  

  This course introduces basic techniques and models for parallel computing. We will discuss the basic theory, algorithms, programming models, and design principles for building parallel programs on multi-core processors, shared memory multiprocessors, and distributed memory multiprocessors respectively cluster systems. Class presentation will be accompanied by hands-on experience, e.g. on an SGI UV-1000 distributed shared memory multiprocessor.
  

  Background in programming in C/C++ and Java is assumed. Course grades will be based on practical programming assignments.
  
• Select topic Topics and Schedule

  Topics and Schedule

  The (preliminary) course schedule is as follows:

  1. March 3 (Schreiner, 8:30-11:00, KEP1): Parallel Architectures and Performance.
  2. March 10 (Biere, 8:30-11:00, KEP1): Parallel Algorithms and Complexity.
  3. March 17 (Schreiner, 8:30-11:00, KEP1): Concurrency in Java and OpenMP.
  4. March 24 (Biere, 8:00-10:00, BA 9908): Shared Memory Programming, Lockless Data Structures.
  5. March 31 (Biere, 8:00-10:00, BA 9908): Shared Memory Programming with Cilk, Lace, Work Stealing
  6. April 21 (Schreiner, 8:30-11:00, MZ 003B): Presentations of Solutions 1.
     
  7. April 28 (Schreiner, 8:30-11:00, KG 519): Message Passing Programming with MPI.
  8. May 5 (Biere, 8:30-11:00, KG 519): Shared Memory Programming with PThreads.
  9. May 12 (Biere, 8:00-10:00, BA 9908): Presentations of Solutions 2.
  10. May 19 (Schreiner, 8:30-11:00, KG 519): Designing Parallel Programs.
      
  11. June 9 (Biere, 8:30-11:00, HS 4): Presentations of Solutions 3.
  12. June 23 (Schreiner, 8:30-11:00, KG 519): Presentation of Solutions 4.
      

  Individual meetings will be organized for discussing the assignments.

  • Select activity Next Zoom Meeting Wolfgang Schreiner: contact me p...

    Next Zoom Meeting Wolfgang Schreiner: contact me per email for an appointment.
    https://jku.zoom.us/j/821203635?pwd=NExrVElZOTUzcWxLeWR1SVVDc0RjZz09
    Meeting-ID: 821 203 635
    Passwort: parallel
    

• Select topic Course Materials

  Course Materials
  • Select activity Introduction and Organization

    

    Introduction and Organization File
  • Select activity Parallel Architectures

    

    Parallel Architectures File
  • Select activity Video "SGI UV" (Lecture March 3)

    

    Video "SGI UV" (Lecture March 3) URL
  • Select activity Technical Advances in the SGI® UV Architecture

    

    Technical Advances in the SGI® UV Architecture File
  • Select activity Performance and Productivity Breakthroughs with Very Large Coherent Shared Memory: The SGI® UV Architecture

    

    Performance and Productivity Breakthroughs with Very Large Coherent Shared Memory: The SGI® UV Architecture File
  • Select activity SGI UV Data Sheet

    

    SGI UV Data Sheet File
  • Select activity JKU Data Sheet

    

    JKU Data Sheet File
  • Select activity How to Use the Parallel Computing Server

    

    How to Use the Parallel Computing Server Page
  • Select activity How to Use the Server From Other Networks (Restricted)

    

    How to Use the Server From Other Networks (Restricted) URL
  • Select activity Some More Information (in German)

    

    Some More Information (in German) Page
  • Select activity The Supercomputer "MACH-2"

    

    The Supercomputer "MACH-2" URL
  • Select activity Performance Analysis

    

    Performance Analysis File
  • Select activity Video "Performance Analysis" (Lecture March 3/17)

    

    Video "Performance Analysis" (Lecture March 3/17) URL
  • Select activity Algorithms and Complexity

    

    Algorithms and Complexity File
  • Select activity Concurrency in Java

    

    Concurrency in Java File
  • Select activity Video "Concurrency in Java" (Lecture March 17)

    

    Video "Concurrency in Java" (Lecture March 17) URL
  • Select activity Sources

    

    Sources File
  • Select activity Lesson: Concurrency

    

    Lesson: Concurrency URL
  • Select activity Trail: Custom Networking

    

    Trail: Custom Networking URL
  • Select activity OpenMP

    

    OpenMP File
  • Select activity Video "OpenMP" (Lecture March 17)

    

    Video "OpenMP" (Lecture March 17) URL
  • Select activity Sources

    

    Sources File
  • Select activity OpenMP

    

    OpenMP URL
  • Select activity OpenMP Tutorial

    

    OpenMP Tutorial URL
  • Select activity Intel OpenMP* Support

    

    Intel OpenMP* Support URL
  • Select activity OpenMP* Pragmas Summary

    

    OpenMP* Pragmas Summary URL
  • Select activity Worksharing Using OpenMP*

    

    Worksharing Using OpenMP* URL
  • Select activity Thread Affinity Interface

    

    Thread Affinity Interface URL
  • Select activity GNU libgomp

    

    GNU libgomp URL
  • Select activity Enabling OpenMP

    

    Enabling OpenMP URL
  • Select activity GOMP_CPU_AFFINITY

    

    GOMP_CPU_AFFINITY URL
  • Select activity Shared Memory Programming, Lockless Data Structures

    

    Shared Memory Programming, Lockless Data Structures File
  • Select activity Shared Memory Examples

    

    Shared Memory Examples File
  • Select activity Video "Data Race Example" (Lecture March 24)

    

    Video "Data Race Example" (Lecture March 24) URL
  • Select activity Video "Peterson Algorithm" (Lecture March 24)

    

    Video "Peterson Algorithm" (Lecture March 24) URL
  • Select activity PerfBook by Paul McKenney

    

    PerfBook by Paul McKenney File
  • Select activity Work Stealing

    Work Stealing

  • Select activity Cilk

    

    Cilk File
  • Select activity Cilk Examples

    

    Cilk Examples File
  • Select activity Lace

    

    Lace File
  • Select activity PThreads

    PThreads

  • Select activity PThreads Introduction

    

    PThreads Introduction File
  • Select activity PThreads Basics

    

    PThreads Basics File
  • Select activity PThreads Synchronization

    

    PThreads Synchronization File
  • Select activity PThreads Examples

    

    PThreads Examples File
  • Select activity MPI

    

    MPI File
  • Select activity Video "MPI" (Lecture April 28)

    

    Video "MPI" (Lecture April 28) URL
  • Select activity Sources

    

    Sources File
  • Select activity MPI Forum

    

    MPI Forum URL
  • Select activity MPI Tutorial

    

    MPI Tutorial URL
  • Select activity Parallel Program Design

    

    Parallel Program Design File
  • Select activity Video "Parallel Program Design" (Lecture May 19)

    

    Video "Parallel Program Design" (Lecture May 19) URL
  • Select activity Ian Foster: Designing and Building Parallel Programs

    

    Ian Foster: Designing and Building Parallel Programs URL
• Select topic Assignments

  Assignments

  We will hand out four assignments that can be elaborated individually or by pairs of students. At least three assignments have to be turned in and graded positively to pass the course. Submitters may be asked for presentations of their solutions; be prepared to give at least one such presentation.
  

  • Select activity Assignment 1 (April 14)

    

    Assignment 1 (April 14)
  • Select activity Assignment 2 (May 11)

    

    Assignment 2 (May 11)
  • Select activity Solution 2

    

    Solution 2 File
  • Select activity Assignment 3 (June 7)

    

    Assignment 3 (June 7)
  • Select activity Solution 3 (proposed)

    

    Solution 3 (proposed) File
  • Select activity Assignment 4 (June 16)

    

    Assignment 4 (June 16)
  • Select activity Assignment 5 (Open End)

    

    Assignment 5 (Open End)