An Introduction to Parallel Processing

Parallel processing is a way to program more quickly and efficiently.   There are many ways in which to use parallel processing, but all involve using multiple processors to preform multiple tasks at once. This could involve each processor doing the same task with different data, or each processor performs one step of the task, or a variety of other ways to split up a task between processors. 

Architecture

Operations

Structure

There are three ways that structures in parallel computers can be different: the control mechanism, the address-space mechanism, and the interconnection network.

Communication

There are two main ways to set up processor communication: statically and dynamically.
​
Click here to learn more

PRAM Model

PRAM stands for parallel random access memory. The PRAM is a theoretical and optimal model for parallel computing.
​Click here to learn more

There are two simple operations that parallel processors use and can preform: broadcasting a value to all processors and finding the minimum or maximum of a list. 
Click here to learn more.

Analysis

 There are two concepts important to the analysis of parallel processing: speed and cost. Speed measures how much faster a parallel algorithm is compared to a sequential one, and cost measures the amount of processors used times time the algorithm takes.
Click here to learn more.

Created as a part of CSCI 225 at St. Norbert College by Hanna Strohm, Emma Alberts, and Josh Leach.