Types of Parallelism.

There are several types of Parallelism, but as researchers on a virtual machine or supercomputer, we will usually encounter the following:

Data Parallelism: ​

• Multiple processes executing the same set of instructions on different ‘chunks’ of a dataset.

Task Parallelism:

• Multiple processes executing different instructions on the same or different (but related) sets of data.