One way of categorizing modern parallel computers is to look at the memory configuration.

• In shared memory systems the CPUs share the same address space. Any CPU can access any data in the global memory.
• In distributed memory systems each CPU has its own memory.

The CPUs are connected by some network and may exchange messages.