Bulk-synchrony: BSP
The BSP idea is basicallyrepeat{compute; communicate}until done
Synchronization is removed as a concern
Data layout and scheduling are automatic
Reductions and scans are built-in
The parallelism model is flat
- nested parallelism is up to the programmer
Most computing problems can be solved this way
- given enough communications bandwidth
The BSP idea is especially popular in the U.K.