Books : reviews

Geoffrey C. Fox, Roy D. Williams, Paul C. Messina.
Parallel Computing Works!.
Morgan Kaufmann. 1994

(read but not reviewed)

This book shows how parallel computers can be successfully applied to large-scale scientific computations. It demonstrates how a variety of applications in physics, biology, mathematics, and other sciences were implemented on real parallel computers To produce new scientific results.

This book investigates issues of fine-grained parallelism relevant for future supercomputers with particular emphasis on hypercube architecture. The authors describe how they used an experimental approach to configure different massively parallel machines, design and implement basic system software, and develop algorithms for frequently used mathematical computations. They also devise performance models, measure the performance characteristics of several computers, and create a high-performance computing facility based exclusively on parallel computers. By addressing all issues involved in scientific problem solving, Parallel Computing Works! provides valuable insight into computational science for large-scale parallel architectures. For those in the sciences, the findings reveal the usefulness of an important experimental tool. Anyone in supercomputing and related computational fields will gain a new perspective on the potential contribution of parallelism.

This book is concerned with mapping the spatio-temporal structure of a problem onto the most appropriate parallel computer architecture and its associated spatio-temporal structure.

p257. We define the embarrassingly parallel class of problems for which the computational graph is disconnected. This spatial structure allows a simple parallelization as no (temporal) synchronization is involved.