Compiler Optimizations for Scalable Parallel Systems: Languages, Compilation Techniques, and Run Time Systems

Ken Kennedy, Charles Koelbel (auth.), Santosh Pande, Dharma P. Agrawal (eds.)3540419454, 9783540419457

Scalable parallel systems or, more generally, distributed memory systems offer a challenging model of computing and pose fascinating problems regarding compiler optimization, ranging from language design to run time systems. Research in this area is foundational to many challenges from memory hierarchy optimizations to communication optimization.
This unique, handbook-like monograph assesses the state of the art in the area in a systematic and comprehensive way. The 21 coherent chapters by leading researchers provide complete and competent coverage of all relevant aspects of compiler optimization for scalable parallel systems. The book is divided into five parts on languages, analysis, communication optimizations, code generation, and run time systems. This book will serve as a landmark source for education, information, and reference to students, practitioners, professionals, and researchers interested in updating their knowledge about or active in parallel computing.

---

Table of contents :
High Performance Fortran 2.0….Pages 3-43
The Sisal Project: Real World Functional Programming….Pages 45-72
HPC++ and the HPC++Lib Toolkit….Pages 73-107
A Concurrency Abstraction Model for Avoiding Inheritance Anomaly in Object-Oriented Programs….Pages 109-137
Loop Parallelization Algorithms….Pages 141-171
Array Dataflow Analysis….Pages 173-219
Interprocedural Analysis Based on Guarded Array Regions….Pages 221-246
Automatic Array Privatization….Pages 247-281
Optimal Tiling for Minimizing Communication in Distributed Shared-Memory Multiprocessors….Pages 285-338
Communication-Free Partitioning of Nested Loops….Pages 339-383
Solving Alignment Using Elementary Linear Algebra….Pages 385-411
A Compilation Method for Communication-Efficient Partitioning of DOALL Loops….Pages 413-443
Compiler Optimization of Dynamic Data Distributions for Distributed-Memory Multicomputers….Pages 445-484
A Framework for Global Communication Analysis and Optimizations….Pages 485-524
Tolerating Communication Latency through Dynamic Thread Invocation in a Multithreaded Architecture….Pages 525-549
Advanced Code Generation for High Performance Fortran….Pages 553-596
Integer Lattice Based Methods for Local Address Generation for Block-Cyclic Distributions….Pages 597-645
A Duplication Based Compile Time Scheduling Method for Task Parallelism….Pages 649-682
SPMD Execution in the Presence of Dynamic Data Structures….Pages 683-708
Supporting Dynamic Data Structures with Olden….Pages 709-749
Runtime and Compiler Support for Irregular Computations….Pages 751-778