Compiler Optimizations for Scalable Parallel Systems

1. Front Matter

   Pages I-XIX

   PDF

2. Languages

   1. High Performance Fortran 2.0

      • Ken Kennedy, Charles Koelbel

      Pages 3-43

   2. The Sisal Project: Real World Functional Programming

      • Jean-Luc Gaudiot, Tom DeBoni, John Feo, Wim Böhm, Walid Najjar, Patrick Miller

      Pages 45-72

   3. HPC++ and the HPC++Lib Toolkit

      • Dennis Gannon, Peter Beckman, Elizabeth Johnson, Todd Green, Mike Levine

      Pages 73-107

   4. A Concurrency Abstraction Model for Avoiding Inheritance Anomaly in Object-Oriented Programs

      • Sandeep Kumar, Dharma P. Agrawal

      Pages 109-137

3. Analysis

   1. Loop Parallelization Algorithms

      • Alain Darte, Yves Robert, Frédéric Vivien

      Pages 141-171

   2. Array Dataflow Analysis

      • Paul Feautrier

      Pages 173-219

   3. Interprocedural Analysis Based on Guarded Array Regions

      • Zhiyuan Li, Junjie Gu, Gyungho Lee

      Pages 221-246

   4. Automatic Array Privatization

      • Peng Tu, David Padua

      Pages 247-281

4. Communication Optimizations

   1. Optimal Tiling for Minimizing Communication in Distributed Shared-Memory Multiprocessors

      • Anant Agarwal, David Kranz, Rajeev Barua, Venkat Natarajan

      Pages 285-338

   2. Communication-Free Partitioning of Nested Loops

      • Kuei-Ping Shih, Chua-Huang Huang, Jang-Ping Sheu

      Pages 339-383

   3. Solving Alignment Using Elementary Linear Algebra

      • Vladimir Kotlyar, David Bau, Induprakas Kodukula, Keshav Pingali, Paul Stodghill

      Pages 385-411

   4. A Compilation Method for Communication-Efficient Partitioning of DOALL Loops

      • Santosh Pande, Tareq Bali

      Pages 413-443

   5. Compiler Optimization of Dynamic Data Distributions for Distributed-Memory Multicomputers

      • Daniel J. Palermo, Eugene W. Hodges IV, Prithviraj Banerjee

      Pages 445-484

   6. A Framework for Global Communication Analysis and Optimizations

      • Manish Gupta

      Pages 485-524

   7. Tolerating Communication Latency through Dynamic Thread Invocation in a Multithreaded Architecture

      • Andrew Sohn, Yuetsu Kodama, Jui-Yuan Ku, Mitsuhisa Sato, Yoshinori Yamaguchi

      Pages 525-549

5. Code Generation

   1. Advanced Code Generation for High Performance Fortran

      • Vikram Adve, John Mellor-Crummey

      Pages 553-596

   2. Integer Lattice Based Methods for Local Address Generation for Block-Cyclic Distributions

      • J. Ramanujam

      Pages 597-645

6. Task Parallelism, Dynamic Data Structures and Run Time Systems

   1. A Duplication Based Compile Time Scheduling Method for Task Parallelism

      • Sekhar Darbha, Dharma P. Agrawal

      Pages 649-682

   2. SPMD Execution in the Presence of Dynamic Data Structures

      • Rajiv Gupta

      Pages 683-708

Scalable parallel systems or, more generally, distributed memory systems offer a challenging model of computing and pose fascinating problems regarding compiler optimization, ranging from language design to run time systems. Research in this area is foundational to many challenges from memory hierarchy optimizations to communication optimization.
This unique, handbook-like monograph assesses the state of the art in the area in a systematic and comprehensive way. The 21 coherent chapters by leading researchers provide complete and competent coverage of all relevant aspects of compiler optimization for scalable parallel systems. The book is divided into five parts on languages, analysis, communication optimizations, code generation, and run time systems. This book will serve as a landmark source for education, information, and reference to students, practitioners, professionals, and researchers interested in updating their knowledge about or active in parallel computing.

• Compiler Optimization
• Distributed Memory Systems
• High-Performance Computing
• Parallel Algorithms
• Parallel Computing
• Parallelization
• Program Optimization
• Run Time Systems
• Scala
• Scalable Parallel Systems
• compiler
• optimization

• College of Computing, Georgia Institute of Technology, Atlanta, USA

  Santosh Pande

• Department of ECECS, University of Cincinnati, Cincinnati, USA

  Dharma P. Agrawal

Policies and ethics