Encyclopedia of Parallel Computing

1. Front Matter

   Pages i-xxxiv

   PDF

2. A

   1. Ab Initio Molecular Dynamics

      Pages 1-1

   2. Access Anomaly

      Pages 1-1

   3. Actors

      • Rajesh K. Karmani, Gul Agha

      Pages 1-11

   4. Affinity Scheduling

      • Mark S. Squillante

      Pages 11-16

   5. Ajtai–Komlós–Szemerédi Sorting Network

      Pages 16-16

   6. AKS Network

      • Joel Seiferas

      Pages 16-23

   7. AKS Sorting Network

      Pages 23-23

   8. Algebraic Multigrid

      • Marian Brezina, Jonathan Hu, Ray Tuminaro

      Pages 23-33

   9. Algorithm Engineering

      • Peter Sanders

      Pages 33-38

   10. Algorithmic Skeletons

       Pages 38-38

   11. All Prefix Sums

       Pages 38-38

   12. Allen and Kennedy Algorithm

       Pages 38-38

   13. Allgather

       • Jesper Larsson Träffe, Robert A. van de Geijn

       Pages 39-42

   14. All-to-All

       • Jesper Larsson Träff, Robert A. vande Geijn

       Pages 42-47

   15. All-to-All Broadcast

       Pages 47-47

   16. Altivec

       Pages 47-47

   17. AMD Opteron Processor Barcelona

       • MS Benjamin Sander

       Pages 47-52

   18. Amdahl’s Argument

       Pages 52-52

   19. Amdahl’s Law

       • John L. Gustafson

       Pages 53-60

Containing over 300 entries in an A-Z format, the Encyclopedia of Parallel Computing provides easy, intuitive access to relevant information for professionals and researchers seeking access to any aspect within the broad field of parallel computing. Topics for this comprehensive reference were selected, written, and peer-reviewed by an international pool of distinguished researchers in the field.  The Encyclopedia is broad in scope, covering machine organization, programming languages, algorithms, and applications.  Within each area, concepts, designs, and specific implementations are presented.  The highly-structured essays in this work comprise synonyms, a definition and discussion of the topic, bibliographies, and links to related literature. Extensive cross-references to other entries within the Encyclopedia support efficient, user-friendly searchers for immediate access to useful information.

 Key concepts presented in the Encyclopedia of Parallel Computing include; laws and metrics; specific numerical and non-numerical algorithms; asynchronous algorithms; libraries of subroutines; benchmark suites;  applications; sequential consistency and cache coherency; machine classes such as clusters, shared-memory multiprocessors, special-purpose machines and dataflow machines; specific machines such as Cray supercomputers, IBM’s cell processor and Intel’s multicore machines; race detection and auto parallelization; parallel programming languages, synchronization primitives, collective operations, message passing libraries, checkpointing, and operating systems. 

 Topics covered: Speedup, Efficiency, Isoefficiency, Redundancy, Amdahls law, Computer Architecture Concepts, Parallel Machine Designs, Benmarks, Parallel Programming concepts & design, Algorithms, Parallel applications.

 This authoritative reference will be published in two formats: print and online.  The online edition features hyperlinks to cross-references and to additional significant research.

 Related Subjects:  supercomputing, high-performance computing, distributed computing

• (parallel) benchmark suites
• (parallel) Numeric algorithms
• (parallel) algorithms
• (parallel) computer architecture
• (parallel) performance laws
• (parallel) program performance metrics
• (parallel) program tuning
• (parallel) programming languages
• PGAS languages
• applications of parallel computing
• autoparallelization
• collective operations
• compilers for parallelism
• determinacy
• exascale computing
• high-performance computing
• inter-processor communication networks
• interconnection networks
• manycores
• multicores
• race detection
• supercomputing
• synchronization
• theory of parallel computing

• University of Illinois at Urbana-Champaign, Urbana, USA

  David Padua

David Padua is the Donald Biggar Willett Professor of Computer Science at the University of Illinois. His research interests include compiler and languages for parallel computing, race detection, compilation of dynamic languages, and autotuning techniques. He is author or co-author of more than 150 papers in these areas. At Illinois, he has taught courses on compilers and parallel programming and supervised 25 PhD Dissertations.  He has served his university and the computer science community as vice-chair of the College of Engineering Executive Committee, chair of the steering committee for the Symposia on Principles and Practices of Parallel Programming (PPoPP), and editorial board member of the Journal of Parallel programming, the Journal of Parallel and Distributed Computing, the IEEE transactions of Parallel and Distributed Processing, and the ACM Transactions on Programming Languages and Systems. He is a fellow of the IEEE and the ACM.

Policies and ethics