Data Organization in Parallel Computers

1. Front Matter

   Pages i-xiii

   PDF

2. Data Communication and Data Organization in Parallel Computations: Classification and Overview

   • Harry A. G. Wijshoff

   Pages 1-31

3. Arbitrary Skewing Schemes for d-Dimensional Arrays

   • Harry A. G. Wijshoff

   Pages 33-81

4. Compactly Representable Skewing Schemes for d-Dimensional Arrays

   • Harry A. G. Wijshoff

   Pages 83-141

5. Arbitrary Skewing Schemes for Trees

   • Harry A. G. Wijshoff

   Pages 143-201

6. Compactly Representable Skewing Schemes for Trees

   • Harry A. G. Wijshoff

   Pages 203-236

7. Back Matter

   Pages 237-247

   PDF

The organization of data is clearly of great importance in the design of high performance algorithms and architectures. Although there are several landmark papers on this subject, no comprehensive treatment has appeared. This monograph is intended to fill that gap. We introduce a model of computation for parallel computer architec­ tures, by which we are able to express the intrinsic complexity of data or­ ganization for specific architectures. We apply this model of computation to several existing parallel computer architectures, e.g., the CDC 205 and CRAY vector-computers, and the MPP binary array processor. The study of data organization in parallel computations was introduced as early as 1970. During the development of the ILLIAC IV system there was a need for a theory of possible data arrangements in interleaved mem­ ory systems. The resulting theory dealt primarily with storage schemes also called skewing schemes for 2-dimensional matrices, i.e., mappings from a- dimensional array to a number of memory banks. By means of the model of computation we are able to apply the theory of skewing schemes to var­ ious kinds of parallel computer architectures. This results in a number of consequences for both the design of parallel computer architectures and for applications of parallel processing.

• Scheme
• algorithms
• architecture
• computer architecture
• organization
• parallel computation
• parallel processing
• processor

• University of Utrecht, The Netherlands

  Harry A. G. Wijshoff

• Center for Supercomputing Research and Development, University of Illinois (Urbana-Champaign), USA

  Harry A. G. Wijshoff

Policies and ethics