Welcome!
To use the personalized features of this site, please log in or register.
If you have forgotten your username or password, we can help.
My Menu
Saved Items

High-Level Data Mapping for Clusters of SMPs

Siegfried BenknerContact Information and Thomas BrandesContact Information

(5)  Institute for Software Science, University of Vienna, Liechtensteinstr. 22, A-1090 Vienna, Austria
(6)  GMD-German National Research Center for Information Technology Schloß Birlinghoven, SCAI-Institute for Algorithms and Scientific Computing, D-53754 St. Augustin, Germany
Abstract
Clusters of shared-memory multiprocessors (SMPs) have become the most promising parallel computing platforms for scientific computing. However, SMP clusters significantly increase the complexity of user application development when using the low-level application programming interfaces MPI and OpenMP, forcing users to deal with both distributed-memory and shared-memory parallelization details. In this paper we present extensions of High Performance Fortran for SMP clusters which enable the compiler to adopt a hybrid parallelization strategy, efficiently combining distributed-memory with shared-memory parallelism. By means of a small set of new language features, the hierarchical structure of SMP clusters may be specified. This information is utilized by the compiler to derive inter-node data mappings for controlling distributed-memory parallelization across the nodes of a cluster, and intra-node data mappings for extracting shared-memory parallelism within nodes. Additional mechanisms are proposed for specifying interand intra-node data mappings explicitly, for controlling specific SM parallelization issues, and for integrating OpenMP routines in HPF applications. The proposed features are being realized within the ADAPTOR and VFC compiler. The parallelization strategy for clusters of SMPs adopted by these compilers is discussed as well as a hybrid-parallel execution model based on a combination of MPI and OpenMP. Early experimental results indicate the effectiveness of the proposed features.

Keywords  Parallel programming - HPF - OpenMP - MPI - SMP clusters - parallelization - hybrid parallelism


Contact Information Siegfried Benkner
Email: sigi@ieee.org

Contact Information Thomas Brandes
Email: brandes@gmd.de
Fulltext Preview (Small, Large)
Image of the first page of the fulltext

References secured to subscribers.



Export this chapter
Export this chapter as RIS | Text
 
Referenced by
1 newer article

  1. Benkner, Siegfried (2002) Efficient parallel programming on scalable shared memory systems with High Performance Fortran. Concurrency and Computation Practice and Experience 14(8-9)
    [CrossRef]
Remote Address: 38.107.191.108 • Server: mpweb07
HTTP User Agent: CCBot/1.0 (+http://www.commoncrawl.org/bot.html)