Global Arrays Applications (Classic UI Only)
The following paragraphs, which are copied from the Global Arrays home site (http://hpc.pnl.gov/globalarrays), describe the global arrays environment:
“The Global Arrays (GA) toolkit provides a shared memory style programming environment in the context of distributed array data structures (called “global arrays”). From the user perspective, a global array can be used as if it was stored in shared memory. All details of the data distribution, addressing, and data access are encapsulated in the global array objects. Information about the actual data distribution and locality can be easily obtained and taken advantage of whenever data locality is important. The primary target architectures for which GA was developed are massively-parallel distributed-memory and scalable shared-memory systems.
“GA divides logically shared data structures into “local” and “remote” portions. It recognizes variable data transfer costs required to access the data depending on the proximity attributes. A local portion of the shared memory is assumed to be faster to access and the remainder (remote portion) is considered slower to access. These differences do not hinder the ease-of-use since the library provides uniform access mechanisms for all the shared data regardless where the referenced data is located. In addition, any processes can access a local portion of the shared data directly/in-place like any other data in process local memory. Access to other portions of the shared data must be done through the GA library calls.
“GA was designed to complement rather than substitute for the message-passing model, and it allows the user to combine shared-memory and message-passing styles of programming in the same program. GA inherits an execution environment from a message-passing library (w.r.t. processes, file descriptors etc.) that started the parallel program.”
The global arrays environment has a few unique attributes. Using TotalView, you can:
Display a list of a program's global arrays.Dive from this list of global variables to see the contents of a global array in C or Fortran format.Cast the data so that TotalView interprets data as a global array handle. This means that TotalView displays the information as a global array. Specifically, casting to $GA forces the Fortran interpretation; casting to $ga forces the C interpretation; and casting to $Ga uses the language in the current context.In the Array Statistics view, the commands that operate on a local array, such as slicing and obtaining statistics, also operate on global arrays.
The command used to start TotalView depends on your operating system. For example, the following command starts TotalView on a program invoked using prun using three processes:
totalview prun -a -N 3 boltz.x
Before your program starts parallel execution, a Question dialog launches so you can stop the job to set breakpoints or inspect the program before it begins execution.
After your program hits a breakpoint, you can either use the CLI command dga to inspect your program’s global arrays, or use the Classic UI’s Global Arrays Window.
dga |
Classic UI only:
Figure 99, Global Arrays Windows (Classic UI only)
The arrays named in this window are displayed using their C and Fortran type names. Diving on the line that contains the type definition displays Variable Windows that contain information about that array.
After TotalView displays this information, you can use other standard commands and operations on the array. For example, you can use the slice and filter operations and the commands that visualize, obtain statistics, and show the nodes from which the data was obtained.
You can cast the variable into a global array using either $ga for a C Language cast or $GA for a Fortran cast.
The dga command to view global arrays | dga in the TotalView Reference Guide |
The Global Array window in the Classic UI | “Process Window: Tools Menu Commands: Tools > Global Arrays in the Classic UI Online Help |
