README.md 1.21 KB
Newer Older
Matthieu Dorier's avatar
Matthieu Dorier committed
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20
Summit
======


Programming environment
-----------------------

Any version of gcc should be working on Summit. Summit provides the
spectrum-mpi package as MPI implementation. When building source codes,
you should load the relevant gcc as follow:

```
$ module swap xl gcc/9.1.0
```

The `spack.yaml` file in this directory uses gcc 9.1.0.

Networking
----------

21 22 23 24 25
Mercury should use the `verbs` transport method in Mercury, which
translates to `ofi+verbs;ofi_rxm` internally.  You must also specify the
libfabric domain when initializing Mercury by using `verbs://mlx5_0`
as the local address. This will insure that libfabric
uses the correct default port on the network card.
Matthieu Dorier's avatar
Matthieu Dorier committed
26

27
Libfabric should be compiled with the `+verbs` and `+rxm` variants.
Matthieu Dorier's avatar
Matthieu Dorier committed
28 29 30 31 32 33 34 35 36 37 38 39 40 41 42

Job management
--------------

Summit uses the lsbatch workload manager. `job.lfs` is an example
of job file. Please modify the header (lines starting with `#BSUB`)
to use your project allocation and set relevant parameters. You can
refer to [the documenattion here](https://docs.olcf.ornl.gov/systems/summit_user_guide.html#running-jobs)
for more information on how to configure such a job script.

Once modified, the job script may be submitted as follows.

```
$ bsub ./job.lfs
```