Commit 1ca4bb5f authored by Philip Carns's avatar Philip Carns

record status so far on Summit

- not completely working yet, but seems to be close
parent 7f9e061c
These are example scripts for running Mochi regression tests on Summit
(or summitdev).
Notes:
* 'module swap xl gcc/6.4.0' first (any gcc compiler should be fine, but that 6.4. is known to work without gcc install prefix problems evident on some of the other gcc builds on summitdev)
* do not build your own verbs (rdma-core) libraries. They will interfere with dlopen of spectrum-mpi components.
* PMDK will not work on summit, at least as of February 2019. It does not support the power architecture.
Status (margo-p2p-latency):
Process 0 of 2 is on summitdev-r0c0n12
# <op> <iterations> <size> <min> <q1> <med> <avg> <q3> <max>
noop 100000 0 0.000011921 0.000012875 0.000013351 0.0000156490.000018358 0.025480509
[summitdev-r0c0n13:04037] *** Process received signal ***
[summitdev-r0c0n13:04037] Signal: Segmentation fault (11)
[summitdev-r0c0n13:04037] Signal code: Invalid permissions (2)
[summitdev-r0c0n13:04037] Failing at address: 0x10000073c318
[summitdev-r0c0n13:04037] [ 0] [0x100000050478]
[summitdev-r0c0n13:04037] [ 1] ./margo-p2p-latency[0x100029d0]
[summitdev-r0c0n13:04037] [ 2] /autofs/nccs-svm1_home1/carns/working/src/spack/opt/spack/linux-rhel7-ppc64le/gcc-6.4.0/argobots-develop-4l7rzjstalkuojewr6ruxbyrcxfw7t7i/lib/libabt.so.0(+0x9de4)[0x1000003f9de4]
Status (margo-p2p-bw):
[summitdev-r0c0n09:04448] *** Process received signal ***
[summitdev-r0c0n09:04448] Signal: Segmentation fault (11)
[summitdev-r0c0n09:04448] Signal code: Invalid permissions (2)
[summitdev-r0c0n09:04448] Failing at address: 0x10000073c318
[summitdev-r0c0n09:04448] [ 0] [0x100000050478]
[summitdev-r0c0n09:04448] [ 1] [0x0]
[summitdev-r0c0n09:04448] [ 2] /autofs/nccs-svm1_home1/carns/working/src/spack/opt/spack/linux-rhel7-ppc64le/gcc-6.4.0/argobots-develop-4l7rzjstalkuojewr6ruxbyrcxfw7t7i/lib/libabt.so.0(+0x9de4)[0x1000003f9de4]
#!/bin/bash
#BSUB -P CSC332
#BSUB -J margo
#BSUB -o margo.o%J
#BSUB -W 10
#BSUB -nnodes 2
cd /ccs/home/carns/working/install/bin
jsrun -n 2 -r 1 ./margo-p2p-latency -i 100000 -n "ofi+verbs;ofi_rxm://"
jsrun -n 2 -r 1 ./margo-p2p-bw -x 1048576 -n "ofi+verbs;ofi_rxm://" -c 1 -D 20
packages:
all:
compiler: [gcc@6.4.0, xl]
providers:
mpi: [spectrum-mpi]
spectrum-mpi:
modules:
spectrum-mpi@10.2.0.7: spectrum-mpi/10.2.0.7-20180830
buildable: False
cmake:
modules:
cmake@3.11.3: cmake/3.11.3
buildable: False
openssl:
paths:
openssl@1.0.2k: /usr
buildable: False
bison:
paths:
bison@3.0.4: /usr
buildable: False
flex:
paths:
flex@2.5.37: /usr
buildable: False
autoconf:
paths:
autoconf@2.69: /usr
buildable: False
automake:
paths:
automake@1.13.4: /usr
buildable: False
libtool:
paths:
libtool@2.4.2: /usr
buildable: False
libnl:
paths:
libnl@3.2.28: /usr
buildable: False
rdma-core:
paths:
rdma-core@20: /usr
buildable: False
ssg:
variants: +mpi
libfabric:
variants: fabrics=verbs,rxm
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment