Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
S
sds-tests
Project overview
Project overview
Details
Activity
Releases
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Analytics
Analytics
CI / CD
Repository
Value Stream
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
sds
sds-tests
Commits
152ecf19
Commit
152ecf19
authored
Jan 09, 2019
by
Philip Carns
Browse files
Options
Browse Files
Download
Plain Diff
Merge branch 'carns/dev-bake-bench'
parents
2135ddec
839cfaa0
Changes
5
Expand all
Hide whitespace changes
Inline
Side-by-side
Showing
5 changed files
with
493 additions
and
2 deletions
+493
-2
configure.ac
configure.ac
+12
-0
perf-regression/Makefile.subdir
perf-regression/Makefile.subdir
+1
-1
perf-regression/bake-p2p-bw.c
perf-regression/bake-p2p-bw.c
+429
-0
perf-regression/bebop/bake-regression.sbatch
perf-regression/bebop/bake-regression.sbatch
+46
-0
perf-regression/bebop/run-regression.sh
perf-regression/bebop/run-regression.sh
+5
-1
No files found.
configure.ac
View file @
152ecf19
...
...
@@ -53,6 +53,18 @@ AC_CHECK_HEADERS(ssg-mpi.h,[],
[AC_MSG_ERROR([Could not find ssg-mpi.h for MPI support in
SSG])])
PKG_CHECK_MODULES([BAKESERVER],[bake-server],[],
AC_MSG_ERROR([Could not find working BAKE server installation!]) )
LIBS="$BAKESERVER_LIBS $LIBS"
CPPFLAGS="$BAKESERVER_CFLAGS $CPPFLAGS"
CFLAGS="$BAKESERVER_CFLAGS $CFLAGS"
PKG_CHECK_MODULES([BAKECLIENT],[bake-client],[],
AC_MSG_ERROR([Could not find working BAKE client installation!]) )
LIBS="$BAKECLIENT_LIBS $LIBS"
CPPFLAGS="$BAKECLIENT_CFLAGS $CPPFLAGS"
CFLAGS="$BAKECLIENT_CFLAGS $CFLAGS"
AC_MSG_CHECKING([If MPI programs can be compiled])
AC_LINK_IFELSE(
[AC_LANG_PROGRAM([[#include<mpi.h>]], [[MPI_Init(0,0);]])],
...
...
perf-regression/Makefile.subdir
View file @
152ecf19
bin_PROGRAMS
+=
perf-regression/margo-p2p-latency perf-regression/margo-p2p-bw
bin_PROGRAMS
+=
perf-regression/margo-p2p-latency perf-regression/margo-p2p-bw
perf-regression/bake-p2p-bw
perf-regression/bake-p2p-bw.c
0 → 100644
View file @
152ecf19
This diff is collapsed.
Click to expand it.
perf-regression/bebop/bake-regression.sbatch
0 → 100644
View file @
152ecf19
#!/bin/bash
#SBATCH -N 2
#SBATCH -A startup-carns
#SBATCH --ntasks-per-node=1
#SBATCH --time=15:00
#SBATCH -p bdwall
# example of running benchmarks with spack-compiled software stack
export
LMOD_PAGER
=
none
module load numactl boost cmake
.
/home/carns/working/src/spack/share/spack/setup-env.sh
spack load
-r
ssg
spack load
-r
bake
module list
# force Intel MPI to use Infiniband instead of Omnipath/PSM2. If we let
# Intel MPI use it's preferred PSM2 path then Mercury can't open interface
# because of apparent MR_SCALABLE/MR_BASIC conflict
# we should also try MR_SCALABLE in Mercury NA as a possible workaround
export
I_MPI_FABRICS
=
shm:ofa
echo
"## Bake OFI/PSM2 (bdw):"
rm
-f
/dev/shm/foo.dat
bake-mkpool
-s
60G /dev/shm/foo.dat
mpirun /home/carns/working/install-bebop/bin/bake-p2p-bw
-x
16777216
-m
34359738368
-n
psm2://enp6s0f0:5000
-p
/dev/shm/foo.dat
-c
1
echo
"## Bake OFI/PSM2 (8x concurrency, bdw):"
rm
-f
/dev/shm/foo.dat
bake-mkpool
-s
60G /dev/shm/foo.dat
mpirun /home/carns/working/install-bebop/bin/bake-p2p-bw
-x
16777216
-m
34359738368
-n
psm2://enp6s0f0:5000
-p
/dev/shm/foo.dat
-c
8
echo
"## Bake OFI/PSM2 (bdw, Hg busy spin):"
rm
-f
/dev/shm/foo.dat
bake-mkpool
-s
60G /dev/shm/foo.dat
mpirun /home/carns/working/install-bebop/bin/bake-p2p-bw
-x
16777216
-m
34359738368
-n
psm2://enp6s0f0:5000
-p
/dev/shm/foo.dat
-c
1
-t
0,0
echo
"## Bake OFI/PSM2 (8x concurrency, bdw, Hg busy spin):"
rm
-f
/dev/shm/foo.dat
bake-mkpool
-s
60G /dev/shm/foo.dat
mpirun /home/carns/working/install-bebop/bin/bake-p2p-bw
-x
16777216
-m
34359738368
-n
psm2://enp6s0f0:5000
-p
/dev/shm/foo.dat
-c
8
-t
0,0
perf-regression/bebop/run-regression.sh
View file @
152ecf19
...
...
@@ -21,6 +21,7 @@ cp packages.yaml $SANDBOX/
# scratch area for job submission
mkdir
-p
$JOBDIR
cp
margo-regression.sbatch
$JOBDIR
cp
bake-regression.sbatch
$JOBDIR
cd
$SANDBOX
git clone https://github.com/spack/spack.git
...
...
@@ -42,12 +43,14 @@ cp $SANDBOX/packages.yaml $SPACK_ROOT/etc/spack
# CI environments
echo
"repos:"
>
$SPACK_ROOT
/etc/spack/repos.yaml
echo
"-
${
SANDBOX
}
/sds-repo"
>>
$SPACK_ROOT
/etc/spack/repos.yaml
spack uninstall
-R
-y
argobots mercury opa-psm2
||
true
spack uninstall
-R
-y
argobots mercury opa-psm2
bake
||
true
spack
install
--dirty
ssg ^mercury@develop
spack
install
--dirty
bake ^mercury@develop
# deliberately repeat setup-env step after building modules to ensure
# that we pick up the right module paths
.
$SANDBOX
/spack/share/spack/setup-env.sh
spack load
-r
ssg
spack load
-r
bake
export
CFLAGS
=
"-O3"
...
...
@@ -89,6 +92,7 @@ cp $PREFIX/libexec/osu-micro-benchmarks/mpi/pt2pt/osu_latency $JOBDIR
cd
$JOBDIR
export
SANDBOX
sbatch
--wait
--export
=
ALL ./margo-regression.sbatch
sbatch
--wait
--export
=
ALL ./bake-regression.sbatch
echo
"=== JOB DONE, COLLECTING AND SENDING RESULTS ==="
# gather output, strip out funny characters, mail
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment