Skip to content

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
    • Help
    • Support
    • Submit feedback
    • Contribute to GitLab
  • Sign in
B
bake
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 7
    • Issues 7
    • List
    • Boards
    • Labels
    • Milestones
  • Merge Requests 2
    • Merge Requests 2
  • CI / CD
    • CI / CD
    • Pipelines
    • Jobs
    • Schedules
  • Analytics
    • Analytics
    • CI / CD
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Members
    • Members
  • Collapse sidebar
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
  • sds
  • bake
  • Issues
  • #20

Closed
Open
Opened Feb 11, 2020 by Rob Latham@robl
  • Report abuse
Report abuse

Bake leaving mercury addressed lying around

from nightly tests:

echo "## Bake OFI/VERBS:"
rm -f /dev/shm/foo.dat
bake-mkpool -s 60G /dev/shm/foo.dat
mpirun -f $COBALT_NODEFILE -n 2 numactl -N 1 -m 1 ./bake-p2p-bw -x 16777216 -m 34359738368 \
                  -n "verbs://" -p /dev/shm/foo.dat -c 1

The test appears to complete without errors and reports a result, but upon shutdown gives this error:

    # HG -- Error -- [...]/src/mercury_core.c:1167
 # hg_core_finalize(): HG addrs must be freed before finalizing HG (2048 remaining)
# HG -- Error -- [...]/src/mercury_core.c:3471
 # HG_Core_finalize(): Cannot finalize HG core layer
# HG -- Error -- [...]/src/mercury.c:1009
 # HG_Finalize(): Could not finalize HG core class

spack version: 0.13.4-1029-e8b6c40b3

==> 15 installed packages
-- linux-rhel7-haswell / gcc@8.2.0 ------------------------------
argobots@1.0rc2
bake@0.4
libfabric@1.9.0
libnl@3.3.0
libpciaccess@0.13.5
libuuid@1.0.3
libxml2@2.9.1
margo@0.6.1
mercury@master
mvapich2@2.3.2
ncurses@5.9
pmdk@1.8
rdma-core@20
ssg@0.4.1
zlib@1.2.7

This "HG addrs must be freed" error message looks a lot like an error message from last week, but as you can see from the packages, we have already picked up that fix (mercury@master).

This error shows up on bebop, cooley, and theta

Edited Feb 11, 2020 by Rob Latham
Assignee
Assign to
None
Milestone
None
Assign milestone
Time tracking
None
Due date
None
0
Labels
None
Assign labels
  • View project labels
Reference: sds/bake#20