GitLab

No reviewer.

By setting "indent-tabs-mode:nil" we should hopefully begin to slowly
squeeze out hard tabs from the source without a disruptive (to
downstream projects) whitespace-fixing change.

No reviewer.

we are still not handling the case where a process running in the
background might look for STDIN (in which case it should get an
EOF). That's a random corner case, which we don't support right now.

socket. This makes STDIN management independent of which bootstrap
server we use. This provides the necessary setup to enable ticket

terminal, and the process is running in the background, discard stdin.

together with POLLIN instead as return values for poll().

With BLCR, since all the processes are restarted by the BLCR library,
and not by Hydra directly, we cannot provide a new PMI_FD for the MPI
processes to use. So, we instead use the PMI_PORT mechanism and ask
the MPI processes to connect back.

This commit also contains a cleanup of the socket fd maintenance
within the code to distinguish between uninitialized sockets and
closed sockets. While this part is independent, parts of it overlapped
with getting the combined PMI_PORT/PMI_FD code working.

can't, disable it.

not available or doesn't work correctly.

it's always required.

confusion.

not deal with the entire proxy structure. Parts that the bootstrap
server creates and destroys (stdio fds, pids) should not be exposed to
the upper layers.

maintenance cleanup. Tools functionality is all HYDT_, utilities are
all HYDU_ and the rest are HYD_.

it clearer with respect to what structures are shared by what parts of
the stack.

  - launch/shutdown proxies using job launcher
  - launch jobs using the standalone proxy
# DMX engine can now handle user contexts. The user registers the context when registering the fd & the DMX engine provides the context in the callback.
# Limitations (will be fixed soon...)
  - Code is a bit hackish... FIXMEs should cover a lot of them
  - Works only on localhost - debugging multiple hosts
  - Does not support MPMD
  - Supports only one job at a time
  - Need to provide complete path to executablea - to be fixed soon

PMI_IDs. This lets us use a single proxy for multiple executables when
they are launched on the same node. This should fix ticket #464 and is
a big step towards tickets #445 (hierarchical proxies part) and #457
(process-core mapping).

naming convention everywhere. Utility functions are more general. And
several hacks in the code have been removed and handled in a cleaner
manner.

case of an abnormal exit, so that the runaway processes can be cleaned
up properly (based on the PID, instead of the executable name).

Algorithm: Each proxy keeps track of the PIDs of the processes it
launches and listens on a socket for incoming connections from the job
launcher. If the exit is clean, this socket is not used at all. However,
if the job launcher wants to kill the application (due to a timeout,
or an abort by another process in the application), a connection is
established on this socket and a message sent to the proxy to kill its
corresponding processes. We only support one command right now (KILLALL).

This should resolve ticket #447.

[svn-r3998] Squashing several compile warnings in Hydra. Also made the demux engine independent of the central Hydra handle so it can be used by the proxy more cleanly.

utilities to a hydra_utils.h header. These do not depend on any other
part of the code and can be used in any process/function.

stdin. Also, the interface between the proxy and the boot-strap server
is broken; so a proxy has no way to launch more proxies. Thus, only a
one-level hierarchy of proxies is supported right now.

[svn-r3560] Move the handle structure from the control system to the top-level hydra code. This commit only contains structural changes, i.e., moving data structures and functions to different layers (with appropriate renaming to match the layer naming convention).

[svn-r3506] Get rid of explicit FUNCNAME definitions for each function and use the compiler's definition where supported.

[svn-r3434] White space change using the cleanup script at http://www.mcs.anl.gov/~balaji/personal/code-cleanup.sh

[svn-r3409] 1. Allow reuse of hostfile from the previous executable if a multi-executable command-line does not specify one for some executables.

2. Several bug fixes in returning errors to the upper layer.

[svn-r3405] Handle the case where the list of fds we poll on changes while we are inside a callback.

[svn-r3388] Merging the code part of the hydra into trunk. The design docs are still left behind; those need to be moved to the wiki anyway.