1. 26 Mar, 2018 1 commit
    • Eric Pershey's avatar
      Added instrumented logging to many of the components. · b9de5d5e
      Eric Pershey authored
      Wrapped Proxy errors with sanatize password.
      Cleaned up logging spelling mistakes.
      Added extract_traceback to format the exceptions
      Added get_current_thread_identifier to help identify threads
      Added get_caller to help identify the caller.
      Added cray_messaging to aid in debugging and allow importing.
      Fixed a bug that would allow retrying of a fork.
      Added debugging tools of slp_hammer.py and slp_nail.py
      Updated the simulator to simulate background tasks.
      b9de5d5e
  2. 14 Feb, 2018 2 commits
  3. 02 Feb, 2018 2 commits
    • Paul Rich's avatar
      Fixing docstrings and remooving defunct variable · 281a9c68
      Paul Rich authored
      queue is no longer needed for cleanup, and the docstrings should
      reflect the changed behavior.
      281a9c68
    • Paul Rich's avatar
      Refactor find_queue_equivalence_classes and drain clear code · 2cda012d
      Paul Rich authored
      After discussions, the current find_queue_equivalence_classes for this
      system really only complicates the codebase for very little actual gain.
      After this, the system will have only one equivalence class at all times
      consisting of all active queues assigned to nodes and all active
      reservations.
      
      This simplification allows us to ensure that find_job_location only gets
      called twice, once for reservations, which ignore drain times, and then
      immediately after for the normal "production" queue jobs, which do set
      drain times.  In both cases we can just clear drain times across the
      machine.
      
      In addition to testing (and more tests coming for the case that caused
      this examination to begin with), we know that this works, as any system
      with a queue or set of overlapping queues across all resources on the
      machine forms a single equivalence class under the old code.
      2cda012d
  4. 31 Jan, 2018 1 commit
  5. 06 Nov, 2017 1 commit
  6. 18 Sep, 2017 1 commit
  7. 13 Sep, 2017 1 commit
  8. 23 Aug, 2017 1 commit
  9. 18 Aug, 2017 2 commits
  10. 16 Aug, 2017 1 commit
  11. 11 Aug, 2017 2 commits
  12. 03 Aug, 2017 1 commit
  13. 28 Jul, 2017 1 commit
  14. 10 Jul, 2017 1 commit
  15. 03 Jul, 2017 2 commits
    • Paul Rich's avatar
      Adding in test cases for _ALPS_reserve_resources · bedcb951
      Paul Rich authored
      In light of this bug, adding checks to make sure that we don't end up
      accidentally adding in bad values to reservations again.
      bedcb951
    • Paul Rich's avatar
      Fix for double-reservation entry · d72c6774
      Paul Rich authored
      This was traced to a call that could cause a non-string key to be added
      to the alps_reservation dictionary, resulting in a version of the
      reservation with an integer jobid key and a second with a string jobid
      key.  These should be keyed with strings.
      
      Added as further mitigation a check to see if there is an integer
      version of a key to clean.  If there is, then notify that it happened
      and clean that one, too.
      
      Triggering condition is an interactive job where the initial ALPS
      reservation times out.
      d72c6774
  16. 30 Jun, 2017 1 commit
  17. 27 Jun, 2017 2 commits
  18. 23 Jun, 2017 1 commit
  19. 19 Jun, 2017 1 commit
  20. 14 Apr, 2017 1 commit
  21. 13 Apr, 2017 2 commits
  22. 12 Apr, 2017 1 commit
  23. 11 Apr, 2017 1 commit
  24. 04 Jan, 2017 1 commit
    • Paul Rich's avatar
      Fix for nodes getting hung up in cleanup-pending state · 5f751a1a
      Paul Rich authored
      A well (or poorly depending on how you look at it) qdel could cause
      Cobalt to put a node into cleanup but never complete the cleanup due to
      there being no ALPS backend reservation to clean up.  This would clear
      if there were no jobs currently running, however, it would hang nodes
      otherwise.
      5f751a1a
  25. 23 Nov, 2016 2 commits
  26. 22 Nov, 2016 1 commit
  27. 15 Nov, 2016 1 commit
  28. 11 Nov, 2016 1 commit
  29. 03 Nov, 2016 1 commit
  30. 06 Oct, 2016 1 commit
  31. 26 Sep, 2016 2 commits