Revamp some deadlock analysis for GH

[knelli2]

Proposed changes

While debugging nodegroup deadlocks, these changes were helpful giving more, better organized, information.

This last commit was useful because sometimes after a deadlock, I'd want to run an event to get some extra information and we have a phase for doing that (PostFailureCleanup), but it wasn't run after a deadlock. If the method I have for implementing this needs a lot of discussion, I'm ok leaving it out for now. The other commits are more important I think.

Upgrade instructions

For BBH and SingleBH executables, must add a block to the input file

EventsRunAtCleanup:
  ObservationValue: -1000.0
  Events:
    - Event1
    - Event2

Code review checklist

• The code is documented and the documentation renders correctly. Run
  make doc to generate the documentation locally into BUILD_DIR/docs/html.
  Then open index.html.
• The code follows the stylistic and code quality guidelines listed in the
  code review guide.
• The PR lists upgrade instructions and is labeled bugfix or
  new feature if appropriate.

Further comments

[nilsdeppe]

LGTM! Thanks for doing this! A few small suggestions on printing. Please squash immediately :)

[nilsdeppe]

It might be easier to read the output file if you do this print outside the for_each. Then you could do something like

============== BEGIN CALLBACKS ON NODE # =====================
...
============== END CALLBACKS ON NODE # =====================

to make the file easier to parse.

[nilsdeppe]

I would move the stream to outside the for loop. Then the block of text is guaranteed to be contiguous. You can then also delineate it with blocks like

=========== BEGIN INTERPOLATION TARGET ========

[nilsdeppe]

I would move the stream to outside the loops. Then the block of text is guaranteed to be contiguous. You can then also delineate it with blocks like

=========== BEGIN INTERPOLATOR =============

[knelli2]

Moving outside the for loop is good, but can't move outside the for_each because I write a new file for each target tag (the output can be long).

[nilsdeppe]

It's not obvious why terminate should be true. Could you add a code comment?

[knelli2]

Squashed!