PAI doesn't clean job container

[mzmssg]

Organization Name:

Micorsoft

Short summary about the issue/question:

PAI doesn't clean job contaienrs.

OpenPAI Environment:

• OpenPAI version: master

Anything else we need to know:
Root cause:
In #1108, we remove --rm as launching job container, so docker daemon won't clean containers. Confirmed with @wangdian that cleaner won't clean these containers. Then there is no container clean mechanism now.
Residual container examples:

42af191d4a5c        openpai/pai.example.tensorflow                        "/bin/bash /pai/boot…"   About an hour ago   Exited (0) About an hour ago                                                    admin-test-sleep-container_e44_1552954684228_0103_01_000002
4fe903811bca        openpai/pai.example.tensorflow                        "/bin/bash /pai/boot…"   About an hour ago   Exited (143) About an hour ago                                                  admin-test-kill-job3-container_e44_1552954684228_0100_01_000002

[mzmssg]

It's a blocking issue

[fanyangCS]

Why removing -rm?

[mzmssg]

@fanyangCS
This pr need docker inspect to get container OOM status.

[fanyangCS]

Ok. After the inspection, we could rm it. Right? Please also check whether the debug mode is affected.

[mzmssg]

@fanyangCS
Nope, all commands in yarn container might be interrupted, so any clean action in the yarn container is unreliable.
We need dockerd(with --rm) or cleaner(implemented by ourselves) to manage the residual containers out of yarn container.

[fanyangCS]

#2355
#1793
#1658

[mzmssg]

Fixed in #2355