[k8s] Fix `--purge` not cleaning up cluster in stale k8s context #18914

Job	Run time
python-test (3.8, tests/unit_tests)	3m 24s
python-test (3.8, tests/test_api.py)	43s
python-test (3.8, tests/test_cli.py)	58s
python-test (3.8, tests/test_config.py)	38s
python-test (3.8, tests/test_global_user_state.py)	26s
python-test (3.8, tests/test_jobs.py)	30s
python-test (3.8, tests/test_list_accelerators.py)	45s
python-test (3.8, tests/test_optimizer_dryruns.py)	1m 51s
python-test (3.8, tests/test_optimizer_random_dag.py)	1m 8s
python-test (3.8, tests/test_storage.py)	29s
python-test (3.8, tests/test_wheels.py)	33s
python-test (3.8, tests/test_jobs_and_serve.py)	29s
python-test (3.8, tests/test_yaml_parser.py)	27s
	12m 21s

Provide feedback