Move perma failing jobs in CI to manual run

[VannTen]

What type of PR is this?
/kind flake

What this PR does / why we need it:
Some our CI jobs are perma-failing and "allowed to fail".
Thus they takes up CI resources while not guarding anything.
Move them to manual instead, which should free some CI resources.

If/when we fix the underlying use case, we should re-enable those tests.

Does this PR introduce a user-facing change?:

Move perma failing jobs in CI to manual run

[floryut]

A little afraid that moving them to manual will end up never trying to fix them and only ending up basically removing them

[VannTen]

A little afraid that moving them to manual will end up never trying to fix them and only ending up basically removing them

Well it's not like we're fixing them now, AFAICT those tests are broken for quite some time ; perma-failing is effectively just noise.

[VannTen]

Just checked the run times of theses jobs (one sample) : 16, 19, 10, 6 ,4 (minutes)
Since they're retried one time, that's 110 minutes of Ci we're using for each pull request, when we know already that they're failing.
I think a TODO or FIXME somewhere would be just as effective (or an open issue in Github). Don't you @floryut @mzaian ?

[VannTen]

AFAICT,

• vagrant_ubuntu20-calico-dual-stack fails since at least 7 months (and 18 was failing before that)
• molecule_kata fails since 8 months
• molecule_{gvisor,youki} since 6 months
• vagrant_fedora37-kube-router since 6 months as well
  So it's not like it has created motivation (or more time out of thin air) to fix them ^.

A little afraid that moving them to manual will end up never trying to fix them and only ending up basically removing them

Well, there is no reason too. They don't cause any problem as 'manual', and we can switch them to mandatory (no failure allowed) in the PR which fix the underlying problem

[floryut]

Can we maybe add a note in the code to flag them as failing ? that would ease my mind about putting them as manual 😅

[VannTen]

Yeah I'll add FIXME comments

[floryut]

@VannTen fine by me, thank you

[VannTen]

Only missing a lgtm then

[MrFreezeex]

And here it is! :D
/lgtm

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: floryut, MrFreezeex, VannTen

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [floryut]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment