[BUG] nvidia-smi wrapper script ignores ENABLE_NON_MIG_GPUS=1 on a heterogeneous multi-GPU machine

[gerashegalov]

Describe the bug
When testing on a machine with multiple physical GPU devices where only a subset of GPUs is sliced into MIGs the wrapper script nvidia-smi-wrapper.sh fails to produce a heterogeneous output including GPU elements backed by MIG devices and non-MIG-enabled GPU elements.

Steps/Code to reproduce bug

MIG_AS_GPU_ENABLED=1 ENABLE_NON_MIG_GPUS=1 ./examples/MIG-Support/yarn-unpatched/scripts/nvidia-smi-wrapper.sh -q -x

Expected behavior
Should be able to produce a mix of physical and MIG devices when ENABLE_NON_MIG_GPUS=1

Environment details (please complete the following information)

• Environment location: Standalone
• Spark configuration settings related to the issue: N/A

Additional context
transparent support for MIG on YARN