Problem CUDA enable runtime

[ox6d]

Hello everyone,

I would like to use LAVA-dl with my PGPU. I installed following the procedure on Github. But the torch installed is version 2.0.0+cpu. The CUDA version used is 11.8:

Cuda compilation tools, release 11.8, V11.8.89
Build cuda_11.8.r11.8/compiler.31833905_0.

When I run the Oxford Dataset tutorial, the build returns the following error:

"No CUDA runtime is found, using CUDA_HOME='C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.8'
Traceback (most recent call last):
  File "*\lava-nc\TUTO_SNN_SLAYER.py", line 73, in <module>
    net = Network().to(device)
  File "*\lava-nc\lava-dl\.venv\lib\site-packages\torch\nn\modules\module.py", line 1145, in to
    return self._apply(convert)
  File "*\lava-nc\lava-dl\.venv\lib\site-packages\torch\nn\modules\module.py", line 797, in _apply
    module._apply(fn)
  File "*\lava-nc\lava-dl\.venv\lib\site-packages\torch\nn\modules\module.py", line 797, in _apply
    module._apply(fn)
  File "*\lava-nc\lava-dl\.venv\lib\site-packages\torch\nn\modules\module.py", line 797, in _apply
    module._apply(fn)
  File "*\lava-nc\lava-dl\.venv\lib\site-packages\torch\nn\modules\module.py", line 820, in _apply
    param_applied = fn(param)
  File "*\lava-nc\lava-dl\.venv\lib\site-packages\torch\nn\modules\module.py", line 1143, in convert
    return t.to(device, dtype if t.is_floating_point() or t.is_complex() else None, non_blocking)
  File "*\lava-nc\lava-dl\.venv\lib\site-packages\torch\cuda\__init__.py", line 239, in _lazy_init
    raise AssertionError("Torch not compiled with CUDA enabled")
AssertionError: Torch not compiled with CUDA enabled"

I have uninstalled torch in the venv and installed torch 2.0.0+cu118. Here the code recognizes the GPU during code execution, but a "where cl" error appears. The pytest error also appears:

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

---------- coverage: platform win32, python 3.10.10-final-0 ----------
Name                                                                Stmts   Miss  Cover   Missing
-------------------------------------------------------------------------------------------------
src\lava\lib\dl\netx\__init__.py                                        5      0   100%
src\lava\lib\dl\netx\blocks\__init__.py                                 0      0   100%
src\lava\lib\dl\netx\blocks\models.py                                  39     11    72%   26-40, 48, 54, 60, 66, 72
src\lava\lib\dl\netx\blocks\process.py                                143    110    23%   35-47, 50-51, 54-72, 76, 98-108, 142-195, 232-278, 296-305, 340-367
src\lava\lib\dl\netx\hdf5.py                                          272    226    17%   73-100, 104, 108, 139-202, 218-243, 271-311, 344-441, 476-524, 547-664, 670
src\lava\lib\dl\netx\sequential_modules.py                             62     38    39%   57-61, 64, 67-68, 71-79, 92-93, 96, 99-101, 121-125, 129, 132-136, 148-151, 154, 157-158
src\lava\lib\dl\netx\utils.py                                          83     65    22%   43-50, 53, 56, 59-73, 100-152, 173-183
src\lava\lib\dl\slayer\__init__.py                                     13      0   100%
src\lava\lib\dl\slayer\auto.py                                        111     96    14%   28-31, 50-54, 88-98, 105-132, 137-141, 146-152, 157-208, 213-227, 233-242
src\lava\lib\dl\slayer\axon\__init__.py                                 3      0   100%
src\lava\lib\dl\slayer\axon\delay.py                                   71     49    31%   35, 66-77, 82-86, 91-93, 109-142, 156-168, 174-175, 184-198, 204-220
src\lava\lib\dl\slayer\axon\delta.py                                   91     64    30%   26-74, 85-122, 235, 251, 256-318
src\lava\lib\dl\slayer\block\__init__.py                                2      0   100%
src\lava\lib\dl\slayer\block\adrf.py                                   92     49    47%   18-23, 40-42, 50, 58, 68, 76-80, 88-92, 100-104, 112-116, 124-128, 136-140, 148-154
src\lava\lib\dl\slayer\block\adrf_iz.py                                92     49    47%   18-23, 40-42, 50, 58, 69, 77-81, 89-93, 101-105, 113-117, 125-129, 137-141, 149-155
src\lava\lib\dl\slayer\block\alif.py                                   92     49    47%   18-23, 40-42, 50, 58, 68, 76-80, 88-92, 100-104, 112-116, 124-128, 136-140, 148-154
src\lava\lib\dl\slayer\block\base.py                                  536    456    15%   26-39, 66-103, 109-129, 135-138, 148-165, 179-182, 188-194, 204-207, 223-226, 233-239, 245, 255-258, 296-322, 328-347, 353, 363-398, 415-426, 432-450, 456, 466-469, 507-533, 539-556, 562, 572-624, 674-697, 702-712, 718, 728-785, 828-850, 855-865, 871, 881-921, 968-991, 996-1006, 1012, 1022-1079, 1122-1144, 1149-1159, 1165, 1175-1215, 1272-1307, 1310, 1324-1364, 1370, 1380, 1423-1458, 1466-1488, 1494, 1504
src\lava\lib\dl\slayer\block\cuba.py                                  105     58    45%   20-25, 42-44, 52, 60, 68-80, 88, 96-100, 108-112, 120-124, 132-136, 144-148, 156-160, 168-174
src\lava\lib\dl\slayer\block\rf.py                                    101     55    46%   18-23, 39-41, 49, 57, 65-71, 79, 87-91, 99-103, 111-115, 123-127, 135-139, 147-151, 159-165
src\lava\lib\dl\slayer\block\rf_iz.py                                 101     55    46%   18-23, 40-42, 50, 58, 66-72, 80, 88-92, 100-104, 112-116, 124-128, 136-140, 148-152, 160-166
src\lava\lib\dl\slayer\block\sigma_delta.py                           120     78    35%   19-29, 45-47, 53-66, 74, 82, 90-94, 102-106, 114-118, 126-130, 138-142, 192-201, 206-211, 217, 227-260
src\lava\lib\dl\slayer\classifier.py                                   48     29    40%   39, 44, 68, 98-104, 128-129, 169-173, 193, 216-231, 251, 256
src\lava\lib\dl\slayer\dendrite\__init__.py                             2      0   100%
src\lava\lib\dl\slayer\dendrite\sigma.py                               25     14    44%   41-72, 77
src\lava\lib\dl\slayer\io.py                                          286    265     7%   46-88, 113-130, 162-247, 255-296, 304-356, 364-441, 466-482, 516-545, 572-612, 642-654, 679-698, 728-741, 768-788, 816-838, 862-881
src\lava\lib\dl\slayer\jitconfig.py                                     8      0   100%
src\lava\lib\dl\slayer\loss.py                                        100     76    24%   38-45, 50, 97-113, 118-141, 177-183, 188-208, 256-263, 268-284, 303-305, 310, 316, 326-327
src\lava\lib\dl\slayer\neuron\__init__.py                               5      0   100%
src\lava\lib\dl\slayer\neuron\adrf.py                                 208    123    41%   44-48, 169, 174, 179, 214-294, 346-347, 355, 360, 365-366, 374, 379-383, 388-392, 398-402, 408-412, 417, 423, 428, 466, 473-519, 524, 549-558, 566, 569, 571, 582-603, 631-657, 676-677
src\lava\lib\dl\slayer\neuron\adrf_iz.py                              208    123    41%   44-48, 169, 174, 179, 215-295, 347-348, 356, 361, 366-367, 375, 380-384, 389-393, 399-403, 409-413, 418, 424, 429, 467, 474-521, 526, 551-560, 568, 571, 573, 589-596, 618-650, 669-670
src\lava\lib\dl\slayer\neuron\alif.py                                 172    104    40%   45, 153, 158, 191-262, 309, 315-319, 325-329, 335-339, 345-349, 354, 360, 366, 371, 408, 415-451, 477-486, 494, 497, 507-537, 557-591, 609-610
src\lava\lib\dl\slayer\neuron\base.py                                  56     16    71%   136, 145-155, 196, 203, 208, 213, 217
src\lava\lib\dl\slayer\neuron\cuba.py                                 119     64    46%   45, 138, 143, 162-193, 228, 234-238, 244-248, 254, 260, 265, 295, 302-323, 343-346, 354, 364-384, 401-421, 439-440
src\lava\lib\dl\slayer\neuron\dropout.py                                7      2    71%   31-32
src\lava\lib\dl\slayer\neuron\dynamics\__init__.py                      4      0   100%
src\lava\lib\dl\slayer\neuron\dynamics\adaptive_phase_th.py            78     57    27%   27-48, 104-132, 152-153, 173-174, 190-225, 231, 241-283
src\lava\lib\dl\slayer\neuron\dynamics\adaptive_resonator.py          193    119    38%   27, 32, 46, 148-158, 178-179, 199-200, 231-266, 272-374, 441-525
src\lava\lib\dl\slayer\neuron\dynamics\adaptive_threshold.py           79     56    29%   27-48, 99-126, 150-151, 171-172, 187-228, 234, 243-274
src\lava\lib\dl\slayer\neuron\dynamics\leaky_integrator.py            103     55    47%   28, 33, 47, 100, 118-119, 139-159, 164-207, 224-225, 236-259
src\lava\lib\dl\slayer\neuron\dynamics\resonator.py                   187    124    34%   27, 32, 46, 132, 150-151, 173-174, 203-239, 244-329, 381-467
src\lava\lib\dl\slayer\neuron\norm.py                                  87     70    20%   38-51, 55, 60, 65-93, 140-159, 163-164, 169-170, 177, 182, 187-230
src\lava\lib\dl\slayer\neuron\rf.py                                   153     58    62%   42-46, 149, 154, 159, 181-187, 190, 195, 203-204, 207, 262-263, 271, 276, 281-282, 295-299, 304-308, 314, 319, 350, 358, 386-387, 392, 411-414, 422, 425, 427, 438-444, 463-480, 499-500
src\lava\lib\dl\slayer\neuron\rf_iz.py                                156     84    46%   44-48, 153, 158, 163, 184-225, 266-267, 275, 280, 285-286, 294, 299-303, 308-312, 318, 323, 354, 361-391, 396, 415-418, 426, 429, 431, 443-448, 466-492, 511-512
src\lava\lib\dl\slayer\neuron\sigma_delta.py                           47     22    53%   31, 125, 139, 145, 150, 165-169, 189-219
src\lava\lib\dl\slayer\object_detection\__init__.py                     4      0   100%
src\lava\lib\dl\slayer\object_detection\boundingbox\__init__.py         3      0   100%
src\lava\lib\dl\slayer\object_detection\boundingbox\metrics.py        159    143    10%   31-52, 71-80, 101-141, 161-166, 209-293, 316-318, 323-324, 338-344, 354-356, 376-385
src\lava\lib\dl\slayer\object_detection\boundingbox\utils.py          238    208    13%   60-106, 139-173, 205-238, 261-270, 287-299, 316-326, 347-350, 371-374, 393-409, 444-467, 486-507, 523-535, 551-563, 595-646, 682-691
src\lava\lib\dl\slayer\object_detection\dataset\__init__.py             2      0   100%
src\lava\lib\dl\slayer\object_detection\dataset\bdd100k.py            106     85    20%   36-38, 47-77, 80-107, 110, 145-161, 176-213, 218
src\lava\lib\dl\slayer\object_detection\models\__init__.py              2      0   100%
src\lava\lib\dl\slayer\object_detection\models\tiny_yolov3_str.py     160    148     8%   48-109, 145-202, 219-235, 248-329
src\lava\lib\dl\slayer\object_detection\models\yolo_kp.py             119    103    13%   50-107, 142-171, 183-206, 217-226, 242-254, 267-296
src\lava\lib\dl\slayer\object_detection\yolo_base.py                  174    151    13%   20-55, 60-82, 104-117, 132-167, 187-201, 242-263, 282-294, 316-358, 383-389, 406-407, 423-424, 436-440, 445-453
src\lava\lib\dl\slayer\spike\__init__.py                                3      0   100%
src\lava\lib\dl\slayer\spike\complex.py                                33     24    27%   60-114, 120-166
src\lava\lib\dl\slayer\spike\spike.py                                  31     21    32%   16-21, 73-110, 116-121
src\lava\lib\dl\slayer\synapse\__init__.py                              3      0   100%
src\lava\lib\dl\slayer\synapse\complex.py                              61     34    44%   15-18, 23, 27-28, 32-33, 38, 44-49, 55-56, 61, 98-110, 164-170, 222-227, 286-292, 345-350
src\lava\lib\dl\slayer\synapse\layer.py                               206    175    15%   22-24, 28-29, 33-34, 39-50, 58, 65, 70, 109-142, 159-172, 234-295, 312-319, 376-436, 453-502, 567-628, 645-653, 709-768, 817-834
src\lava\lib\dl\slayer\utils\__init__.py                                7      0   100%
src\lava\lib\dl\slayer\utils\assistant.py                              99     91     8%   59-66, 80-82, 102-145, 165-203, 223-260
src\lava\lib\dl\slayer\utils\filter\__init__.py                         4      0   100%
src\lava\lib\dl\slayer\utils\filter\conv.py                            68     41    40%   25-45, 51, 64, 77-80, 90-93, 107-118, 124-131, 141-152, 158-165, 191-194, 220-223
src\lava\lib\dl\slayer\utils\filter\fir.py                             37     20    46%   41-49, 54, 78-93, 98-100, 110, 115, 120
src\lava\lib\dl\slayer\utils\int_utils.py                              15      4    73%   26, 43-44, 50
src\lava\lib\dl\slayer\utils\quantize.py                               33     11    67%   32, 43, 49, 78-81, 109-114
src\lava\lib\dl\slayer\utils\recurrent.py                              70     61    13%   8-15, 19-33, 37-42, 55-74, 85-111
src\lava\lib\dl\slayer\utils\stats.py                                 197    172    13%   37-49, 53-55, 60-63, 68-71, 76, 81, 85-97, 102-118, 143-158, 162-167, 171, 176-183, 209-237, 254-305, 316-360, 365
src\lava\lib\dl\slayer\utils\time\__init__.py                           4      0   100%
src\lava\lib\dl\slayer\utils\time\replicate.py                          6      3    50%   32-34
src\lava\lib\dl\slayer\utils\time\shift.py                             59     45    24%   22-43, 49-68, 74-91, 119-139
src\lava\lib\dl\slayer\utils\utils.py                                  21     10    52%   43-53, 71-74
-------------------------------------------------------------------------------------------------
TOTAL                                                                6389   4519    29%

FAIL Required test coverage of 45.0% not reached. Total coverage: 29.27%
============================================================================== short test summary info ==============================================================================
ERROR tests/lava/lib/dl/slayer/neuron/test_adrf.py - subprocess.CalledProcessError: Command '['where', 'cl']' returned non-zero exit status 1.
ERROR tests/lava/lib/dl/slayer/neuron/test_adrf_iz.py - subprocess.CalledProcessError: Command '['where', 'cl']' returned non-zero exit status 1.
ERROR tests/lava/lib/dl/slayer/neuron/test_alif.py - subprocess.CalledProcessError: Command '['where', 'cl']' returned non-zero exit status 1.
ERROR tests/lava/lib/dl/slayer/neuron/test_cuba.py
ERROR tests/lava/lib/dl/slayer/neuron/test_rf.py - subprocess.CalledProcessError: Command '['where', 'cl']' returned non-zero exit status 1.
ERROR tests/lava/lib/dl/slayer/neuron/test_rf_iz.py
ERROR tests/lava/lib/dl/slayer/neuron/test_sigma_delta.py
ERROR tests/lava/lib/dl/slayer/neuron/dynamics/test_adaptive_phase_th.py
ERROR tests/lava/lib/dl/slayer/neuron/dynamics/test_adaptive_resonator.py - subprocess.CalledProcessError: Command '['where', 'cl']' returned non-zero exit status 1.
ERROR tests/lava/lib/dl/slayer/neuron/dynamics/test_adaptive_threshold.py - subprocess.CalledProcessError: Command '['where', 'cl']' returned non-zero exit status 1.
ERROR tests/lava/lib/dl/slayer/neuron/dynamics/test_leaky_integrator.py
ERROR tests/lava/lib/dl/slayer/neuron/dynamics/test_resonator.py - subprocess.CalledProcessError: Command '['where', 'cl']' returned non-zero exit status 1.
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Interrupted: 12 errors during collection !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
========================================================================= 11 warnings, 12 errors in 20.28s ==========================================================================

So I'm stuck and I don't know what to do.

Best