train.py 运行到第二轮报运行时错误

[hopesala]

...很多如下错误
/opt/conda/conda-bld/pytorch_1603729062494/work/aten/src/ATen/native/cuda/IndexKernel.cu:84: operator(): block: [60,0,0], thread: [60,0,0] Assertion index >= -sizes[i] && index < sizes[i] && "index out of bounds" failed.
/opt/conda/conda-bld/pytorch_1603729062494/work/aten/src/ATen/native/cuda/IndexKernel.cu:84: operator(): block: [60,0,0], thread: [61,0,0] Assertion index >= -sizes[i] && index < sizes[i] && "index out of bounds" failed.
/opt/conda/conda-bld/pytorch_1603729062494/work/aten/src/ATen/native/cuda/IndexKernel.cu:84: operator(): block: [60,0,0], thread: [62,0,0] Assertion index >= -sizes[i] && index < sizes[i] && "index out of bounds" failed.
/opt/conda/conda-bld/pytorch_1603729062494/work/aten/src/ATen/native/cuda/IndexKernel.cu:84: operator(): block: [60,0,0], thread: [63,0,0] Assertion index >= -sizes[i] && index < sizes[i] && "index out of bounds" failed.
2/59 2.59G 0.0773 0.04795 0.05063 0.2194 0.3953 1 1024: 93%|█████▌| 12214/13191 [1:37:05<07:46, 2.10it/s]
Traceback (most recent call last):
File "train.py", line 456, in
train(hyp, opt, device, tb_writer)
File "train.py", line 269, in train
loss, loss_items = compute_loss(pred, targets.to(device), model) # loss scaled by batch_size
File "/home/cao/Downloads/rotation-yolov5-master/utils/general.py", line 530, in compute_loss
tobj[b, a, gj, gi] = (1.0 - model.gr) + model.gr * iou.detach().clamp(0).type(tobj.dtype) # iou ratio
RuntimeError: CUDA error: device-side assert triggered