Shape mismatch when trying to use different strides in decoder

[amirbakhtiary23]

Hi, I tried to train RT-DETR with higher res (1280x1280), using default settings, the result were disappointing.
According to #187 , you mentioned we can use deeper look into features by configuring the num_layers in decoder.
I did it and training is fine so far but there is a problem. When i try to change the feat_strides by adding a 64 to it ( [8,16,32,64] ), i get an RuntimeError: The size of tensor a (34000) must match the size of tensor b (35200) at non-singleton dimension 1 during inference (evaluation) which is related to :

/src/zoo/rtdetr/rtdetr_decoder.py", line 496, in _get_decoder_input
 memory = valid_mask.to(memory.dtype) * memory  # TODO fix type error for onnx export 

but when i set the feat_strides to [8,16,32,32] it works fine. How is that? shouldn't the shapes be consistent?

[lyuwenyu]

feat_strides should not be manually add for extra features but depents on features from neck;

You can try to keep [8,16,32] as neck features, and jsut modify num_layers. It will add extra strides implicitly.

---

see related code:
https://github.com/lyuwenyu/RT-DETR/blob/main/rtdetrv2_pytorch/src/zoo/rtdetr/rtdetrv2_decoder.py#L318-L319

[amirbakhtiary23]

Thanks, I had seen that before and that's how I figured I might be able to change the extra stride.
another matter, do you have any full diagram of your model with every component clearly specified (with their module name in the code of course)? I need that because I want to make a few adjustment to your model to test my hypothesis.