Mistral compile not working on T4 GPU (torch 2.3 + cu121)

[ydshieh]

System Info

Mistral compile not working on T4 GPU

torch 2.3 + cu121
transformers commit: 4ef85fe

See #30991 (comment)

tests/models/mistral/test_modeling_mistral.py::tests/models/mistral/test_modeling_mistral.py::test_compile_static_cache

TODO: enable test_compile_static_cache for mistral model test once fixed.

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.