My file stuck at “Submitted” ScanQA

[diandianhe]

Hello, the verification file I submitted in the ScanQA competition has remained submitted for several days, can you fix it?

[Sudhanshu727]

If the submission status is not updated correctly, the submission will remain in the "running" or "submitted" state indefinitely.
We can try to solve it by verifying that the "update_submission_data()" call is successful. We can log the result of the API call to see if there’s an issue with updating the status.
We can check if the evaluation script is correctly imported and accessible and can add logging to see if the evaluation is triggered correctly, and if there are any issues during the evaluation step.

@diandianhe Can you please assign this to me, I will try to solve the issue.

[aroundabout]

If the submission status is not updated correctly, the submission will remain in the "running" or "submitted" state indefinitely. We can try to solve it by verifying that the "update_submission_data()" call is successful. We can log the result of the API call to see if there’s an issue with updating the status. We can check if the evaluation script is correctly imported and accessible and can add logging to see if the evaluation is triggered correctly, and if there are any issues during the evaluation step.

@diandianhe Can you please assign this to me, I will try to solve the issue.

Hi Sidjamshu, I have met the same question in Argoverse Motion Forecasting Competition.
Can u help me to check the submission status with the API?

[Sudhanshu727]

Yes please, I would like to contribute. Can I get the details first.

…

On Sat, 4 Jan 2025, 8:47 pm Dandelion, ***@***.***> wrote: If the submission status is not updated correctly, the submission will remain in the *"running*" or *"submitted"* state indefinitely. We can try to solve it by verifying that the "*update_submission_data()*" call is successful. We can log the result of the API call to see if there’s an issue with updating the status. We can check if the evaluation script is correctly imported and accessible and can add *logging* to see if the evaluation is triggered correctly, and if there are any issues during the evaluation step. @diandianhe <https://github.com/diandianhe> Can you please assign this to me, I will try to solve the issue. Hi Sidjamshu, I have met the same question in Argoverse Motion Forecasting Competition <https://eval.ai/web/challenges/challenge-page/454/overview>. Can u help me to check the submission status with the API? — Reply to this email directly, view it on GitHub <#4426 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BNNMLOAZ6ZBOPP2R5B7B6RT2I73SBAVCNFSM6AAAAABS44IUT6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNZRGMZTCNBYG4> . You are receiving this because you commented.Message ID: ***@***.***>

[aroundabout]

Yes please, I would like to contribute. Can I get the details first.
…
On Sat, 4 Jan 2025, 8:47 pm Dandelion, @.> wrote: If the submission status is not updated correctly, the submission will remain in the "running" or "submitted" state indefinitely. We can try to solve it by verifying that the "update_submission_data()" call is successful. We can log the result of the API call to see if there’s an issue with updating the status. We can check if the evaluation script is correctly imported and accessible and can add logging to see if the evaluation is triggered correctly, and if there are any issues during the evaluation step. @diandianhe https://github.com/diandianhe Can you please assign this to me, I will try to solve the issue. Hi Sidjamshu, I have met the same question in Argoverse Motion Forecasting Competition https://eval.ai/web/challenges/challenge-page/454/overview. Can u help me to check the submission status with the API? — Reply to this email directly, view it on GitHub <#4426 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/BNNMLOAZ6ZBOPP2R5B7B6RT2I73SBAVCNFSM6AAAAABS44IUT6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNZRGMZTCNBYG4 . You are receiving this because you commented.Message ID: @.>

Challenge URL is: https://eval.ai/web/challenges/challenge-page/454/overview
I have submitted the file and the status keeps "submitted". And I found that the latest recode in leaderboard is about 20 days ago.

My team name is AET.
Any more details shall I provide?

[Sudhanshu727]

I need the complete repository/code for this. Can you share your whatsapp contact details with me, so that we can coordinate easily? Although, you can try once by adding logging in loop to check the submission status and whether the evaluation is triggered properly or not. May be the program is not able to access the updation of files when you make any changes.

…

On Wed, 8 Jan 2025, 9:34 pm Dandelion, ***@***.***> wrote: Yes please, I would like to contribute. Can I get the details first. … <#m_-4310746885720184468_> On Sat, 4 Jan 2025, 8:47 pm Dandelion, *@*.*> wrote: If the submission status is not updated correctly, the submission will remain in the "running" or "submitted" state indefinitely. We can try to solve it by verifying that the "update_submission_data()" call is successful. We can log the result of the API call to see if there’s an issue with updating the status. We can check if the evaluation script is correctly imported and accessible and can add logging to see if the evaluation is triggered correctly, and if there are any issues during the evaluation step. @diandianhe <https://github.com/diandianhe> https://github.com/diandianhe <https://github.com/diandianhe> Can you please assign this to me, I will try to solve the issue. Hi Sidjamshu, I have met the same question in Argoverse Motion Forecasting Competition https://eval.ai/web/challenges/challenge-page/454/overview <https://eval.ai/web/challenges/challenge-page/454/overview>. Can u help me to check the submission status with the API? — Reply to this email directly, view it on GitHub <#4426 (comment) <#4426 (comment)>>, or unsubscribe https://github.com/notifications/unsubscribe-auth/BNNMLOAZ6ZBOPP2R5B7B6RT2I73SBAVCNFSM6AAAAABS44IUT6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNZRGMZTCNBYG4 <https://github.com/notifications/unsubscribe-auth/BNNMLOAZ6ZBOPP2R5B7B6RT2I73SBAVCNFSM6AAAAABS44IUT6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNZRGMZTCNBYG4> . You are receiving this because you commented.Message ID: @.*> Challenge URL is: https://eval.ai/web/challenges/challenge-page/454/overview I have submitted the file and the status keeps "submitted". And I found that the latest recode in leaderboard is about 20 days ago. image.png (view on web) <https://github.com/user-attachments/assets/210e49ac-e4ec-4662-b70f-29072cd7aab5> My team name is AET. Any more details shall I provide? — Reply to this email directly, view it on GitHub <#4426 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/BNNMLOBSG22CRT5AXDZG44T2JVECVAVCNFSM6AAAAABS44IUT6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNZYGA2DQMBQGM> . You are receiving this because you commented.Message ID: ***@***.***>

[aroundabout]

I need the complete repository/code for this. Can you share your whatsapp contact details with me, so that we can coordinate easily? Although, you can try once by adding logging in loop to check the submission status and whether the evaluation is triggered properly or not. May be the program is not able to access the updation of files when you make any changes.
…
On Wed, 8 Jan 2025, 9:34 pm Dandelion, @.> wrote: Yes please, I would like to contribute. Can I get the details first. … <#m_-4310746885720184468_> On Sat, 4 Jan 2025, 8:47 pm Dandelion, @.> wrote: If the submission status is not updated correctly, the submission will remain in the "running" or "submitted" state indefinitely. We can try to solve it by verifying that the "update_submission_data()" call is successful. We can log the result of the API call to see if there’s an issue with updating the status. We can check if the evaluation script is correctly imported and accessible and can add logging to see if the evaluation is triggered correctly, and if there are any issues during the evaluation step. @diandianhe https://github.com/diandianhe https://github.com/diandianhe https://github.com/diandianhe Can you please assign this to me, I will try to solve the issue. Hi Sidjamshu, I have met the same question in Argoverse Motion Forecasting Competition https://eval.ai/web/challenges/challenge-page/454/overview https://eval.ai/web/challenges/challenge-page/454/overview. Can u help me to check the submission status with the API? — Reply to this email directly, view it on GitHub <#4426 (comment) <#4426 (comment)>>, or unsubscribe https://github.com/notifications/unsubscribe-auth/BNNMLOAZ6ZBOPP2R5B7B6RT2I73SBAVCNFSM6AAAAABS44IUT6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNZRGMZTCNBYG4 https://github.com/notifications/unsubscribe-auth/BNNMLOAZ6ZBOPP2R5B7B6RT2I73SBAVCNFSM6AAAAABS44IUT6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNZRGMZTCNBYG4 . You are receiving this because you commented.Message ID: @.> Challenge URL is: https://eval.ai/web/challenges/challenge-page/454/overview I have submitted the file and the status keeps "submitted". And I found that the latest recode in leaderboard is about 20 days ago. image.png (view on web) https://github.com/user-attachments/assets/210e49ac-e4ec-4662-b70f-29072cd7aab5 My team name is AET. Any more details shall I provide? — Reply to this email directly, view it on GitHub <#4426 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/BNNMLOBSG22CRT5AXDZG44T2JVECVAVCNFSM6AAAAABS44IUT6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNZYGA2DQMBQGM . You are receiving this because you commented.Message ID: @.**>

I am not the host of the challenge but just a user, so I do not have the code.
Maybe I should wait the challenge host for fixing the problem~