You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In your paper, the performance of RoBERTaGen on SVAMP is 30.3%. But my reproduced result is only 23.4%. Could you share with me about why this happens?
Thanks again for your work!
The text was updated successfully, but these errors were encountered:
Hi,
Thanks for your great work.
I am trying to reproduce the results for RobertaGen on SVAMP.
This is my command
python run_mwptoolkit.py
--model=RobertaGen --dataset=mawps_asdiv-a_svamp --task_type=single_equation --equation_fix=prefix --k_fold=None --test_step=5 --gpu_id=1
In your paper, the performance of RoBERTaGen on SVAMP is 30.3%. But my reproduced result is only 23.4%. Could you share with me about why this happens?
Thanks again for your work!
The text was updated successfully, but these errors were encountered: