You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Although all of the other tests produce identical results when run with the same commit, two.pf does not. The results are similar but not identical, as they should be since it is not being run with a random seed. Here is what the comparison looks like in the regression plot.
(Aside: the commands.txt file for the regression tests has not been updated and still refers to python, though this probably does not matter for anything. All of the regression tests are run with the defaults. It's more generally unclear that we have a good set of tests, which is something that should be reviewed. However the problem with two.pf is independent of these concerns)
The text was updated successfully, but these errors were encountered:
Although all of the other tests produce identical results when run with the same commit, two.pf does not. The results are similar but not identical, as they should be since it is not being run with a random seed. Here is what the comparison looks like in the regression plot.
(Aside: the commands.txt file for the regression tests has not been updated and still refers to python, though this probably does not matter for anything. All of the regression tests are run with the defaults. It's more generally unclear that we have a good set of tests, which is something that should be reviewed. However the problem with two.pf is independent of these concerns)
The text was updated successfully, but these errors were encountered: