Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Testing regressions #81

Open
turican0 opened this issue Mar 14, 2021 · 3 comments
Open

Testing regressions #81

turican0 opened this issue Mar 14, 2021 · 3 comments
Assignees
Labels
enhancement New feature or request

Comments

@turican0
Copy link
Collaborator

turican0 commented Mar 14, 2021

This week I add to engine procedures for regressions testing.

Script will run game compiled with special commands, they will compare data with first 20 frame from begin level1.
After exit this game, script will be continue with compare 20 frames from level2, and next.

We can later too add samples from custom levels, too.

We can test x86 and x64 versions.

At now I program only the necessary functions and gradually collect samples of data from the levels.

@turican0 turican0 self-assigned this Mar 14, 2021
@turican0 turican0 added the enhancement New feature or request label Mar 14, 2021
@turican0
Copy link
Collaborator Author

I add regression testing (at now for level 1). You can compile game with #define TEST_REGRESSIONS_GAME and run testRegressions.bat or testRegressions_wxcopy.bat.
Later I add data for next levels.
Tom.

@turican0
Copy link
Collaborator Author

turican0 commented Mar 18, 2021

Level1 x86 - OK
Level1 x64 - OK
Level2 x86 - OK
Level2 x64 - OK
Level3 x86 - OK
Level3 x64 - OK
Level4 x86 - OK
Level4 x64 - OK
Level5 x86 - OK
Level5 x64 - OK
Level6 x86 - OK
Level6 x64 - OK
Level7 x86 - OK
Level7 x64 - OK
Level8 x86 - OK
Level8 x64 - OK
Level9 x86 - OK
Level9 x64 - OK
Level10 x86 - OK
Level10 x64 - OK
Level11 x86 - OK
Level11 x64 - OK
Level12 x86 - OK
Level12 x64 - OK
Level13 x86 - OK
Level13 x64 - OK
Level14 x86 - OK
Level14 x64 - OK
Level15 x86 - OK
Level15 x64 - OK
Level16 x86 - OK
Level16 x64 - OK
Level17 x86 - OK
Level17 x64 - OK
Level18 x86 - OK
Level18 x64 - OK
Level19 x86 - OK
Level19 x64 - OK
Level20 x86 - OK
Level20 x64 - OK
Level21 x86 - OK
Level21 x64 - OK
Level22 x86 - failed(not problem this is random differences)
Level22 x64 - failed(not problem this is random differences)
Level23 x86 - OK
Level23 x64 - OK
Level24 x86 - OK
Level24 x64 - OK
Level25 x86 - OK
Level25 x64 - OK
HiddenLevel1 x86 - OK
HiddenLevel1 x64 - ?
HiddenLevel2 x86 - OK
HiddenLevel2 x64 - ?
HiddenLevel3 x86 - OK
HiddenLevel3 x64 - ?
HiddenLevel4 x86 - OK
HiddenLevel4 x64 - ?
HiddenLevel5 x86 - OK
HiddenLevel5 x64 - ?
MultiplayerLevel1 x86 - OK
MultiplayerLevel2 x86 - failed
MultiplayerLevel3 x86 - OK
MultiplayerLevel4 x86 - OK
MultiplayerLevel5 x86 - OK
MultiplayerLevel6 x86 - OK
MultiplayerLevel7 x86 - OK
MultiplayerLevel8 x86 - OK
MultiplayerLevel9 x86 - OK
MultiplayerLevel10 x86 - OK

@turican0
Copy link
Collaborator Author

Please when find any error in Level1(x86 or x64) write it.

GrimSqueaker pushed a commit that referenced this issue Jun 25, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant