Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] FSharpQA tests migration to xUnit suite - Part 1/? #10415

Merged
merged 36 commits into from
Dec 4, 2020

Conversation

vzarytovskii
Copy link
Member

@vzarytovskii vzarytovskii commented Nov 9, 2020

This is a (semi-)automatic migration of F#QA tests to xUnit suite.
This PR is migrating only small fraction of simpler tests, which do not require running, IL comparison, or linking other libs - to test the migration script.

After this one is passing, I will start migrating other batches.

@@ -58,7 +204,4 @@
<ProjectReference Include="$(FSharpTestsRoot)\FSharp.Test.Utilities\FSharp.Test.Utilities.fsproj" />
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These tests can directly use FSharp.Compiler.Service.fsproj, and the test project can be included in FSharp.Compiler.Service.sln if not there already

@@ -19,9 +19,10 @@
</ItemGroup>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These tests can run just on netcoreapp3.1. We have enough coverage on net472 through visual studio tests and other test/fsharp tests

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@dsyme This is the fsharpqa suite. For sure they run on desktop, if we can't make them run net472 then we are doing something wrong.

@vzarytovskii vzarytovskii changed the title [WIP] FSharpQA tests migration to xUnit suite - Part 1 [WIP] FSharpQA tests migration to xUnit suite - Part 1/? Dec 1, 2020
@vzarytovskii vzarytovskii marked this pull request as ready for review December 1, 2020 18:34
@vzarytovskii
Copy link
Member Author

I've significantly reduced tests migrated to the xunit - only test which don't require running or IL comparisons. Migraing them in smaller batches makes troubleshooting so much easier.

@KevinRansom KevinRansom merged commit 67b936f into dotnet:main Dec 4, 2020
vzarytovskii added a commit that referenced this pull request Dec 5, 2020
ScottHutchinson pushed a commit to ScottHutchinson/fsharp that referenced this pull request Dec 8, 2020
nosami pushed a commit to xamarin/visualfsharp that referenced this pull request Feb 23, 2021
* [WIP] F#QA tests (semi-)auto migration.

* More IL cleanup in checker

* Removed already migrated tests

* Fixed some lst files format

* Component tests fsproj changes

* Component tests fsproj changes

* Moved test file according to its name in the env list

* Moved test file according to its name in the env list

* Moved test file according to its name in the env list

* Moved test file according to its name in the env list

* Moved test file according to its name in the env list

* Moved test file according to its name in the env list

* Moved test file according to its name in the env list

* Added 'Include' support for DirectoryAttribute

* Added a bunch of functions asserting diagnostics and run ouput against pattern

* Fix a bunch of F#QA tests (Expect -> Expects)

* Fix a bunch of F#QA tests (file name typos)

* Fix a bunch of F#QA tests (file name typos)

* Fix a bunch of F#QA tests (removed missing tests from env.lst)

* Added singleline regex option when matchin stderr/stdout

* Don't check overall issues count when just comparing code

* Removed some non-needed functionality from test fwk

* Fixed F#QA test name according to env.lst

* Builds + most of the tests passing

* Added 'times' tests

* Revert test changes

* added asFsx helper

* Added helper functions to Compiler testing framework

* Revert test changes

* Compiler testing helper functions

* Reduced migrated tests to only tests we compile (don't run or compare IL)

* Added missing 'times' tests

* Fixed a regex for IL cleanup
nosami pushed a commit to xamarin/visualfsharp that referenced this pull request Feb 23, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants