Use flutter test instead of flutter drive

[mateuszwojtczak]

No description provided.

[bartekpacia]

flutter test currently doesn't allow for using custom bindings. See flutter/flutter#113097.

We have our own custom binding – PatrolBinding. The only things it does is setting the source of every pointer event (tap, slide, etc) to test instead of device.

It lets native automators tap on our Flutter app (the most common use case for this is a WebView).

Without our custom bindings, when we $.native.tap() on some widget, no tap is performed, instead we only get the following output in the console:

Some possible finders for the widgets at Offset(195.0, 779.0):
  find.text('Open webview screen')
  find.widgetWithText(Align, 'Open webview screen')
  find.widgetWithText(Padding, 'Open webview screen')
  find.widgetWithText(GestureDetector, 'Open webview screen')
  find.widgetWithText(MouseRegion, 'Open webview screen')
  find.widgetWithText(InkWell, 'Open webview screen')
  find.byType(SliverList)
  find.byType(SliverPadding)
  find.byType(Viewport)
  find.byType(Scrollable)
  find.byKey(const Key('listViewKey'))
  find.byType(NotificationListener<ScrollNotification>)
  find.byKey(const Key('scaffold'))
  find.byElementType(InheritedModelElement<Object>)

[bartekpacia]

Replacing flutter drive with flutter test should also fix #425 (source).

[bartekpacia]

We won't need PatrolBinding at all when flutter/flutter#108430 lands on the stable channel. It's currently on beta.

See also:

• page of the commit that fixes this

[bartekpacia]

Homemade dependency graph

Some nodes are clickable

graph TD
  flutter_test[use `flutter test` - it gives us JUnit #495] --> a[stop using custom binding]
  click flutter_test "https://www.github.com/leancodepl/patrol/pull/495"
  a[we need custom binding because #107934] --> b[but it can be done with default binding in Flutter 3.5]
  click a "http://www.github.com/flutter/flutter/issues/107934"
  b --> c[remove custom binding]
  flutter_test --> useappbinary[once we migrate to it, we lose flake detection feature #114541]
  click useappbinary "http://www.github.com/flutter/flutter/issues/114541"

  host_features[screenshots, scripts] --> host_server[vmservice running on host #593]
  click host_server "https://www.github.com/leancodepl/patrol/pull/593"
  host_server --> custom_binding[requires custom binding] --> flutter_test_binding[`flutter test` doesn't support it #113097]
  click flutter_test_binding "http://www.github.com/flutter/flutter/issues/113097"
  host_server --> driver_script[needs driver script] --> flutter_test_driver[`flutter test` doesn't support it #115289]
  click flutter_test_driver "http://www.github.com/flutter/flutter/issues/115289"
  style custom_binding fill:#FF0000
  style c fill:#FF0000

  finder_apis[Improve Finder APIs]
  click finder_apis "https://github.com/flutter/flutter/issues/115874"

  single_test_binary[Single binary for all tests]
  click single_test_binary "https://github.com/flutter/flutter/issues/115751"

Loading

Flutter issue, but listed:

• flutter test is missing the --use-application-binary argument, which flutter drive has flutter/flutter#114541
• [integration_test] allow custom binding initialization when running integration_test tests flutter/flutter#113097
• flutter test integration_test doesn't allow for specyfing a custom driver script flutter/flutter#115289
• Improve Finder APIs flutter/flutter#115874
• Building all integration test targets into a single application binary flutter/flutter#115751

[bartekpacia]

This is superseded by #661.

[github-actions]

This issue has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar problem, please file a new issue. Make sure to follow the template and provide all the information necessary to reproduce the issue.