Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to update expectations #12696

Closed
gsnedders opened this issue Aug 27, 2018 · 4 comments
Closed

Unable to update expectations #12696

gsnedders opened this issue Aug 27, 2018 · 4 comments
Labels
infra priority:roadmap wptrunner The automated test runner, commonly called through ./wpt run

Comments

@gsnedders
Copy link
Member

$ ./wpt run --metadata infrastructure/metadata/ --manifest MANIFEST.json --log-raw safari.log safari infrastructure/
$ ./wpt update-expectations --product safari --metadata infrastructure/metadata/ --manifest MANIFEST.json safari.log 
Traceback (most recent call last):
  File "./wpt", line 5, in <module>
    wpt.main()
  File "/Users/gsnedders/Documents/other-projects/wpt/web-platform-tests/tools/wpt/wpt.py", line 132, in main
    rv = script(*args, **kwargs)
  File "/Users/gsnedders/Documents/other-projects/wpt/web-platform-tests/tools/wpt/update.py", line 32, in update_expectations
    updater.run()
  File "/Users/gsnedders/Documents/other-projects/wpt/web-platform-tests/tools/wptrunner/wptrunner/update/update.py", line 150, in run
    rv = update_runner.run()
  File "/Users/gsnedders/Documents/other-projects/wpt/web-platform-tests/tools/wptrunner/wptrunner/update/base.py", line 61, in run
    rv = step(self.logger).run(step_index, self.state)
  File "/Users/gsnedders/Documents/other-projects/wpt/web-platform-tests/tools/wptrunner/wptrunner/update/base.py", line 32, in run
    self.create(state)
  File "/Users/gsnedders/Documents/other-projects/wpt/web-platform-tests/tools/wptrunner/wptrunner/update/update.py", line 96, in create
    runner.run()
  File "/Users/gsnedders/Documents/other-projects/wpt/web-platform-tests/tools/wptrunner/wptrunner/update/base.py", line 61, in run
    rv = step(self.logger).run(step_index, self.state)
  File "/Users/gsnedders/Documents/other-projects/wpt/web-platform-tests/tools/wptrunner/wptrunner/update/base.py", line 32, in run
    self.create(state)
  File "/Users/gsnedders/Documents/other-projects/wpt/web-platform-tests/tools/wptrunner/wptrunner/update/metadata.py", line 14, in create
    state.property_order = property_order + state.extra_properties
TypeError: unsupported operand type(s) for +: 'NoneType' and 'list'

Hacking that line to be state.property_order = (property_order or []) + (state.extra_properties or []) causes it to change the expectations of several tests unconditionally, instead of adding exceptions for safari, which is what I'd expect given I didn't pass in --ignore-existing.

@gsnedders gsnedders added infra wptrunner The automated test runner, commonly called through ./wpt run priority:roadmap labels Aug 27, 2018
@gsnedders
Copy link
Member Author

(I have no idea whether the above is the correct fix because I don't understand the code at all.)

foolip added a commit to foolip/wpt that referenced this issue Oct 5, 2018
Using gsnedder's hack in
web-platform-tests#12696 and then manually
editing for safari-specific expectations.
@foolip
Copy link
Member

foolip commented Oct 30, 2018

@jgraham, have you seen this error? I ran into the same thing, and used @gsnedders' workaround.

@mdittmer
Copy link
Contributor

friendly ping. Glad to see this has a workaround, but should the issue be re-prioritized or receive an owner?

@gsnedders
Copy link
Member Author

We should just land some workaround, at least, before de-prioritizing.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
infra priority:roadmap wptrunner The automated test runner, commonly called through ./wpt run
Projects
None yet
Development

No branches or pull requests

3 participants