Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Submitting ported Microsoft custom props test suite #5288

Merged
merged 7 commits into from
Jun 5, 2017
Merged

Submitting ported Microsoft custom props test suite #5288

merged 7 commits into from
Jun 5, 2017

Conversation

gsnedders
Copy link
Member

@gsnedders gsnedders commented Mar 31, 2017 •
edited by wpt-pr-bot
Loading

Originally posted as w3c/csswg-test#1249 by @gregwhitworth on 23 Mar 2017, 22:01 UTC:

I have ported over (where necessary) the testcases we have for custom properties. Just to pre-empt some feedback, a lot of these are not technically covered by this spec but a lot of regular cascade and element features needed to be thoroughly tested in order to work.

CCing for review to the owners: @dbaron @svgeesus @SimonSapin @tabatkins

I'm also going to cc @atanassov and @astearns since we're actively looking into test coverage for specs that we can try to get to Rec.

@wpt-pr-bot
Copy link
Collaborator

Notifying @SimonSapin, @dbaron, @svgeesus, and @tabatkins. (Learn how reviewing works.)

@wpt-issue-mover wpt-issue-mover changed the title Csswg test pr 1249 Submitting ported Microsoft custom props test suite Mar 31, 2017
@wpt-issue-mover
Copy link

Originally posted as w3c/csswg-test#1249 (comment) by @syncbot on 23 Mar 2017, 22:10 UTC:

Automatic validation checks of commit 5cb5445 passed.

@wpt-issue-mover wpt-issue-mover mentioned this pull request Mar 31, 2017
Closed
@gregwhitworth
Copy link
Contributor

@gsnedders I apologize for my ignorance, but what exactly is Travis saying is failing here? All the meta is setup as expected, is it because FF/Chrome are failing tests?

@gsnedders
Copy link
Member Author

gsnedders commented Mar 31, 2017 •
edited
Loading

@gregwhitworth the fact some are failing is irrelevant: it's the fact that for some of the subtests it's getting 20 results from running the tests 10 times, which is likely caused by default test names (looking quickly in /css/css-variables-1/variable-definition.html, you have in the array two tests with name !important and case sensetivity (sic), hence why it's getting more results for those test names than the number of times it is running those tests).

@jgraham @jugglinmike can we make this clearer somehow?

gsnedders
gsnedders commented Mar 31, 2017
View reviewed changes
css/css-variables-1/variable-definition.html Outdated
{ varName:"--var", expectedValue:"value", style:"--var:value;--var:;", testName:"can't overwrite with no value"},
{ varName:"--var", expectedValue:" ", style:"--var:value;--var: ;", testName:"can overwrite with space value"},
{ varName:"--var", expectedValue:"value1", style:"--var:value1; --Var:value2", testName:"case sensetivity"},
{ varName:"--Var", expectedValue:"value2", style:"--var:value1; --Var:value2", testName:"case sensetivity"},
Copy link
Member Author

@gsnedders gsnedders Mar 31, 2017 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some test name as the line above, also that's not how you spell sensitivity. See the rest of the unstable results found, they're likely all similar.

@jugglinmike
Copy link
Contributor

Sure thing. Check out gh-5305. It's a little subtle since we're working within
the confines of a Markdown table, but I'm hoping it will be enough to clear up
confusion.

@gregwhitworth
Copy link
Contributor

@gsnedders Since you now "own" this merge from what I believe - how do I update my PR? Should I just create a new one?

@gsnedders
Copy link
Member Author

@gregwhitworth you now have push access

@ghost
Copy link

ghost commented May 16, 2017 •
edited by ghost
Loading

View the complete job log.

Firefox (nightly)

Testing web-platform-tests at revision f3d796e
Using browser at version BuildID 20170516192431; SourceStamp b8e9b674033bcd1f3a4c59b9d0ee7619c1a17cc5
Starting 10 test iterations
All results were stable

All results

42 tests ran
/css/css-variables-1/vars-font-shorthand-001.html
Subtest Results Messages
CRASH
/css/css-variables-1/variable-animation-from-to.html
Subtest Results Messages
OK
Verify CSS variable value before animation FAIL assert_equals: --value is blue before animation runs expected "blue" but got "red"
Verify substituted color value before animation FAIL assert_equals: color is blue before animation runs expected "rgb(0, 0, 255)" but got "rgb(255, 0, 0)"
Verify CSS variable value after animation FAIL assert_equals: --value is green after animation runs expected "green" but got "red"
Verify substituted color value after animation FAIL assert_equals: color is green after animation runs expected "rgb(0, 128, 0)" but got "rgb(255, 0, 0)"
/css/css-variables-1/variable-animation-over-transition.html
Subtest Results Messages
OK
Verify CSS variable value before animation FAIL assert_equals: --value is blue before animation runs expected "blue" but got "red"
Verify substituted color value before animation FAIL assert_equals: color is blue before animation runs expected "rgb(0, 0, 255)" but got "rgb(255, 0, 0)"
Verify CSS variable value after animation FAIL assert_equals: --value is green after animation runs expected "green" but got "black"
Verify substituted color value after animation FAIL assert_equals: color is green after animation runs expected "rgb(0, 128, 0)" but got "rgb(0, 0, 0)"
/css/css-variables-1/variable-animation-substitute-into-keyframe-shorthand.html
Subtest Results Messages
OK
Verify border-bottom-color before animation PASS
Verify border-bottom-color after animation PASS
/css/css-variables-1/variable-animation-substitute-into-keyframe-transform.html
Subtest Results Messages
OK
Verify transform before animation PASS
Verify transform after animation PASS
/css/css-variables-1/variable-animation-substitute-into-keyframe.html
Subtest Results Messages
OK
Verify color before animation PASS
Verify color after animation PASS
/css/css-variables-1/variable-animation-substitute-within-keyframe-fallback.html
Subtest Results Messages
OK
Verify color before animation PASS
Verify color after animation PASS
/css/css-variables-1/variable-animation-substitute-within-keyframe-multiple.html
Subtest Results Messages
OK
Verify color before animation PASS
Verify color after animation PASS
/css/css-variables-1/variable-animation-substitute-within-keyframe.html
Subtest Results Messages
OK
Verify color before animation PASS
Verify color after animation PASS
/css/css-variables-1/variable-animation-to-only.html
Subtest Results Messages
OK
Verify CSS variable value before animation PASS
Verify CSS variable value after animation FAIL assert_equals: --value is green after animation runs expected "green" but got "blue"
/css/css-variables-1/variable-created-document.html
Subtest Results Messages
OK
Variable definition appearing in a created document should work once spliced into the creating document PASS
Variable reference appearing in a created document should work once spliced into the creating document PASS
/css/css-variables-1/variable-created-element.html
Subtest Results Messages
OK
Specified variable value appearing in a created element's inline style should work once spliced into the creating document PASS
Computed variable value appearing in a created element's inline style should work once spliced into the creating document PASS
Variable reference appearing in a created element's inline style should work once spliced into the creating document PASS
/css/css-variables-1/variable-cssText.html
Subtest Results Messages
OK
target1 undefined FAIL assert_equals: expected "--var: var1;" but got "--var: var1;"
target2 undefined PASS
target3 undefined PASS
target4 undefined FAIL assert_equals: expected "margin: var(--prop) !important;" but got "margin: var(--prop) !important;"
target5 undefined FAIL assert_equals: expected "background: var(--prop) !important;" but got "background: var(--prop) !important;"
target6 undefined FAIL assert_equals: expected "background: green;" but got "background: green none repeat scroll 0% 0%;"
target7 undefined PASS
target8 undefined FAIL assert_equals: expected "color: var(--prop);" but got "color: var(--prop);"
target9 undefined FAIL assert_equals: expected "margin-top: 10px; margin-right: ; margin-bottom: ; margin-left: ;" but got "margin-right:; margin-bottom:; margin-left:; margin-top: 10px;"
target10 undefined PASS
/css/css-variables-1/variable-definition-border-shorthand-serialize.html
Subtest Results Messages
OK
border-color should serialize to empty when border shorthand references a variable PASS
/css/css-variables-1/variable-definition-cascading.html
Subtest Results Messages
OK
testing cascaded CSS Variables on div 't0' PASS
testing cascaded CSS Variables on div 't1a' PASS
testing cascaded CSS Variables on div 't1b' PASS
testing cascaded CSS Variables on div 't1c' PASS
testing cascaded CSS Variables on div 't1d' PASS
testing cascaded CSS Variables on div 't2a' PASS
testing cascaded CSS Variables on div 't2b' PASS
testing cascaded CSS Variables on div 't2c' PASS
testing cascaded CSS Variables on div 't2d' PASS
/css/css-variables-1/variable-definition-keywords.html
Subtest Results Messages
OK
computed style inherit PASS
computed style initial PASS
computed style unset PASS
specified style inherit PASS
specified style initial PASS
specified style unset PASS
/css/css-variables-1/variable-definition.html
Subtest Results Messages
OK
no variable PASS
variable PASS
single char variable PASS
single char '-' variable PASS
no char variable PASS
white space value (single space) PASS
white space value (double space) PASS
overwrite PASS
can't overwrite with no value PASS
can overwrite with space value PASS
case sensetivity PASS
case sensetivity2 PASS
parsing three dashes at start of variable PASS
parsing multiple dashes with one dash at start of variable PASS
leading white space (single space) PASS
middle white space (single space) PASS
trailing white space (single space) PASS
leading white space (double space) 2 PASS
middle white space (double space) 2 PASS
trailing white space (double space) 2 PASS
!important PASS
!important 2 PASS
!important (with space) PASS
no variable (Computed Style) PASS
variable (Computed Style) PASS
single char variable (Computed Style) PASS
single char '-' variable (Computed Style) PASS
no char variable (Computed Style) PASS
white space value (single space) (Computed Style) PASS
white space value (double space) (Computed Style) PASS
overwrite (Computed Style) PASS
can't overwrite with no value (Computed Style) PASS
can overwrite with space value (Computed Style) PASS
case sensetivity (Computed Style) PASS
case sensetivity2 (Computed Style) PASS
parsing three dashes at start of variable (Computed Style) PASS
parsing multiple dashes with one dash at start of variable (Computed Style) PASS
leading white space (single space) (Computed Style) PASS
middle white space (single space) (Computed Style) PASS
trailing white space (single space) (Computed Style) PASS
leading white space (double space) 2 (Computed Style) PASS
middle white space (double space) 2 (Computed Style) PASS
trailing white space (double space) 2 (Computed Style) PASS
!important (Computed Style) PASS
!important 2 (Computed Style) PASS
!important (with space) (Computed Style) PASS
no variable (Cascading) PASS
variable (Cascading) PASS
single char variable (Cascading) PASS
single char '-' variable (Cascading) PASS
no char variable (Cascading) PASS
white space value (single space) (Cascading) PASS
white space value (double space) (Cascading) PASS
overwrite (Cascading) PASS
can't overwrite with no value (Cascading) PASS
can overwrite with space value (Cascading) PASS
case sensetivity (Cascading) PASS
case sensetivity2 (Cascading) PASS
parsing three dashes at start of variable (Cascading) PASS
parsing multiple dashes with one dash at start of variable (Cascading) PASS
leading white space (single space) (Cascading) PASS
middle white space (single space) (Cascading) PASS
trailing white space (single space) (Cascading) PASS
leading white space (double space) 2 (Cascading) PASS
middle white space (double space) 2 (Cascading) PASS
trailing white space (double space) 2 (Cascading) PASS
!important (Cascading) PASS
!important 2 (Cascading) PASS
!important (with space) (Cascading) PASS
basic CSSOM.setProperty PASS
CSSOM.setProperty with space 1 FAIL assert_equals: Expected Value should match actual value expected "" but got "green"
CSSOM.setProperty with space 2 FAIL assert_equals: Expected Value should match actual value expected "" but got "green"
CSSOM.setProperty with space 3 PASS
/css/css-variables-1/variable-first-letter.html
Subtest Results Messages
OK
color PASS
font-size PASS
font-weight PASS
position PASS
nested color PASS
abspos PASS
/css/css-variables-1/variable-first-line.html
Subtest Results Messages
OK
color PASS
font-size PASS
font-weight PASS
position PASS
nested color PASS
abspos PASS
/css/css-variables-1/variable-invalidation.html
Subtest Results Messages
OK
css rule test FAIL assert_equals: cssText initial. expected "--var1: red;" but got "--var1:red;"
css rule test important FAIL assert_equals: cssText initial. expected "--var2: red !important;" but got "--var2:red!important;"
inline style test FAIL assert_equals: cssText initial. expected "--var3: red;" but got "--var3:red;"
inline style test important FAIL assert_equals: cssText initial. expected "--var4: red !important;" but got "--var4:red!important;"
/css/css-variables-1/variable-presentation-attribute.html
Subtest Results Messages
OK
Testing 'stroke-width' on '#box1'. PASS
Testing 'stroke-width' on '#box2'. PASS
Testing 'stroke-width' on '#box3'. PASS
Testing 'clip' on '#test4'. FAIL assert_equals: expected "rect(1px, 160px, 48px, 16px)" but got "rect(1px, 160px, 48px, 20px)"
Testing 'alignment-baseline'. FAIL assert_equals: Default value. expected "auto" but got ""
Testing 'baseline-shift'. FAIL assert_equals: Default value. expected "baseline" but got ""
Testing 'clip-rule'. PASS
Testing 'color'. PASS
Testing 'color-interpolation-filters'. FAIL assert_equals: Default value. expected "" but got "linearrgb"
Testing 'cursor'. PASS
Testing 'direction'. PASS
Testing 'display'. PASS
Testing 'dominant-baseline'. PASS
Testing 'fill'. FAIL assert_equals: Default value. expected "black" but got "rgb(0, 0, 0)"
Testing 'fill-opacity'. PASS
Testing 'fill-rule'. PASS
Testing 'filter'. PASS
Testing 'flood-color'. FAIL assert_equals: Default value. expected "" but got "rgb(0, 0, 0)"
Testing 'flood-opacity'. PASS
Testing 'font-family'. FAIL assert_equals: Default value. expected "Times New Roman" but got "serif"
Testing 'font-size'. PASS
Testing 'font-size-adjust'. PASS
Testing 'font-stretch'. PASS
Testing 'font-style'. PASS
Testing 'font-weight'. PASS
Testing 'glyph-orientation-horizontal'. FAIL assert_equals: Default value. expected "0deg" but got ""
Testing 'glyph-orientation-vertical'. FAIL assert_equals: Default value. expected "auto" but got ""
Testing 'kerning'. FAIL assert_equals: Default value. expected "auto" but got ""
Testing 'letter-spacing'. PASS
Testing 'lighting-color'. FAIL assert_equals: Default value. expected "" but got "rgb(255, 255, 255)"
Testing 'opacity'. PASS
Testing 'overflow'. PASS
Testing 'pointer-events'. FAIL assert_equals: Default value. expected "visiblePainted" but got "auto"
Testing 'stop-color'. FAIL assert_equals: Default value. expected "" but got "rgb(0, 0, 0)"
Testing 'stop-opacity'. PASS
Testing 'stroke'. FAIL assert_equals: Default value. expected "" but got "none"
Testing 'stroke-dasharray'. PASS
Testing 'stroke-dashoffset'. PASS
Testing 'stroke-linecap'. PASS
Testing 'stroke-linejoin'. PASS
Testing 'stroke-miterlimit'. PASS
Testing 'stroke-opacity'. PASS
Testing 'stroke-width'. PASS
Testing 'text-anchor'. PASS
Testing 'text-decoration'. PASS
Testing 'visibility'. PASS
Testing 'word-spacing'. PASS
Testing 'writing-mode'. FAIL assert_equals: Default value. expected "lr-tb" but got "horizontal-tb"
/css/css-variables-1/variable-pseudo-element.html
Subtest Results Messages
OK
div1 PASS
div2 PASS
div3 PASS
div4 PASS
/css/css-variables-1/variable-reference-cssom.html
Subtest Results Messages
OK
Verify correct results using CSSOM PASS
Verify correct results with CSSOM overriding markup-set values PASS
/css/css-variables-1/variable-reference-refresh.html
Subtest Results Messages
OK
Verify substituted color value before refresh PASS
Verify substituted color value after refresh PASS
/css/css-variables-1/variable-reference-shorthands-cssom.html
Subtest Results Messages
OK
CSS variable references - shorthand properties - via CSSOM PASS
/css/css-variables-1/variable-reference-shorthands.html
Subtest Results Messages
OK
target1 margin PASS
target1 margin-left PASS
target1 margin-top PASS
target1 margin-right PASS
target1 margin-bottom PASS
target2 margin PASS
target2 margin-left PASS
target2 margin-top PASS
target2 margin-right PASS
target2 margin-bottom PASS
target3 margin PASS
target3 margin-left PASS
target3 margin-top PASS
target3 margin-right PASS
target3 margin-bottom PASS
target4 background PASS
/css/css-variables-1/variable-reference-variable.html
Subtest Results Messages
OK
Parse, store, and serialize CSS variable referencing another CSS variable PASS
Parse, store, and serialize CSS variable referencing another CSS variable 1 PASS
/css/css-variables-1/variable-reference.html
Subtest Results Messages
OK
width: var(--prop); PASS
width: var(--prop) !important; PASS
width: var(--prop, ); PASS
width: var(--prop, 20px); PASS
width: var(--prop, blue); PASS
width: var(--prop1, var(--prop2)); PASS
width: var(--prop1, var(--prop2, var(--prop3, auto))); PASS
width: var(--prop1) var(--prop2) PASS
width: var(); PASS
width: var(prop); PASS
width: var(-prop); PASS
width: var(--prop,); PASS
width: var(--prop 20px); PASS
width: var(--prop, var(prop)); PASS
width: var(--prop, var(-prop)); PASS
width: var(20px); PASS
width: var(var(--prop)); PASS
Variable reference left open at end of stylesheet FAIL assert_equals: expected "var(--prop" but got "var(--prop)"
/css/css-variables-1/variable-substitution-background-properties.html
Subtest Results Messages
OK
background-attachment PASS
background-clip PASS
background-color PASS
background-origin PASS
background-position PASS
background-repeat PASS
background-size PASS
background-image-url PASS
background-image-linear-gradient PASS
background-image-radial-gradient FAIL assert_equals: Expected Value should match actual value expected "radial-gradient(at 25px 25px, black 10%, green 90%)" but got "radial-gradient(at 25px 25px, rgb(0, 0, 0) 10%, rgb(0, 128, 0) 90%)"
/css/css-variables-1/variable-substitution-basic.html
Subtest Results Messages
OK
Simple substitution test PASS
You can't build up a single token where part of it is provided by a variable PASS
Multiple variable references in a single property PASS
Multiple variable references in a single property (no spaces) PASS
Fallback value PASS
Fallback value which is also a variable reference PASS
Multiple var references in fallback value PASS
Multiple nested fallbacks PASS
Bad variable reference that should inherit by default PASS
Test that var reference doesn�t overwrite !important PASS
Test that !important on a property that has a variable reference can overwrite !important PASS
Test that !important inside of var reference can't overwrite !important on property PASS
/css/css-variables-1/variable-substitution-filters.html
Subtest Results Messages
OK
blur PASS
brightness PASS
contrast PASS
grayscale PASS
invert PASS
sepia PASS
saturate PASS
/css/css-variables-1/variable-substitution-plus-box-shadow.html
Subtest Results Messages
OK
box-shadow PASS
--alpha PASS
color PASS
/css/css-variables-1/variable-substitution-replaced-size.html
Subtest Results Messages
OK
width on IFRAME PASS
height on IFRAME PASS
width on INPUT PASS
height on INPUT PASS
width on CANVAS PASS
height on CANVAS PASS
/css/css-variables-1/variable-substitution-shadow-properties.html
Subtest Results Messages
OK
box-shadow FAIL assert_equals: Expected Value should match actual value expected "1px 1px 1px 1px rgb(0,128,0)" but got "rgb(0, 128, 0) 1px 1px 1px 1px"
text-shadow FAIL assert_equals: Expected Value should match actual value expected "1px 1px 1px rgb(0,128,0)" but got "rgb(0, 128, 0) 1px 1px 1px"
/css/css-variables-1/variable-substitution-shorthands.html
Subtest Results Messages
OK
target1 margin-left PASS
target1 margin-top PASS
target1 margin-right PASS
target1 margin-bottom PASS
target2 margin-left PASS
target2 margin-top PASS
target2 margin-right PASS
target2 margin-bottom PASS
target3 margin-left PASS
target3 margin-top PASS
target3 margin-right PASS
target3 margin-bottom PASS
target4 margin-left PASS
target4 margin-top PASS
target4 margin-right PASS
target4 margin-bottom PASS
target5 border-top-width PASS
target5 border-top-style PASS
target5 border-top-color PASS
target5 border-right-width PASS
target5 border-right-style PASS
target5 border-right-color PASS
target5 border-bottom-width PASS
target5 border-bottom-style PASS
target5 border-bottom-color PASS
target5 border-left-width PASS
target5 border-left-style PASS
target5 border-left-color PASS
target6 border-top-width PASS
target6 border-top-style PASS
target6 border-top-color PASS
target6 border-right-width PASS
target6 border-right-style PASS
target6 border-right-color PASS
target6 border-bottom-width PASS
target6 border-bottom-style PASS
target6 border-bottom-color PASS
target6 border-left-width PASS
target6 border-left-style PASS
target6 border-left-color PASS
target7 margin-left PASS
target7 margin-top PASS
target7 margin-right PASS
target7 margin-bottom PASS
target8 transition-duration PASS
target9 border-left-width PASS
target9 border-left-style PASS
target9 border-left-color PASS
target9 border-top-width PASS
target9 border-right-width PASS
target9 border-bottom-width PASS
/css/css-variables-1/variable-substitution-variable-declaration.html
Subtest Results Messages
OK
target1 --var2 PASS
target1 margin-top PASS
target1 margin-right PASS
target1 margin-bottom PASS
target1 margin-left PASS
target2parent --var1 PASS
target2parent --var2 PASS
target2 --var1 PASS
target2 --var2 PASS
target3 --var1 PASS
target3 --var2 PASS
target4 --varA PASS
target4 --varB PASS
target4 --varC PASS
target5 --varA PASS
target5 --varB PASS
target5 --varC PASS
target6 --varA PASS
target6 --varB PASS
target6 --varC PASS
target7 --varA PASS
target7 --varB PASS
target7 --varC PASS
target8 --varA PASS
target8 --varB PASS
target9 --varA PASS
target9 --varB PASS
target9 --varC PASS
target10 --varA PASS
target10 --varB PASS
target10 --varC PASS
/css/css-variables-1/variable-transitions-from-no-value.html
Subtest Results Messages
TIMEOUT
Verify CSS variable value before transition PASS
Verify substituted color value before transition PASS
Verify CSS variable value after transition NOTRUN
Verify substituted color value after transition NOTRUN
/css/css-variables-1/variable-transitions-to-no-value.html
Subtest Results Messages
TIMEOUT
Verify CSS variable value before transition PASS
Verify substituted color value before transition PASS
Verify CSS variable value after transition NOTRUN
Verify substituted color value after transition NOTRUN
/css/css-variables-1/variable-transitions-transition-property-all-before-value.html
Subtest Results Messages
OK
Verify CSS variable value before transition PASS
Verify substituted color value before transition PASS
Verify CSS variable value after transition PASS
Verify substituted color value after transition PASS
/css/css-variables-1/variable-transitions-transition-property-variable-before-value.html
Subtest Results Messages
TIMEOUT
Verify CSS variable value before transition PASS
Verify substituted color value before transition PASS
Verify CSS variable value after transition NOTRUN
Verify substituted color value after transition NOTRUN
/css/css-variables-1/variable-transitions-value-before-transition-property-all.html
Subtest Results Messages
OK
Verify CSS variable value before transition PASS
Verify substituted color value before transition PASS
Verify CSS variable value after transition PASS
Verify substituted color value after transition PASS
/css/css-variables-1/variable-transitions-value-before-transition-property-variable.html
Subtest Results Messages
TIMEOUT
Verify CSS variable value before transition PASS
Verify substituted color value before transition PASS
Verify CSS variable value after transition NOTRUN
Verify substituted color value after transition NOTRUN

@ghost
Copy link

ghost commented May 16, 2017 •
edited by ghost
Loading

*This report has been truncated because the total content is 68382 characters in length, which is in excess of GitHub.com's limit for comments (65536 characters).

View the complete job log.

Sauce (safari)

Testing web-platform-tests at revision f3d796e
Using browser at version 10.0
Starting 10 test iterations
All results were stable

All results

42 tests ran
/css/css-variables-1/variable-animation-from-to.html
Subtest Results Messages
OK
Verify CSS variable value before animation FAIL assert_equals: --value is blue before animation runs expected "blue" but got "red"
Verify substituted color value before animation FAIL assert_equals: color is blue before animation runs expected "rgb(0, 0, 255)" but got "rgb(255, 0, 0)"
Verify CSS variable value after animation FAIL assert_equals: --value is green after animation runs expected "green" but got "red"
Verify substituted color value after animation FAIL assert_equals: color is green after animation runs expected "rgb(0, 128, 0)" but got "rgb(255, 0, 0)"
/css/css-variables-1/variable-animation-over-transition.html
Subtest Results Messages
OK
Verify CSS variable value before animation FAIL assert_equals: --value is blue before animation runs expected "blue" but got "red"
Verify substituted color value before animation FAIL assert_equals: color is blue before animation runs expected "rgb(0, 0, 255)" but got "rgb(255, 0, 0)"
Verify CSS variable value after animation FAIL assert_equals: --value is green after animation runs expected "green" but got "black"
Verify substituted color value after animation FAIL assert_equals: color is green after animation runs expected "rgb(0, 128, 0)" but got "rgb(0, 0, 0)"
/css/css-variables-1/variable-animation-substitute-into-keyframe-shorthand.html
Subtest Results Messages
OK
Verify border-bottom-color before animation PASS
Verify border-bottom-color after animation PASS
/css/css-variables-1/variable-animation-substitute-into-keyframe-transform.html
Subtest Results Messages
OK
Verify transform before animation PASS
Verify transform after animation PASS
/css/css-variables-1/variable-animation-substitute-into-keyframe.html
Subtest Results Messages
OK
Verify color before animation PASS
Verify color after animation PASS
/css/css-variables-1/variable-animation-substitute-within-keyframe-fallback.html
Subtest Results Messages
OK
Verify color before animation PASS
Verify color after animation PASS
/css/css-variables-1/variable-animation-substitute-within-keyframe-multiple.html
Subtest Results Messages
OK
Verify color before animation PASS
Verify color after animation PASS
/css/css-variables-1/variable-animation-substitute-within-keyframe.html
Subtest Results Messages
OK
Verify color before animation PASS
Verify color after animation PASS
/css/css-variables-1/variable-animation-to-only.html
Subtest Results Messages
OK
Verify CSS variable value before animation PASS
Verify CSS variable value after animation FAIL assert_equals: --value is green after animation runs expected "green" but got "blue"
/css/css-variables-1/variable-created-document.html
Subtest Results Messages
OK
Variable definition appearing in a created document should work once spliced into the creating document PASS
Variable reference appearing in a created document should work once spliced into the creating document PASS
/css/css-variables-1/variable-created-element.html
Subtest Results Messages
OK
Specified variable value appearing in a created element's inline style should work once spliced into the creating document PASS
Computed variable value appearing in a created element's inline style should work once spliced into the creating document PASS
Variable reference appearing in a created element's inline style should work once spliced into the creating document PASS
/css/css-variables-1/variable-cssText.html
Subtest Results Messages
OK
target1 undefined FAIL assert_equals: expected "--var: var1;" but got "--var: var1;"
target2 undefined PASS
target3 undefined PASS
target4 undefined FAIL assert_equals: expected "margin: var(--prop) !important;" but got "margin: var(--prop) !important;"
target5 undefined FAIL assert_equals: expected "background: var(--prop) !important;" but got "background: var(--prop) !important;"
target6 undefined FAIL assert_equals: expected "background: green;" but got "background-color: green; background-position: initial initial; background-repeat: initial initial;"
target7 undefined PASS
target8 undefined FAIL assert_equals: expected "color: var(--prop);" but got "color: var(--prop);"
target9 undefined FAIL assert_equals: expected "margin-top: 10px; margin-right: ; margin-bottom: ; margin-left: ;" but got "margin: 10px var(--prop) var(--prop);"
target10 undefined PASS
/css/css-variables-1/variable-definition-border-shorthand-serialize.html
Subtest Results Messages
OK
border-color should serialize to empty when border shorthand references a variable FAIL assert_equals: expected "" but got "var(--borderwidth) solid black"
/css/css-variables-1/variable-definition-cascading.html
Subtest Results Messages
OK
testing cascaded CSS Variables on div 't0' PASS
testing cascaded CSS Variables on div 't1a' PASS
testing cascaded CSS Variables on div 't1b' PASS
testing cascaded CSS Variables on div 't1c' PASS
testing cascaded CSS Variables on div 't1d' PASS
testing cascaded CSS Variables on div 't2a' PASS
testing cascaded CSS Variables on div 't2b' PASS
testing cascaded CSS Variables on div 't2c' PASS
testing cascaded CSS Variables on div 't2d' PASS
/css/css-variables-1/variable-definition-keywords.html
Subtest Results Messages
OK
computed style inherit PASS
computed style initial PASS
computed style unset PASS
specified style inherit PASS
specified style initial PASS
specified style unset PASS
/css/css-variables-1/variable-definition.html
Subtest Results Messages
OK
no variable PASS
variable PASS
single char variable PASS
single char '-' variable PASS
no char variable FAIL assert_equals: Expected Value should match actual value expected "value" but got ""
white space value (single space) PASS
white space value (double space) FAIL assert_equals: Expected Value should match actual value expected " " but got " "
overwrite PASS
can't overwrite with no value PASS
can overwrite with space value PASS
case sensetivity PASS
case sensetivity2 PASS
parsing three dashes at start of variable PASS
parsing multiple dashes with one dash at start of variable PASS
leading white space (single space) FAIL assert_equals: Expected Value should match actual value expected " value" but got "value"
middle white space (single space) PASS
trailing white space (single space) FAIL assert_equals: Expected Value should match actual value expected "value " but got "value"
leading white space (double space) 2 FAIL assert_equals: Expected Value should match actual value expected " value" but got "value"
middle white space (double space) 2 FAIL assert_equals: Expected Value should match actual value expected "value1 value2" but got "value1 value2"
trailing white space (double space) 2 FAIL assert_equals: Expected Value should match actual value expected "value " but got "value"
!important FAIL assert_equals: Expected Value should match actual value expected "value1 " but got "value1"
!important 2 PASS
!important (with space) FAIL assert_equals: Expected Value should match actual value expected "value1 " but got "value1"
no variable (Computed Style) PASS
variable (Computed Style) PASS
single char variable (Computed Style) PASS
single char '-' variable (Computed Style) PASS
no char variable (Computed Style) FAIL assert_equals: Expected Value should match actual value expected "value" but got ""
white space value (single space) (Computed Style) PASS
white space value (double space) (Computed Style) FAIL assert_equals: Expected Value should match actual value expected " " but got " "
overwrite (Computed Style) PASS
can't overwrite with no value (Computed Style) PASS
can overwrite with space value (Computed Style) PASS
case sensetivity (Computed Style) PASS
case sensetivity2 (Computed Style) PASS
parsing three dashes at start of variable (Computed Style) PASS
parsing multiple dashes with one dash at start of variable (Computed Style) PASS
leading white space (single space) (Computed Style) FAIL assert_equals: Expected Value should match actual value expected " value" but got "value"
middle white space (single space) (Computed Style) PASS
trailing white space (single space) (Computed Style) FAIL assert_equals: Expected Value should match actual value expected "value " but got "value"
leading white space (double space) 2 (Computed Style) FAIL assert_equals: Expected Value should match actual value expected " value" but got "value"
middle white space (double space) 2 (Computed Style) FAIL assert_equals: Expected Value should match actual value expected "value1 value2" but got "value1 value2"
trailing white space (double space) 2 (Computed Style) FAIL assert_equals: Expected Value should match actual value expected "value " but got "value"
!important (Computed Style) FAIL assert_equals: Expected Value should match actual value expected "value1 " but got "value1"
!important 2 (Computed Style) PASS
!important (with space) (Computed Style) FAIL assert_equals: Expected Value should match actual value expected "value1 " but got "value1"
no variable (Cascading) PASS
variable (Cascading) PASS
single char variable (Cascading) PASS
single char '-' variable (Cascading) PASS
no char variable (Cascading) FAIL assert_equals: Expected Value should match actual value expected "value" but got ""
white space value (single space) (Cascading) PASS
white space value (double space) (Cascading) FAIL assert_equals: Expected Value should match actual value expected " " but got " "
overwrite (Cascading) PASS
can't overwrite with no value (Cascading) PASS
can overwrite with space value (Cascading) PASS
case sensetivity (Cascading) PASS
case sensetivity2 (Cascading) PASS
parsing three dashes at start of variable (Cascading) PASS
parsing multiple dashes with one dash at start of variable (Cascading) PASS
leading white space (single space) (Cascading) FAIL assert_equals: Expected Value should match actual value expected " value" but got "value"
middle white space (single space) (Cascading) PASS
trailing white space (single space) (Cascading) FAIL assert_equals: Expected Value should match actual value expected "value " but got "value"
leading white space (double space) 2 (Cascading) FAIL assert_equals: Expected Value should match actual value expected " value" but got "value"
middle white space (double space) 2 (Cascading) FAIL assert_equals: Expected Value should match actual value expected "value1 value2" but got "value1 value2"
trailing white space (double space) 2 (Cascading) FAIL assert_equals: Expected Value should match actual value expected "value " but got "value"
!important (Cascading) FAIL assert_equals: Expected Value should match actual value expected "value1 " but got "value1"
!important 2 (Cascading) PASS
!important (with space) (Cascading) FAIL assert_equals: Expected Value should match actual value expected "value1 " but got "value1"
basic CSSOM.setProperty PASS
CSSOM.setProperty with space 1 FAIL assert_equals: Expected Value should match actual value expected "" but got "green"
CSSOM.setProperty with space 2 FAIL assert_equals: Expected Value should match actual value expected "" but got "green"
CSSOM.setProperty with space 3 PASS
/css/css-variables-1/variable-first-letter.html
Subtest Results Messages
OK
color FAIL assert_equals: expected "rgb(0, 0, 0)" but got "rgb(0, 0, 255)"
font-size FAIL assert_equals: expected "16px" but got "25px"
font-weight FAIL assert_equals: expected "normal" but got "900"
position PASS
nested color FAIL assert_equals: expected "rgb(0, 0, 0)" but got "rgb(0, 0, 255)"
abspos PASS
/css/css-variables-1/variable-first-line.html
Subtest Results Messages
OK
color FAIL assert_equals: expected "rgb(0, 0, 0)" but got "rgb(0, 0, 255)"
font-size FAIL assert_equals: expected "16px" but got "25px"
font-weight FAIL assert_equals: expected "normal" but got "900"
position PASS
nested color FAIL assert_equals: expected "rgb(0, 0, 0)" but got "rgb(0, 0, 255)"
abspos PASS
/css/css-variables-1/variable-invalidation.html
Subtest Results Messages
OK
css rule test PASS
css rule test important PASS
inline style test PASS
inline style test important PASS
/css/css-variables-1/variable-presentation-attribute.html
Subtest Results Messages
OK
Testing 'stroke-width' on '#box1'. PASS
Testing 'stroke-width' on '#box2'. PASS
Testing 'stroke-width' on '#box3'. PASS
Testing 'clip' on '#test4'. FAIL assert_equals: expected "rect(1px, 160px, 48px, 16px)" but got "rect(1px, 160px, 48px, 48px)"
Testing 'alignment-baseline'. FAIL assert_equals: Value Test. expected "alphabetic" but got "auto"
Testing 'baseline-shift'. PASS
Testing 'clip-rule'. PASS
Testing 'color'. PASS
Testing 'color-interpolation-filters'. FAIL assert_equals: Default value. expected "" but got "linearrgb"
Testing 'cursor'. PASS
Testing 'direction'. PASS
Testing 'display'. PASS
Testing 'dominant-baseline'. FAIL assert_equals: Value Test. expected "alphabetic" but got "auto"
Testing 'fill'. FAIL assert_equals: Default value. expected "black" but got "rgb(0, 0, 0)"
Testing 'fill-opacity'. FAIL assert_equals: Value Test. expected "0.8" but got "0.800000011920929"
Testing 'fill-rule'. PASS
Testing 'filter'. PASS
Testing 'flood-color'. FAIL assert_equals: Default value. expected "" but got "rgb(0, 0, 0)"
Testing 'flood-opacity'. FAIL assert_equals: Value Test. expected "0.7" but got "0.699999988079071"
Testing 'font-family'. FAIL assert_equals: Default value. expected "Times New Roman" but got "-webkit-standard"
Testing 'font-size'. PASS
Testing 'font-size-adjust'. FAIL assert_equals: Default value. expected "none" but got ""
Testing 'font-stretch'. FAIL assert_equals: Default value. expected "normal" but got ""
Testing 'font-style'. PASS
Testing 'font-weight'. FAIL assert_equals: Default value. expected "400" but got "normal"
Testing 'glyph-orientation-horizontal'. FAIL assert_equals: Value Test. expected "13deg" but got "0deg"
Testing 'glyph-orientation-vertical'. FAIL assert_equals: Value Test. expected "19deg" but got "0deg"
Testing 'kerning'. FAIL assert_equals: Default value. expected "auto" but got "0"
Testing 'letter-spacing'. PASS
Testing 'lighting-color'. FAIL assert_equals: Default value. expected "" but got "rgb(255, 255, 255)"
Testing 'opacity'. FAIL assert_equals: Value Test. expected "0.11" but got "0.10999999940395355"
Testing 'overflow'. PASS
Testing 'pointer-events'. FAIL assert_equals: Default value. expected "visiblePainted" but got "auto"
Testing 'stop-color'. FAIL assert_equals: Default value. expected "" but got "rgb(0, 0, 0)"
Testing 'stop-opacity'. FAIL assert_equals: Value Test. expected "0.225" but got "0.22499999403953552"
Testing 'stroke'. FAIL assert_equals: Default value. expected "" but got "none"
Testing 'stroke-dasharray'. PASS
Testing 'stroke-dashoffset'. PASS
Testing 'stroke-linecap'. PASS
Testing 'stroke-linejoin'. PASS
Testing 'stroke-miterlimit'. PASS
Testing 'stroke-opacity'. FAIL assert_equals: Value Test. expected "0.221" but got "0.22100000083446503"
Testing 'stroke-width'. PASS
Testing 'text-anchor'. PASS
Testing 'text-decoration'. PASS
Testing 'visibility'. PASS
Testing 'word-spacing'. PASS
Testing 'writing-mode'. PASS
/css/css-variables-1/variable-pseudo-element.html
Subtest Results Messages
OK
div1 PASS
div2 PASS
div3 PASS
div4 PASS
/css/css-variables-1/variable-reference-cssom.html
Subtest Results Messages
OK
Verify correct results using CSSOM PASS
Verify correct results with CSSOM overriding markup-set values PASS
/css/css-variables-1/variable-reference-refresh.html
Subtest Results Messages
OK
Verify substituted color value before refresh PASS
Verify substituted color value after refresh PASS
/css/css-variables-1/variable-reference-shorthands-cssom.html
Subtest Results Messages
OK
CSS variable references - shorthand properties - via CSSOM PASS
/css/css-variables-1/variable-reference-shorthands.html
Subtest Results Messages
OK
target1 margin FAIL assert_equals: expected "" but got "10px var(--prop) var(--prop)"
target1 margin-left PASS
target1 margin-top PASS
target1 margin-right PASS
target1 margin-bottom PASS
target2 margin PASS
target2 margin-left PASS
target2 margin-top PASS
target2 margin-right PASS
target2 margin-bottom PASS
target3 margin PASS
target3 margin-left PASS
target3 margin-top PASS
target3 margin-right PASS
target3 margin-bottom PASS
target4 background PASS
/css/css-variables-1/variable-reference-variable.html
Subtest Results Messages
OK
Parse, store, and serialize CSS variable referencing another CSS variable PASS
Parse, store, and serialize CSS variable referencing another CSS variable 1 PASS
/css/css-variables-1/variable-reference.html
Subtest Results Messages
OK
width: var(--prop); PASS
width: var(--prop) !important; PASS
width: var(--prop, ); PASS
width: var(--prop, 20px); PASS
width: var(--prop, blue); PASS
width: var(--prop1, var(--prop2)); PASS
width: var(--prop1, var(--prop2, var(--prop3, auto))); PASS
width: var(--prop1) var(--prop2) PASS
width: var(); PASS
width: var(prop); PASS
width: var(-prop); PASS
width: var(--prop,); PASS
width: var(--prop 20px); PASS
width: var(--prop, var(prop)); PASS
width: var(--prop, var(-prop)); PASS
width: var(20px); PASS
width: var(var(--prop)); PASS
Variable reference left open at end of stylesheet FAIL assert_equals: expected "var(--prop" but got "var(--prop)"
/css/css-variables-1/variable-substitution-background-properties.html
Subtest Results Messages
OK
background-attachment PASS
background-clip PASS
background-color PASS
background-origin PASS
background-position PASS
background-repeat PASS
background-size PASS
background-image-url PASS
background-image-linear-gradient PASS
background-image-radial-gradient PASS
/css/css-variables-1/variable-substitution-basic.html
Subtest Results Messages
OK
test basic variable substitution FAIL SyntaxError: Can't create duplicate variable that shadows a global property: 'testArea'
/css/css-variables-1/variable-substitution-filters.html
Subtest Results Messages
OK
blur PASS
brightness PASS
contrast PASS
grayscale PASS
invert PASS
sepia PASS
saturate PASS
/css/css-variables-1/variable-substitution-plus-box-shadow.html
Subtest Results Messages
OK
box-shadow + variable substitution on same element FAIL SyntaxError: Can't create duplicate variable that shadows a global property: 'target'
/css/css-variables-1/variable-substitution-replaced-size.html
Subtest Results Messages
OK
width on IFRAME PASS
height on IFRAME PASS
width on INPUT PASS
height on INPUT PASS
width on CANVAS PASS
height on CANVAS PASS
/css/css-variables-1/variable-substitution-shadow-properties.html
Subtest Results Messages
OK
box-shadow FAIL assert_equals: Expected Value should match actual value expected "1px 1px 1px 1px rgb(0,128,0)" but got "rgb(0, 128, 0) 1px 1px 1px 1px"
text-shadow FAIL assert_equals: Expected Value should match actual value expected "1px 1px 1px rgb(0,128,0)" but got "rgb(0, 128, 0) 1px 1px 1px"
/css/css-variables-1/variable-substitution-shorthands.html
Subtest Results Messages
OK
target1 margin-left PASS
target1 margin-top PASS
target1 margin-right PASS
target1 margin-bottom PASS
target2 margin-left PASS
target2 margin-top PASS
target2 margin-right PASS
target2 margin-bottom PASS
target3 margin-left PASS
target3 margin-top PASS
target3 margin-right PASS
target3 margin-bottom PASS
target4 margin-left PASS
target4 margin-top PASS
target4 margin-right PASS
target4 margin-bottom PASS
target5 border-top-width PASS
target5 border-top-style PASS
target5 border-top-color PASS
target5 border-right-width PASS
target5 border-right-style PASS
target5 border-right-color PASS
target5 border-bottom-width PASS
target5 border-bottom-style PASS
target5 border-bottom-color PASS
target5 border-left-width PASS
target5 border-left-style PASS
target5 border-left-color PASS
target6 border-top-width PASS
target6 border-top-style PASS
target6 border-top-color PASS
target6 border-right-width PASS
target6 border-right-style PASS
target6 border-right-color PASS
target6 border-bottom-width PASS
target6 border-bottom-style PASS
target6 border-bottom-color PASS
target6 border-left-width PASS
target6 border-left-style PASS
target6 border-left-color PASS
target7 margin-left PASS
target7 margin-top PASS
target7 margin-right PASS
target7 margin-bottom PASS
target8 transition-duration FAIL assert_equals: expected "2s" but got "0s"
target9 border-left-width PASS
target9 border-left-style PASS
target9 border-left-color PASS
target9 border-top-width PASS
target9 border-right-width PASS
target9 border-bottom-width PASS
/css/css-variables-1/variable-substitution-variable-declaration.html
Subtest Results Messages
OK
target1 --var2 FAIL assert_equals: expected " 23px 13px 17px 10px" but got "23px 13px 17px 10px"
target1 margin-top PASS
target1 margin-right PASS
target1 margin-bottom PASS
target1 margin-left PASS
target2parent --var1 PASS
target2parent --var2 PASS
target2 --var1 FAIL assert_equals: expected " good" but got "good"
target2 --var2 PASS
target3 --var1 FAIL assert_equals: expected " 5px" but got "5px"
target3 --var2 FAIL assert_equals: expected " 5px" but got "5px"
target4 --varA PASS
target4 --varB PASS
target4 --varC FAIL assert_equals: expected " 13px" but got ""
target5 --varA PASS
target5 --varB PASS
target5 --varC PASS
target6 --varA PASS
target6 --varB PASS
target6 --varC PASS
target7 --varA PASS
target7 --varB PASS
target7 --varC PASS
target8 --varA PASS
target8 --varB FAIL assert_equals: expected " 7px" but got ""
target9 --varA FAIL assert_equals: expected " good" but got "good"
target9 --varB PASS
target9 --varC PASS
target10 --varA PASS
target10 --varB PASS
target10 --varC PASS
/css/css-variables-1/variable-transitions-from-no-value.html
Subtest Results Messages
OK
Verify CSS variable value before transition PASS
Verify substituted color value before transition PASS
Verify CSS variable value after transition PASS
Verify substituted color value after transition PASS
/css/css-variables-1/variable-transitions-to-no-value.html
Subtest Results Messages
OK
Verify CSS variable value before transition PASS
Verify substituted color value before transition PASS
Verify CSS variable value after transition PASS
Verify substituted color value after transition PASS
/css/css-variables-1/variable-transitions-transition-property-all-before-value.html
Subtest Results Messages
OK
`Veri

@ghost
Copy link

ghost commented May 16, 2017 •
edited by ghost
Loading

View the complete job log.

Sauce (MicrosoftEdge)

Testing web-platform-tests at revision 3178d1e
Using browser at version 14.14393
Starting 10 test iterations

@ghost
Copy link

ghost commented May 16, 2017 •
edited by ghost
Loading

View the complete job log.

Chrome (unstable)

Testing web-platform-tests at revision f3d796e
Using browser at version 60.0.3100.0 dev
Starting 10 test iterations
All results were stable

All results

42 tests ran
/css/css-variables-1/variable-animation-from-to.html
Subtest Results Messages
OK
Verify CSS variable value before animation PASS
Verify substituted color value before animation PASS
Verify CSS variable value after animation PASS
Verify substituted color value after animation PASS
/css/css-variables-1/variable-animation-over-transition.html
Subtest Results Messages
OK
Verify CSS variable value before animation PASS
Verify substituted color value before animation PASS
Verify CSS variable value after animation PASS
Verify substituted color value after animation PASS
/css/css-variables-1/variable-animation-substitute-into-keyframe-shorthand.html
Subtest Results Messages
OK
Verify border-bottom-color before animation PASS
Verify border-bottom-color after animation PASS
/css/css-variables-1/variable-animation-substitute-into-keyframe-transform.html
Subtest Results Messages
OK
Verify transform before animation PASS
Verify transform after animation PASS
/css/css-variables-1/variable-animation-substitute-into-keyframe.html
Subtest Results Messages
OK
Verify color before animation PASS
Verify color after animation PASS
/css/css-variables-1/variable-animation-substitute-within-keyframe-fallback.html
Subtest Results Messages
OK
Verify color before animation PASS
Verify color after animation PASS
/css/css-variables-1/variable-animation-substitute-within-keyframe-multiple.html
Subtest Results Messages
OK
Verify color before animation PASS
Verify color after animation PASS
/css/css-variables-1/variable-animation-substitute-within-keyframe.html
Subtest Results Messages
OK
Verify color before animation PASS
Verify color after animation PASS
/css/css-variables-1/variable-animation-to-only.html
Subtest Results Messages
OK
Verify CSS variable value before animation PASS
Verify CSS variable value after animation PASS
/css/css-variables-1/variable-created-document.html
Subtest Results Messages
OK
Variable definition appearing in a created document should work once spliced into the creating document PASS
Variable reference appearing in a created document should work once spliced into the creating document PASS
/css/css-variables-1/variable-created-element.html
Subtest Results Messages
OK
Specified variable value appearing in a created element's inline style should work once spliced into the creating document PASS
Computed variable value appearing in a created element's inline style should work once spliced into the creating document PASS
Variable reference appearing in a created element's inline style should work once spliced into the creating document PASS
/css/css-variables-1/variable-cssText.html
Subtest Results Messages
OK
target1 undefined FAIL assert_equals: expected "--var: var1;" but got "--var: var1;"
target2 undefined PASS
target3 undefined PASS
target4 undefined PASS
target5 undefined PASS
target6 undefined PASS
target7 undefined PASS
target8 undefined FAIL assert_equals: expected "color: var(--prop);" but got "color: var(--prop);"
target9 undefined FAIL assert_equals: expected "margin-top: 10px; margin-right: ; margin-bottom: ; margin-left: ;" but got "margin-right: ; margin-bottom: ; margin-left: ; margin-top: 10px;"
target10 undefined PASS
/css/css-variables-1/variable-definition-border-shorthand-serialize.html
Subtest Results Messages
OK
border-color should serialize to empty when border shorthand references a variable FAIL assert_equals: expected "" but got "var(--borderwidth) solid black"
/css/css-variables-1/variable-definition-cascading.html
Subtest Results Messages
OK
testing cascaded CSS Variables on div 't0' PASS
testing cascaded CSS Variables on div 't1a' PASS
testing cascaded CSS Variables on div 't1b' PASS
testing cascaded CSS Variables on div 't1c' PASS
testing cascaded CSS Variables on div 't1d' PASS
testing cascaded CSS Variables on div 't2a' PASS
testing cascaded CSS Variables on div 't2b' PASS
testing cascaded CSS Variables on div 't2c' PASS
testing cascaded CSS Variables on div 't2d' PASS
/css/css-variables-1/variable-definition-keywords.html
Subtest Results Messages
OK
computed style inherit PASS
computed style initial PASS
computed style unset PASS
specified style inherit PASS
specified style initial PASS
specified style unset PASS
/css/css-variables-1/variable-definition.html
Subtest Results Messages
OK
no variable PASS
variable PASS
single char variable PASS
single char '-' variable PASS
no char variable PASS
white space value (single space) PASS
white space value (double space) FAIL assert_equals: Expected Value should match actual value expected " " but got " "
overwrite PASS
can't overwrite with no value PASS
can overwrite with space value PASS
case sensetivity PASS
case sensetivity2 PASS
parsing three dashes at start of variable PASS
parsing multiple dashes with one dash at start of variable PASS
leading white space (single space) PASS
middle white space (single space) PASS
trailing white space (single space) PASS
leading white space (double space) 2 FAIL assert_equals: Expected Value should match actual value expected " value" but got " value"
middle white space (double space) 2 FAIL assert_equals: Expected Value should match actual value expected "value1 value2" but got "value1 value2"
trailing white space (double space) 2 FAIL assert_equals: Expected Value should match actual value expected "value " but got "value "
!important PASS
!important 2 PASS
!important (with space) PASS
no variable (Computed Style) PASS
variable (Computed Style) PASS
single char variable (Computed Style) PASS
single char '-' variable (Computed Style) PASS
no char variable (Computed Style) PASS
white space value (single space) (Computed Style) PASS
white space value (double space) (Computed Style) FAIL assert_equals: Expected Value should match actual value expected " " but got " "
overwrite (Computed Style) PASS
can't overwrite with no value (Computed Style) PASS
can overwrite with space value (Computed Style) PASS
case sensetivity (Computed Style) PASS
case sensetivity2 (Computed Style) PASS
parsing three dashes at start of variable (Computed Style) PASS
parsing multiple dashes with one dash at start of variable (Computed Style) PASS
leading white space (single space) (Computed Style) PASS
middle white space (single space) (Computed Style) PASS
trailing white space (single space) (Computed Style) PASS
leading white space (double space) 2 (Computed Style) FAIL assert_equals: Expected Value should match actual value expected " value" but got " value"
middle white space (double space) 2 (Computed Style) FAIL assert_equals: Expected Value should match actual value expected "value1 value2" but got "value1 value2"
trailing white space (double space) 2 (Computed Style) FAIL assert_equals: Expected Value should match actual value expected "value " but got "value "
!important (Computed Style) PASS
!important 2 (Computed Style) PASS
!important (with space) (Computed Style) PASS
no variable (Cascading) PASS
variable (Cascading) PASS
single char variable (Cascading) PASS
single char '-' variable (Cascading) PASS
no char variable (Cascading) PASS
white space value (single space) (Cascading) PASS
white space value (double space) (Cascading) FAIL assert_equals: Expected Value should match actual value expected " " but got " "
overwrite (Cascading) PASS
can't overwrite with no value (Cascading) PASS
can overwrite with space value (Cascading) PASS
case sensetivity (Cascading) PASS
case sensetivity2 (Cascading) PASS
parsing three dashes at start of variable (Cascading) PASS
parsing multiple dashes with one dash at start of variable (Cascading) PASS
leading white space (single space) (Cascading) PASS
middle white space (single space) (Cascading) PASS
trailing white space (single space) (Cascading) PASS
leading white space (double space) 2 (Cascading) FAIL assert_equals: Expected Value should match actual value expected " value" but got " value"
middle white space (double space) 2 (Cascading) FAIL assert_equals: Expected Value should match actual value expected "value1 value2" but got "value1 value2"
trailing white space (double space) 2 (Cascading) FAIL assert_equals: Expected Value should match actual value expected "value " but got "value "
!important (Cascading) PASS
!important 2 (Cascading) PASS
!important (with space) (Cascading) PASS
basic CSSOM.setProperty PASS
CSSOM.setProperty with space 1 FAIL assert_equals: Expected Value should match actual value expected "" but got "green"
CSSOM.setProperty with space 2 FAIL assert_equals: Expected Value should match actual value expected "" but got "green"
CSSOM.setProperty with space 3 PASS
/css/css-variables-1/variable-first-letter.html
Subtest Results Messages
OK
color FAIL assert_equals: expected "rgb(0, 0, 0)" but got "rgb(0, 0, 255)"
font-size FAIL assert_equals: expected "16px" but got "25px"
font-weight FAIL assert_equals: expected "normal" but got "900"
position PASS
nested color FAIL assert_equals: expected "rgb(0, 0, 0)" but got "rgb(0, 0, 255)"
abspos PASS
/css/css-variables-1/variable-first-line.html
Subtest Results Messages
OK
color PASS
font-size PASS
font-weight PASS
position FAIL assert_equals: expected "absolute" but got "static"
nested color PASS
abspos FAIL assert_equals: expected "absolute" but got "static"
/css/css-variables-1/variable-invalidation.html
Subtest Results Messages
OK
css rule test FAIL assert_equals: cssText initial. expected "--var1: red;" but got "--var1:red;"
css rule test important FAIL assert_equals: cssText initial. expected "--var2: red !important;" but got "--var2:red !important;"
inline style test FAIL assert_equals: cssText initial. expected "--var3: red;" but got "--var3:red;"
inline style test important FAIL assert_equals: cssText initial. expected "--var4: red !important;" but got "--var4:red !important;"
/css/css-variables-1/variable-presentation-attribute.html
Subtest Results Messages
OK
Testing 'stroke-width' on '#box1'. PASS
Testing 'stroke-width' on '#box2'. PASS
Testing 'stroke-width' on '#box3'. PASS
Testing 'clip' on '#test4'. FAIL assert_equals: expected "rect(1px, 160px, 48px, 16px)" but got "rect(1px 160px 48px 16px)"
Testing 'alignment-baseline'. PASS
Testing 'baseline-shift'. FAIL assert_equals: Default value. expected "baseline" but got "0px"
Testing 'clip-rule'. PASS
Testing 'color'. PASS
Testing 'color-interpolation-filters'. FAIL assert_equals: Default value. expected "" but got "linearRGB"
Testing 'cursor'. PASS
Testing 'direction'. PASS
Testing 'display'. PASS
Testing 'dominant-baseline'. PASS
Testing 'fill'. FAIL assert_equals: Default value. expected "black" but got "rgb(0, 0, 0)"
Testing 'fill-opacity'. PASS
Testing 'fill-rule'. PASS
Testing 'filter'. PASS
Testing 'flood-color'. FAIL assert_equals: Default value. expected "" but got "rgb(0, 0, 0)"
Testing 'flood-opacity'. PASS
Testing 'font-family'. FAIL assert_equals: Default value. expected "Times New Roman" but got "\"Times New Roman\""
Testing 'font-size'. PASS
Testing 'font-size-adjust'. FAIL assert_equals: Default value. expected "none" but got ""
Testing 'font-stretch'. PASS
Testing 'font-style'. PASS
Testing 'font-weight'. FAIL assert_equals: Default value. expected "400" but got "normal"
Testing 'glyph-orientation-horizontal'. FAIL assert_equals: Default value. expected "0deg" but got ""
Testing 'glyph-orientation-vertical'. FAIL assert_equals: Default value. expected "auto" but got ""
Testing 'kerning'. FAIL assert_equals: Default value. expected "auto" but got ""
Testing 'letter-spacing'. PASS
Testing 'lighting-color'. FAIL assert_equals: Default value. expected "" but got "rgb(255, 255, 255)"
Testing 'opacity'. PASS
Testing 'overflow'. PASS
Testing 'pointer-events'. FAIL assert_equals: Default value. expected "visiblePainted" but got "auto"
Testing 'stop-color'. FAIL assert_equals: Default value. expected "" but got "rgb(0, 0, 0)"
Testing 'stop-opacity'. PASS
Testing 'stroke'. FAIL assert_equals: Default value. expected "" but got "none"
Testing 'stroke-dasharray'. PASS
Testing 'stroke-dashoffset'. PASS
Testing 'stroke-linecap'. PASS
Testing 'stroke-linejoin'. PASS
Testing 'stroke-miterlimit'. PASS
Testing 'stroke-opacity'. PASS
Testing 'stroke-width'. PASS
Testing 'text-anchor'. PASS
Testing 'text-decoration'. FAIL assert_equals: Default value. expected "none" but got "none solid rgb(0, 0, 0)"
Testing 'visibility'. PASS
Testing 'word-spacing'. PASS
Testing 'writing-mode'. FAIL assert_equals: Default value. expected "lr-tb" but got "horizontal-tb"
/css/css-variables-1/variable-pseudo-element.html
Subtest Results Messages
OK
div1 PASS
div2 PASS
div3 PASS
div4 PASS
/css/css-variables-1/variable-reference-cssom.html
Subtest Results Messages
OK
Verify correct results using CSSOM PASS
Verify correct results with CSSOM overriding markup-set values PASS
/css/css-variables-1/variable-reference-refresh.html
Subtest Results Messages
OK
Verify substituted color value before refresh PASS
Verify substituted color value after refresh PASS
/css/css-variables-1/variable-reference-shorthands-cssom.html
Subtest Results Messages
OK
CSS variable references - shorthand properties - via CSSOM PASS
/css/css-variables-1/variable-reference-shorthands.html
Subtest Results Messages
OK
target1 margin PASS
target1 margin-left PASS
target1 margin-top PASS
target1 margin-right PASS
target1 margin-bottom PASS
target2 margin PASS
target2 margin-left PASS
target2 margin-top PASS
target2 margin-right PASS
target2 margin-bottom PASS
target3 margin PASS
target3 margin-left PASS
target3 margin-top PASS
target3 margin-right PASS
target3 margin-bottom PASS
target4 background PASS
/css/css-variables-1/variable-reference-variable.html
Subtest Results Messages
OK
Parse, store, and serialize CSS variable referencing another CSS variable PASS
Parse, store, and serialize CSS variable referencing another CSS variable 1 PASS
/css/css-variables-1/variable-reference.html
Subtest Results Messages
OK
width: var(--prop); PASS
width: var(--prop) !important; PASS
width: var(--prop, ); PASS
width: var(--prop, 20px); PASS
width: var(--prop, blue); PASS
width: var(--prop1, var(--prop2)); PASS
width: var(--prop1, var(--prop2, var(--prop3, auto))); PASS
width: var(--prop1) var(--prop2) PASS
width: var(); PASS
width: var(prop); PASS
width: var(-prop); PASS
width: var(--prop,); PASS
width: var(--prop 20px); PASS
width: var(--prop, var(prop)); PASS
width: var(--prop, var(-prop)); PASS
width: var(20px); PASS
width: var(var(--prop)); PASS
Variable reference left open at end of stylesheet PASS
/css/css-variables-1/variable-substitution-background-properties.html
Subtest Results Messages
OK
background-attachment PASS
background-clip PASS
background-color PASS
background-origin PASS
background-position PASS
background-repeat PASS
background-size PASS
background-image-url PASS
background-image-linear-gradient PASS
background-image-radial-gradient PASS
/css/css-variables-1/variable-substitution-basic.html
Subtest Results Messages
OK
Simple substitution test PASS
You can't build up a single token where part of it is provided by a variable PASS
Multiple variable references in a single property PASS
Multiple variable references in a single property (no spaces) PASS
Fallback value PASS
Fallback value which is also a variable reference PASS
Multiple var references in fallback value PASS
Multiple nested fallbacks PASS
Bad variable reference that should inherit by default PASS
Test that var reference doesn�t overwrite !important PASS
Test that !important on a property that has a variable reference can overwrite !important PASS
Test that !important inside of var reference can't overwrite !important on property PASS
/css/css-variables-1/variable-substitution-filters.html
Subtest Results Messages
OK
blur PASS
brightness PASS
contrast PASS
grayscale PASS
invert PASS
sepia PASS
saturate PASS
/css/css-variables-1/variable-substitution-plus-box-shadow.html
Subtest Results Messages
OK
box-shadow PASS
--alpha PASS
color PASS
/css/css-variables-1/variable-substitution-replaced-size.html
Subtest Results Messages
OK
width on IFRAME PASS
height on IFRAME PASS
width on INPUT PASS
height on INPUT PASS
width on CANVAS PASS
height on CANVAS PASS
/css/css-variables-1/variable-substitution-shadow-properties.html
Subtest Results Messages
OK
box-shadow FAIL assert_equals: Expected Value should match actual value expected "1px 1px 1px 1px rgb(0,128,0)" but got "rgb(0, 128, 0) 1px 1px 1px 1px"
text-shadow FAIL assert_equals: Expected Value should match actual value expected "1px 1px 1px rgb(0,128,0)" but got "rgb(0, 128, 0) 1px 1px 1px"
/css/css-variables-1/variable-substitution-shorthands.html
Subtest Results Messages
OK
target1 margin-left PASS
target1 margin-top PASS
target1 margin-right PASS
target1 margin-bottom PASS
target2 margin-left PASS
target2 margin-top PASS
target2 margin-right PASS
target2 margin-bottom PASS
target3 margin-left PASS
target3 margin-top PASS
target3 margin-right PASS
target3 margin-bottom PASS
target4 margin-left PASS
target4 margin-top PASS
target4 margin-right PASS
target4 margin-bottom PASS
target5 border-top-width PASS
target5 border-top-style PASS
target5 border-top-color PASS
target5 border-right-width PASS
target5 border-right-style PASS
target5 border-right-color PASS
target5 border-bottom-width PASS
target5 border-bottom-style PASS
target5 border-bottom-color PASS
target5 border-left-width PASS
target5 border-left-style PASS
target5 border-left-color PASS
target6 border-top-width PASS
target6 border-top-style PASS
target6 border-top-color PASS
target6 border-right-width PASS
target6 border-right-style PASS
target6 border-right-color PASS
target6 border-bottom-width PASS
target6 border-bottom-style PASS
target6 border-bottom-color PASS
target6 border-left-width PASS
target6 border-left-style PASS
target6 border-left-color PASS
target7 margin-left PASS
target7 margin-top PASS
target7 margin-right PASS
target7 margin-bottom PASS
target8 transition-duration PASS
target9 border-left-width PASS
target9 border-left-style PASS
target9 border-left-color PASS
target9 border-top-width PASS
target9 border-right-width PASS
target9 border-bottom-width PASS
/css/css-variables-1/variable-substitution-variable-declaration.html
Subtest Results Messages
OK
target1 --var2 PASS
target1 margin-top PASS
target1 margin-right PASS
target1 margin-bottom PASS
target1 margin-left PASS
target2parent --var1 PASS
target2parent --var2 PASS
target2 --var1 PASS
target2 --var2 PASS
target3 --var1 PASS
target3 --var2 PASS
target4 --varA PASS
target4 --varB PASS
target4 --varC PASS
target5 --varA PASS
target5 --varB PASS
target5 --varC PASS
target6 --varA PASS
target6 --varB PASS
target6 --varC PASS
target7 --varA PASS
target7 --varB PASS
target7 --varC PASS
target8 --varA PASS
target8 --varB PASS
target9 --varA PASS
target9 --varB PASS
target9 --varC PASS
target10 --varA PASS
target10 --varB PASS
target10 --varC PASS
/css/css-variables-1/variable-transitions-from-no-value.html
Subtest Results Messages
TIMEOUT
Verify CSS variable value before transition PASS
Verify substituted color value before transition PASS
Verify CSS variable value after transition NOTRUN
Verify substituted color value after transition NOTRUN
/css/css-variables-1/variable-transitions-to-no-value.html
Subtest Results Messages
TIMEOUT
Verify CSS variable value before transition PASS
Verify substituted color value before transition PASS
Verify CSS variable value after transition NOTRUN
Verify substituted color value after transition NOTRUN
/css/css-variables-1/variable-transitions-transition-property-all-before-value.html
Subtest Results Messages
OK
Verify CSS variable value before transition PASS
Verify substituted color value before transition PASS
Verify CSS variable value after transition PASS
Verify substituted color value after transition PASS
/css/css-variables-1/variable-transitions-transition-property-variable-before-value.html
Subtest Results Messages
TIMEOUT
Verify CSS variable value before transition PASS
Verify substituted color value before transition PASS
Verify CSS variable value after transition NOTRUN
Verify substituted color value after transition NOTRUN
/css/css-variables-1/variable-transitions-value-before-transition-property-all.html
Subtest Results Messages
OK
Verify CSS variable value before transition PASS
Verify substituted color value before transition PASS
Verify CSS variable value after transition PASS
Verify substituted color value after transition PASS
/css/css-variables-1/variable-transitions-value-before-transition-property-variable.html
Subtest Results Messages
TIMEOUT
Verify CSS variable value before transition PASS
Verify substituted color value before transition PASS
Verify CSS variable value after transition NOTRUN
Verify substituted color value after transition NOTRUN
/css/css-variables-1/vars-font-shorthand-001.html
Subtest Results Messages
PASS

@codecov-io
Copy link

codecov-io commented May 17, 2017 •
edited
Loading

Codecov Report

Merging #5288 into master will increase coverage by <.01%.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #5288      +/-   ##
==========================================
+ Coverage   87.22%   87.22%   +<.01%     
==========================================
  Files          24       24              
  Lines        2418     2419       +1     
  Branches      406      406              
==========================================
+ Hits         2109     2110       +1     
- Misses        239      240       +1     
+ Partials       70       69       -1
Impacted Files Coverage Δ
tools/localpaths.py 100% <0%> (ø) ⬆️
tools/lint/fnmatch.py 71.42% <0%> (ø) ⬆️
...ple/assertion/global_testmodule_config/conftest.py
...ebsocket/src/mod_pywebsocket/handshake/__init__.py
tools/__init__.py 100% <0%> (ø)
tools/conftest.py 100% <0%> (ø)

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 4114edb...7a3330a. Read the comment docs.

@gsnedders gsnedders mentioned this pull request May 17, 2017
Closed
@gregwhitworth
Copy link
Contributor

Ok, @tabatkins @svgeesus @SimonSapin or @dbaron can one of you please review this as it's good to go.

@svgeesus
Copy link
Contributor

@gsnedders can we assume the non-terminating Edge bot results are unrelated to this PR?
https://travis-ci.org/w3c/web-platform-tests/jobs/233024736

@gsnedders
Copy link
Member Author

@svgeesus yes

@svgeesus
Copy link
Contributor

On first look these tests seem good but it will take me a while to check each one. If another reviewer completes a review before I do, please merge

@gregwhitworth
Copy link
Contributor

@svgeesus Any update here?

svgeesus
svgeesus approved these changes Jun 5, 2017
View reviewed changes
Copy link
Contributor

@svgeesus svgeesus left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It slightly sucks that interpolated colors are reported differently in different browsers, but that isn't the spec under test here so is fine.

For variable-invalidation.html and related tests I agree this should be tested; they are more integration tests than unit tests, but justified.

In a few cases there is text in comments which could have been put in link rel="assertion" but this is optional and I'm certainly not going to hold up review for that; if it happens great but no biggie.

On vars-font-shorthand-001.html I wasn't sure if the ahem flag should be used, as it doesn't matter if ahem is installed locally; it is provided as a webfont. But again, not holding up approval for that.

These tests are clear and straightforward.

Looks good to me.

@svgeesus
Copy link
Contributor

svgeesus commented Jun 5, 2017

Merging despite the unrelated CI fail, as agreed with @gsnedders

@svgeesus svgeesus merged commit a861f2b into master Jun 5, 2017
@gsnedders gsnedders deleted the csswg-test-pr-1249 branch June 23, 2017 14:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@svgeesus svgeesus svgeesus approved these changes

@dbaron dbaron Awaiting requested review from dbaron

@SimonSapin SimonSapin Awaiting requested review from SimonSapin

@tabatkins tabatkins Awaiting requested review from tabatkins

Assignees
No one assigned
Labels
css-variables wg-css
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
7 participants
@gsnedders @wpt-pr-bot @wpt-issue-mover @gregwhitworth @jugglinmike @codecov-io @svgeesus