VO repeats descriptions in Wrappers #286

Nancy-Salpepi · 2022-04-01T12:02:12Z

Test device
MacBook Air (m1 chip)

Operating System
12.3

Browser
Safari

Problem description
For phetsims/qa#791, VoiceOver repeats descriptions in the downstream sim. This only happens for changes made in the sim (moving the book, moving a toggle button on/off).

Steps to reproduce

In the state wrapper, set the Set State Rate = 0
Make a change in the upstream sim and press 'Set State Now'
Turn on VO and tab into the play area of the downstream sim
Move book back and forth -- descriptions will repeat

Visuals

VOstate.mov

Nancy-Salpepi · 2022-04-01T15:39:07Z

Also seen in the following wrappers: Data: textarea, Data: recording, Screenshot, Multi, and Active wrappers (unable to test studio at this time)

DevonQui · 2022-04-04T19:02:49Z

I tested these cases out on an M1 Macbook as well and saw the same behavior where VoiceOver repeated descriptions when changes were made to the sim.

terracoda · 2022-06-17T14:55:56Z

Just and FYI, when we used to do Sound design using a wrapper, this type of repetition was very common. I do not know what causes it.

zepumph · 2022-07-15T15:39:01Z

I couldn't reproduce this with windows/chrome/nvda. I'll need to solicit a mac user.

jessegreenberg · 2022-07-15T22:04:42Z

I was able to reproduce this problem with MacOS 11.6.2 Safari. I tried a basic HTML + js example but could not get this to happen.

index:

<!doctype html>
<html class="no-js" lang="">
<body>

  <!-- Add your site or application content here -->
  <p>Hello world! This is HTML5 Boilerplate.</p>

  <iframe src="content.html"></iframe>
</body>

</html>

content:

<!DOCTYPE html>
<html lang="en">
<head>
  <meta charset="UTF-8">
  <title>Title</title>
</head>
<body>
<div>
  <h1>Example iFrame content</h1>
  <p aria-live="polite" id="alerter"></p>
</div>
</body>

<script>
  const alerter = document.getElementById( 'alerter' );

  let counter = 1;

  window.setInterval( () => {
      alerter.textContent = `This is a new alert: ${counter}`;
      counter++;
  }, 5000 );

</script>
</html>

I tried

aria-live="polite" and aria-live="assertive" to see if one caused it.
Using the platform workarounds we have in AriaLiveAlerter in our example, so my content.html looks like

<!DOCTYPE html>
<html lang="en">
<head>
  <meta charset="UTF-8">
  <title>Title</title>
</head>
<body>
<div>
  <h1>Example iFrame content</h1>
  <p aria-live="polite" id="alerter"></p>
</div>
</body>

<script>
  const alerter = document.getElementById( 'alerter' );

  let counter = 1;

  window.setInterval( () => {

    setTimeout( () => {
      alerter.textContent = '';

      alerter.hidden = false;

      alerter.textContent = `This is a new alert: ${counter}`;
      counter++;

      window.setTimeout( () => {
        alerter.hidden = true;
      }, 200 );
    } );
  }, 5000 );

</script>
</html>

I am not sure why this is happening in Safari in iFrames but I am not convinced yet that it is not our fault. But I am not sure if we should spend more time on this.

Outside of PhET-iO, I know that embedding PhET sims in iFrames is a popular use case so I am sad that this is broken.

Also, the experience with the sim on my Mac was very poor. VoiceOver almost always just said "Safari busy..." as it struggled with performance. If we continue here we may want to test by remote access into a different PhET machine.

zepumph · 2022-07-26T23:00:26Z

@jessegreenberg and I discussed this a bit more. We don't see any potential workarounds, and we don't think it is worth spending more time reproducing the issue at this time. This does not block Friction.

zepumph · 2022-08-05T18:30:45Z

@terracoda, @emily-phet, and I think we should create a bug report for this. If any of our third-party embedder of PhET sims reach out with this issue, we can recommend directly using the sim from our website (a bad workaround, but potentially possible).

UPDATE: @jessegreenberg helped me realize that I read #286 (comment) incorrectly. It isn't reproducible in that snippet. We will spend a modest amount of time seeing if it is possible (give our moderate success and large amount of fun doing the same thing last week in phetsims/a11y-research#175). I'll report back.

jessegreenberg · 2022-08-29T21:22:51Z

We came back to this today and tried not to
@jessegreenberg on a Mac 11.6.2 - Could not reproduce this (tested on https://phet-dev.colorado.edu/html/john-travoltage/1.6.4/phet/john-travoltage_all_iframe_phet.html)
@chrisklus on a Mac 10.13.6 Safari 13.1 - Tested (https://phet-dev.colorado.edu/html/john-travoltage/1.6.4/phet/john-travoltage_all_iframe_phet.html)
@Nancy-Salpepi on a Mac 12.5.1, Safar 15.6.1 - It happened immediately in both RAP and JT

Then, @jessegreenberg tried again DID see the problem happen in john-travoltage example. We created some more examples to test on @Nancy-Salpepi machine to see if it will happen outside of PhET. If so we can either identify and fix the problem or submit a bug report to Apple. See examples here: https://phet-dev.colorado.edu/html/jg-tests/iframe-tests/

jessegreenberg · 2022-08-29T21:32:45Z

We got it to happen on my machine in the most basic case by doing the following:

Go to https://phet-dev.colorado.edu/html/jg-tests/iframe-tests/basic/.
Enter the iframe with the virtual cursor and read the first heading in the content.
If the aria-live element changes while you are reading the heading with a virtual cursor you will hear the alert content twice.

jessegreenberg · 2022-08-29T21:35:07Z

This is about as simple as it gets for aria-live we are ready to submit this example to Apple as a bug report. Since it is outside of our hands we will also make sure it is in the list of known platform issues.

zepumph · 2022-08-29T22:15:56Z

Thanks so much to @jessegreenberg @Nancy-Salpepi and @chrisklus for helping to investigate this bug. We couldn't have done it without you all. I'm going to close this issue as a won'tfix knowing that an apple bug report will be given for phetsims/a11y-research#177.

Closing

Nancy-Salpepi · 2023-01-02T22:03:22Z

I know this was closed as "won't fix," but wanted to note that I also see repetition in the Standard Phet-iO wrapper
in the most recent dev test (phetsims/qa#868).

EDIT: I also see this bug was added to the list of known a11y bugs. Thanks 🙂

Nancy-Salpepi added the type:bug label Apr 1, 2022

Nancy-Salpepi assigned zepumph Apr 1, 2022

Nancy-Salpepi added the dev:description label Apr 1, 2022

Nancy-Salpepi changed the title ~~VO repeats descriptions in State Wrapper~~ VO repeats descriptions in Wrappers Apr 1, 2022

jessegreenberg added a commit to phetsims/qa that referenced this issue Aug 29, 2022

add note to accessibility-bugs.md, see phetsims/friction#286

f2ca0b1

jessegreenberg mentioned this issue Aug 29, 2022

VoiceOver repeates alerts when in an iframe phetsims/a11y-research#177

Open

zepumph closed this as completed Aug 29, 2022

Nancy-Salpepi mentioned this issue Jan 4, 2023

Dev Test: Friction 1.6.0-dev.28 phetsims/qa#868

Closed

20 tasks

zepumph added the type:wontfix label Jan 4, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

VO repeats descriptions in Wrappers #286

VO repeats descriptions in Wrappers #286

Nancy-Salpepi commented Apr 1, 2022

Nancy-Salpepi commented Apr 1, 2022

DevonQui commented Apr 4, 2022

terracoda commented Jun 17, 2022

zepumph commented Jul 15, 2022

jessegreenberg commented Jul 15, 2022 •

edited

Loading

zepumph commented Jul 26, 2022

zepumph commented Aug 5, 2022 •

edited

Loading

jessegreenberg commented Aug 29, 2022

jessegreenberg commented Aug 29, 2022

jessegreenberg commented Aug 29, 2022

zepumph commented Aug 29, 2022

Nancy-Salpepi commented Jan 2, 2023 •

edited

Loading

VO repeats descriptions in Wrappers #286

VO repeats descriptions in Wrappers #286

Comments

Nancy-Salpepi commented Apr 1, 2022

Nancy-Salpepi commented Apr 1, 2022

DevonQui commented Apr 4, 2022

terracoda commented Jun 17, 2022

zepumph commented Jul 15, 2022

jessegreenberg commented Jul 15, 2022 • edited Loading

zepumph commented Jul 26, 2022

zepumph commented Aug 5, 2022 • edited Loading

jessegreenberg commented Aug 29, 2022

jessegreenberg commented Aug 29, 2022

jessegreenberg commented Aug 29, 2022

zepumph commented Aug 29, 2022

Nancy-Salpepi commented Jan 2, 2023 • edited Loading

jessegreenberg commented Jul 15, 2022 •

edited

Loading

zepumph commented Aug 5, 2022 •

edited

Loading

Nancy-Salpepi commented Jan 2, 2023 •

edited

Loading