Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci: Talk to Shaka Bot #5565

Merged
merged 4 commits into from
Aug 31, 2023
Merged

Conversation

joeyparrish
Copy link
Member

@joeyparrish joeyparrish commented Aug 30, 2023

Now maintainers can send commands to Shaka Bot via PR comments.

Initially, Shaka Bot understands the following commands from anyone:

  • @shaka-bot help: Show this help message

And the following commands from maintainers only:

  • @shaka-bot test: Start lab tests on all devices
  • @shaka-bot test ce: Start lab tests on CE devices only (no desktop browsers)

Now maintainers can send commands to Shaka Bot via PR comments.

Shaka Bot understands the following commands to start:
 - `@shaka-bot help`: Show this help message
 - `@shaka-bot test`: Start lab tests (maintainers only)
@joeyparrish
Copy link
Member Author

With this, instead of copying the PR number, clicking "Actions", finding "Selenium lab tests", clicking that, then clicking the "Run workflow" button, then pasting in the PR number, then clicking yet another "Run workflow button"...

I could just comment on the PR with @shaka-bot test.

@github-actions
Copy link
Contributor

Incremental code coverage: No instrumented code was changed.

.github/workflows/talk-to-shaka-bot.yaml Outdated Show resolved Hide resolved
.github/workflows/talk-to-shaka-bot.yaml Outdated Show resolved Hide resolved
@alekzz
Copy link

alekzz commented Aug 31, 2023

Now maintainers can send commands to Shaka Bot via PR comments.

Shaka Bot understands the following commands to start:

  • @shaka-bot help: Show this help message
  • @shaka-bot test: Start lab tests (maintainers only)

Great feature. Will it be documented somewhere? How could I discover this ability of the Shaka bot?

@joeyparrish
Copy link
Member Author

Now maintainers can send commands to Shaka Bot via PR comments.
Shaka Bot understands the following commands to start:

  • @shaka-bot help: Show this help message
  • @shaka-bot test: Start lab tests (maintainers only)

Great feature. Will it be documented somewhere? How could I discover this ability of the Shaka bot?

Good question. I'm not sure. We can add it to the maintenance documentation for the project: https://github.com/shaka-project/shaka-project.github.io/blob/main/maintenance/shaka-player.md

But I was wondering if I should add a feature to have the bot comment on each new PR to remind maintainers of common tasks it can do.

Maybe I should document it first, then try out some kind of reminder feature later.

Thoughts?

@joeyparrish
Copy link
Member Author

I'm about to do a test run of the refactored bash script against this PR. I'm supplying all the values manually and running it locally with shaka-bot's token. When shaka-bot starts commenting on this PR, that's the result of my manual testing.

@shaka-bot
Copy link
Collaborator

@joeyparrish: I understand the following commands:

  • @shaka-bot help: Show this help message
  • @shaka-bot test: Start lab tests (maintainers only)

@shaka-bot
Copy link
Collaborator

@joeyparrish: Only maintainers may start lab tests.

1 similar comment
@shaka-bot
Copy link
Collaborator

@joeyparrish: Only maintainers may start lab tests.

@shaka-bot
Copy link
Collaborator

@joeyparrish: Lab tests started.

@joeyparrish
Copy link
Member Author

@alekzz, I think you'll find the refactored version much improved. Let me know what you think!

Copy link
Member

@avelad avelad left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would suggest an extra parameter in @shaka-bot test that allows us to indicate "only test on devices that are not in github actions" (ex: chromecast and tizen).

Do you think you could add it?

@shaka-bot
Copy link
Collaborator

@joeyparrish: I honor the following commands from anyone:

  • @shaka-bot help: Show this help message

I honor the following commands from maintainers only:

  • @shaka-bot test: Start lab tests on all devices
  • @shaka-bot test ce: Start lab tests on CE devices only (no desktop browsers)

@shaka-project shaka-project deleted a comment from shaka-bot Aug 31, 2023
@shaka-bot
Copy link
Collaborator

@joeyparrish: Lab tests started with arguments: pr=5565 browser_filter=Tizen Chromecast ChromeAndroid

@shaka-bot
Copy link
Collaborator

@joeyparrish: Lab tests started with arguments:

  • pr=5565
  • browser_filter=Tizen Chromecast ChromeAndroid

@joeyparrish
Copy link
Member Author

I would suggest an extra parameter in @shaka-bot test that allows us to indicate "only test on devices that are not in github actions" (ex: chromecast and tizen).

Do you think you could add it?

Done!

@shaka-bot test ce will run tests only on CE (consumer electronics) devices (no desktop browsers).

@alekzz
Copy link

alekzz commented Aug 31, 2023

Now maintainers can send commands to Shaka Bot via PR comments.
Shaka Bot understands the following commands to start:

  • @shaka-bot help: Show this help message
  • @shaka-bot test: Start lab tests (maintainers only)

Great feature. Will it be documented somewhere? How could I discover this ability of the Shaka bot?

Good question. I'm not sure. We can add it to the maintenance documentation for the project: https://github.com/shaka-project/shaka-project.github.io/blob/main/maintenance/shaka-player.md

But I was wondering if I should add a feature to have the bot comment on each new PR to remind maintainers of common tasks it can do.

Maybe I should document it first, then try out some kind of reminder feature later.

Thoughts?

Adding to the maintenance documentation sounds reasonable and sufficient IMHO.

@alekzz
Copy link

alekzz commented Aug 31, 2023

@alekzz, I think you'll find the refactored version much improved. Let me know what you think!

Yes, looks very good! Thanks!

@joeyparrish joeyparrish merged commit 27e991d into shaka-project:main Aug 31, 2023
@joeyparrish joeyparrish deleted the comment-to-run-tests branch August 31, 2023 17:15
@@ -0,0 +1,27 @@
# Copyright 2022 Google LLC
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why 2022? We are in 2023…

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's a copy-paste bug.

joeyparrish added a commit that referenced this pull request Sep 2, 2023
Now maintainers can send commands to Shaka Bot via PR comments.

Initially, Shaka Bot understands the following commands from anyone:
 - `@shaka-bot help`: Show this help message

And the following commands from maintainers only:
 - `@shaka-bot test`: Start lab tests on all devices
- `@shaka-bot test ce`: Start lab tests on CE devices only (no desktop
browsers)
joeyparrish added a commit that referenced this pull request Sep 2, 2023
Now maintainers can send commands to Shaka Bot via PR comments.

Initially, Shaka Bot understands the following commands from anyone:
 - `@shaka-bot help`: Show this help message

And the following commands from maintainers only:
 - `@shaka-bot test`: Start lab tests on all devices
- `@shaka-bot test ce`: Start lab tests on CE devices only (no desktop
browsers)
@shaka-bot shaka-bot added the status: archived Archived and locked; will not be updated label Oct 30, 2023
@shaka-project shaka-project locked as resolved and limited conversation to collaborators Oct 30, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
status: archived Archived and locked; will not be updated
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants