-
Notifications
You must be signed in to change notification settings - Fork 77
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Create a reusable app for task review #1058
Merged
Merged
Changes from all commits
Commits
Show all changes
33 commits
Select commit
Hold shift + click to select a range
c8faeb9
[WIP] Task review app - initial API commit
meta-paul 5b5a733
[WIP] Task review app - moved unit_review to Mephisto DB and updated …
meta-paul 1ddfb81
[WIP] Task review app - initial UI commit
meta-paul 16e6e5d
[WIP] Task review app - added modal components, updated /stats endpoint
meta-paul 03d4e8f
[WIP] Task review app - added getting units and stats data
meta-paul 5a0fc23
[WIP] Task review app - implemented demo display of mnist task data
meta-paul 1162f27
[WIP] Task review app - made transition between units and improved el…
meta-paul 8f794bc
[WIP] Task review app - small fixes
meta-paul 439bd46
[WIP] Task review app - more fixes
meta-paul 86c8442
Task review app - Ported mnist app to load during task review
meta-paul 4c291e3
Task review app - Added JSON viewer as fallback and fixed a bug
meta-paul 96bff4b
Task review app - improved worker qualification endpoint
meta-paul 75bf0e3
Task review app - linted code with Prettier
meta-paul c9489d9
Task review app - Fixed worker picking order during review
meta-paul 259739a
Task review app - added creating Unit Review to Agent logic
meta-paul 15689e2
Task review app - added a separate review-specific build for Task com…
meta-paul 9318cac
Task review app - renamed 'tips' to 'bonus', updated docs
meta-paul ebe5cd5
removed deprecated mephisto client code
meta-paul 1654887
Task review app - addressed PR review comments
meta-paul 418c4c7
Fixed linting warnings
meta-paul 2387d11
Added docs for dockerization support
meta-paul e7230c3
Addressed review comments
meta-paul 88df9ad
Added a single script for launching TaskReview app server and client
meta-paul a8b8f40
Merge branch 'v1.2-dev' into make-task-review-server
meta-paul 5b07bcc
Deprecated version of MNIST app without TaskReview support
meta-paul 221bae3
Added step-by-step Mephisto guide
meta-paul 6dfb39f
Added option to create new qualification during task review
meta-paul f2fe874
Tested TaskReview edge cases for Prolific
meta-paul ecfa55b
Added TaskReview API documentation
meta-paul 9933658
Covered TaskReview app with unittests
meta-paul cc1c2e0
Fixed unittests for Prolific integration
meta-paul 3494563
Added results export in JSON format for TaskReview app
meta-paul 650326a
Fixed failing e2e Cypress tests
meta-paul File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
Binary file not shown.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
3 changes: 2 additions & 1 deletion
3
examples/parlai_chat_task_demo/hydra_configs/conf/custom_prebuilt.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
3 changes: 2 additions & 1 deletion
3
examples/parlai_chat_task_demo/hydra_configs/conf/custom_simple.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
3 changes: 2 additions & 1 deletion
3
examples/parlai_chat_task_demo/hydra_configs/conf/example.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
3 changes: 2 additions & 1 deletion
3
examples/parlai_chat_task_demo/hydra_configs/conf/onboarding_example.yaml
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,11 +1,9 @@ | ||
<!--- | ||
Copyright (c) Meta Platforms and its affiliates. | ||
This source code is licensed under the MIT license found in the | ||
LICENSE file in the root directory of this source tree. | ||
--> | ||
|
||
# Mephisto MNIST Model Evaluator demo | ||
|
||
This task is a simple model evaluation demo, presenting the worker with three spaces to draw images in, running an MNIST model on them to predict an output, and then allowing the worker to assess and correct that output. | ||
|
||
Introduced in [#677](https://github.com/facebookresearch/Mephisto/pull/677), some screenshots and discussion there. | ||
Introduced in [#677](https://github.com/facebookresearch/Mephisto/pull/677), some screenshots and discussion there. | ||
|
||
For more details how to write your own `webapp` (ReactJS application) see example in current directory. | ||
Also, read [short documentation](../../../mephisto/client/review_app/README.md) | ||
for the main Review App to understand how to add review part in your `webapp`. |
This file was deleted.
Oops, something went wrong.
This file was deleted.
Oops, something went wrong.
42 changes: 0 additions & 42 deletions
42
examples/remote_procedure/mnist/custom-review/package.json
This file was deleted.
Oops, something went wrong.
Binary file not shown.
44 changes: 0 additions & 44 deletions
44
examples/remote_procedure/mnist/custom-review/public/index.html
This file was deleted.
Oops, something went wrong.
Binary file not shown.
Binary file not shown.
3 changes: 0 additions & 3 deletions
3
examples/remote_procedure/mnist/custom-review/public/robots.txt
This file was deleted.
Oops, something went wrong.
2 changes: 0 additions & 2 deletions
2
examples/remote_procedure/mnist/custom-review/sample-data.csv
This file was deleted.
Oops, something went wrong.
2 changes: 0 additions & 2 deletions
2
examples/remote_procedure/mnist/custom-review/sample-data.jsonl
This file was deleted.
Oops, something went wrong.
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Are licenses not required for
.md
?