From 77b51a8e7e07368357f09fa639c18d0466c6a1cc Mon Sep 17 00:00:00 2001 From: jorg-vr Date: Thu, 19 Oct 2023 10:08:02 +0200 Subject: [PATCH 1/3] Add judge info for debugger --- en/references/judges/creating-a-judge/index.md | 7 ++++++- nl/references/judges/creating-a-judge/index.md | 7 ++++++- 2 files changed, 12 insertions(+), 2 deletions(-) diff --git a/en/references/judges/creating-a-judge/index.md b/en/references/judges/creating-a-judge/index.md index 9a9ede910..065f3f5bd 100644 --- a/en/references/judges/creating-a-judge/index.md +++ b/en/references/judges/creating-a-judge/index.md @@ -51,7 +51,7 @@ The `run` executable should output JSON to _stdout_, which will be interpreted b #### Full output -The complete format description can be found on [the wiki]() and is specified through a [JSON schema](https://github.com/dodona-edu/dodona/tree/develop/public/schemas). A more concise format can be found below. (Note: all items are rendered in the order used below; all list-type keys are optional, defaulting to the empty list as value) +The complete format description can be found on [the wiki]() and is specified through a [JSON schema](https://github.com/dodona-edu/dodona/tree/main/public/schemas). A more concise format can be found below. (Note: all items are rendered in the order used below; all list-type keys are optional, defaulting to the empty list as value) The full output returns a single JSON at the end. You must ensure that this is emitted before the docker runs out of time or memory. @@ -77,6 +77,7 @@ The full output returns a single JSON at the end. You must ensure that this is e - An optional `description`, a `Message` object (probably a statement formatted as `code`). - `tests`, a list of `Test` objects. - `messages`, a list of message objects. + - `data`, an optional `DebugData` object. - A `Test` object (used, e.g. to test either the returned and printed output of a statement) consists of: - An optional `description`, a `Message` object. - `accepted`, a boolean indicating whether this test is considered correct. `true` results in only showing the `generated` string, `false` results in showing a "diff" between the `generated` and `expected` strings. @@ -121,6 +122,10 @@ The full output returns a single JSON at the end. You must ensure that this is e - `"internal error"`, the judge exited with a non-zero status code. - `"unknown"`, something went wrong. +- A `DebugData` object is used to run the python tutor that gives students a debug interface. Currently it is only relevant for python. It consists of: + - `statements`, a string containing the extra code to be executed in the python tutor, to mimic this testcase. + - `input`, a string containing the input to be given to the python tutor, to mimic this testcase. + ![judge-output-reflection](./judge-output.png) #### Partial output diff --git a/nl/references/judges/creating-a-judge/index.md b/nl/references/judges/creating-a-judge/index.md index 46d68933c..c004800b0 100644 --- a/nl/references/judges/creating-a-judge/index.md +++ b/nl/references/judges/creating-a-judge/index.md @@ -51,7 +51,7 @@ The `run` executable should output JSON to _stdout_, which will be interpreted b #### Full output -The complete format description can be found on [the wiki]() and is specified through a [JSON schema](https://github.com/dodona-edu/dodona/tree/develop/public/schemas). A more concise format can be found below. (Note: all items are rendered in the order used below; all list-type keys are optional, defaulting to the empty list as value) +The complete format description can be found on [the wiki]() and is specified through a [JSON schema](https://github.com/dodona-edu/dodona/tree/main/public/schemas). A more concise format can be found below. (Note: all items are rendered in the order used below; all list-type keys are optional, defaulting to the empty list as value) The full output returns a single JSON at the end. You must ensure that this is emitted before the docker runs out of time or memory. @@ -77,6 +77,7 @@ The full output returns a single JSON at the end. You must ensure that this is e - An optional `description`, a `Message` object (probably a statement formatted as `code`). - `tests`, a list of `Test` objects. - `messages`, a list of message objects. + - `data`, an optional `DebugData` object. - A `Test` object (used, e.g. to test either the returned and printed output of a statement) consists of: - An optional `description`, a `Message` object. - `accepted`, a boolean indicating whether this test is considered correct. `true` results in only showing the `generated` string, `false` results in showing a "diff" between the `generated` and `expected` strings. @@ -121,6 +122,10 @@ The full output returns a single JSON at the end. You must ensure that this is e - `"internal error"`, the judge exited with a non-zero status code. - `"unknown"`, something went wrong. +- A `DebugData` object is used to run the python tutor that gives students a debug interface. Currently it is only relevant for python. It consists of: + - `statements`, a string containing the extra code to be executed in the python tutor, to mimic this testcase. + - `input`, a string containing the input to be given to the python tutor, to mimic this testcase. + ![judge-output-reflection](./judge-output.png) #### Partial output From c8720354d973d30f9d3fb926e6d1dbd2a494d1da Mon Sep 17 00:00:00 2001 From: jorg-vr Date: Thu, 19 Oct 2023 16:39:56 +0200 Subject: [PATCH 2/3] Rename input to stdin --- en/references/judges/creating-a-judge/index.md | 2 +- nl/references/judges/creating-a-judge/index.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/en/references/judges/creating-a-judge/index.md b/en/references/judges/creating-a-judge/index.md index 065f3f5bd..c319d536f 100644 --- a/en/references/judges/creating-a-judge/index.md +++ b/en/references/judges/creating-a-judge/index.md @@ -124,7 +124,7 @@ The full output returns a single JSON at the end. You must ensure that this is e - A `DebugData` object is used to run the python tutor that gives students a debug interface. Currently it is only relevant for python. It consists of: - `statements`, a string containing the extra code to be executed in the python tutor, to mimic this testcase. - - `input`, a string containing the input to be given to the python tutor, to mimic this testcase. + - `stdin`, a string containing the input to be given to the python tutor, to mimic this testcase. ![judge-output-reflection](./judge-output.png) diff --git a/nl/references/judges/creating-a-judge/index.md b/nl/references/judges/creating-a-judge/index.md index c004800b0..f51aa95c7 100644 --- a/nl/references/judges/creating-a-judge/index.md +++ b/nl/references/judges/creating-a-judge/index.md @@ -124,7 +124,7 @@ The full output returns a single JSON at the end. You must ensure that this is e - A `DebugData` object is used to run the python tutor that gives students a debug interface. Currently it is only relevant for python. It consists of: - `statements`, a string containing the extra code to be executed in the python tutor, to mimic this testcase. - - `input`, a string containing the input to be given to the python tutor, to mimic this testcase. + - `stdin`, a string containing the input to be given to the python tutor, to mimic this testcase. ![judge-output-reflection](./judge-output.png) From 67711a39bd9bc99c825cac72a60d7d56f8bc03f0 Mon Sep 17 00:00:00 2001 From: Bart Mesuere Date: Mon, 30 Oct 2023 09:10:06 +0100 Subject: [PATCH 3/3] Apply suggestions from code review Co-authored-by: Niko Strijbol --- en/references/judges/creating-a-judge/index.md | 8 ++++---- nl/references/judges/creating-a-judge/index.md | 8 ++++---- 2 files changed, 8 insertions(+), 8 deletions(-) diff --git a/en/references/judges/creating-a-judge/index.md b/en/references/judges/creating-a-judge/index.md index c319d536f..8019140c0 100644 --- a/en/references/judges/creating-a-judge/index.md +++ b/en/references/judges/creating-a-judge/index.md @@ -51,7 +51,7 @@ The `run` executable should output JSON to _stdout_, which will be interpreted b #### Full output -The complete format description can be found on [the wiki]() and is specified through a [JSON schema](https://github.com/dodona-edu/dodona/tree/main/public/schemas). A more concise format can be found below. (Note: all items are rendered in the order used below; all list-type keys are optional, defaulting to the empty list as value) +The complete format description is specified through a [JSON schema](https://github.com/dodona-edu/dodona/tree/main/public/schemas). A more concise format can be found below. (Note: all items are rendered in the order used below; all list-type keys are optional, defaulting to the empty list as value) The full output returns a single JSON at the end. You must ensure that this is emitted before the docker runs out of time or memory. @@ -122,9 +122,9 @@ The full output returns a single JSON at the end. You must ensure that this is e - `"internal error"`, the judge exited with a non-zero status code. - `"unknown"`, something went wrong. -- A `DebugData` object is used to run the python tutor that gives students a debug interface. Currently it is only relevant for python. It consists of: - - `statements`, a string containing the extra code to be executed in the python tutor, to mimic this testcase. - - `stdin`, a string containing the input to be given to the python tutor, to mimic this testcase. +- A `DebugData` object is used to run the Python Tutor that gives students a debug interface. Currently it is only relevant for Python. It consists of: + - `statements`, a string containing the extra code to be executed in the Python Tutor, to mimic this testcase. + - `stdin`, a string containing the input to be given to the Python Tutor, to mimic this testcase. ![judge-output-reflection](./judge-output.png) diff --git a/nl/references/judges/creating-a-judge/index.md b/nl/references/judges/creating-a-judge/index.md index f51aa95c7..c2d968d17 100644 --- a/nl/references/judges/creating-a-judge/index.md +++ b/nl/references/judges/creating-a-judge/index.md @@ -51,7 +51,7 @@ The `run` executable should output JSON to _stdout_, which will be interpreted b #### Full output -The complete format description can be found on [the wiki]() and is specified through a [JSON schema](https://github.com/dodona-edu/dodona/tree/main/public/schemas). A more concise format can be found below. (Note: all items are rendered in the order used below; all list-type keys are optional, defaulting to the empty list as value) +The complete format description is specified through a [JSON schema](https://github.com/dodona-edu/dodona/tree/main/public/schemas). A more concise format can be found below. (Note: all items are rendered in the order used below; all list-type keys are optional, defaulting to the empty list as value) The full output returns a single JSON at the end. You must ensure that this is emitted before the docker runs out of time or memory. @@ -122,9 +122,9 @@ The full output returns a single JSON at the end. You must ensure that this is e - `"internal error"`, the judge exited with a non-zero status code. - `"unknown"`, something went wrong. -- A `DebugData` object is used to run the python tutor that gives students a debug interface. Currently it is only relevant for python. It consists of: - - `statements`, a string containing the extra code to be executed in the python tutor, to mimic this testcase. - - `stdin`, a string containing the input to be given to the python tutor, to mimic this testcase. +- A `DebugData` object is used to run the Python Tutor that gives students a debug interface. Currently it is only relevant for Python. It consists of: + - `statements`, a string containing the extra code to be executed in the Python Tutor, to mimic this testcase. + - `stdin`, a string containing the input to be given to the Python Tutor, to mimic this testcase. ![judge-output-reflection](./judge-output.png)