Skip to content

Commit

Permalink
fixed type error
Browse files Browse the repository at this point in the history
  • Loading branch information
ShiboSoftwareDev committed Dec 7, 2024
1 parent 8734874 commit 855b15a
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions benchmarks-evalite/benchmark.eval.ts
Original file line number Diff line number Diff line change
Expand Up @@ -59,13 +59,13 @@ for (const problem of problems) {
outputType: 'board',
preSuppliedImports: {},
});
return problem.questions.map(question => ({ input: { code: evaluation.success ? code : null, question: question.text }, expected: question.answer }));
return problem.questions.map(question => ({ input: { code: evaluation.success ? code : null, question: question.text }, expected: question.answer.toString() }));
},
task: async (input) => {
if (!input.code)
return undefined
return ""
const answer = await askAboutOutput(input.code, input.question);
return answer;
return answer.toString();
},
scorers: [Levenshtein],
});
Expand Down

0 comments on commit 855b15a

Please sign in to comment.