Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(evals): Make context support any type. #1517

Merged
merged 10 commits into from
Dec 13, 2024
Merged

feat(evals): Make context support any type. #1517

merged 10 commits into from
Dec 13, 2024

Conversation

ssbushi
Copy link
Contributor

@ssbushi ssbushi commented Dec 13, 2024

Update context of EvalInput to be not just strings. This will simplify many JSON parsings and stringifications. Should not affect 3P plugins, since context already has unknown type in BaseEvalDataPoint.

Checklist (if applicable):

@ssbushi ssbushi changed the base branch from main to sb/fixFaithfulnessOutput December 13, 2024 17:34
@ssbushi ssbushi marked this pull request as ready for review December 13, 2024 17:41
Base automatically changed from sb/fixFaithfulnessOutput to main December 13, 2024 17:56
@ssbushi ssbushi merged commit 7893efd into main Dec 13, 2024
4 checks passed
@ssbushi ssbushi deleted the sb/anyEvalInput branch December 13, 2024 17:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

Successfully merging this pull request may close these issues.

2 participants