Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add new AutoJudge class for custom judges #11

Merged
merged 35 commits into from
Dec 20, 2024
+987 −24
Merged

Add new AutoJudge class for custom judges #11

Changes from 1 commit
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
f61c626
deploy WIP
Dec 16, 2024
aa5b7ea
deploy WIP
Dec 17, 2024
e14f364
deploy WIP
Dec 17, 2024
72aa0ea
deploy autojudge v0
Dec 17, 2024
762e6bc
deploy autojudge v0
Dec 17, 2024
705e68e
deploy tutorial nb
Dec 17, 2024
54e6ecc
reorganize
Dec 17, 2024
4defef6
delete unneccessary dir
Dec 17, 2024
443e49b
remove test script
Dec 17, 2024
37fa2f7
add missing methods
Dec 17, 2024
56e0795
Update base.py to handle dynamic output parsing
jamesliounis Dec 11, 2024
4db2033
Revert to original logic, add docstrings
jamesliounis Dec 11, 2024
396f65c
Clean up files
freddiev4 Dec 18, 2024
7fcd0d2
Add instructor dependency
freddiev4 Dec 18, 2024
0ecbd66
Add task description argument to "from_dataset" class method.
jamesliounis Dec 18, 2024
f5ff839
Update docstring + task param
freddiev4 Dec 18, 2024
d1ed2d5
add back tenacity decorator
Dec 19, 2024
771fc81
deploy bug fix to completions error
Dec 19, 2024
6b6e746
deploy README
Dec 19, 2024
691837c
remove dotenv
Dec 19, 2024
1a5ba54
Add autojudge dependencies
freddiev4 Dec 20, 2024
d25a6f9
Some fixups for clients
freddiev4 Dec 20, 2024
6d4d925
Client fixup
freddiev4 Dec 20, 2024
b3f1a8f
Move autojudge submodule
freddiev4 Dec 20, 2024
70854bb
Auto save prompts to disk
freddiev4 Dec 20, 2024
1979fc8
add conversion for '0'
freddiev4 Dec 20, 2024
70d781e
remove marketing content
Dec 20, 2024
cf2e8d3
bug fix --> remove unneccessary user prompt formatting
Dec 20, 2024
6f62e77
remove unneccesary pydantic structure
Dec 20, 2024
de86239
Add AutoJudge section to readme
freddiev4 Dec 20, 2024
d639f2f
Add AutoJudge section to readme
freddiev4 Dec 20, 2024
85850dc
Update README.md
freddiev4 Dec 20, 2024
69a8bea
Update README.md
freddiev4 Dec 20, 2024
48a2891
Update README
freddiev4 Dec 20, 2024
44c4970
Rename fields
freddiev4 Dec 20, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
remove test script
@freddiev4
James Liounis authored and freddiev4 committed Dec 20, 2024
commit 443e49b05232ff8146f68e5c20c8969518ef4551
35 changes: 0 additions & 35 deletions judges/autojudge/test_core.py
View file

This file was deleted.