Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Scoring services #204

Closed
wants to merge 83 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
83 commits
Select commit Hold shift + click to select a range
27bb5b8
testing
samyarpotlapalli Jun 4, 2024
44dc0fb
"Testing."
samyarpotlapalli Jun 4, 2024
3df1df9
Fixing comments
samyarpotlapalli Jun 19, 2024
407427b
Getting a model and input mapping
samyarpotlapalli Jun 19, 2024
8af52b4
Creating score definition JSON information
samyarpotlapalli Jun 19, 2024
1461ded
Adding comments and adjusting for various API call and responses
samyarpotlapalli Jun 19, 2024
07d6c93
Exits program after an error
samyarpotlapalli Jun 20, 2024
2110d66
Added original score_execution implementation
samyarpotlapalli Jun 20, 2024
3e46e78
refactor: swap in Service class for ScoreDefinitions class
smlindauer Jun 21, 2024
210bf6c
Refactoring and adjusting for invalid HTTP status codes
samyarpotlapalli Jun 25, 2024
dddc116
Raising exception if input file for table does not exist
samyarpotlapalli Jun 26, 2024
e697c25
Added import statements
samyarpotlapalli Jun 26, 2024
ba59858
Rename score_execution.py to src/_services/score_execution.py
samyarpotlapalli Jun 26, 2024
ba11e11
Rename score_definition.py to src/sasctl/_services/score_definition.py
samyarpotlapalli Jun 28, 2024
409167c
refactor: move score_execution to appropriate directory
smlindauer Jul 1, 2024
a7e6288
refactor: remove redundant score_definition.py; leave plural form to …
smlindauer Jul 1, 2024
8d55624
chore: apply black linter
smlindauer Jul 1, 2024
6e6390d
refactor: add comments and proper indenting for classmethod
smlindauer Jul 1, 2024
fcb19ab
fix: proper call to model_repository in score_definitions.py
smlindauer Jul 3, 2024
a38f4a7
fix: proper call to cls for score execution and black formatting
smlindauer Jul 3, 2024
4087b59
First draft of unit testing for score definitions and score execution
smlindauer Jul 3, 2024
43f2ab1
Added comments for test cases in test.score_definitions.py and starte…
samyarpotlapalli Jul 5, 2024
9e43960
Testing requests approach to pass get_model test
samyarpotlapalli Jul 11, 2024
b4692a0
refactor: adjust score_definitions.py for easier unit testing
smlindauer Jul 11, 2024
c68cb8b
test: update unit tests and put in draft score_definitions test
smlindauer Jul 11, 2024
a73a08c
Formatting score definitions and running binary classification to tes…
samyarpotlapalli Jul 15, 2024
2770514
Adding fail cases for get_table and upload_file
samyarpotlapalli Jul 16, 2024
e433643
First version of all test cases for score definition
samyarpotlapalli Jul 17, 2024
00f358e
Reformatting
samyarpotlapalli Jul 17, 2024
2ef46a4
Reformatting with black version 24.4.2
samyarpotlapalli Jul 17, 2024
91fc771
Skipping this file for build
samyarpotlapalli Jul 17, 2024
0791fdc
Adding new notebook for Azure Open AI example
SophiaRowland Jun 27, 2024
3b7aba0
Update register_Azure_Open_AI_REST_Call.ipynb
SophiaRowland Jun 27, 2024
ec82f3f
Update README.md
SophiaRowland Jun 27, 2024
c2e0ba2
Edited new Azure OpenAI GPT model example.
kaponte75 Jun 27, 2024
1a16cd4
Edited examples README.md file.
kaponte75 Jun 27, 2024
7c95b56
updated casing in model properties so they are correctly read
djm21 Jun 28, 2024
2ecab5d
GitHub test changes
djm21 Jun 10, 2024
6a35e5b
Updated xgboost version in tox.ini file
djm21 Jun 10, 2024
d33a1a4
remove tests for python 3.6 and 3.7 to allow for compatibility with x…
djm21 Jun 10, 2024
65f9c9c
fix formatting error in build-test-deploy.yml
djm21 Jun 10, 2024
50d115f
update GitHub scoring to allow for compatibility with swat
djm21 Jun 10, 2024
ece3f17
change to conftest.py to try to fix issues with GitHub actions
djm21 Jun 10, 2024
818f0bf
pinned scikit-learn to 1.5.0 for tox testing
djm21 Jul 8, 2024
7c82b08
scikit-learn version less than 1.5.0 for python versions that do not …
djm21 Jul 8, 2024
c4c3cde
changed scikit-learn to less than 1.5.0 in tox.ini
djm21 Jul 8, 2024
7b92264
further changes to github testing
djm21 Jul 8, 2024
dbc9f99
more changes to github testing
djm21 Jul 8, 2024
32ed7e0
change numpy to be less than version 2.0.0 in tox tests
djm21 Jul 8, 2024
78ac0fd
updated unit tests to align with code changes
djm21 Jul 8, 2024
a081f49
prep for release
djm21 Jul 8, 2024
c705539
Updating files for testing
samyarpotlapalli Jul 18, 2024
af938c5
Adding proper return value for successfu; get_definition call
samyarpotlapalli Jul 18, 2024
cb775bf
Raised http error for failed delete API call
samyarpotlapalli Jul 19, 2024
d026241
tests: adjustment to score_execution tests
samyarpotlapalli Jul 19, 2024
000d123
reformat: adjust score_execution.py to use same style of internal ser…
smlindauer Jul 19, 2024
f0984c4
tests: fix test_score_execution json reading error
smlindauer Jul 19, 2024
ae41977
Adding frameworks for the rest of score_execution unit tests
samyarpotlapalli Jul 23, 2024
2a3607f
Pushing with all successful test cases
samyarpotlapalli Jul 26, 2024
410b9cc
Fixed mapping issue in score_definitions
samyarpotlapalli Jul 30, 2024
3af08ff
Fixed import statements
samyarpotlapalli Jul 30, 2024
172dddd
Removed extra print statement and Class call
samyarpotlapalli Jul 30, 2024
26fe616
Corrected status code comparisons
samyarpotlapalli Aug 2, 2024
2a58f5f
Fixed incorrect get_table syntax
samyarpotlapalli Aug 2, 2024
3cd5a2a
filter changed
samyarpotlapalli Aug 19, 2024
a68d2d3
chore: add score-definitions and score-execution service into service…
smlindauer Aug 14, 2024
913fe03
chore: fix spelling errors
smlindauer Aug 14, 2024
2f54f8c
fix: proper call to the object uri in modelManagement for score defin…
smlindauer Aug 14, 2024
f250b5f
feat: change base score definition to use CAS Gateway
smlindauer Aug 14, 2024
4f9ab4d
refactor: swap model_id to model for ease of use in argument choice
smlindauer Aug 16, 2024
fa248a2
feat: add new task to score models in SAS Model Manager
smlindauer Aug 16, 2024
bde6304
Added docstrings and removed list_executions unit tests in test_score…
samyarpotlapalli Aug 22, 2024
21808ec
Added this to fix code quality linting error
samyarpotlapalli Aug 22, 2024
73092a4
Edited test_score_definitions for syntax issue
samyarpotlapalli Aug 30, 2024
7520ca0
black reformatting
samyarpotlapalli Oct 10, 2024
63c2068
checking black formatting
samyarpotlapalli Oct 10, 2024
b88c928
added cas gateway optional parameter
samyarpotlapalli Oct 18, 2024
c8b1c70
Add files via upload
samyarpotlapalli Oct 18, 2024
b7347b3
score testing example
samyarpotlapalli Oct 18, 2024
7b23992
Merge branch 'refs/heads/master' into scoring_services
smlindauer Oct 21, 2024
b7210ab
pushing correct version
samyarpotlapalli Oct 23, 2024
b3f4358
Use gateway with score_model_with_cas call
djm21 Oct 23, 2024
fa4de17
black reformatting
djm21 Oct 28, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 10 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,16 @@ v1.10.4 (2024-07-08)
- Added `dmcas_misc.json` template file for model card generation.
- Updated generation of `ModelProperties.json` to allow for model card generation immediately upon upload.

v1.10.4 (2024-07-08)
----------
**Improvements**
- Added example Jupyter notebook for OpenAI models.

**Buxfixes**
- Dropped support for Python 3.6 and Python 3.7, as those are no longer officially supported versions.
- Added `dmcas_misc.json` template file for model card generation.
- Updated generation of `ModelProperties.json` to allow for model card generation immediately upon upload.

v1.10.3 (2024-04-12)
--------------------
**Bugfixes**
Expand Down
Binary file not shown.
Binary file not shown.
Original file line number Diff line number Diff line change
Expand Up @@ -2,16 +2,19 @@
"name": "DecisionTreeClassifier",
"description": "Description for the DecisionTreeClassifier model.",
"scoreCodeType": "python",
"trainTable": "",
"trainTable": "cas-shared-default/Public/DecisionTreeClassifier_train_data",
"trainCodeType": "Python",
"algorithm": "",
"algorithm": "DecisionTreeClassifier",
"function": "Classification",
"targetVariable": "BAD",
"targetEvent": "1",
"targetLevel": "BINARY",
"targetLevel": "Binary",
"eventProbVar": "P_1",
"modeler": "sasdemo",
"tool": "Python 3",
"toolVersion": "3.8.16",
"properties": []
"toolVersion": "3.11.7",
"properties": [],
"eventPercentage": "0.20182166826462",
"selectionStatistic": "_RASE_",
"selectionStatisticValue": "0.33514616799162"
}
Original file line number Diff line number Diff line change
Expand Up @@ -222,13 +222,14 @@
"_MCE_": 0.88710450623202,
"_ASE_": 0.11232295391947,
"_MCLL_": 0.99896429012045,
"_KS_": null,
"_KS_": 1.0,
"_KSPostCutoff_": null,
"_DIV_": 4172.0,
"_TAU_": null,
"_KSCut_": null,
"_C_": null,
"_PartInd_": null
"_C_": 0.85770092470509,
"_PartInd_": null,
"_KS2_": 0.71540184941018
},
"rowNumber": 2,
"header": null
Expand All @@ -243,14 +244,15 @@
"_DataRole_": "TEST",
"_MCE_": 0.99328859060402,
"_ASE_": 0.10439243746467,
"_MCLL_": 0.18029189766592,
"_KS_": null,
"_MCLL_": 0.1674139049754,
"_KS_": 1.0,
"_KSPostCutoff_": null,
"_DIV_": 1788.0,
"_TAU_": null,
"_KSCut_": null,
"_C_": null,
"_PartInd_": null
"_C_": 0.83803076656035,
"_PartInd_": null,
"_KS2_": 0.6760615331207
},
"rowNumber": 3,
"header": null
Expand Down
Loading
Loading