Releases: exasol/transformers-extension
2.1.0: Added new deploy command
Summary
This release features a new CLI command for deploying the Transformers Extension,
additionally improvements where made for the tests.
Bugs
- #256: Removed imports of pytest fixtures to avoid session fixtures running for each test
Refactorings
2.0.0: Fixed model saving, added SaaS support and update to Python 3.10
Summary
This release Fixes an error in saving and loading of the model metadata. It also adds Exasol Saas support and
updated the project to python 3.10
Features
- #243: Added an option to deploy scripts in a SaaS database.
- #244: Made the integration tests running in SaaS, as well as in the Docker-DB.
Bugs
- #237: Fixed reference to python-extension-common
- #245: Added task_type parameter to fix model saving and loading
Documentation
- #210: Fixed typos in user guide.
- #247: Updated documentation including the deployment options in SaaS.
Refactorings
- #216: Simplified model path constructions, consolidating them into one function
- #228: Now use python-extension-common for the language container deployment.
- #232: Added Class which holds model information
- #217: Refactored PredictionUDFs and LoadLocalModel so that LoadLocalModel constructs the bucketfs model file path
- #230: Updated supported python version to >= Python 3.10
- #236: Moved to the PathLike bucketfs interface.
- #218: Changed upload_model_udf to load model from Huggingface
Security
1.0.1: Fixed the directory structure bug
Summary
Attention: In the 1.0.x Releases the model saving process is broken. Some metadata is not saved correctly resulting in executable models which return bad results. If you use locally saved models that you upload manually you are not affected, otherwise, please skip this version and wait for release 2.0.0. We are working on fixing this issue.
Fixed the directory structure made by the model upload UDF.
Bugs
- #221: Directory Structure that Model Upload UDF creates is different from what PredictionUDFs expect.
Features
N/A
Refactorings
N/A
Security
N/A
1.0.0: Local model loading
Summary
Attention: In the 1.0.x Releases the model saving process is broken. Some metadata is not saved correctly resulting in executable models which return bad results. If you use locally saved models that you upload manually you are not affected, otherwise, please skip this version and wait for release 2.0.0. We are working on fixing this issue.
In this release, we integrated a new model loading functionality which means downloaded models will now be saved
in the BucketFS. This means, the Prediction UDFs do not connect to the internet to look for model updates.
There are also documentation updates, and we updated cryptography to >= 42.0.4.
Breaking API changes
The change in the model loading functionality means the API for the Prediction UDFs has changed.
The 'token_conn' parameter was removed from the UDF calls. You can now call the UDFs
as follows (Example case for the filling mask udf):
SELECT TE_FILLING_MASK_UDF(
device_id,
bucketfs_conn,
sub_dir,
model_name,
text_data,
top_k
)Features
Documentation
- #133: Improved user and developer documentation with additional information
Refactorings
- #147: Removed token_conn from Prediction UDFs
Security
- Updated cryptography to >= 42.0.4
0.10.0: Fixing deployment issues.
0.9.2: Updated and Fixed Dependencies III
Summary
Changed the dependency on exasol-bucketfs and typeguard.
Features
N/A
Refactorings
- #192 (revisited): Changed the dependency on exasol-bucketfs
Security
N/A
0.9.1: Updated and Fixed Dependencies II
Summary
Changed the dependency on exasol-bucketfs, removing the limit to version 0.7.0.
Features
N/A
Refactorings
- #192: Changed the dependency on exasol-bucketfs
Security
N/A
0.9.0: Updated and Fixed Dependencies
Summary
This release changes how we import the torch package, adds the sacremoses tokenizer
and includes security updates. It also adds functions to load locally saved models as
a preparation for changing the model downloading and saving process.
Features
- #145: Added load function for loading local models
Refactorings
Security
- Update gitpython (3.1.40 -> 3.1.41)
- Updated jinja2 (3.1.2 -> 3.1.3)
0.8.0: Get Language Definition in LanguageContainerDeployer
Summary
This release added the get_language_definition function to the LanguageContainerDeployer.
Features
- #174: Added get_language_definition to the language container deployer
Bug Fixes
- n/a
Refactorings
- n/a
Documentation
- n/a
Security
- Update paramiko version to 3.4.0
- Updated transformers to 4.36.2
0.7.0: Split SLC actions
Summary
This release splits the container uploading and registration into two separate actions. Additionally,
a workflow for checking the correctness of the version number in multiple places was added. Apart from that there
are some refactorings for better usability and the Cryptography dependency version has been upgraded to 41.0.7
Features
- #151: Made the container uploading and language registration two separate actions
- #167: Added version check workflow
- #143: Added HuggingfaceTransfer class with save_pretrained for saving model locally
Refactorings
- #144: Extracted base_model_udf.load_models into separate class
- #159: Refactored LanguageContainer Deployer to make it reusable by other extensions
Security
- #144: Updated Cryptography to version 41.0.7