Skip to content

1.0.0: Local model loading

Compare
Choose a tag to compare
@MarleneKress79789 MarleneKress79789 released this 12 Apr 11:23
· 21 commits to main since this release
1c7c26f

Summary

Attention: In the 1.0.x Releases the model saving process is broken. Some metadata is not saved correctly resulting in executable models which return bad results. If you use locally saved models that you upload manually you are not affected, otherwise, please skip this version and wait for release 2.0.0. We are working on fixing this issue.

In this release, we integrated a new model loading functionality which means downloaded models will now be saved
in the BucketFS. This means, the Prediction UDFs do not connect to the internet to look for model updates.
There are also documentation updates, and we updated cryptography to >= 42.0.4.

Breaking API changes

The change in the model loading functionality means the API for the Prediction UDFs has changed.
The 'token_conn' parameter was removed from the UDF calls. You can now call the UDFs
as follows (Example case for the filling mask udf):

SELECT TE_FILLING_MASK_UDF(
    device_id,
    bucketfs_conn,
    sub_dir,
    model_name,
    text_data,
    top_k
)

Features

  • #205: Added vagrant setup
  • #146: Integrated new download and load functions using save_pretrained

Documentation

  • #133: Improved user and developer documentation with additional information

Refactorings

  • #147: Removed token_conn from Prediction UDFs

Security

  • Updated cryptography to >= 42.0.4