Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update dependency transformers to ~=4.30.2 #72

Merged
merged 1 commit into from
Jun 28, 2023
Merged

Update dependency transformers to ~=4.30.2 #72

merged 1 commit into from
Jun 28, 2023

Conversation

renovate[bot]
Copy link
Contributor

@renovate renovate bot commented Jun 8, 2023 •
edited
Loading

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
transformers ~=4.29.2 -> ~=4.30.2 age adoption passing confidence

Release Notes

huggingface/transformers

v4.30.2: : Patch release

Compare Source

v4.30.1: Patch release

Compare Source

v4.30.0: : 100k, Agents improvements, Safetensors core dependency, Swiftformer, Autoformer, MobileViTv2, timm-as-a-backbone

Compare Source

100k

Transformers has just reached 100k stars on GitHub, and to celebrate we wanted to highlight 100 projects in the vicinity of transformers and we have decided to create an awesome-transformers page to do just that.

We accept PRs to add projects to the list!

4-bit quantization and QLoRA

By leveraging the bitsandbytes library by @​TimDettmers, we add 4-bit support to transformers models!

Agents

The Agents framework has been improved and continues to be stabilized. Among bug fixes, here are the important new features that were added:

  • Local agent capabilities, to load a generative model directly from transformers instead of relying on APIs.
  • Prompts are now hosted on the Hub, which means that anyone can fork the prompts and update them with theirs, to let other community contributors re-use them
  • We add an AzureOpenAiAgent class to support Azure OpenAI agents.

Safetensors

The safetensors library is a safe serialization framework for machine learning tensors. It has been audited and will become the default serialization framework for several organizations (Hugging Face, EleutherAI, Stability AI).

It has now become a core dependency of transformers.

New models

Swiftformer

The SwiftFormer paper introduces a novel efficient additive attention mechanism that effectively replaces the quadratic matrix multiplication operations in the self-attention computation with linear element-wise multiplications. A series of models called ‘SwiftFormer’ is built based on this, which achieves state-of-the-art performance in terms of both accuracy and mobile inference speed. Even their small variant achieves 78.5% top-1 ImageNet1K accuracy with only 0.8 ms latency on iPhone 14, which is more accurate and 2× faster compared to MobileViT-v2.

Autoformer

This model augments the Transformer as a deep decomposition architecture, which can progressively decompose the trend and seasonal components during the forecasting process.

MobileViTv2

MobileViTV2 is the second version of MobileViT, constructed by replacing the multi-headed self-attention in MobileViT with separable self-attention.

PerSAM

PerSAM proposes a minimal modification to SAM to allow dreambooth-like personalization, enabling to segment concepts in new images using just one example.

Timm backbone

We add support for loading timm weights within the AutoBackbone API in transformers. timm models can be instantiated through the TimmBackbone class, and then used with any vision model that needs a backbone.

Image to text pipeline conditional support

We add conditional text generation to the image to text pipeline; allowing the model to continue generating an initial text prompt according to an image.

TensorFlow implementations

Accelerate Migration

A major rework of the internals of the Trainer is underway, leveraging accelerate instead of redefining them in transformers. This should unify both framework and lead to increased interoperability and more efficient development.

Bugfixes and improvements

Significant community contributions

The following contributors have made significant changes to the library over the last release:

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

  • If you want to rebase/retry this PR, check this box

This PR has been generated by Mend Renovate. View repository job log here.

@renovate renovate bot force-pushed the renovate/transformers-4.x branch from 61e90ca to f9a5bd1 Compare June 9, 2023 17:20
@renovate renovate bot changed the title Update dependency transformers to ~=4.30.0 Update dependency transformers to ~=4.30.1 Jun 9, 2023
@renovate renovate bot force-pushed the renovate/transformers-4.x branch from f9a5bd1 to a8471bf Compare June 13, 2023 20:29
@renovate renovate bot changed the title Update dependency transformers to ~=4.30.1 Update dependency transformers to ~=4.30.2 Jun 13, 2023
@renovate renovate bot force-pushed the renovate/transformers-4.x branch from a8471bf to 2451dc0 Compare June 27, 2023 18:51
@renovate renovate bot force-pushed the renovate/transformers-4.x branch from 2451dc0 to d08e080 Compare June 28, 2023 01:37
@gerred gerred merged commit bf47cb3 into main Jun 28, 2023
@gerred gerred deleted the renovate/transformers-4.x branch June 28, 2023 01:39
andrewrisse pushed a commit that referenced this pull request Apr 18, 2024
@gerred
Merge pull request #72 from defenseunicorns/renovate/transformers-4.x
7877123 
Update dependency transformers to ~=4.30.2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@gerred gerred gerred approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@gerred