You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I've built my own container based off DLC (and I've attached the code used to build my own image)
Concise Description:
It doesn't seem that the HuggingFace TGI DLCs support a requirements.txt file? I've tried to upload one with my model package, but it isn't updating the transformers version.
Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
I'm not able to load a model with model.safetensors instead of pytorch_model.bin with the current transformers version
Describe the solution you'd like
I'd like to be able to include a requirements file instead of needing to build a custom image
The text was updated successfully, but these errors were encountered:
Checklist
Concise Description:
It doesn't seem that the HuggingFace TGI DLCs support a
requirements.txt
file? I've tried to upload one with my model package, but it isn't updating the transformers version.DLC image/dockerfile:
763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-inference:2.0-transformers4.28-gpu-py310-cu118-ubuntu20.04
Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
I'm not able to load a model with
model.safetensors
instead ofpytorch_model.bin
with the current transformers versionDescribe the solution you'd like
I'd like to be able to include a requirements file instead of needing to build a custom image
The text was updated successfully, but these errors were encountered: