Add IPEX models support

[echarlaix]

Add IPEX support to HuggingFacePipeline

from langchain_huggingface import HuggingFacePipeline

hf_pipe = HuggingFacePipeline.from_model_id(
    model_id=model_id,
    task="text-generation",
    backend="ipex",
)

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment

Name	Status	Preview	Comments	Updated (UTC)
langchain	⬜️ Ignored (Inspect)	Visit Preview		Jan 22, 2025 0:10am

[efriis]

hey there! I believe this has come up before, and I think @Jofthomas on the huggingface side had a preference for having some separate packages for openvino (e.g. langchain-openvino or langchain-huggingface-openvino) and ipex

I see your profile indicates you work at huggingface - we have a shared slack channel with you that you could join if you want to discuss!

[echarlaix]

Hi @efriis, thanks for the rapid update! Yes I believe @Jofthomas is planning to work on a refactorization, in the meantime I opened this PR to add IPEX support (+ simplifying the current code a bit as well), let me know if that works for you or if you'd like to wait for the refactorization before adding anything else cc @Jofthomas

[Jofthomas]

Thanks ! The PR LGTM @echarlaix 👍

@efriis, It has been decided otherwise in the meantime. We will indeed enable Intel backend in the HF pipeline directly in this package.

[Jofthomas]

Thanks @echarlaix for this PR.

Seems good to merge @efriis

[echarlaix]

@efriis let me know if you need any additional modifications

[efriis]

sounds good thanks!

[efriis]

Also, if you're interested in maintaining this integration without us in the loop, we'd love to get an integration package out! Future PRs against langchain would just be {docs updates, as well as registering your package in libs/packages.yml, deprecating this community integration in favor of your integration package}

Here's the guide, and if you have questions, feel free to leave them in the comments on those pages so others can see them! https://python.langchain.com/docs/contributing/how_to/integrations/