Enhancement: Use HTTP 2.0 for OpenAI requests

[Manouchehri]

What features would you like to see added?

Should hopefully improve perf slightly. Right now requests to my LiteLLM (aka custom OpenAI API) endpoint are all HTTP/1.1 from what I see. =)

More details

See BerriAI/litellm#3533 (comment) for example code in Python. Not entirely sure how to do it with node.

Which components are impacted by your request?

General, Endpoints

Pictures

No response

Code of Conduct

• I agree to follow this project's Code of Conduct

[Manouchehri]

See openai/openai-node#392 (comment) for more info.

[Manouchehri]

https://github.com/openai/openai-node?tab=readme-ov-file#customizing-the-fetch-client

[danny-avila]

https://github.com/openai/openai-node?tab=readme-ov-file#customizing-the-fetch-client

gotcha that's an easy implementation, thanks!

[Manouchehri]

Thanks! Should I be seeing this working in https://github.com/danny-avila/LibreChat/pkgs/container/librechat-dev-api/229754456?tag=4416f69a9b299c03dd947e52a033af202672597d? It looks like requests are still HTTP/1.1 for me, but I might be doing something wrong. :)

[danny-avila]

@Manouchehri I see, there's a little more to configure to enable h2 by default

nodejs/undici#399
nodejs/undici#2750