WebGPU Support

[okpatil4u]

Any plans to add webgpu support ?

[xenova]

Absolutely! ONNX runtime web is planning to add support for it in April this year (microsoft/onnxruntime#11695), so, when it does, I will be adding support for it!

[okpatil4u]

That's freaking amazing. Waiting for the patch :).

Should I keep this issue open ?

[xenova]

That's freaking amazing. Waiting for the patch :).

Should I keep this issue open ?

I can't wait either haha! I think I can close it for now, but perhaps pin it (since I imagine others will have the same question).

[sanbuphy]

Absolutely! ONNX runtime web is planning to add support for it in April this year (microsoft/onnxruntime#11695), so, when it does, I will be adding support for it!

Thank you very much! love for onnxruntime and you !

[jlia0]

Just a follow up on this, any updates? I noticed there is Web LLM doing similar stuff. Really looking forward to a big boost in speed.

Also, is onnxruntime-node still faster than onnxruntime-web with WebGPU support? 5x speed up sounds too amazing to not be fixed. :(

[xenova]

Hi! Yes, onnxruntime-web merged a PR into main yesterday which adds webgpu support! (see here).

While we wait for a full release, I'll do some local building and testing.

[jozefchutka]

hi @xenova , any promising updates? Is this THE issue to subscribe to to get notified about upcoming release with webgpu ?

[hadnet]

Alright, it's already July 7th, any updates on the progress of this?

[jozefchutka]

this issue is closed, worth to subscribe to #73 and #100