-
build onnxruntime with WebGPU
use branch
fs-eire/webgpu-ep
in the root folder of onnxruntime source code, run the following command:
build --config Debug --use_webgpu --build_nodejs --skip_tests
-
make a symbol link to the root folder of ONNX Runtime source code. (assume the source code is in C:\code\onnxruntime)
mklink /D /J onnxruntime C:\code\onnxruntime
-
run
npm install
in the root folder of this project. -
prepare model.
md models\microsoft cd models\microsoft git clone https://huggingface.co/microsoft/Phi-3-mini-4k-instruct-onnx-web
if not working, try this link.
-
run
node .\main.js
to run the sample code.
-
Notifications
You must be signed in to change notification settings - Fork 2
fs-eire/ort-webgpu-nodejs-chatapp-prototype
Folders and files
Name | Name | Last commit message | Last commit date | |
---|---|---|---|---|
Repository files navigation
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published