Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Build] [On-device-training] Running onnxruntime-training (CPU) Python Demo on Debian 12 aarch64 Environment #22270

Open
Leo5050xvjf opened this issue Sep 30, 2024 · 1 comment
Labels
ep:RockchipNPU issues related to Rockchip execution provider stale issues that have not been addressed in a while; categorized by a bot training issues related to ONNX Runtime training; typically submitted using template

Comments

@Leo5050xvjf
Copy link

Leo5050xvjf commented Sep 30, 2024

Describe the issue

Env:

  • RK3576: Debian 12 aarch64, CPU only
  • PC : Ubuntu20.04, x86

Ram

  • 8GB

Description:
Hello,

  1. I am currently working with the onnxruntime-training demo, which I've successfully run on my PC and on Colab using Python, achieving satisfactory results. Now, I wish to deploy this project on my development board, a Rockchip RK3576. However, I've encountered an issue where I can't directly install the necessary packages via:

pip install onnxruntime
pip install onnxruntime-training

It appears that PyPI does not offer pre-compiled packages for my development board's environment. After some research, I found the following pre-compiled packages at this release page: https://github.com/Microsoft/onnxruntime/releases/tag/v1.19.2. I believe the files I need are:

  • onnxruntime-linux-aarch64-1.19.2.tgz

  • onnxruntime-training-linux-aarch64-1.19.2.tgz

Is my understanding correct?

  1. As I am new to this, I'm unsure how to use these .tgz files with Python after downloading. Can the project only be invoked via C/C++, or is there a way to utilize these with Python?

  2. Can I perform On-Device Training (CPU Only) using Python or C/C++ on Debian 12, arm64? Are there any example codes for ONNX Runtime training in C/C++? I have not found any relevant information so far, only Python code.

Thank you!
I look forward to your response, thank you!

Urgency

Yes, this issue is quite urgent for me as it affects my current work progress. I hope to receive a response as soon as possible so that I can continue advancing my project. Thank you for your understanding and support!

Target platform

aarch64

Build script

None

Error / output

None

Visual Studio Version

No response

GCC / Compiler Version

No response

@Leo5050xvjf Leo5050xvjf added the build build issues; typically submitted using template label Sep 30, 2024
@github-actions github-actions bot added the ep:RockchipNPU issues related to Rockchip execution provider label Sep 30, 2024
@Leo5050xvjf Leo5050xvjf changed the title [Build] Running onnxruntime-training (CPU) Python Demo on Debian 12 aarch64 Environment [Build] [On-device-training] Running onnxruntime-training (CPU) Python Demo on Debian 12 aarch64 Environment Sep 30, 2024
@snnn snnn added training issues related to ONNX Runtime training; typically submitted using template and removed build build issues; typically submitted using template labels Oct 10, 2024
Copy link
Contributor

This issue has been automatically marked as stale due to inactivity and will be closed in 30 days if no further activity occurs. If further support is needed, please provide an update and/or more details.

@github-actions github-actions bot added the stale issues that have not been addressed in a while; categorized by a bot label Nov 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:RockchipNPU issues related to Rockchip execution provider stale issues that have not been addressed in a while; categorized by a bot training issues related to ONNX Runtime training; typically submitted using template
Projects
None yet
Development

No branches or pull requests

2 participants