Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[🐛BUG] Waiting time for 1st epoch #627

Closed
mayaKaplansky opened this issue Dec 28, 2020 · 3 comments
Closed

[🐛BUG] Waiting time for 1st epoch #627

mayaKaplansky opened this issue Dec 28, 2020 · 3 comments
Labels
question Further information is requested

Comments

@mayaKaplansky
Copy link

Hi
My inter file has almost 8M lines.
How much time is it reasonable to wait at this stage:
image

I did check on a smaller file and it worked.
How can I configure to use more than one GPU?
Should I increase the log level in some way?

thanks!

@mayaKaplansky mayaKaplansky added the bug Something isn't working label Dec 28, 2020
@mayaKaplansky
Copy link
Author

Hi,
after more than 40 minutes I got the first epoch:
image

I checked and my server has 2 GPUs of NVIDIA Tesla M60. Should I run this on Tesla K80?
How can I configure REcBole to use 2 GPUs?
Thanks!

@2017pxy 2017pxy added enhancement New feature or request and removed bug Something isn't working labels Dec 29, 2020
@hyp1231
Copy link
Member

hyp1231 commented Dec 30, 2020

Hi,

@mayaKaplansky
Copy link
Author

Thank you very much, I replaced my machine to NVIDIA Tesla T4, and eventually it finished running :)

@Sherry-XLL Sherry-XLL added time/memory cost question Further information is requested and removed enhancement New feature or request labels Feb 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

4 participants