Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable CUDNN download when it's not found at install time #334

Open
szagoruyko opened this issue Feb 20, 2017 · 10 comments · Fixed by #336
Open

Disable CUDNN download when it's not found at install time #334

szagoruyko opened this issue Feb 20, 2017 · 10 comments · Fixed by #336

Comments

@szagoruyko
Copy link
Collaborator

I skimmed through the code and I don't see such option, it tries to download the lib even though it can just be picked up at runtime.

@borisfom
Copy link
Contributor

Option may make sense, however:
What is your exact use-case? Do you have CUDNN installed in location you do not have in your LD_LIBRARY_PATH at the time of install ?

@szagoruyko
Copy link
Collaborator Author

I have it in LD_LIBRARY_PATH, it is not picked up. Solved it by local clone and reverting the PR with new cmake file.

@dasguptar
Copy link

Can this be re-opened?
Even with a local clone of the latest master, it still downloads CUDNN, even though I have CUDNN paths added to my LD_LIBRARY_PATH.

@borisfom
Copy link
Contributor

borisfom commented Mar 1, 2017

Do you have existing CUDNN 5.1 in your LD_LIBRARY_PATH? It works for me. Also, does it do it more than once for you ?

@soumith soumith reopened this Mar 1, 2017
@borisfom
Copy link
Contributor

borisfom commented Mar 1, 2017

@soumith: it's trivial to add an option, and I am not even against it. I am just wondering what the use-case is. How do you know before installing Torch for the first time you actually want this option ?
And once you downloaded it once, it won't do it for this install location anymore - and if the install location is global, then won't ever.

@dasguptar
Copy link

I have CUDNN version 5.1 in my LD_LIBRARY_PATH. Yet it downloads CUDNN again, both when I do luarocks install cudnn, as well as when I do luarocks make from a local clone.
Additionally, it also happens when I change my LD_LIBRARY_PATH to point to CUDNN version 5.0 instead of 5.1 as well.
It does not happen multiple times, since after the first download, the needed files are saved to the torch/install/include/ and torch/install/lib/ folders.

@dasguptar
Copy link

@borisfom @soumith I guess this is fine, as long as a new version of CUDNN does still work on the existing GPU configuration (driver/toolkit/etc.)
But on some older cards, it could be an issue? You guys will know better than me, deferring to your judgement. As of now, the only issue is the mild bother that something existing is being re-downloaded.

@borisfom
Copy link
Contributor

borisfom commented Mar 1, 2017

@dasguptar Older cards won't be an issue. I have put 5.1 requirement in as there were certain important bug fixes and there are no cases where 5.0 would do better.
The original extra download of 5.1 should not have happened, if you had cudnn.h in ../include corresponding to where your 5.1 was - because we look for .so.major only, and the minor is only deduced from the header. I think, I probably should change '5.1' back to '5' to accept whatever CUDNN5 is found.

@soumith
Copy link
Owner

soumith commented Mar 1, 2017

i think one central problem is that torch users dont copy over the header (it's not needed for ffi). That's why maybe downloads are happening. If you only check for the correct .so* file, then it's better.

@borisfom
Copy link
Contributor

borisfom commented Mar 1, 2017

Right, I have changed required version to '5' which would fit both cases - with and without headers.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants