Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Garbage collector error with make_wiki script #635

Closed
erogol opened this issue Mar 23, 2016 · 5 comments
Closed

Garbage collector error with make_wiki script #635

erogol opened this issue Mar 23, 2016 · 5 comments
Assignees
Labels
bug Issue described a bug

Comments

@erogol
Copy link

erogol commented Mar 23, 2016

I call:

python -m gensim.scripts.make_wiki trwiki-latest-pages-articles.xml.bz2 .

The only difference is I used trwiki dump

Here what I got:

Error when tring to find the memory information on the GPU: initialization error
Error freeing device pointer 0x704b88000 (initialization error). Driver report 0 bytes free and 0 bytes total 
CudaNdarray_uninit: error freeing self->devdata. (self=0x7fc542c1e470, self->devata=0x704b88000)
Exception MemoryError: 'error freeing device pointer 0x704b88000 (initialization error)' in 'garbage collection' ignored
Fatal Python error: unexpected exception during garbage collection
@piskvorky
Copy link
Owner

Oh wow. Wiki processing has nothing to do with CUDA or GPUs, so I'm not sure what this is.

Do you have Theano installed? Is it installed properly? (gensim does import theano in gensim/corpora/sharded_corpus.py, but nothing else)

@erogol
Copy link
Author

erogol commented Mar 24, 2016

yeap theano works fine.

@fredtcaroli
Copy link

fredtcaroli commented Jul 29, 2016

I had the same problem here. What I did to fix was disable the gpu.
On your case, you should run the script like so:

THEANO_FLAGS=device=cpu python -m gensim.scripts.make_wiki trwiki-latest-pages-articles.xml.bz2 .

@piskvorky piskvorky added the bug Issue described a bug label Jul 30, 2016
@piskvorky
Copy link
Owner

@tmylk this is issue #696 (comment) again -- fixing urgent.

@tmylk
Copy link
Contributor

tmylk commented Oct 6, 2016

Fixed in #919

@tmylk tmylk closed this as completed Oct 6, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Issue described a bug
Projects
None yet
Development

No branches or pull requests

4 participants