Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor syn0 initialization #1799

Closed
wants to merge 1 commit into from
Closed

refactor syn0 initialization #1799

wants to merge 1 commit into from

Conversation

stegben
Copy link

@stegben stegben commented Dec 19, 2017

I slightly refactor the initialization of syn0 of KeyedVectors in order to support memmap in the future (if possible).

@stegben
Copy link
Author

stegben commented Dec 19, 2017

Any suggestion or roadmap for supporting memmap?

@menshikh-iv
Copy link
Contributor

menshikh-iv commented Dec 19, 2017

@stegben can you add more motivation, why this needed / useful (link to related issues if exists)?

@gojomo
Copy link
Collaborator

gojomo commented Dec 20, 2017

Note that there's some bigger refactoring on the way via #1777, which may change the name of syn0 (a holdover from the class's origin inside W2V NN models).

@menshikh-iv
Copy link
Contributor

Thanks for reminder @gojomo, so, I think we should merge #1777 first (in any case).

About this PR - I'm waiting additional comments from @stegben

@menshikh-iv
Copy link
Contributor

ping @stegben

@menshikh-iv
Copy link
Contributor

I close this PR because it looks abadoned.

@piskvorky
Copy link
Owner

Needs better motivation / use-case description. Whom does this help and how?

AFAICS, memmap doesn't help if syn0 is larger than RAM because of constant swapping. And if it's smaller than RAM, what's the point?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants