Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[bugfix] remove erroneous signed param from SAE layer config #47

Merged
merged 2 commits into from
Sep 29, 2024

Conversation

mloef
Copy link
Contributor

@mloef mloef commented Aug 23, 2024

eleuther's SAE library removed the signed param: https://github.com/EleutherAI/sae/pull/23/files#diff-6c69aa3bdde2eab407068f120a5b3eb62e26242fcbccb190a11df2d0dc3aa03bR24

but it's still present in the config files on huggingface. Loading the config with this param doesn't work, so just delete it.

@vgel vgel merged commit ccb89f5 into vgel:sae Sep 29, 2024
@vgel
Copy link
Owner

vgel commented Sep 29, 2024

thank you! sorry for the delay getting this merged

vgel added a commit that referenced this pull request Sep 29, 2024
* prototype sae support

* fix path

* convert to float always

* fix index handling

* dtype conversion

* fix dtype

* add sae notebook

* [bugfix] remove erroneous signed param from SAE layer config (#47)

* remove signed param from SAE layer ocnfig

* handle key missing + fmt

---------

Co-authored-by: Theia Vogel <[email protected]>

---------

Co-authored-by: Max Loeffler <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants