Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add check of softmax result, and make them no less than std::numeric_limits<>::min(); #3

Merged
merged 1 commit into from
Jul 20, 2017

Conversation

Xreki
Copy link

@Xreki Xreki commented Jul 18, 2017

No description provided.

@gangliao gangliao merged commit 0a60ee5 into gangliao:master Jul 20, 2017
@xinghai-sun
Copy link

xinghai-sun commented Jul 20, 2017

I'm afraid "truncation" is not the best way to avoid this numerical instability problem, as log(exp(x)) is actually x. Truncation might introduce unnecessary bias.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants