Skip to content

Commit

Permalink
Update 7c-OOD-detection-energy.md
Browse files Browse the repository at this point in the history
  • Loading branch information
qualiaMachine authored Dec 20, 2024
1 parent 71d5e10 commit 49ff42f
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion episodes/7c-OOD-detection-energy.md
Original file line number Diff line number Diff line change
Expand Up @@ -61,6 +61,7 @@ Here:
The exponential relationship ensures that even small differences in energy values translate to significant changes in probability.

If your stakeholders or downstream tasks require interpretable confidence scores, a Gibbs-based probability might make the thresholding process more understandable and adaptable. However, the raw energy scores can be more sensitive to OOD data since they do not compress their values between 0 and 1.

### 3. Why energy works better than softmax

Softmax probabilities are computed as:
Expand Down Expand Up @@ -527,4 +528,4 @@ The energy-based approach for out-of-distribution (OOD) detection has several st
- While energy-based methods excel in many scenarios, challenges include tuning thresholds across diverse OOD classes and ensuring generalizability to unseen distributions.
- Transitioning to energy-based detection lays the groundwork for exploring training-time regularization and hybrid approaches.

::::::::::::::::::::::::::::::::::::::::::::::::::
::::::::::::::::::::::::::::::::::::::::::::::::::

0 comments on commit 49ff42f

Please sign in to comment.