Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve extreme batch visualization callbacks #1488

Merged
merged 7 commits into from
Oct 3, 2023

Conversation

BloodAxe
Copy link
Contributor

  • Allow user to control whether to run on train and/or validation loaders
  • Allow to control maximum number of logged images
  • Store extreme batch on CPU
  • OD visualization of batches changed to render side-by-side (pred-gt) images per image (This is mainly to allow easy understanding in W&B since old implementation was showing whole plot of GT batch first, then you had to scroll down to see Pred batch and go up and down to compare prediction for certain sample => not convinient)

Louis-Dupont
Louis-Dupont previously approved these changes Sep 26, 2023
Copy link
Contributor

@Louis-Dupont Louis-Dupont left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, just 1 small doc note. But I think it would be nice having @shaydeci having a look since he wrote the original code he might have deeper insights.

src/super_gradients/training/utils/callbacks/callbacks.py Outdated Show resolved Hide resolved
src/super_gradients/training/utils/callbacks/callbacks.py Outdated Show resolved Hide resolved
Copy link
Contributor

@shaydeci shaydeci left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not quite sure why we moved to channels last...
Did we check everything works well with WandB and default SG Logger and pictures make sense?
Also, would be great if you can add additional tests covering the train loader end cases in our tests.unit_tests.extreme_batch_cb_test.ExtremeBatchSanityTest test

Copy link
Contributor

@shaydeci shaydeci left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@BloodAxe BloodAxe merged commit f873fcb into master Oct 3, 2023
3 checks passed
@BloodAxe BloodAxe deleted the feature/SG-000-improve-visualization-callback branch October 3, 2023 12:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants