Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

.detach() on bias init #8044

Merged
merged 1 commit into from
May 31, 2022
Merged

.detach() on bias init #8044

merged 1 commit into from
May 31, 2022

Conversation

tcmyxc
Copy link
Contributor

@tcmyxc tcmyxc commented May 30, 2022

make init bias better,
I think detach is more safer than data

πŸ› οΈ PR Summary

Made with ❀️ by Ultralytics Actions

🌟 Summary

Improvement in model bias initialization for object detection.

πŸ“Š Key Changes

  • Changed how bias tensors are manipulated in the YOLO model; now they are detached before updates.
  • Ensured the updated biases are re-wrapped as a parameter, allowing gradient updates.

🎯 Purpose & Impact

  • Purpose: To modify the bias initialization process in a way that is safer for gradient calculations, likely aimed at improving training stability.
  • Impact: These changes should result in more stable and reliable model training performance, but they may require users to update their code if relying on internals of the YOLO model. πŸš€

make init bias better, 
I think `detach` is more safer than `data`
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

πŸ‘‹ Hello @tcmyxc, thank you for submitting a YOLOv5 πŸš€ PR! To allow your work to be integrated as seamlessly as possible, we advise you to:

  • βœ… Verify your PR is up-to-date with upstream/master. If your PR is behind upstream/master an automatic GitHub Actions merge may be attempted by writing /rebase in a new comment, or by running the following code, replacing 'feature' with the name of your local branch:
git remote add upstream https://github.com/ultralytics/yolov5.git
git fetch upstream
# git checkout feature  # <--- replace 'feature' with local branch name
git merge upstream/master
git push -u origin -f
  • βœ… Verify all Continuous Integration (CI) checks are passing.
  • βœ… Reduce changes to the absolute minimum required for your bug fix or feature addition. "It is not daily increase but daily decrease, hack away the unessential. The closer to the source, the less wastage there is." -Bruce Lee

@glenn-jocher glenn-jocher changed the title Update yolo.py .detach() on bias init May 31, 2022
@glenn-jocher glenn-jocher merged commit 50b886d into ultralytics:master May 31, 2022
@glenn-jocher
Copy link
Member

@tcmyxc yes you are right, this method is better! PR is merged. Thank you for your contributions to YOLOv5 πŸš€ and Vision AI ⭐

tdhooghe pushed a commit to tdhooghe/yolov5 that referenced this pull request Jun 10, 2022
make init bias better, 
I think `detach` is more safer than `data`
ctjanuhowski pushed a commit to ctjanuhowski/yolov5 that referenced this pull request Sep 8, 2022
make init bias better, 
I think `detach` is more safer than `data`
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants