chore: Add ability to configure affinity and tolerations to Helm chart

[bspaans]

Description

(messed up the history trying to sign old commits, so reopening this as a new PR; previously #1119)

What this PR does / why we need it:

The update-crds-hook allows the configuration of affinity and tolerations, but the main deployment does not. This PR adds those fields to the deployment as well. Backwards compatible with current chart.

Which issue(s) this PR fixes (optional, using fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when the PR gets merged):

Fixes #

Type of change

Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to not work as expected)
• Helm Chart Change (any edit/addition/update that is necessary for changes merged to the main branch)
• This change requires a documentation update

How Has This Been Tested?

Please describe the tests that you ran to verify your changes. Please also list any relevant details for your test configuration

• Test A
• Test B

Checklist:

• Does the affected code have corresponding tests?
• Are the changes documented, not just with inline documentation, but also with conceptual documentation such as an overview of a new feature, or task-based documentation like a tutorial? Consider if this change should be announced on your project blog.
• Does this introduce breaking changes that would require an announcement or bumping the major version?
• Do all new files have appropriate license header?

Post Merge Requirements

• MAINTAINERS: manually trigger the "Publish Package" workflow after merging any PR that indicates Helm Chart Change

[codecov]

Codecov Report

All modified lines are covered by tests ✅

Comparison is base (f5eaa99) 52.30% compared to head (ef1b906) 52.30%.

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #1130   +/-   ##
=======================================
  Coverage   52.30%   52.30%           
=======================================
  Files         101      101           
  Lines        6305     6305           
=======================================
  Hits         3298     3298           
  Misses       2688     2688           
  Partials      319      319           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.