Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conditionally add OTEL events when processing executor events #43558

Merged
merged 1 commit into from
Oct 31, 2024

Conversation

jedcunningham
Copy link
Member

It's possible that the start/end date are null when processing an executor event, and there is no point in adding an OTEL event in that case.

Before this, we'd try and convert None to nanoseconds and blow up the scheduler.

Note: I don't think queued_dttm can be empty, but figured it didn't hurt to guard against it just in case I've overlooked a way it can be possible.

Closes #42456

It's possible that the start/end date are null when processing an
executor event, and there is no point in adding an OTEL event in that
case.

Before this, we'd try and convert `None` to nanoseconds and blow up the
scheduler.

Note: I don't think `queued_dttm` can be empty, but figured it didn't hurt to
guard against it just in case I've overlooked a way it can be possible.
@boring-cyborg boring-cyborg bot added the area:Scheduler including HA (high availability) scheduler label Oct 31, 2024
@jedcunningham jedcunningham merged commit fe41e15 into apache:main Oct 31, 2024
53 checks passed
@jedcunningham jedcunningham deleted the fix_ol_datetime_conversion branch October 31, 2024 22:34
jedcunningham added a commit to astronomer/airflow that referenced this pull request Oct 31, 2024
…#43558)

It's possible that the start/end date are null when processing an
executor event, and there is no point in adding an OTEL event in that
case.

Before this, we'd try and convert `None` to nanoseconds and blow up the
scheduler.

Note: I don't think `queued_dttm` can be empty, but figured it didn't hurt to
guard against it just in case I've overlooked a way it can be possible.

(cherry picked from commit fe41e15)
@jedcunningham jedcunningham added this to the Airflow 2.10.3 milestone Oct 31, 2024
@jedcunningham jedcunningham added the type:bug-fix Changelog: Bug Fixes label Oct 31, 2024
potiuk pushed a commit that referenced this pull request Oct 31, 2024
#43567)

It's possible that the start/end date are null when processing an
executor event, and there is no point in adding an OTEL event in that
case.

Before this, we'd try and convert `None` to nanoseconds and blow up the
scheduler.

Note: I don't think `queued_dttm` can be empty, but figured it didn't hurt to
guard against it just in case I've overlooked a way it can be possible.

(cherry picked from commit fe41e15)
utkarsharma2 pushed a commit that referenced this pull request Nov 1, 2024
#43567)

It's possible that the start/end date are null when processing an
executor event, and there is no point in adding an OTEL event in that
case.

Before this, we'd try and convert `None` to nanoseconds and blow up the
scheduler.

Note: I don't think `queued_dttm` can be empty, but figured it didn't hurt to
guard against it just in case I've overlooked a way it can be possible.

(cherry picked from commit fe41e15)
(cherry picked from commit c83e524)
utkarsharma2 pushed a commit that referenced this pull request Nov 1, 2024
#43567)

It's possible that the start/end date are null when processing an
executor event, and there is no point in adding an OTEL event in that
case.

Before this, we'd try and convert `None` to nanoseconds and blow up the
scheduler.

Note: I don't think `queued_dttm` can be empty, but figured it didn't hurt to
guard against it just in case I've overlooked a way it can be possible.

(cherry picked from commit fe41e15)
(cherry picked from commit c83e524)
utkarsharma2 pushed a commit that referenced this pull request Nov 1, 2024
#43567)

It's possible that the start/end date are null when processing an
executor event, and there is no point in adding an OTEL event in that
case.

Before this, we'd try and convert `None` to nanoseconds and blow up the
scheduler.

Note: I don't think `queued_dttm` can be empty, but figured it didn't hurt to
guard against it just in case I've overlooked a way it can be possible.

(cherry picked from commit fe41e15)
(cherry picked from commit c83e524)
utkarsharma2 pushed a commit that referenced this pull request Nov 1, 2024
#43567)

It's possible that the start/end date are null when processing an
executor event, and there is no point in adding an OTEL event in that
case.

Before this, we'd try and convert `None` to nanoseconds and blow up the
scheduler.

Note: I don't think `queued_dttm` can be empty, but figured it didn't hurt to
guard against it just in case I've overlooked a way it can be possible.

(cherry picked from commit fe41e15)
(cherry picked from commit c83e524)
ellisms pushed a commit to ellisms/airflow that referenced this pull request Nov 13, 2024
…#43558)

It's possible that the start/end date are null when processing an
executor event, and there is no point in adding an OTEL event in that
case.

Before this, we'd try and convert `None` to nanoseconds and blow up the
scheduler.

Note: I don't think `queued_dttm` can be empty, but figured it didn't hurt to
guard against it just in case I've overlooked a way it can be possible.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:Scheduler including HA (high availability) scheduler type:bug-fix Changelog: Bug Fixes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

OTEL Collector exception scheduler termination
3 participants