bug: rengine_celery-beat_1 stop working after few second #971

zinwelzl · 2023-10-09T08:43:20Z

Is there an existing issue for this?

I have searched the existing issues

Current Behavior

rengine_celery-beat_1 stop working after few second
or don't start

Expected Behavior

rengine_celery-beat_1

Steps To Reproduce

kali os

Environment

- reNgine: 2
- OS: kali
- Python: Python 3.9.2
- Docker Engine: 20.10.5+dfsg1
- Docker Compose: 2.22.0
- Browser: Chromium

Anything else?

No response

github-actions · 2023-10-09T08:43:32Z

👋 Hi @zinwelzl,
Issues is only for reporting a bug/feature request. Please read documentation before raising an issue https://rengine.wiki
For very limited support, questions, and discussions, please join reNgine Discord channel: https://discord.gg/azv6fzhNCE
Please include all the requested and relevant information when opening a bug report. Improper reports will be closed without any response.

cezarq · 2023-10-15T13:16:44Z

I am facing the same issue.

Environment:

- reNgine: 2.0.0
- OS: Ubuntu 23.04
- Python: Python 3.10
- Docker version 24.0.6, build ed223bc
- Docker Compose version v2.5.0
- Browser: Firefox

Current error

  File "/usr/local/lib/python3.10/dist-packages/click/decorators.py", line 33, in new_func

    return f(get_current_context(), *args, **kwargs)

  File "/usr/local/lib/python3.10/dist-packages/celery/bin/base.py", line 134, in caller

    return f(ctx, *args, **kwargs)

  File "/usr/local/lib/python3.10/dist-packages/celery/bin/beat.py", line 72, in beat

    return beat().run()

  File "/usr/local/lib/python3.10/dist-packages/celery/apps/beat.py", line 84, in run

    self.start_scheduler()

  File "/usr/local/lib/python3.10/dist-packages/celery/apps/beat.py", line 113, in start_scheduler

    service.start()

  File "/usr/local/lib/python3.10/dist-packages/celery/beat.py", line 634, in start

    humanize_seconds(self.scheduler.max_interval))

  File "/usr/local/lib/python3.10/dist-packages/kombu/utils/objects.py", line 31, in __get__

    return super().__get__(instance, owner)

  File "/usr/lib/python3.10/functools.py", line 981, in __get__

    val = self.func(instance)

  File "/usr/local/lib/python3.10/dist-packages/celery/beat.py", line 677, in scheduler

    return self.get_scheduler()

  File "/usr/local/lib/python3.10/dist-packages/celery/beat.py", line 668, in get_scheduler

    return symbol_by_name(self.scheduler_cls, aliases=aliases)(

  File "/usr/local/lib/python3.10/dist-packages/django_celery_beat/schedulers.py", line 231, in __init__

    Scheduler.__init__(self, *args, **kwargs)

  File "/usr/local/lib/python3.10/dist-packages/celery/beat.py", line 264, in __init__

    self.setup_schedule()

  File "/usr/local/lib/python3.10/dist-packages/django_celery_beat/schedulers.py", line 239, in setup_schedule

    self.install_default_entries(self.schedule)

  File "/usr/local/lib/python3.10/dist-packages/django_celery_beat/schedulers.py", line 361, in schedule

    self._schedule = self.all_as_schedule()

  File "/usr/local/lib/python3.10/dist-packages/django_celery_beat/schedulers.py", line 247, in all_as_schedule

    s[model.name] = self.Entry(model, app=self.app)

  File "/usr/local/lib/python3.10/dist-packages/django_celery_beat/schedulers.py", line 93, in __init__

    model.last_run_at = self._default_now()

  File "/usr/local/lib/python3.10/dist-packages/django_celery_beat/schedulers.py", line 143, in _default_now

    now = now.tzinfo.localize(now.replace(tzinfo=None))

AttributeError: 'zoneinfo.ZoneInfo' object has no attribute 'localize'

AnonymousWP · 2023-10-15T17:28:16Z

Did you upgrade from 1.3.6? If so, consider performing a clean install of 2.0.0.

cezarq · 2023-10-15T18:10:14Z

I deleted my 1.3.6 version and deploy a clean install of 2.0.0.

cezarq · 2023-10-15T18:24:03Z

I am also getting the error "Server Error (500)" in some pages, for instance to save the report settings

[15/Oct/2023:18:19:15 +0000] "GET /api/scan_status/?project=default HTTP/1.1" 200 12874 "https://rengine.site.com/scanEngine/default/report_settings" "Mozilla/5.0 (X11; Linux x86_64; rv:109.0) Gecko/20100101 Firefox/118.0" "xxx.xxx.xxx.xxx"

[15/Oct/2023:18:19:31 +0000] "POST /scanEngine/default/report_settings HTTP/1.1" 500 145 "https://rengine.site.com/scanEngine/default/report_settings" "Mozilla/5.0 (X11; Linux x86_64; rv:109.0) Gecko/20100101 Firefox/118.0" "xxx.xxx.xxx.xxx"

[15/Oct/2023:18:19:31 +0000] "GET /favicon.ico HTTP/1.1" 500 145 "https://rengine.site.com/scanEngine/default/report_settings" "Mozilla/5.0 (X11; Linux x86_64; rv:109.0) Gecko/20100101 Firefox/118.0" "xxx.xxx.xxx.xxx"

AnonymousWP · 2023-10-15T19:08:39Z

I don't have the zoneinfo.ZoneInfo' object has no attribute 'localize' error at all on 2.0.0. Installs and works fine for me.

cezarq · 2023-10-15T19:24:26Z

Thank you man, but do you suggest anything to solve the issue or any test to run, please?

AnonymousWP · 2023-10-15T19:51:33Z

I can reproduce the issue and it seems like it's related to the favicon missing:

Maybe it doesn't accept ico file extensions? Actually, in fact the entire favicon doesn't seem te exist on the current path.

Maybe it's related to @psyray's commit? d668985

psyray · 2023-10-16T11:40:51Z

Maybe it's related to @psyray's commit? d668985

Can't see why it could be related to my commit without the full error 500 details

psyray · 2023-10-16T14:10:15Z

I did a fresh install of a 2.0 and it's working well, favicon is loading correctly

AnonymousWP · 2023-10-16T14:17:31Z

I did a fresh install of a 2.0 and it's working well, favicon is loading correctly

Huh, that's weird, I did a fresh install too. Which pages did you try to access? Tried editing the report_settings and submitted to save? That

psyray · 2023-10-16T14:37:35Z

I did a fresh install of a 2.0 and it's working well, favicon is loading correctly

Huh, that's weird, I did a fresh install too. Which pages did you try to access? Tried editing the report_settings and submitted to save? That

Did you remove all the docker volumes ?
If you don't remove them, install is not fresh.
But warning it erases all datas

psyray · 2023-10-16T14:41:28Z

File "/usr/local/lib/python3.10/dist-packages/django_celery_beat/schedulers.py", line 143, in _default_now
now = now.tzinfo.localize(now.replace(tzinfo=None))
AttributeError: 'zoneinfo.ZoneInfo' object has no attribute 'localize'

I confirm this error too and celery_beat exit on a fresh install
I'm trying to investigate

psyray · 2023-10-16T14:48:28Z

Seems this issue should be related
celery/django-celery-beat#668

psyray · 2023-10-16T15:14:42Z

@yogeshojha I think django celery beat is too old and need to be updated to be compatible with python 3.10
Version used in the docker container seems to be v2.2.1 according to this piece of code which is 2 years old !!!
https://github.com/celery/django-celery-beat/blob/a979d0a6a32e56e116a3fddaacd0d03ea79d0960/django_celery_beat/schedulers.py#L143C8-L143C64

And there is an update for Django 4.0 and python 3.10 in the v2.3.0
https://github.com/celery/django-celery-beat/blob/v2.3.0/django_celery_beat/schedulers.py

psyray · 2023-10-16T15:32:24Z

As a workaround with this buggy version, to make celery-beat container start and scheduler works, just add the DJANGO_CELERY_BEAT_TZ_AWARE = False settings to the web/reNgine/settings.py and do a docker-compose start celery-beat and it should work.
But your time zone will be UTC

AnonymousWP · 2023-10-18T12:25:06Z

I did a fresh install of a 2.0 and it's working well, favicon is loading correctly

Huh, that's weird, I did a fresh install too. Which pages did you try to access? Tried editing the report_settings and submitted to save? That

Did you remove all the docker volumes ? If you don't remove them, install is not fresh. But warning it erases all datas

Of course, that's what I even explicitly implemented within my fork (it also asks what you want to remove).

psyray mentioned this issue Oct 16, 2023

Schedule Scan Page not Found #982

Closed

1 task

This was referenced Oct 16, 2023

Proxy container display certificate error #766

Closed

bug: Scans hanging in "Pending" state #989

Closed

psyray mentioned this issue Oct 22, 2023

bug: Bad Gateway after a few requests on fresh install #1009

Closed

1 task

zinwelzl closed this as completed Nov 16, 2023

psyray mentioned this issue Nov 23, 2023

Temporary fix to prevent celery beat crash #1072

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

bug: rengine_celery-beat_1 stop working after few second #971

bug: rengine_celery-beat_1 stop working after few second #971

zinwelzl commented Oct 9, 2023

github-actions bot commented Oct 9, 2023

cezarq commented Oct 15, 2023

AnonymousWP commented Oct 15, 2023

cezarq commented Oct 15, 2023

cezarq commented Oct 15, 2023

AnonymousWP commented Oct 15, 2023

cezarq commented Oct 15, 2023

AnonymousWP commented Oct 15, 2023 •

edited

Loading

psyray commented Oct 16, 2023

psyray commented Oct 16, 2023

AnonymousWP commented Oct 16, 2023

psyray commented Oct 16, 2023 •

edited

Loading

psyray commented Oct 16, 2023 •

edited

Loading

psyray commented Oct 16, 2023

psyray commented Oct 16, 2023 •

edited

Loading

psyray commented Oct 16, 2023

AnonymousWP commented Oct 18, 2023

bug: rengine_celery-beat_1 stop working after few second #971

bug: rengine_celery-beat_1 stop working after few second #971

Comments

zinwelzl commented Oct 9, 2023

Is there an existing issue for this?

Current Behavior

Expected Behavior

Steps To Reproduce

Environment

Anything else?

github-actions bot commented Oct 9, 2023

cezarq commented Oct 15, 2023

AnonymousWP commented Oct 15, 2023

cezarq commented Oct 15, 2023

cezarq commented Oct 15, 2023

AnonymousWP commented Oct 15, 2023

cezarq commented Oct 15, 2023

AnonymousWP commented Oct 15, 2023 • edited Loading

psyray commented Oct 16, 2023

psyray commented Oct 16, 2023

AnonymousWP commented Oct 16, 2023

psyray commented Oct 16, 2023 • edited Loading

psyray commented Oct 16, 2023 • edited Loading

psyray commented Oct 16, 2023

psyray commented Oct 16, 2023 • edited Loading

psyray commented Oct 16, 2023

AnonymousWP commented Oct 18, 2023

AnonymousWP commented Oct 15, 2023 •

edited

Loading

psyray commented Oct 16, 2023 •

edited

Loading

psyray commented Oct 16, 2023 •

edited

Loading

psyray commented Oct 16, 2023 •

edited

Loading