Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Synapse: fix the build and reduce logging noise #1334

Merged
merged 4 commits into from
Mar 2, 2023

Conversation

DMRobertson
Copy link
Contributor

a42e75a origin/dmr/sytest-tweaks Limit number of haproxy connections

Suppresses big scary warnings of the form

WARN: server process exited 1
[server]: [NOTICE]   (2457) : haproxy version is 2.6.7-1
[server]: [NOTICE]   (2457) : path to executable is /usr/sbin/haproxy
[server]: [ALERT]    (2457) : Not enough memory to allocate 1073741815 entries for fdtab!
[server]: [ALERT]    (2457) : No polling mechanism available.
[server]:   It is likely that haproxy was built with TARGET=generic and that FD_SETSIZE
[server]:   is too low on this platform to support maxconn and the number of listeners
[server]:   and servers. You should rebuild haproxy specifying your system using TARGET=
[server]:   in order to support other polling systems (poll, epoll, kqueue) or reduce the
[server]:   global maxconn setting to accommodate the system's limitation. For reference,
[server]:   FD_SETSIZE=1024 on this system, global.maxconn=536870884 resulting in a maximum of
[server]:   1073741815 file descriptors. You should thus reduce global.maxconn by 536870396. Also,
[server]:   check build settings using 'haproxy -vv'.
[server]: 
WARN: Error starting server-0: Process died without becoming connectable at tests/05homeserver.pl line 126.
WARN: Aborting test run due to failure to start test server at tests/05homeserver.pl line 130.
WARN: server process exited 1
[server]: [NOTICE]   (2466) : haproxy version is 2.6.7-1
[server]: [NOTICE]   (2466) : path to executable is /usr/sbin/haproxy
[server]: [ALERT]    (2466) : Not enough memory to allocate 1073741815 entries for fdtab!
[server]: [ALERT]    (2466) : No polling mechanism available.
[server]:   It is likely that haproxy was built with TARGET=generic and that FD_SETSIZE
[server]:   is too low on this platform to support maxconn and the number of listeners
[server]:   and servers. You should rebuild haproxy specifying your system using TARGET=
[server]:   in order to support other polling systems (poll, epoll, kqueue) or reduce the
[server]:   global maxconn setting to accommodate the system's limitation. For reference,
[server]:   FD_SETSIZE=1024 on this system, global.maxconn=536870884 resulting in a maximum of
[server]:   1073741815 file descriptors. You should thus reduce global.maxconn by 536870396. Also,
[server]:   check build settings using 'haproxy -vv'.
[server]: 

19046cf Reduce poetry install verbosity

otherwise this means that poetry install tells about every single file
it ignores, which includes loads of guff in .mypy_cache and
.ruff_cache and others

352d0a7 Fix synapse-sytest:testing build

This might break the other builds though, I haven't tested. See e.g. https://github.com/matrix-org/sytest/actions/workflows/docker.yml

David Robertson added 3 commits February 24, 2023 16:00
otherwise this means that `poetry install` tells about every single file
it ignores, which includes loads of guff in `.mypy_cache` and
`.ruff_cache` and others
I don't know the full context, but
haproxy/haproxy#2043 seems to explain what's
going on. The number `2000` was chosen arbitrarily.
@DMRobertson DMRobertson marked this pull request as ready for review February 24, 2023 16:07
@DMRobertson DMRobertson requested a review from a team as a code owner February 24, 2023 16:07
@DMRobertson DMRobertson changed the title Dmr/sytest tweaks Synapse: fix the build and reduce logging noise Feb 27, 2023
@H-Shay
Copy link
Contributor

H-Shay commented Feb 27, 2023

I am unclear if the dendrite failures are expected, or the failures at https://github.com/matrix-org/sytest/actions/workflows/docker.yml?

@DMRobertson
Copy link
Contributor Author

I am unclear if the dendrite failures are expected, or the failures at https://github.com/matrix-org/sytest/actions/workflows/docker.yml?

The dendrite failures are unrelated (and I'll let @matrix-org/dendrite-core fix them up).

I don't recognise the other failures. It looks like debian bookworm (the current testing version) now includes packages for python 3.11 rather than 3.10. I'll see if I can fix that up here.

@DMRobertson DMRobertson merged commit 10bbbc0 into develop Mar 2, 2023
@DMRobertson DMRobertson deleted the dmr/sytest-tweaks branch March 2, 2023 12:26
@DMRobertson
Copy link
Contributor Author

Sigh. It looks like --break-system-packages only exists on the newest Debians.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants