⬆️ Maintenance/week 05: test and tooling libs

[pcrespov]

What do these changes do?

• Updates ONLY test and tooling dependencies repo-wide.
• New table that highlights major & minor upgrades
  • highlights major upgraded libraries
  • spots how this upgrade unifies versions repo-wide ( see many before -> one after)

@GitHK we have to discuss about how to upgrade constraints more reliably since now many of the services upgrades are blocked because upstream constraints were not enforced downstream.

Summary

NOTE that all these libraries are used for testing or tools. Those upgraded from service base requirements are marked with * (this is sometimes necesssary because previous commits with changes in uppermost constraints were not enforced downstream and therefore test upgrades are block by some frozen version sin the base.txt)

• #packages before: 68
• #packages after : 66 (2 removed)

#	name	before	after	upgrade
1	aio-pika	6.8.0	6.8.2
2	aiodebug	1.1.2	2.3.0	MAJOR
3	aioresponses	0.7.2	0.7.3
4	alembic	1.7.5	1.7.6
5	anyio	3.4.0, 3.3.4	3.5.0	minor
6	astroid	2.9.0	2.9.3
7	async-asgi-testclient	1.4.7	1.4.9
8	async-timeout	4.0.1	4.0.2
9	attrs	21.2.0	21.4.0	minor
10	black	21.12	22.1.0	MAJOR
11	charset-normalizer	2.0.8, 2.0.7, 2.0.10	2.0.11
12*	click	7.1.2	8.0.3	MAJOR
13	coverage	6.1.2	6.3.1	minor
14	cryptography	36.0.0	36.0.1
15	dask	2021.12.0	2022.1.1	MAJOR
16	distlib	0.3.3	0.3.4
17	distributed	2021.12.0	2022.1.1	MAJOR
18	dnspython	2.1.0	2.2.0	minor
19	faker	9.8.3	12.1.0	MAJOR
20	fastapi	0.70.0, 0.71.0	0.73.0	minor
21	filelock	3.4.0	3.4.2
22	frozenlist	1.2.0	1.3.0	minor
23	fsspec	2021.11.0	2022.1.0	MAJOR
24	httpcore	0.14.3	0.14.7
25	httpx	0.21.3	0.22.0	minor
26	identify	2.4.0	2.4.9
27	importlib-metadata	4.8.2	4.10.1	minor
28	isodate	0.6.0	0.6.1
29	jsonschema	4.2.1	4.4.0	minor
30	lazy-object-proxy	1.6.0	1.7.1	minor
31	multidict	5.2.0	6.0.2	MAJOR
32	mypy	0.910	0.931	minor
33	openapi-schema-validator	0.1.5	0.2.3	minor
34	openapi-spec-validator	0.3.1	0.4.0	minor
35	paramiko	2.8.0	2.9.2	minor
36	pip-tools	6.4.0	6.5.1	minor
37	platformdirs	2.4.0	2.5.0	minor
38	pre-commit	2.15.0	2.17.0	minor
39	prometheus-client	0.12.0	0.13.1	minor
40	psutil	5.8.0	5.9.0	minor
41	psycopg2-binary	2.9.2	2.9.3
42	pylint	2.12.1	2.12.2
43	pynacl	1.4.0	1.5.0	minor
44	pyopenssl	21.0.0	22.0.0	MAJOR
45	pyparsing	3.0.6	3.0.7
46	pyrsistent	0.18.0	0.18.1
47	pytest	6.2.5	7.0.0	MAJOR
48	pytest-aiohttp	0.3.0	1.0.3	MAJOR
49	pytest-asyncio	0.16.0	0.18.0	minor
50	pytest-forked	1.3.0	1.4.0	minor
51	pytest-mock	3.6.1	3.7.0	minor
52	pytest-xdist	2.4.0	2.5.0	minor
53	requests	2.26.0	2.27.1	minor
54	respx	0.19.1	0.19.2
55	sqlalchemy	1.4.27	1.4.31
56	starlette	0.16.0	0.17.1	minor
57	text-unidecode	1.3	removed
58	toml	0.10.2	removed
59	tomli	1.2.2	1.2.3
60	types-aiofiles	0.8.2	0.8.3
61	types-pyyaml	6.0.1	6.0.4
62	typing-extensions	4.0.0	4.0.1
63	urllib3	1.26.7	1.26.8
64	virtualenv	20.10.0	20.13.1	minor
65	websocket-client	1.2.1	1.2.3
66	werkzeug	2.0.2	2.0.3
67	wheel	0.37.0	0.37.1
68	zipp	3.6.0	3.7.0	minor

Related issue/s

weekly maintenance of test and tooling libraries

How to test

all tests

Checklist

• Openapi changes? make openapi-specs, git commit ... and then make version-*)
• Database migration script? cd packages/postgres-database, make setup-commit, sc-pg review -m "my changes"
• Unit tests for the changes exist
• Runs in the swarm
• Documentation reflects the changes
• New module? Add your github username to .github/CODEOWNERS

[codecov]

Codecov Report

Merging #2809 (f3fad27) into master (441542e) will increase coverage by 0.0%.
The diff coverage is n/a.

@@           Coverage Diff           @@
##           master   #2809    +/-   ##
=======================================
  Coverage    78.9%   78.9%            
=======================================
  Files         670     670            
  Lines       27236   27236            
  Branches     2678    3141   +463     
=======================================
+ Hits        21495   21497     +2     
- Misses       4981    4985     +4     
+ Partials      760     754     -6     

Flag	Coverage Δ
integrationtests	65.9% <ø> (+<0.1%)	⬆️
unittests	74.4% <ø> (-0.1%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
...c/simcore_service_catalog/core/background_tasks.py	68.0% <0.0%> (-12.8%)	⬇️
...imcore_service_catalog/db/repositories/projects.py	41.6% <0.0%> (-12.5%)	⬇️
...ce_webserver/resource_manager/garbage_collector.py	72.7% <0.0%> (-0.9%)	⬇️
...car/src/simcore_service_dask_sidecar/dask_utils.py	90.7% <0.0%> (ø)
...ector_v2/modules/dynamic_sidecar/scheduler/task.py	86.4% <0.0%> (+0.5%)	⬆️
...simcore_service_director_v2/modules/dask_client.py	82.6% <0.0%> (+0.6%)	⬆️
...tor_v2/modules/dynamic_sidecar/scheduler/events.py	95.8% <0.0%> (+1.1%)	⬆️
.../director/src/simcore_service_director/producer.py	63.1% <0.0%> (+1.2%)	⬆️
...ore_service_director_v2/api/routes/computations.py	82.7% <0.0%> (+2.5%)	⬆️
...rvice_datcore_adapter/utils/requests_decorators.py	78.9% <0.0%> (+7.8%)	⬆️
... and 1 more

[mguidon]

Very nice table!

[GitHK]

Let's have a discussion about what constraint removal will bring more benefits.