DEV: Remove unused dependencies #4593

Job	Run time
Build & verify package	12s
Check code style issues	46s
pytest on windows	5m 42s
pytest on 3.7 (crypto-lib: cryptography)	3m 42s
pytest on 3.8 (crypto-lib: cryptography)	3m 40s
pytest on 3.9 (crypto-lib: cryptography)	3m 48s
pytest on 3.10 (crypto-lib: cryptography)	3m 50s
pytest on 3.11 (crypto-lib: cryptography)	3m 29s
pytest on 3.12 (crypto-lib: cryptography)	4m 58s
pytest on 3.7 (crypto-lib: pycryptodome)	3m 34s
pytest on 3.7 (crypto-lib: none)	3m 34s
Combine & check coverage.	15s
	37m 30s

Provide feedback