fix(ingest/airflow): simplify env configuration #24162

Job	Run time
setup	26s
Build and Push DataHub GMS Docker Image	0s
Build and Push DataHub MAE Consumer Docker Image	0s
Build and Push DataHub MCE Consumer Docker Image	0s
Build and Push DataHub Upgrade Docker Image	0s
Build and Push DataHub Frontend Docker Image	0s
Build and Push DataHub Kafka Setup Docker Image	0s
Build and Push DataHub MySQL Setup Docker Image	0s
Build and Push DataHub Ingestion (Base) Docker Image	12s
Build and Push DataHub Elasticsearch Setup Docker Image	0s
smoke_test_matrix	2s
[Monitoring] Scan GMS images for vulnerabilities	0s
[Monitoring] Scan MCE consumer images for vulnerabilities	0s
[Monitoring] Scan DataHub Upgrade images for vulnerabilities	0s
[Monitoring] Scan MAE consumer images for vulnerabilities	0s
[Monitoring] Scan Frontend images for vulnerabilities	0s
Build and Push DataHub Ingestion (Base-Slim) Docker Image	10s
Build and Push DataHub Ingestion (Base-Full) Docker Image	9s
Build and Push DataHub Ingestion (Full) Docker Images	8m 12s
Build and Push DataHub Ingestion Docker Images	3m 48s
[Monitoring] Scan Datahub Ingestion Slim images for vulnerabilities	3m 7s
Run Smoke Tests (no_cypress_suite0)	24m 4s
Run Smoke Tests (no_cypress_suite1)	23m 39s
[Monitoring] Scan Datahub Ingestion images for vulnerabilities	4m 58s
Deploy to Datahub HEAD	0s
	1h 8m 47s

Provide feedback