azul2 on ξ‚  issues/dsotirho-ucsc/6620-duos-id ο…Š daniel2.local 🐍 v3.11.10 (.venv) at 12/02 12:15:42 ❯ make auto_deploy ; sleep 60 ; make integration_test ; git status ; git rev-parse HEAD ; date /Library/Developer/CommandLineTools/usr/bin/make -C lambdas /Library/Developer/CommandLineTools/usr/bin/make -C layer layer python /Users/daniel/repo/azul2/scripts/check_branch.py python .chalice/config.json.template.py .chalice/config.json Creating .chalice/config.json python /Users/daniel/repo/azul2/scripts/stage_layer.py 2024-12-02 12:15:45,797 INFO MainThread botocore.credentials: Found credentials in shared credentials file: ~/.aws/credentials 2024-12-02 12:15:45,833 INFO MainThread azul.deployment: Allocated new Boto3 client for 'iam' with ID 4375927696 2024-12-02 12:15:46,255 INFO MainThread azul.deployment: Allocated new Boto3 client for 'sts' with ID 4376638992 2024-12-02 12:15:46,284 INFO MainThread azul.lambda_layer: Checking for dependencies layer package at s3://edu-ucsc-gi-platform-anvil-dev-shared.us-east-1/azul/daniel2/lambda_layers/985c70f2554b05063f8a15c988cdec5311f2aac6.zip. 2024-12-02 12:15:46,313 INFO MainThread azul.deployment: Allocated new Boto3 client for 's3' with ID 4394064400 2024-12-02 12:15:46,422 INFO MainThread azul.boto3: s3.HeadObject: Making HEAD request to https://s3.amazonaws.com/edu-ucsc-gi-platform-anvil-dev-shared.us-east-1/azul/daniel2/lambda_layers/985c70f2554b05063f8a15c988cdec5311f2aac6.zip 2024-12-02 12:15:46,422 INFO MainThread azul.boto3: s3.HeadObject: … without request body 2024-12-02 12:15:46,751 INFO MainThread azul.boto3: s3.HeadObject: Got 200 response 2024-12-02 12:15:46,751 INFO MainThread azul.boto3: s3.HeadObject: … with response body b'' 2024-12-02 12:15:46,752 INFO MainThread azul.lambda_layer: Layer package already up-to-date. /Library/Developer/CommandLineTools/usr/bin/make -C indexer package python /Users/daniel/repo/azul2/scripts/check_branch.py python .chalice/config.json.template.py .chalice/config.json [INFO] 2024-12-02T12:15:48.506Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-12-02T12:15:48.572Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4860215376 Creating .chalice/config.json python vendor/resources/environ.json.template.py vendor/resources/environ.json Creating vendor/resources/environ.json PYTHONHASHSEED=0 python -m compileall \ -f -q --invalidation-mode checked-hash \ vendor vendor/humancellatlas vendor/azul python -m azul.changelog vendor chalice package --stage daniel2 --pkg-format terraform .chalice/terraform /Users/daniel/repo/azul2/.venv/lib/python3.11/site-packages/_distutils_hack/__init__.py:32: UserWarning: Setuptools is replacing distutils. Support for replacing an already imported distutils is deprecated. In the future, this condition will fail. Register concerns at https://github.com/pypa/setuptools/issues/new?template=distutils-deprecation.yml warnings.warn( [INFO] 2024-12-02T12:15:50.215Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-12-02T12:15:50.247Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4386999440 Creating deployment package. Reusing existing deployment package. [INFO] 2024-12-02T12:15:50.662Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in environment variables. /Library/Developer/CommandLineTools/usr/bin/make -C service package python /Users/daniel/repo/azul2/scripts/check_branch.py python .chalice/config.json.template.py .chalice/config.json [INFO] 2024-12-02T12:15:52.342Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-12-02T12:15:52.389Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4413110608 Creating .chalice/config.json python vendor/resources/environ.json.template.py vendor/resources/environ.json Creating vendor/resources/environ.json PYTHONHASHSEED=0 python -m compileall \ -f -q --invalidation-mode checked-hash \ vendor vendor/humancellatlas vendor/azul python -m azul.changelog vendor chalice package --stage daniel2 --pkg-format terraform .chalice/terraform /Users/daniel/repo/azul2/.venv/lib/python3.11/site-packages/_distutils_hack/__init__.py:32: UserWarning: Setuptools is replacing distutils. Support for replacing an already imported distutils is deprecated. In the future, this condition will fail. Register concerns at https://github.com/pypa/setuptools/issues/new?template=distutils-deprecation.yml warnings.warn( Creating deployment package. Reusing existing deployment package. [INFO] 2024-12-02T12:15:53.976Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in environment variables. /Library/Developer/CommandLineTools/usr/bin/make -C terraform auto_apply python /Users/daniel/repo/azul2/scripts/check_branch.py set -o pipefail && git ls-files --ignored --others --directory --exclude-standard | (grep -v '/[^/]' || test $? -eq 1) | xargs -r rm -rv __pycache__//cloudwatch_dashboard.template.json.cpython-311.pyc __pycache__/ api_gateway.tf.json authentication.tf.json backend.tf.json cloudwatch.tf.json common.tf.json dynamo.tf.json lambda_layer.tf.json plan.bin plan.json providers.tf.json s3.tf.json sqs.tf.json step_function.tf.json python providers.tf.json.template.py providers.tf.json Creating providers.tf.json python backend.tf.json.template.py backend.tf.json Creating backend.tf.json terraform init -reconfigure -lockfile=readonly Initializing the backend... Successfully configured the backend "s3"! Terraform will automatically use this backend unless the backend configuration changes. Initializing provider plugins... - Reusing previous version of hashicorp/null from the dependency lock file - Reusing previous version of hashicorp/google from the dependency lock file - Reusing previous version of hashicorp/aws from the dependency lock file - Reusing previous version of opensearch-project/opensearch from the dependency lock file - Reusing previous version of hashicorp/external from the dependency lock file - Using previously-installed hashicorp/aws v5.49.0 - Using previously-installed opensearch-project/opensearch v2.2.1 - Using previously-installed hashicorp/external v2.2.0 - Using previously-installed hashicorp/null v3.2.0 - Using previously-installed hashicorp/google v4.58.0 Terraform has been successfully initialized! You may now begin working with Terraform. Try running "terraform plan" to see any changes that are required for your infrastructure. All Terraform commands should now work. If you ever set or change modules or backend configuration for Terraform, rerun this command to reinitialize your working directory. If you forget, other commands will detect it and remind you to do so if necessary. python /Users/daniel/repo/azul2/scripts/terraform_schema.py check \ || (echo "Schema is stale. Run 'make update_schema' and commit." ; false) 2024-12-02 12:16:00,310 INFO MainThread azul.terraform: Running ['terraform', 'version', '-json'] 2024-12-02 12:16:00,358 INFO MainThread azul.terraform: Terraform output: { "terraform_version": "1.9.8", "platform": "darwin_arm64", "provider_selections": { "registry.terraform.io/hashicorp/aws": "5.49.0", "registry.terraform.io/hashicorp/external": "2.2.0", "registry.terraform.io/hashicorp/google": "4.58.0", "registry.terraform.io/hashicorp/null": "3.2.0", "registry.terraform.io/opensearch-project/opensearch": "2.2.1" }, "terraform_outdated": true } python api_gateway.tf.json.template.py api_gateway.tf.json [INFO] 2024-12-02T12:16:01.702Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'es' with ID 4433057680 Creating api_gateway.tf.json python authentication.tf.json.template.py authentication.tf.json Creating authentication.tf.json python cloudwatch.tf.json.template.py cloudwatch.tf.json Creating cloudwatch.tf.json python common.tf.json.template.py common.tf.json Creating common.tf.json python dynamo.tf.json.template.py dynamo.tf.json Creating dynamo.tf.json python elasticsearch.tf.json.template.py elasticsearch.tf.json python lambda_layer.tf.json.template.py lambda_layer.tf.json Creating lambda_layer.tf.json python s3.tf.json.template.py s3.tf.json Creating s3.tf.json python sqs.tf.json.template.py sqs.tf.json Creating sqs.tf.json python step_function.tf.json.template.py step_function.tf.json [INFO] 2024-12-02T12:16:08.599Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-12-02T12:16:08.647Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4391686928 [INFO] 2024-12-02T12:16:09.080Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'sts' with ID 4422655952 Creating step_function.tf.json terraform validate Success! The configuration is valid. python /Users/daniel/repo/azul2/scripts/rename_resources.py 2024-12-02 12:16:13,088 INFO MainThread azul.terraform: Running ['terraform', 'state', 'list'] terraform plan -no-color -out=plan.bin null_resource.hmac_secret: Refreshing state... [id=5577006791947779410] data.external.elasticsearch_nodes: Reading... aws_acm_certificate.service_0: Refreshing state... [id=arn:aws:acm:us-east-1:289950828509:certificate/f45019e8-e108-4dc6-bcd6-f0e2191f1f49] aws_acm_certificate.indexer_0: Refreshing state... [id=arn:aws:acm:us-east-1:289950828509:certificate/85eeb04f-c530-49d9-9427-e655f010e33f] data.google_client_config.current: Reading... google_project_iam_custom_role.azul: Refreshing state... [id=projects/platform-anvil-dev/roles/azul_daniel2_6] data.aws_wafv2_ip_set.allowed_v4_ips: Reading... data.aws_caller_identity.service: Reading... data.aws_vpc.gitlab: Reading... data.aws_subnet.gitlab_private_1: Reading... data.aws_region.current: Reading... data.aws_region.current: Read complete after 0s [id=us-east-1] aws_cloudwatch_log_group.service: Refreshing state... [id=/aws/apigateway/azul-service-daniel2] data.google_client_config.current: Read complete after 0s [id=projects/platform-anvil-dev/regions//zones/] data.aws_route53_zone.anvil_gi_ucsc_edu: Reading... data.aws_caller_identity.service: Read complete after 0s [id=289950828509] data.aws_subnet.gitlab_public_1: Reading... data.aws_wafv2_ip_set.blocked_v4_ips: Reading... aws_cloudwatch_log_group.waf_api_gateway: Refreshing state... [id=aws-waf-logs-azul-api_gateway-daniel2] aws_dynamodb_table.sources_cache_by_auth: Refreshing state... [id=azul-sources_cache_by_auth-daniel2] aws_kms_key.manifest: Refreshing state... [id=57f8a9db-d62d-4d34-bf71-dec9de4e5a68] data.aws_subnet.gitlab_private_1: Read complete after 1s [id=subnet-029fa823faef9be96] aws_cloudwatch_event_rule.service_servicecachehealth: Refreshing state... [id=azul-servicecachehealth-daniel2] data.aws_subnet.gitlab_public_1: Read complete after 1s [id=subnet-02a80653dfdfd4280] data.aws_subnet.gitlab_private_0: Reading... data.aws_subnet.gitlab_private_0: Read complete after 0s [id=subnet-0410795269b2194be] aws_sqs_queue.tallies_fail: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/289950828509/azul-tallies_fail-daniel2.fifo] aws_iam_role.service: Refreshing state... [id=azul-service-daniel2] data.aws_route53_zone.anvil_gi_ucsc_edu: Read complete after 1s [id=Z05898353G87FKJOLNP7N] data.aws_caller_identity.current: Reading... data.aws_wafv2_ip_set.allowed_v4_ips: Read complete after 1s [id=cc183ccf-c615-4fb3-a4d3-a688e8855843] data.aws_region.indexer: Reading... data.aws_region.indexer: Read complete after 0s [id=us-east-1] data.aws_partition.indexer: Reading... data.aws_partition.indexer: Read complete after 0s [id=aws] aws_cloudwatch_event_rule.indexer_indexercachehealth: Refreshing state... [id=azul-indexercachehealth-daniel2] data.aws_caller_identity.current: Read complete after 0s [id=289950828509] data.aws_region.service: Reading... data.aws_region.service: Read complete after 0s [id=us-east-1] aws_cloudwatch_log_group.indexer: Refreshing state... [id=/aws/apigateway/azul-indexer-daniel2] data.external.elasticsearch_nodes: Read complete after 1s [id=-] aws_lambda_layer_version.dependencies: Refreshing state... [id=arn:aws:lambda:us-east-1:289950828509:layer:azul-dependencies-daniel2:6] data.aws_wafv2_ip_set.blocked_v4_ips: Read complete after 0s [id=e94dbda0-d614-4e1f-bc7a-8bab52c577b7] aws_sqs_queue.notifications_fail: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/289950828509/azul-notifications_fail-daniel2] data.aws_vpc.gitlab: Read complete after 1s [id=vpc-053fc6eb1daf602f9] aws_iam_role.states: Refreshing state... [id=azul-statemachine-daniel2] data.aws_s3_bucket.logs: Reading... data.aws_subnet.gitlab_public_0: Reading... aws_dynamodb_table.object_versions: Refreshing state... [id=azul-object_versions-daniel2] aws_s3_bucket.storage: Refreshing state... [id=edu-ucsc-gi-platform-anvil-dev-storage-daniel2.us-east-1] data.aws_caller_identity.indexer: Reading... data.aws_subnet.gitlab_public_0: Read complete after 1s [id=subnet-0dfee4332c4f7383a] data.aws_partition.service: Reading... aws_iam_role.indexer: Refreshing state... [id=azul-indexer-daniel2] data.aws_partition.service: Read complete after 0s [id=aws] aws_route53_record.service_domain_validation_0: Refreshing state... [id=Z05898353G87FKJOLNP7N__b5c7cd26db92935ac3523b9e7386f0e4.service.daniel2.anvil.gi.ucsc.edu._CNAME] aws_route53_record.indexer_domain_validation_0: Refreshing state... [id=Z05898353G87FKJOLNP7N__e069388fdcb911a9cd22fab225055e26.indexer.daniel2.anvil.gi.ucsc.edu._CNAME] data.aws_caller_identity.indexer: Read complete after 1s [id=289950828509] aws_security_group.indexer: Refreshing state... [id=sg-0c923c16c2eb6df98] aws_security_group.service: Refreshing state... [id=sg-0d4e2784edc0c51ba] aws_kms_alias.manifest: Refreshing state... [id=alias/azul-manifest-daniel2] data.aws_s3_bucket.logs: Read complete after 1s [id=edu-ucsc-gi-platform-anvil-dev-logs.us-east-1] aws_sqs_queue.tallies_retry: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/289950828509/azul-tallies_retry-daniel2.fifo] google_service_account.azul: Refreshing state... [id=projects/platform-anvil-dev/serviceAccounts/azul-ucsc-6-daniel2@platform-anvil-dev.iam.gserviceaccount.com] google_service_account.azul_public: Refreshing state... [id=projects/platform-anvil-dev/serviceAccounts/azul-ucsc-6-public-daniel2@platform-anvil-dev.iam.gserviceaccount.com] google_service_account.azul_unregistered: Refreshing state... [id=projects/platform-anvil-dev/serviceAccounts/azul-ucsc-6-unreg-daniel2@platform-anvil-dev.iam.gserviceaccount.com] aws_sqs_queue.notifications_retry: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/289950828509/azul-notifications_retry-daniel2] aws_cloudwatch_dashboard.dashboard: Refreshing state... [id=azul-dashboard-daniel2] aws_acm_certificate_validation.service_0: Refreshing state... [id=2024-10-04 00:42:25.007 +0000 UTC] aws_lambda_function.service_manifest: Refreshing state... [id=azul-service-daniel2-manifest] aws_lambda_function.service_servicecachehealth: Refreshing state... [id=azul-service-daniel2-servicecachehealth] aws_wafv2_web_acl.api_gateway: Refreshing state... [id=e8d9c8ae-c8b0-479a-852d-eb64685fc1ed] aws_lambda_function.service: Refreshing state... [id=azul-service-daniel2] aws_acm_certificate_validation.indexer_0: Refreshing state... [id=2024-10-04 00:43:30.395 +0000 UTC] aws_sfn_state_machine.manifest: Refreshing state... [id=arn:aws:states:us-east-1:289950828509:stateMachine:azul-manifest-daniel2] aws_iam_role_policy.states: Refreshing state... [id=azul-statemachine-daniel2:azul-statemachine-daniel2] aws_sqs_queue.tallies: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/289950828509/azul-tallies-daniel2.fifo] google_project_iam_member.azul: Refreshing state... [id=platform-anvil-dev/projects/platform-anvil-dev/roles/azul_daniel2_6/serviceAccount:azul-ucsc-6-daniel2@platform-anvil-dev.iam.gserviceaccount.com] aws_lambda_function.indexer_aggregate_retry: Refreshing state... [id=azul-indexer-daniel2-aggregate_retry] aws_lambda_function.indexer_indexercachehealth: Refreshing state... [id=azul-indexer-daniel2-indexercachehealth] aws_lambda_function.indexer_contribute: Refreshing state... [id=azul-indexer-daniel2-contribute] aws_lambda_function.indexer: Refreshing state... [id=azul-indexer-daniel2] aws_lambda_function.indexer_contribute_retry: Refreshing state... [id=azul-indexer-daniel2-contribute_retry] aws_lambda_function.indexer_aggregate: Refreshing state... [id=azul-indexer-daniel2-aggregate] aws_sqs_queue.notifications: Refreshing state... [id=https://sqs.us-east-1.amazonaws.com/289950828509/azul-notifications-daniel2] aws_api_gateway_domain_name.service_0: Refreshing state... [id=service.daniel2.anvil.gi.ucsc.edu] aws_api_gateway_domain_name.indexer_0: Refreshing state... [id=indexer.daniel2.anvil.gi.ucsc.edu] aws_lambda_function_event_invoke_config.service_servicecachehealth: Refreshing state... [id=azul-service-daniel2-servicecachehealth] aws_cloudwatch_event_target.service_servicecachehealth: Refreshing state... [id=azul-servicecachehealth-daniel2-azul-servicecachehealth-daniel2] aws_lambda_permission.service_servicecachehealth: Refreshing state... [id=terraform-20241004005149287500000004] aws_lambda_event_source_mapping.indexer_aggregate_retry: Refreshing state... [id=efac04d4-a9cd-40a2-955e-d485ce373ea9] aws_cloudwatch_event_target.indexer_indexercachehealth: Refreshing state... [id=azul-indexercachehealth-daniel2-azul-indexercachehealth-daniel2] aws_lambda_permission.indexer_indexercachehealth: Refreshing state... [id=terraform-20241004005133472500000003] aws_lambda_function_event_invoke_config.indexer_indexercachehealth: Refreshing state... [id=azul-indexer-daniel2-indexercachehealth] aws_lambda_event_source_mapping.indexer_contribute: Refreshing state... [id=295b3db0-05b2-4040-bc24-85712e87f3a8] aws_lambda_event_source_mapping.indexer_contribute_retry: Refreshing state... [id=92d9eafa-1951-4f37-b20d-8b5afe9ee981] aws_api_gateway_rest_api.service: Refreshing state... [id=pjlb65sk4c] aws_s3_bucket_public_access_block.storage: Refreshing state... [id=edu-ucsc-gi-platform-anvil-dev-storage-daniel2.us-east-1] aws_s3_bucket_lifecycle_configuration.storage: Refreshing state... [id=edu-ucsc-gi-platform-anvil-dev-storage-daniel2.us-east-1] aws_s3_bucket_inventory.storage: Refreshing state... [id=edu-ucsc-gi-platform-anvil-dev-storage-daniel2.us-east-1:azul-inventory-daniel2] aws_iam_role_policy.indexer: Refreshing state... [id=azul-indexer-daniel2:indexer] aws_s3_bucket_logging.storage: Refreshing state... [id=edu-ucsc-gi-platform-anvil-dev-storage-daniel2.us-east-1] aws_iam_role_policy.service: Refreshing state... [id=azul-service-daniel2:service] aws_lambda_event_source_mapping.indexer_aggregate: Refreshing state... [id=106b9384-54e6-442b-924e-68fed790ceb0] aws_api_gateway_rest_api.indexer: Refreshing state... [id=cg8vga0kph] aws_route53_record.service_0: Refreshing state... [id=Z05898353G87FKJOLNP7N_service.daniel2.anvil.gi.ucsc.edu_A] aws_route53_record.indexer_0: Refreshing state... [id=Z05898353G87FKJOLNP7N_indexer.daniel2.anvil.gi.ucsc.edu_A] aws_lambda_permission.service: Refreshing state... [id=terraform-20241004004654204200000001] aws_api_gateway_deployment.service: Refreshing state... [id=4a9evd] aws_api_gateway_deployment.indexer: Refreshing state... [id=kpr0oa] aws_lambda_permission.indexer: Refreshing state... [id=terraform-20241004005039045700000002] aws_api_gateway_stage.service: Refreshing state... [id=ags-pjlb65sk4c-daniel2] aws_api_gateway_stage.indexer: Refreshing state... [id=ags-cg8vga0kph-daniel2] aws_api_gateway_base_path_mapping.service_0: Refreshing state... [id=service.daniel2.anvil.gi.ucsc.edu/] aws_api_gateway_method_settings.service_0: Refreshing state... [id=pjlb65sk4c-daniel2-*/*] aws_api_gateway_base_path_mapping.indexer_0: Refreshing state... [id=indexer.daniel2.anvil.gi.ucsc.edu/] aws_api_gateway_method_settings.indexer_0: Refreshing state... [id=cg8vga0kph-daniel2-*/*] aws_wafv2_web_acl_association.service: Refreshing state... [id=arn:aws:wafv2:us-east-1:289950828509:regional/webacl/azul-api_gateway-daniel2/e8d9c8ae-c8b0-479a-852d-eb64685fc1ed,arn:aws:apigateway:us-east-1::/restapis/pjlb65sk4c/stages/daniel2] aws_wafv2_web_acl_association.indexer: Refreshing state... [id=arn:aws:wafv2:us-east-1:289950828509:regional/webacl/azul-api_gateway-daniel2/e8d9c8ae-c8b0-479a-852d-eb64685fc1ed,arn:aws:apigateway:us-east-1::/restapis/cg8vga0kph/stages/daniel2] aws_wafv2_web_acl_logging_configuration.waf_api_gateway: Refreshing state... [id=arn:aws:wafv2:us-east-1:289950828509:regional/webacl/azul-api_gateway-daniel2/e8d9c8ae-c8b0-479a-852d-eb64685fc1ed] Terraform used the selected providers to generate the following execution plan. Resource actions are indicated with the following symbols: ~ update in-place Terraform will perform the following actions: # aws_lambda_function.indexer will be updated in-place ~ resource "aws_lambda_function" "indexer" { id = "azul-indexer-daniel2" ~ last_modified = "2024-12-02T20:12:47.000+0000" -> (known after apply) ~ source_code_hash = "WzG7VmgUZEMqunnKYBWVeS+x8PMUgNVwp29DMIoDFW4=" -> "av8vWPNlzGTlN3D0wvggUduSGAjKF1gw2pdFEr6DrHU=" tags = { "Name" = "azul-indexer-daniel2" "aws-chalice" = "version=1.30.0:stage=daniel2:app=azul-indexer" "billing" = "anvil" "component" = "azul-indexer" "deployment" = "daniel2" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (26 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "37790dddf9d0758be5e8c81acdacd21d9bd7e6d7" -> "06cb30a4e743484fe1c9b0ce91aaddab58a5c703" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_aggregate will be updated in-place ~ resource "aws_lambda_function" "indexer_aggregate" { id = "azul-indexer-daniel2-aggregate" ~ last_modified = "2024-12-02T20:13:44.000+0000" -> (known after apply) ~ source_code_hash = "WzG7VmgUZEMqunnKYBWVeS+x8PMUgNVwp29DMIoDFW4=" -> "av8vWPNlzGTlN3D0wvggUduSGAjKF1gw2pdFEr6DrHU=" tags = { "Name" = "azul-indexer_aggregate-daniel2" "aws-chalice" = "version=1.30.0:stage=daniel2:app=azul-indexer" "billing" = "anvil" "component" = "azul-indexer_aggregate" "deployment" = "daniel2" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (26 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "37790dddf9d0758be5e8c81acdacd21d9bd7e6d7" -> "06cb30a4e743484fe1c9b0ce91aaddab58a5c703" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_aggregate_retry will be updated in-place ~ resource "aws_lambda_function" "indexer_aggregate_retry" { id = "azul-indexer-daniel2-aggregate_retry" ~ last_modified = "2024-12-02T20:13:34.000+0000" -> (known after apply) ~ source_code_hash = "WzG7VmgUZEMqunnKYBWVeS+x8PMUgNVwp29DMIoDFW4=" -> "av8vWPNlzGTlN3D0wvggUduSGAjKF1gw2pdFEr6DrHU=" tags = { "Name" = "azul-indexer_aggregate_retry-daniel2" "aws-chalice" = "version=1.30.0:stage=daniel2:app=azul-indexer" "billing" = "anvil" "component" = "azul-indexer_aggregate_retry" "deployment" = "daniel2" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (26 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "37790dddf9d0758be5e8c81acdacd21d9bd7e6d7" -> "06cb30a4e743484fe1c9b0ce91aaddab58a5c703" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_contribute will be updated in-place ~ resource "aws_lambda_function" "indexer_contribute" { id = "azul-indexer-daniel2-contribute" ~ last_modified = "2024-12-02T20:12:37.000+0000" -> (known after apply) ~ source_code_hash = "WzG7VmgUZEMqunnKYBWVeS+x8PMUgNVwp29DMIoDFW4=" -> "av8vWPNlzGTlN3D0wvggUduSGAjKF1gw2pdFEr6DrHU=" tags = { "Name" = "azul-indexer_contribute-daniel2" "aws-chalice" = "version=1.30.0:stage=daniel2:app=azul-indexer" "billing" = "anvil" "component" = "azul-indexer_contribute" "deployment" = "daniel2" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (26 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "37790dddf9d0758be5e8c81acdacd21d9bd7e6d7" -> "06cb30a4e743484fe1c9b0ce91aaddab58a5c703" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_contribute_retry will be updated in-place ~ resource "aws_lambda_function" "indexer_contribute_retry" { id = "azul-indexer-daniel2-contribute_retry" ~ last_modified = "2024-12-02T20:13:06.000+0000" -> (known after apply) ~ source_code_hash = "WzG7VmgUZEMqunnKYBWVeS+x8PMUgNVwp29DMIoDFW4=" -> "av8vWPNlzGTlN3D0wvggUduSGAjKF1gw2pdFEr6DrHU=" tags = { "Name" = "azul-indexer_contribute_retry-daniel2" "aws-chalice" = "version=1.30.0:stage=daniel2:app=azul-indexer" "billing" = "anvil" "component" = "azul-indexer_contribute_retry" "deployment" = "daniel2" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (26 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "37790dddf9d0758be5e8c81acdacd21d9bd7e6d7" -> "06cb30a4e743484fe1c9b0ce91aaddab58a5c703" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.indexer_indexercachehealth will be updated in-place ~ resource "aws_lambda_function" "indexer_indexercachehealth" { id = "azul-indexer-daniel2-indexercachehealth" ~ last_modified = "2024-12-02T20:13:15.000+0000" -> (known after apply) ~ source_code_hash = "WzG7VmgUZEMqunnKYBWVeS+x8PMUgNVwp29DMIoDFW4=" -> "av8vWPNlzGTlN3D0wvggUduSGAjKF1gw2pdFEr6DrHU=" tags = { "Name" = "azul-indexer_indexercachehealth-daniel2" "aws-chalice" = "version=1.30.0:stage=daniel2:app=azul-indexer" "billing" = "anvil" "component" = "azul-indexer_indexercachehealth" "deployment" = "daniel2" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (26 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "37790dddf9d0758be5e8c81acdacd21d9bd7e6d7" -> "06cb30a4e743484fe1c9b0ce91aaddab58a5c703" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.service will be updated in-place ~ resource "aws_lambda_function" "service" { id = "azul-service-daniel2" ~ last_modified = "2024-12-02T20:13:25.000+0000" -> (known after apply) ~ source_code_hash = "M+61FoxBOAQmVzcfuqtTINmuYmbyzU4O7I+Q+03O2WM=" -> "9dCw3u1a8+OWep2Qrg+450bJrENeiTtbRFDh7QMZBkU=" tags = { "Name" = "azul-service-daniel2" "aws-chalice" = "version=1.30.0:stage=daniel2:app=azul-service" "billing" = "anvil" "component" = "azul-service" "deployment" = "daniel2" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (26 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "37790dddf9d0758be5e8c81acdacd21d9bd7e6d7" -> "06cb30a4e743484fe1c9b0ce91aaddab58a5c703" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.service_manifest will be updated in-place ~ resource "aws_lambda_function" "service_manifest" { id = "azul-service-daniel2-manifest" ~ last_modified = "2024-12-02T20:12:28.000+0000" -> (known after apply) ~ source_code_hash = "M+61FoxBOAQmVzcfuqtTINmuYmbyzU4O7I+Q+03O2WM=" -> "9dCw3u1a8+OWep2Qrg+450bJrENeiTtbRFDh7QMZBkU=" tags = { "Name" = "azul-service_manifest-daniel2" "aws-chalice" = "version=1.30.0:stage=daniel2:app=azul-service" "billing" = "anvil" "component" = "azul-service_manifest" "deployment" = "daniel2" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (26 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "37790dddf9d0758be5e8c81acdacd21d9bd7e6d7" -> "06cb30a4e743484fe1c9b0ce91aaddab58a5c703" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } # aws_lambda_function.service_servicecachehealth will be updated in-place ~ resource "aws_lambda_function" "service_servicecachehealth" { id = "azul-service-daniel2-servicecachehealth" ~ last_modified = "2024-12-02T20:12:56.000+0000" -> (known after apply) ~ source_code_hash = "M+61FoxBOAQmVzcfuqtTINmuYmbyzU4O7I+Q+03O2WM=" -> "9dCw3u1a8+OWep2Qrg+450bJrENeiTtbRFDh7QMZBkU=" tags = { "Name" = "azul-service_servicecachehealth-daniel2" "aws-chalice" = "version=1.30.0:stage=daniel2:app=azul-service" "billing" = "anvil" "component" = "azul-service_servicecachehealth" "deployment" = "daniel2" "owner" = "dsotirho@ucsc.edu" "service" = "azul" } # (26 unchanged attributes hidden) ~ environment { ~ variables = { ~ "azul_git_commit" = "37790dddf9d0758be5e8c81acdacd21d9bd7e6d7" -> "06cb30a4e743484fe1c9b0ce91aaddab58a5c703" # (41 unchanged elements hidden) } } # (4 unchanged blocks hidden) } Plan: 0 to add, 9 to change, 0 to destroy. ────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────── Saved the plan to: plan.bin To perform exactly these actions, run the following command to apply: terraform apply "plan.bin" terraform show -json plan.bin > plan.json terraform apply -auto-approve plan.bin aws_lambda_function.service_servicecachehealth: Modifying... [id=azul-service-daniel2-servicecachehealth] aws_lambda_function.indexer_contribute_retry: Modifying... [id=azul-indexer-daniel2-contribute_retry] aws_lambda_function.indexer_contribute: Modifying... [id=azul-indexer-daniel2-contribute] aws_lambda_function.indexer_aggregate: Modifying... [id=azul-indexer-daniel2-aggregate] aws_lambda_function.service_manifest: Modifying... [id=azul-service-daniel2-manifest] aws_lambda_function.indexer: Modifying... [id=azul-indexer-daniel2] aws_lambda_function.indexer_aggregate_retry: Modifying... [id=azul-indexer-daniel2-aggregate_retry] aws_lambda_function.indexer_indexercachehealth: Modifying... [id=azul-indexer-daniel2-indexercachehealth] aws_lambda_function.service: Modifying... [id=azul-service-daniel2] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel2-aggregate, 10s elapsed] aws_lambda_function.indexer: Still modifying... [id=azul-indexer-daniel2, 10s elapsed] aws_lambda_function.indexer_contribute_retry: Still modifying... [id=azul-indexer-daniel2-contribute_retry, 10s elapsed] aws_lambda_function.service_manifest: Still modifying... [id=azul-service-daniel2-manifest, 10s elapsed] aws_lambda_function.indexer_contribute: Still modifying... [id=azul-indexer-daniel2-contribute, 10s elapsed] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel2-servicecachehealth, 10s elapsed] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel2-aggregate_retry, 10s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel2-indexercachehealth, 10s elapsed] aws_lambda_function.service: Still modifying... [id=azul-service-daniel2, 10s elapsed] aws_lambda_function.indexer_contribute_retry: Modifications complete after 15s [id=azul-indexer-daniel2-contribute_retry] aws_lambda_function.service_servicecachehealth: Still modifying... [id=azul-service-daniel2-servicecachehealth, 20s elapsed] aws_lambda_function.service_manifest: Still modifying... [id=azul-service-daniel2-manifest, 20s elapsed] aws_lambda_function.indexer_contribute: Still modifying... [id=azul-indexer-daniel2-contribute, 20s elapsed] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel2-aggregate, 20s elapsed] aws_lambda_function.indexer: Still modifying... [id=azul-indexer-daniel2, 20s elapsed] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel2-aggregate_retry, 20s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel2-indexercachehealth, 20s elapsed] aws_lambda_function.service: Still modifying... [id=azul-service-daniel2, 20s elapsed] aws_lambda_function.service_servicecachehealth: Modifications complete after 24s [id=azul-service-daniel2-servicecachehealth] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel2-indexercachehealth, 30s elapsed] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel2-aggregate, 30s elapsed] aws_lambda_function.service_manifest: Still modifying... [id=azul-service-daniel2-manifest, 30s elapsed] aws_lambda_function.indexer_contribute: Still modifying... [id=azul-indexer-daniel2-contribute, 30s elapsed] aws_lambda_function.indexer: Still modifying... [id=azul-indexer-daniel2, 30s elapsed] aws_lambda_function.indexer_aggregate_retry: Still modifying... [id=azul-indexer-daniel2-aggregate_retry, 30s elapsed] aws_lambda_function.service: Still modifying... [id=azul-service-daniel2, 30s elapsed] aws_lambda_function.indexer_aggregate_retry: Modifications complete after 32s [id=azul-indexer-daniel2-aggregate_retry] aws_lambda_function.service_manifest: Still modifying... [id=azul-service-daniel2-manifest, 40s elapsed] aws_lambda_function.indexer: Still modifying... [id=azul-indexer-daniel2, 40s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel2-indexercachehealth, 40s elapsed] aws_lambda_function.indexer_contribute: Still modifying... [id=azul-indexer-daniel2-contribute, 40s elapsed] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel2-aggregate, 40s elapsed] aws_lambda_function.service: Still modifying... [id=azul-service-daniel2, 40s elapsed] aws_lambda_function.indexer_contribute: Modifications complete after 41s [id=azul-indexer-daniel2-contribute] aws_lambda_function.indexer_aggregate: Still modifying... [id=azul-indexer-daniel2-aggregate, 50s elapsed] aws_lambda_function.service_manifest: Still modifying... [id=azul-service-daniel2-manifest, 50s elapsed] aws_lambda_function.indexer: Still modifying... [id=azul-indexer-daniel2, 50s elapsed] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel2-indexercachehealth, 50s elapsed] aws_lambda_function.service: Still modifying... [id=azul-service-daniel2, 50s elapsed] aws_lambda_function.indexer_aggregate: Modifications complete after 51s [id=azul-indexer-daniel2-aggregate] aws_lambda_function.indexer_indexercachehealth: Still modifying... [id=azul-indexer-daniel2-indexercachehealth, 1m0s elapsed] aws_lambda_function.indexer: Still modifying... [id=azul-indexer-daniel2, 1m0s elapsed] aws_lambda_function.service_manifest: Still modifying... [id=azul-service-daniel2-manifest, 1m0s elapsed] aws_lambda_function.service: Still modifying... [id=azul-service-daniel2, 1m0s elapsed] aws_lambda_function.indexer_indexercachehealth: Modifications complete after 1m1s [id=azul-indexer-daniel2-indexercachehealth] aws_lambda_function.service_manifest: Modifications complete after 1m10s [id=azul-service-daniel2-manifest] aws_lambda_function.indexer: Still modifying... [id=azul-indexer-daniel2, 1m10s elapsed] aws_lambda_function.service: Still modifying... [id=azul-service-daniel2, 1m10s elapsed] aws_lambda_function.indexer: Modifications complete after 1m18s [id=azul-indexer-daniel2] aws_lambda_function.service: Still modifying... [id=azul-service-daniel2, 1m20s elapsed] aws_lambda_function.service: Modifications complete after 1m28s [id=azul-service-daniel2] Apply complete! Resources: 0 added, 9 changed, 0 destroyed. python /Users/daniel/repo/azul2/scripts/post_deploy_tdr.py 2024-12-02 12:18:05,100 INFO MainThread botocore.credentials: Found credentials in shared credentials file: ~/.aws/credentials 2024-12-02 12:18:05,132 INFO MainThread azul.deployment: Allocated new Boto3 client for 'secretsmanager' with ID 4350992912 2024-12-02 12:18:05,723 INFO MainThread azul.terra: Making POST request to 'https://sam.dsde-dev.broadinstitute.org/register/user/v1' 2024-12-02 12:18:05,723 DEBUG MainThread azul.terra: … with request body '' 2024-12-02 12:18:05,899 INFO MainThread azul.terra: Got 409 response after 0.176s from POST to https://sam.dsde-dev.broadinstitute.org/register/user/v1 2024-12-02 12:18:05,900 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Mon, 02 Dec 2024 20:18:05 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Referrer-Policy': 'strict-origin-when-cross-origin', 'Access-Control-Allow-Origin': '*', 'Access-Control-Allow-Headers': 'authorization,content-type,accept,origin,x-app-id', 'Access-Control-Allow-Methods': 'GET,POST,PUT,PATCH,DELETE,OPTIONS,HEAD', 'Access-Control-Max-Age': '1728000', 'Content-Type': 'application/json', 'Content-Length': '163', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-12-02 12:18:05,900 DEBUG MainThread azul.terra: … with response body b'{"causes":[],"message":"user azul-ucsc-6-daniel2@platform-anvil-dev.iam.gserviceaccount.com is already registered","source":"...' 2024-12-02 12:18:05,900 INFO MainThread azul.terra: Google service account 'azul-ucsc-6-daniel2@platform-anvil-dev.iam.gserviceaccount.com' previously registered with SAM. 2024-12-02 12:18:05,900 INFO MainThread azul.terra: Making GET request to 'https://sam.dsde-dev.broadinstitute.org/register/user/v1' 2024-12-02 12:18:05,900 DEBUG MainThread azul.terra: … without request body 2024-12-02 12:18:06,619 INFO MainThread azul.terra: Got 200 response after 0.719s from GET to https://sam.dsde-dev.broadinstitute.org/register/user/v1 2024-12-02 12:18:06,619 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Mon, 02 Dec 2024 20:18:05 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Referrer-Policy': 'strict-origin-when-cross-origin', 'Access-Control-Allow-Origin': '*', 'Access-Control-Allow-Headers': 'authorization,content-type,accept,origin,x-app-id', 'Access-Control-Allow-Methods': 'GET,POST,PUT,PATCH,DELETE,OPTIONS,HEAD', 'Access-Control-Max-Age': '1728000', 'Content-Type': 'application/json', 'Content-Length': '229', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-12-02 12:18:06,620 DEBUG MainThread azul.terra: … with response body b'{"enabled":{"tosAccepted":true,"google":true,"ldap":true,"allUsersGroup":true,"adminEnabled":true},"userInfo":{"userEmail":"a...' 2024-12-02 12:18:06,951 INFO MainThread azul.terra: Making POST request to 'https://sam.dsde-dev.broadinstitute.org/register/user/v1' 2024-12-02 12:18:06,951 DEBUG MainThread azul.terra: … with request body '' 2024-12-02 12:18:07,146 INFO MainThread azul.terra: Got 409 response after 0.195s from POST to https://sam.dsde-dev.broadinstitute.org/register/user/v1 2024-12-02 12:18:07,146 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Mon, 02 Dec 2024 20:18:06 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Referrer-Policy': 'strict-origin-when-cross-origin', 'Access-Control-Allow-Origin': '*', 'Access-Control-Allow-Headers': 'authorization,content-type,accept,origin,x-app-id', 'Access-Control-Allow-Methods': 'GET,POST,PUT,PATCH,DELETE,OPTIONS,HEAD', 'Access-Control-Max-Age': '1728000', 'Content-Type': 'application/json', 'Content-Length': '170', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-12-02 12:18:07,146 DEBUG MainThread azul.terra: … with response body b'{"causes":[],"message":"user azul-ucsc-6-public-daniel2@platform-anvil-dev.iam.gserviceaccount.com is already registered","so...' 2024-12-02 12:18:07,146 INFO MainThread azul.terra: Google service account 'azul-ucsc-6-public-daniel2@platform-anvil-dev.iam.gserviceaccount.com' previously registered with SAM. 2024-12-02 12:18:07,147 INFO MainThread azul.terra: Making GET request to 'https://sam.dsde-dev.broadinstitute.org/register/user/v1' 2024-12-02 12:18:07,147 DEBUG MainThread azul.terra: … without request body 2024-12-02 12:18:07,736 INFO MainThread azul.terra: Got 200 response after 0.589s from GET to https://sam.dsde-dev.broadinstitute.org/register/user/v1 2024-12-02 12:18:07,736 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Mon, 02 Dec 2024 20:18:07 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'X-XSS-Protection': '1; mode=block', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains', 'Referrer-Policy': 'strict-origin-when-cross-origin', 'Access-Control-Allow-Origin': '*', 'Access-Control-Allow-Headers': 'authorization,content-type,accept,origin,x-app-id', 'Access-Control-Allow-Methods': 'GET,POST,PUT,PATCH,DELETE,OPTIONS,HEAD', 'Access-Control-Max-Age': '1728000', 'Content-Type': 'application/json', 'Content-Length': '236', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-12-02 12:18:07,736 DEBUG MainThread azul.terra: … with response body b'{"enabled":{"tosAccepted":true,"google":true,"ldap":true,"allUsersGroup":true,"adminEnabled":true},"userInfo":{"userEmail":"a...' 2024-12-02 12:18:07,880 INFO ThreadPoolExecutor-0_0 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=ANVIL_CMG_Sample_1_20230225_ANV5_202302281509&limit=2' 2024-12-02 12:18:07,880 DEBUG ThreadPoolExecutor-0_0 azul.terra: … without request body 2024-12-02 12:18:07,880 INFO ThreadPoolExecutor-0_1 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732&limit=2' 2024-12-02 12:18:07,880 DEBUG ThreadPoolExecutor-0_1 azul.terra: … without request body 2024-12-02 12:18:07,881 INFO ThreadPoolExecutor-0_2 azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520&limit=2' 2024-12-02 12:18:07,881 DEBUG ThreadPoolExecutor-0_2 azul.terra: … without request body 2024-12-02 12:18:08,312 INFO ThreadPoolExecutor-0_1 azul.terra: Got 200 response after 0.432s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732&limit=2 2024-12-02 12:18:08,312 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Mon, 02 Dec 2024 20:18:08 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pnA5vQAJ', 'Content-Type': 'application/json', 'Content-Length': '903', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-12-02 12:18:08,314 DEBUG ThreadPoolExecutor-0_1 azul.terra: … with response body b'{"total":156,"filteredTotal":1,"items":[{"id":"790795c4-49b1-4ac8-a060-207b92ea08c5","name":"ANVIL_1000G_2019_Dev_20230609_AN...' 2024-12-02 12:18:08,314 INFO ThreadPoolExecutor-0_0 azul.terra: Got 200 response after 0.434s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=ANVIL_CMG_Sample_1_20230225_ANV5_202302281509&limit=2 2024-12-02 12:18:08,314 INFO ThreadPoolExecutor-0_2 azul.terra: Got 200 response after 0.433s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots?filter=ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520&limit=2 2024-12-02 12:18:08,315 INFO ThreadPoolExecutor-0_1 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-e53e74aa:ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732:. 2024-12-02 12:18:08,315 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Mon, 02 Dec 2024 20:18:08 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pPgjGG24', 'Content-Type': 'application/json', 'Content-Length': '908', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-12-02 12:18:08,315 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response headers HTTPHeaderDict({'Date': 'Mon, 02 Dec 2024 20:18:08 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': '6d5G8VW4', 'Content-Type': 'application/json', 'Content-Length': '910', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-12-02 12:18:08,316 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (202 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_biosample`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-12-02 12:18:08,316 DEBUG ThreadPoolExecutor-0_0 azul.terra: … with response body b'{"total":156,"filteredTotal":1,"items":[{"id":"7d632e2a-54f1-4021-81fd-dbaf893715cd","name":"ANVIL_CMG_Sample_1_20230225_ANV5...' 2024-12-02 12:18:08,316 DEBUG ThreadPoolExecutor-0_2 azul.terra: … with response body b'{"total":156,"filteredTotal":1,"items":[{"id":"5f55901c-4bfc-4d33-b85d-bd9f812f57cd","name":"ANVIL_CCDG_Sample_1_20230228_ANV...' 2024-12-02 12:18:08,318 INFO ThreadPoolExecutor-0_0 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-97ad270b:ANVIL_CMG_Sample_1_20230225_ANV5_202302281509:. 2024-12-02 12:18:08,318 INFO ThreadPoolExecutor-0_2 __main__: TDR client is authorized for API access to tdr:bigquery:gcp:datarepo-dev-42c70e6a:ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520:. 2024-12-02 12:18:08,319 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (200 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_biosample`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-12-02 12:18:08,319 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (201 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_biosample`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-12-02 12:18:09,375 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "3e3fa57c-ac0b-421e-a5ab-ab4377145eef", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_biosample`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-12-02 12:18:09,392 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "c4ea792d-c0e1-4aea-a908-a3c4582c254a", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_biosample`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-12-02 12:18:09,396 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "5ecf2c3b-bf08-4a22-ac97-ad0e42f3441b", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_biosample`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-12-02 12:18:09,578 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (199 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_dataset`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-12-02 12:18:09,581 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (200 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_dataset`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-12-02 12:18:09,635 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (198 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_dataset`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-12-02 12:18:10,459 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "dc6ece49-4534-4d2e-ba84-56bd84fee166", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_dataset`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-12-02 12:18:10,517 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "078f72cd-c1a9-467b-a4da-248b4a428888", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_dataset`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-12-02 12:18:10,524 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "8897cae5-18f1-473b-89de-d14ecbd81732", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_dataset`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-12-02 12:18:10,867 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Calculating batch prefix lengths for partition '' of 15 tables in source tdr:bigquery:gcp:datarepo-dev-42c70e6a:ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520: 2024-12-02 12:18:10,868 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (15940 characters total): '(\n SELECT * FROM (\n SELECT\n \'anvil_activity\' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, ""), IFNULL(p2, ""), IFNULL(p3, ""), IFNULL(p4, "")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_activity`\n WHERE STARTS_WITH(datarepo_row_id, \'\')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER BY ABS(256 - average_batch_size)\n LIMIT 1\n )\n ) UNION ALL (\n SELECT * FROM (\n SELECT\n \'anvil_alignmentactivity\' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, ""), IFNULL(p2, ""), IFNULL(p3, ""), IFNULL(p4, "")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_alignmentactivity`\n WHERE STARTS_WITH(datarepo_row_id, \'\')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDE…' 2024-12-02 12:18:10,918 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Calculating batch prefix lengths for partition '' of 16 tables in source tdr:bigquery:gcp:datarepo-dev-97ad270b:ANVIL_CMG_Sample_1_20230225_ANV5_202302281509: 2024-12-02 12:18:10,919 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (16969 characters total): '(\n SELECT * FROM (\n SELECT\n \'anvil_activity\' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, ""), IFNULL(p2, ""), IFNULL(p3, ""), IFNULL(p4, "")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_activity`\n WHERE STARTS_WITH(datarepo_row_id, \'\')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER BY ABS(256 - average_batch_size)\n LIMIT 1\n )\n ) UNION ALL (\n SELECT * FROM (\n SELECT\n \'anvil_alignmentactivity\' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, ""), IFNULL(p2, ""), IFNULL(p3, ""), IFNULL(p4, "")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_alignmentactivity`\n WHERE STARTS_WITH(datarepo_row_id, \'\')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER …' 2024-12-02 12:18:10,927 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Calculating batch prefix lengths for partition '' of 16 tables in source tdr:bigquery:gcp:datarepo-dev-e53e74aa:ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732: 2024-12-02 12:18:10,927 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (17025 characters total): '(\n SELECT * FROM (\n SELECT\n \'anvil_activity\' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, ""), IFNULL(p2, ""), IFNULL(p3, ""), IFNULL(p4, "")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_activity`\n WHERE STARTS_WITH(datarepo_row_id, \'\')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER BY ABS(256 - average_batch_size)\n LIMIT 1\n )\n ) UNION ALL (\n SELECT * FROM (\n SELECT\n \'anvil_alignmentactivity\' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, ""), IFNULL(p2, ""), IFNULL(p3, ""), IFNULL(p4, "")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_alignmentactivity`\n WHERE STARTS_WITH(datarepo_row_id, \'\')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n OR…' 2024-12-02 12:18:12,163 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "d90e9e25-c26a-4e8c-978f-3be75b03eae3", "total_rows": 9, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "(\n SELECT * FROM (\n SELECT\n 'anvil_activity' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, \"\"), IFNULL(p2, \"\"), IFNULL(p3, \"\"), IFNULL(p4, \"\")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_activity`\n WHERE STARTS_WITH(datarepo_row_id, '')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER BY ABS(256 - average_batch_size)\n LIMIT 1\n )\n ) UNION ALL (\n SELECT * FROM (\n SELECT\n 'anvil_alignmentactivity' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, \"\"), IFNULL(p2, \"\"), IFNULL(p3, \"\"), IFNULL(p4, \"\")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_alignmentactivity`\n WHERE STARTS_WITH(datarepo_row_id, '')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDE\u2026"} 2024-12-02 12:18:12,220 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "9a8165aa-91bd-49be-aed0-91fca207ea9f", "total_rows": 10, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "(\n SELECT * FROM (\n SELECT\n 'anvil_activity' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, \"\"), IFNULL(p2, \"\"), IFNULL(p3, \"\"), IFNULL(p4, \"\")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_activity`\n WHERE STARTS_WITH(datarepo_row_id, '')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER BY ABS(256 - average_batch_size)\n LIMIT 1\n )\n ) UNION ALL (\n SELECT * FROM (\n SELECT\n 'anvil_alignmentactivity' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, \"\"), IFNULL(p2, \"\"), IFNULL(p3, \"\"), IFNULL(p4, \"\")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_alignmentactivity`\n WHERE STARTS_WITH(datarepo_row_id, '')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER \u2026"} 2024-12-02 12:18:12,335 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_project' (average batch size 1.0, num batches 1) 2024-12-02 12:18:12,335 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_file' (average batch size 28.0, num batches 1) 2024-12-02 12:18:12,335 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'subject' (average batch size 25.0, num batches 1) 2024-12-02 12:18:12,335 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'sample' (average batch size 25.0, num batches 1) 2024-12-02 12:18:12,335 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'file_inventory' (average batch size 28.0, num batches 1) 2024-12-02 12:18:12,335 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'workspace_attributes' (average batch size 37.0, num batches 1) 2024-12-02 12:18:12,335 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_donor' (average batch size 25.0, num batches 1) 2024-12-02 12:18:12,335 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'sequencing' (average batch size 25.0, num batches 1) 2024-12-02 12:18:12,335 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_sequencingactivity' (average batch size 25.0, num batches 1) 2024-12-02 12:18:12,336 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (201 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_biosample`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-12-02 12:18:12,399 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'workspace_attributes' (average batch size 37.0, num batches 1) 2024-12-02 12:18:12,399 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'sequencing' (average batch size 50.0, num batches 1) 2024-12-02 12:18:12,399 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'file_inventory' (average batch size 50.0, num batches 1) 2024-12-02 12:18:12,399 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'family' (average batch size 13.0, num batches 1) 2024-12-02 12:18:12,399 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'subject' (average batch size 25.0, num batches 1) 2024-12-02 12:18:12,399 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_project' (average batch size 1.0, num batches 1) 2024-12-02 12:18:12,399 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_donor' (average batch size 25.0, num batches 1) 2024-12-02 12:18:12,399 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'sample' (average batch size 25.0, num batches 1) 2024-12-02 12:18:12,399 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_sequencingactivity' (average batch size 50.0, num batches 1) 2024-12-02 12:18:12,399 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_file' (average batch size 50.0, num batches 1) 2024-12-02 12:18:12,400 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (200 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_biosample`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-12-02 12:18:12,573 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "fe4c740e-78aa-40eb-8fad-da589cdab757", "total_rows": 10, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "(\n SELECT * FROM (\n SELECT\n 'anvil_activity' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, \"\"), IFNULL(p2, \"\"), IFNULL(p3, \"\"), IFNULL(p4, \"\")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_activity`\n WHERE STARTS_WITH(datarepo_row_id, '')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER BY ABS(256 - average_batch_size)\n LIMIT 1\n )\n ) UNION ALL (\n SELECT * FROM (\n SELECT\n 'anvil_alignmentactivity' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, \"\"), IFNULL(p2, \"\"), IFNULL(p3, \"\"), IFNULL(p4, \"\")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_alignmentactivity`\n WHERE STARTS_WITH(datarepo_row_id, '')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n OR\u2026"} 2024-12-02 12:18:12,729 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_project' (average batch size 1.0, num batches 1) 2024-12-02 12:18:12,729 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 2 for table 'file_inventory' (average batch size 101.6, num batches 256) 2024-12-02 12:18:12,729 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 1 for table 'participant' (average batch size 200.1, num batches 16) 2024-12-02 12:18:12,729 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 1 for table 'anvil_donor' (average batch size 200.1, num batches 16) 2024-12-02 12:18:12,729 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 1 for table 'qc_result_sample' (average batch size 199.0, num batches 16) 2024-12-02 12:18:12,729 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 1 for table 'sample' (average batch size 200.1, num batches 16) 2024-12-02 12:18:12,729 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 2 for table 'anvil_activity' (average batch size 101.0, num batches 256) 2024-12-02 12:18:12,729 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'workspace_attributes' (average batch size 24.0, num batches 1) 2024-12-02 12:18:12,729 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 2 for table 'anvil_file' (average batch size 101.6, num batches 256) 2024-12-02 12:18:12,729 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 1 for table 'pedigree' (average batch size 200.1, num batches 16) 2024-12-02 12:18:12,730 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (204 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_biosample`\n WHERE STARTS_WITH(datarepo_row_id, '65')\n " 2024-12-02 12:18:13,191 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "086a9fad-f2ee-48fd-b93a-9c2964b62b6e", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_biosample`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-12-02 12:18:13,209 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "0d24f349-39e4-4886-b9c3-c347a271be24", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_biosample`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-12-02 12:18:13,347 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (199 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_dataset`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-12-02 12:18:13,445 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (198 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_dataset`\n WHERE STARTS_WITH(datarepo_row_id, '')\n " 2024-12-02 12:18:13,523 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "bb3a0b6c-0888-4d65-b206-b98eb6c32bdf", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_biosample`\n WHERE STARTS_WITH(datarepo_row_id, '65')\n "} 2024-12-02 12:18:13,695 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (202 characters total): "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_dataset`\n WHERE STARTS_WITH(datarepo_row_id, '65')\n " 2024-12-02 12:18:14,240 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "7397d1d9-3a3f-45d9-877e-5fdfb77bf484", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_dataset`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-12-02 12:18:14,326 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "d12751ba-db1b-44eb-8264-ea15b8a28d68", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_dataset`\n WHERE STARTS_WITH(datarepo_row_id, '')\n "} 2024-12-02 12:18:14,571 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "5fdce007-41b6-4509-8590-8ee932a1b1d4", "total_rows": 1, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "\n SELECT COUNT(*) AS count\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_dataset`\n WHERE STARTS_WITH(datarepo_row_id, '65')\n "} 2024-12-02 12:18:14,667 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Calculating batch prefix lengths for partition '' of 15 tables in source tdr:bigquery:gcp:datarepo-dev-42c70e6a:ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520:/1 2024-12-02 12:18:14,667 DEBUG ThreadPoolExecutor-0_2 azul.terra: Query (15940 characters total): '(\n SELECT * FROM (\n SELECT\n \'anvil_activity\' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, ""), IFNULL(p2, ""), IFNULL(p3, ""), IFNULL(p4, "")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_activity`\n WHERE STARTS_WITH(datarepo_row_id, \'\')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER BY ABS(256 - average_batch_size)\n LIMIT 1\n )\n ) UNION ALL (\n SELECT * FROM (\n SELECT\n \'anvil_alignmentactivity\' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, ""), IFNULL(p2, ""), IFNULL(p3, ""), IFNULL(p4, "")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_alignmentactivity`\n WHERE STARTS_WITH(datarepo_row_id, \'\')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDE…' 2024-12-02 12:18:14,699 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Calculating batch prefix lengths for partition '' of 16 tables in source tdr:bigquery:gcp:datarepo-dev-97ad270b:ANVIL_CMG_Sample_1_20230225_ANV5_202302281509:/1 2024-12-02 12:18:14,699 DEBUG ThreadPoolExecutor-0_0 azul.terra: Query (16969 characters total): '(\n SELECT * FROM (\n SELECT\n \'anvil_activity\' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, ""), IFNULL(p2, ""), IFNULL(p3, ""), IFNULL(p4, "")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_activity`\n WHERE STARTS_WITH(datarepo_row_id, \'\')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER BY ABS(256 - average_batch_size)\n LIMIT 1\n )\n ) UNION ALL (\n SELECT * FROM (\n SELECT\n \'anvil_alignmentactivity\' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, ""), IFNULL(p2, ""), IFNULL(p3, ""), IFNULL(p4, "")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_alignmentactivity`\n WHERE STARTS_WITH(datarepo_row_id, \'\')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER …' 2024-12-02 12:18:14,979 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Calculating batch prefix lengths for partition '65' of 16 tables in source tdr:bigquery:gcp:datarepo-dev-e53e74aa:ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732:65/1 2024-12-02 12:18:14,980 DEBUG ThreadPoolExecutor-0_1 azul.terra: Query (17057 characters total): '(\n SELECT * FROM (\n SELECT\n \'anvil_activity\' AS table_name,\n 2 + LENGTH(CONCAT(\n IFNULL(p1, ""), IFNULL(p2, ""), IFNULL(p3, ""), IFNULL(p4, "")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 2 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 2 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 2 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 2 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_activity`\n WHERE STARTS_WITH(datarepo_row_id, \'65\')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER BY ABS(256 - average_batch_size)\n LIMIT 1\n )\n ) UNION ALL (\n SELECT * FROM (\n SELECT\n \'anvil_alignmentactivity\' AS table_name,\n 2 + LENGTH(CONCAT(\n IFNULL(p1, ""), IFNULL(p2, ""), IFNULL(p3, ""), IFNULL(p4, "")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 2 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 2 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 2 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 2 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_alignmentactivity`\n WHERE STARTS_WITH(datarepo_row_id, \'65\')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n …' 2024-12-02 12:18:15,894 DEBUG ThreadPoolExecutor-0_0 azul.terra: Job info: {"job_id": "8cf454f3-095a-4b54-b491-81aa4532ada3", "total_rows": 10, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "(\n SELECT * FROM (\n SELECT\n 'anvil_activity' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, \"\"), IFNULL(p2, \"\"), IFNULL(p3, \"\"), IFNULL(p4, \"\")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_activity`\n WHERE STARTS_WITH(datarepo_row_id, '')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER BY ABS(256 - average_batch_size)\n LIMIT 1\n )\n ) UNION ALL (\n SELECT * FROM (\n SELECT\n 'anvil_alignmentactivity' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, \"\"), IFNULL(p2, \"\"), IFNULL(p3, \"\"), IFNULL(p4, \"\")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-97ad270b.ANVIL_CMG_Sample_1_20230225_ANV5_202302281509.anvil_alignmentactivity`\n WHERE STARTS_WITH(datarepo_row_id, '')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER \u2026"} 2024-12-02 12:18:15,907 DEBUG ThreadPoolExecutor-0_2 azul.terra: Job info: {"job_id": "c423db78-6c23-45c0-800b-7a100a7f05f0", "total_rows": 9, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "(\n SELECT * FROM (\n SELECT\n 'anvil_activity' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, \"\"), IFNULL(p2, \"\"), IFNULL(p3, \"\"), IFNULL(p4, \"\")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_activity`\n WHERE STARTS_WITH(datarepo_row_id, '')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER BY ABS(256 - average_batch_size)\n LIMIT 1\n )\n ) UNION ALL (\n SELECT * FROM (\n SELECT\n 'anvil_alignmentactivity' AS table_name,\n 0 + LENGTH(CONCAT(\n IFNULL(p1, \"\"), IFNULL(p2, \"\"), IFNULL(p3, \"\"), IFNULL(p4, \"\")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 0 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 0 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 0 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 0 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-42c70e6a.ANVIL_CCDG_Sample_1_20230228_ANV5_202302281520.anvil_alignmentactivity`\n WHERE STARTS_WITH(datarepo_row_id, '')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDE\u2026"} 2024-12-02 12:18:16,063 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'workspace_attributes' (average batch size 37.0, num batches 1) 2024-12-02 12:18:16,063 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'sequencing' (average batch size 50.0, num batches 1) 2024-12-02 12:18:16,064 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'file_inventory' (average batch size 50.0, num batches 1) 2024-12-02 12:18:16,064 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'family' (average batch size 13.0, num batches 1) 2024-12-02 12:18:16,064 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'subject' (average batch size 25.0, num batches 1) 2024-12-02 12:18:16,064 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_project' (average batch size 1.0, num batches 1) 2024-12-02 12:18:16,064 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_donor' (average batch size 25.0, num batches 1) 2024-12-02 12:18:16,064 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'sample' (average batch size 25.0, num batches 1) 2024-12-02 12:18:16,064 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_sequencingactivity' (average batch size 50.0, num batches 1) 2024-12-02 12:18:16,064 INFO ThreadPoolExecutor-0_0 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_file' (average batch size 50.0, num batches 1) 2024-12-02 12:18:16,066 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_project' (average batch size 1.0, num batches 1) 2024-12-02 12:18:16,066 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_file' (average batch size 28.0, num batches 1) 2024-12-02 12:18:16,066 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'subject' (average batch size 25.0, num batches 1) 2024-12-02 12:18:16,066 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'sample' (average batch size 25.0, num batches 1) 2024-12-02 12:18:16,066 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'file_inventory' (average batch size 28.0, num batches 1) 2024-12-02 12:18:16,066 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'workspace_attributes' (average batch size 37.0, num batches 1) 2024-12-02 12:18:16,066 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_donor' (average batch size 25.0, num batches 1) 2024-12-02 12:18:16,067 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'sequencing' (average batch size 25.0, num batches 1) 2024-12-02 12:18:16,067 INFO ThreadPoolExecutor-0_2 azul.plugins.repository.tdr_anvil: Selected batch prefix length 0 for table 'anvil_sequencingactivity' (average batch size 25.0, num batches 1) 2024-12-02 12:18:16,235 DEBUG ThreadPoolExecutor-0_1 azul.terra: Job info: {"job_id": "3dbd7308-c2fe-44c5-a003-8bdbf17c5224", "total_rows": 8, "stats": {"totalBytesProcessed": "0", "totalBytesBilled": "0", "cacheHit": true, "searchStatistics": {"indexUsageMode": "UNUSED", "indexUnusedReasons": [{"code": "QUERY_CACHE_HIT", "message": "Search indexes are not used because the query was cached."}]}}, "query": "(\n SELECT * FROM (\n SELECT\n 'anvil_activity' AS table_name,\n 2 + LENGTH(CONCAT(\n IFNULL(p1, \"\"), IFNULL(p2, \"\"), IFNULL(p3, \"\"), IFNULL(p4, \"\")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 2 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 2 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 2 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 2 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_activity`\n WHERE STARTS_WITH(datarepo_row_id, '65')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n ORDER BY ABS(256 - average_batch_size)\n LIMIT 1\n )\n ) UNION ALL (\n SELECT * FROM (\n SELECT\n 'anvil_alignmentactivity' AS table_name,\n 2 + LENGTH(CONCAT(\n IFNULL(p1, \"\"), IFNULL(p2, \"\"), IFNULL(p3, \"\"), IFNULL(p4, \"\")\n )) AS batch_prefix_length,\n AVG(num_rows) AS average_batch_size,\n COUNT(*) AS num_batches\n FROM (\n SELECT\n SUBSTR(datarepo_row_id, 2 + 1, 1) AS p1, SUBSTR(datarepo_row_id, 2 + 2, 1) AS p2, SUBSTR(datarepo_row_id, 2 + 3, 1) AS p3, SUBSTR(datarepo_row_id, 2 + 4, 1) AS p4,\n COUNT(*) AS num_rows\n FROM `datarepo-dev-e53e74aa.ANVIL_1000G_2019_Dev_20230609_ANV5_202306121732.anvil_alignmentactivity`\n WHERE STARTS_WITH(datarepo_row_id, '65')\n GROUP BY ROLLUP (p1, p2, p3, p4)\n )\n GROUP BY batch_prefix_length\n \u2026"} 2024-12-02 12:18:16,413 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 2 for table 'file_inventory' (average batch size 97.0, num batches 1) 2024-12-02 12:18:16,413 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 2 for table 'anvil_donor' (average batch size 13.0, num batches 1) 2024-12-02 12:18:16,413 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 2 for table 'anvil_file' (average batch size 114.0, num batches 1) 2024-12-02 12:18:16,413 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 2 for table 'anvil_activity' (average batch size 89.0, num batches 1) 2024-12-02 12:18:16,413 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 2 for table 'sample' (average batch size 10.0, num batches 1) 2024-12-02 12:18:16,413 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 2 for table 'qc_result_sample' (average batch size 22.0, num batches 1) 2024-12-02 12:18:16,413 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 2 for table 'pedigree' (average batch size 11.0, num batches 1) 2024-12-02 12:18:16,413 INFO ThreadPoolExecutor-0_1 azul.plugins.repository.tdr_anvil: Selected batch prefix length 2 for table 'participant' (average batch size 13.0, num batches 1) 2024-12-02 12:18:16,414 INFO MainThread azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/roleMap' 2024-12-02 12:18:16,414 DEBUG MainThread azul.terra: … without request body 2024-12-02 12:18:16,864 INFO MainThread azul.terra: Got 200 response after 0.450s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/roleMap 2024-12-02 12:18:16,865 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Mon, 02 Dec 2024 20:18:16 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'pQmkrLjQ', 'Content-Type': 'application/json', 'Content-Length': '13303', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-12-02 12:18:16,865 DEBUG MainThread azul.terra: … with response body b'{"roleMap":{"a0925f5f-3d38-4f8a-a09f-f6997072dc23":["reader","aggregate_data_reader","discoverer"],"215793b0-b991-4b73-9584-1...' 2024-12-02 12:18:16,866 INFO MainThread azul.terra: Making GET request to 'https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/roleMap' 2024-12-02 12:18:16,866 DEBUG MainThread azul.terra: … without request body 2024-12-02 12:18:17,087 INFO MainThread azul.terra: Got 200 response after 0.221s from GET to https://jade.datarepo-dev.broadinstitute.org/api/repository/v1/snapshots/roleMap 2024-12-02 12:18:17,087 DEBUG MainThread azul.terra: … with response headers HTTPHeaderDict({'Date': 'Mon, 02 Dec 2024 20:18:17 GMT', 'Server': 'Apache', 'X-Frame-Options': 'SAMEORIGIN', 'Access-Control-Allow-Headers': 'DNT,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Range,Authorization,Accept,Referer,X-App-Id,Origin', 'Access-Control-Allow-Methods': 'GET,POST,DELETE,PUT,PATCH,OPTIONS,HEAD', 'X-Content-Type-Options': 'nosniff', 'Strict-Transport-Security': 'max-age=31536000;includeSubDomains', 'Cache-Control': 'no-cache,no-store,must-revalidate', 'X-Request-ID': 'aN5o2GGD', 'Content-Type': 'application/json', 'Content-Length': '13564', 'Vary': 'Accept-Encoding,Origin', 'Via': '1.1 google', 'Alt-Svc': 'h3=":443"; ma=2592000,h3-29=":443"; ma=2592000'}) 2024-12-02 12:18:17,087 DEBUG MainThread azul.terra: … with response body b'{"roleMap":{"a0925f5f-3d38-4f8a-a09f-f6997072dc23":["discoverer","reader","aggregate_data_reader"],"215793b0-b991-4b73-9584-1...' python /Users/daniel/repo/azul2/scripts/check_branch.py python /Users/daniel/repo/azul2/lambdas/service/.chalice/config.json.template.py /Users/daniel/repo/azul2/lambdas/service/.chalice/config.json [INFO] 2024-12-02T12:19:18.367Z 00010ca1-b0ba-466f-8c58-dabbad000000 botocore.credentials Found credentials in shared credentials file: ~/.aws/credentials [INFO] 2024-12-02T12:19:18.417Z 00010ca1-b0ba-466f-8c58-dabbad000000 azul.deployment Allocated new Boto3 client for 'iam' with ID 4453268560 Creating /Users/daniel/repo/azul2/lambdas/service/.chalice/config.json python -m unittest -v integration_test 2024-12-02 12:19:19,433 INFO MainThread botocore.credentials: Found credentials in shared credentials file: ~/.aws/credentials 2024-12-02 12:19:19,463 INFO MainThread azul.deployment: Allocated new Boto3 client for 'es' with ID 4487330000 2024-12-02 12:19:20,029 DEBUG MainThread azul.es: Creating ES client [vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443] 2024-12-02 12:19:20,039 INFO MainThread azul.deployment: Allocated new Boto3 client for 'sts' with ID 4519683408 2024-12-02 12:19:20,054 INFO MainThread botocore.credentials: Found credentials in environment variables. 2024-12-02 12:19:20,055 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_activities 2024-12-02 12:19:20,055 INFO MainThread elasticsearch: … without request body 2024-12-02 12:19:20,463 INFO MainThread elasticsearch: Got 200 response after 0.408s from GET to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_activities 2024-12-02 12:19:20,464 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel2_anvil-it_activities":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_type":…' 2024-12-02 12:19:20,469 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_activities_aggregate 2024-12-02 12:19:20,469 INFO MainThread elasticsearch: … without request body 2024-12-02 12:19:20,578 INFO MainThread elasticsearch: Got 200 response after 0.109s from GET to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_activities_aggregate 2024-12-02 12:19:20,578 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel2_anvil-it_activities_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapp…' 2024-12-02 12:19:20,580 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_biosamples 2024-12-02 12:19:20,580 INFO MainThread elasticsearch: … without request body 2024-12-02 12:19:20,676 INFO MainThread elasticsearch: Got 200 response after 0.096s from GET to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_biosamples 2024-12-02 12:19:20,676 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel2_anvil-it_biosamples":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_type":…' 2024-12-02 12:19:20,679 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_biosamples_aggregate 2024-12-02 12:19:20,679 INFO MainThread elasticsearch: … without request body 2024-12-02 12:19:20,781 INFO MainThread elasticsearch: Got 200 response after 0.101s from GET to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_biosamples_aggregate 2024-12-02 12:19:20,781 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel2_anvil-it_biosamples_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapp…' 2024-12-02 12:19:20,783 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_bundles 2024-12-02 12:19:20,783 INFO MainThread elasticsearch: … without request body 2024-12-02 12:19:20,876 INFO MainThread elasticsearch: Got 200 response after 0.093s from GET to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_bundles 2024-12-02 12:19:20,876 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel2_anvil-it_bundles":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_type":"st…' 2024-12-02 12:19:20,878 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_bundles_aggregate 2024-12-02 12:19:20,878 INFO MainThread elasticsearch: … without request body 2024-12-02 12:19:20,970 INFO MainThread elasticsearch: Got 200 response after 0.092s from GET to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_bundles_aggregate 2024-12-02 12:19:20,970 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel2_anvil-it_bundles_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping…' 2024-12-02 12:19:20,973 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_datasets 2024-12-02 12:19:20,973 INFO MainThread elasticsearch: … without request body 2024-12-02 12:19:21,069 INFO MainThread elasticsearch: Got 200 response after 0.096s from GET to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_datasets 2024-12-02 12:19:21,070 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel2_anvil-it_datasets":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_type":"s…' 2024-12-02 12:19:21,071 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_datasets_aggregate 2024-12-02 12:19:21,071 INFO MainThread elasticsearch: … without request body 2024-12-02 12:19:21,167 INFO MainThread elasticsearch: Got 200 response after 0.096s from GET to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_datasets_aggregate 2024-12-02 12:19:21,167 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel2_anvil-it_datasets_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mappin…' 2024-12-02 12:19:21,169 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_donors 2024-12-02 12:19:21,169 INFO MainThread elasticsearch: … without request body 2024-12-02 12:19:21,262 INFO MainThread elasticsearch: Got 200 response after 0.093s from GET to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_donors 2024-12-02 12:19:21,262 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel2_anvil-it_donors":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_type":"str…' 2024-12-02 12:19:21,265 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_donors_aggregate 2024-12-02 12:19:21,265 INFO MainThread elasticsearch: … without request body 2024-12-02 12:19:21,358 INFO MainThread elasticsearch: Got 200 response after 0.094s from GET to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_donors_aggregate 2024-12-02 12:19:21,359 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel2_anvil-it_donors_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_…' 2024-12-02 12:19:21,361 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_files 2024-12-02 12:19:21,361 INFO MainThread elasticsearch: … without request body 2024-12-02 12:19:21,453 INFO MainThread elasticsearch: Got 200 response after 0.092s from GET to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_files 2024-12-02 12:19:21,453 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel2_anvil-it_files":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_type":"stri…' 2024-12-02 12:19:21,454 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_files_aggregate 2024-12-02 12:19:21,454 INFO MainThread elasticsearch: … without request body 2024-12-02 12:19:21,550 INFO MainThread elasticsearch: Got 200 response after 0.096s from GET to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_files_aggregate 2024-12-02 12:19:21,551 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel2_anvil-it_files_aggregate":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_t…' 2024-12-02 12:19:21,553 INFO MainThread elasticsearch: Making GET request to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_replica 2024-12-02 12:19:21,553 INFO MainThread elasticsearch: … without request body 2024-12-02 12:19:21,645 INFO MainThread elasticsearch: Got 200 response after 0.092s from GET to https://vpc-azul-index-anvilbox-y7lvuxpx7jaryr6rpxubm6ey6u.us-east-1.es.amazonaws.com:443/azul_v2_daniel2_anvil-it_replica 2024-12-02 12:19:21,645 INFO MainThread elasticsearch: … with response body '{"azul_v2_daniel2_anvil-it_replica":{"aliases":{},"mappings":{"dynamic_templates":[{"strings_as_text":{"match_mapping_type":"st…' test_local_chalice (integration_test.AzulChaliceLocalIntegrationTest.test_local_chalice) ... 2024-12-02 12:19:21,694 INFO Thread-2 (process_request_thread) azul.chalice: Received GET request for '/', with {"query": null, "headers": {"host": "127.0.0.1:8000", "user-agent": "python-requests/2.32.3", "accept-encoding": "gzip, deflate, br", "accept": "*/*", "connection": "keep-alive"}}. 2024-12-02 12:19:21,694 INFO Thread-2 (process_request_thread) azul.chalice: Did not authenticate request. 2024-12-02 12:19:21,695 DEBUG Thread-2 (process_request_thread) azul.chalice: Returning 200 response with headers {"Content-Type": "text/html", "Content-Security-Policy": "default-src 'self';img-src 'self' data:;script-src 'self' 'nonce-BvEfN16s8Jh/lHz38Ej4gMLkz+LUijkDDQsSjKXvo5I';style-src 'self' 'nonce-BvEfN16s8Jh/lHz38Ej4gMLkz+LUijkDDQsSjKXvo5I';frame-ancestors 'none'", "Referrer-Policy": "strict-origin-when-cross-origin", "Strict-Transport-Security": "max-age=63072000; includeSubDomains; preload", "X-Content-Type-Options": "nosniff", "X-Frame-Options": "DENY", "X-XSS-Protection": "1; mode=block", "Cache-Control": "no-store"}. See next line for the first 1024 characters of the body. Swagger UI