Skip to content

Commit

Permalink
Trying workaround for labeling scheduled queries (#105)
Browse files Browse the repository at this point in the history
* trying workaround for labeling scheduled queries

* path fix?

* path fix?

* tweaked formatting

* proper support for multiple labels

* removed need for separate template

* fixed bad concat
  • Loading branch information
cleentfaar authored Dec 11, 2024
1 parent a350020 commit fa120b7
Showing 1 changed file with 8 additions and 5 deletions.
13 changes: 8 additions & 5 deletions terraform/bigquery_scheduled_data_transfer/main.tf
Original file line number Diff line number Diff line change
Expand Up @@ -23,12 +23,15 @@ resource "google_bigquery_data_transfer_config" "default" {
destination_dataset_id = var.destination_dataset_id

params = {
query = templatefile(
var.query_template,
merge(var.query_variables, { interval = try(local.bigquery_interval_mappings[var.interval], var.interval) })
)
destination_table_name_template = var.destination_table_name_template
write_disposition = var.write_disposition
query = join("", [
length(var.labels) > 0 ? format("SET @@query_label = \"%s\";\n\n", join(",", [for key, value in var.labels : format("%s:%s", key, value)])) : "",
templatefile(
var.query_template,
merge(var.query_variables, { interval = try(local.bigquery_interval_mappings[var.interval], var.interval) })
)
])
write_disposition = var.write_disposition
}

# formatting rules are quite hard to generalize, see: https://cloud.google.com/appengine/docs/flexible/scheduling-jobs-with-cron-yaml#cron_yaml_The_schedule_format
Expand Down

0 comments on commit fa120b7

Please sign in to comment.