Skip to content

This module automates the scheduled export of Firestore data by triggering Cloud Run jobs that export to Cloud Storage and load the data into BigQuery.

License

Notifications You must be signed in to change notification settings

UnitVectorY-Labs/firestore-to-bigquery-tofu

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

firestore-to-bigquery-tofu

This module automates the scheduled export of Firestore data by triggering Cloud Run jobs that export to Cloud Storage and load the data into BigQuery.

Requirements

Name Version
terraform >= 1.0.0

Providers

Name Version
google n/a
random n/a

Modules

No modules.

Resources

Name Type
google_bigquery_dataset_iam_member.bigquery_data_editor resource
google_cloud_run_v2_job.default resource
google_project_iam_member.bigquery_job_user resource
google_project_iam_member.firestore_export resource
google_service_account.cloud_run_sa resource
google_storage_bucket.export_bucket resource
google_storage_bucket_iam_member.bucket resource
random_uuid.random resource
google_bigquery_dataset.dataset data source

Inputs

Name Description Type Default Required
bigquery_dataset The BigQuery dataset name string n/a yes
firestore_collection The Firestore collection name string n/a yes
firestore_database The Firestore database name string "(default)" no
name The name of the application (used for Cloud Run, Subscription, and BigQuery dataset) string "firestore-to-biguery" no
project_id The GCP project id string n/a yes
region The GCP region to deploy resources to string n/a yes

Outputs

No outputs.

About

This module automates the scheduled export of Firestore data by triggering Cloud Run jobs that export to Cloud Storage and load the data into BigQuery.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages