Skip to content

Latest commit

 

History

History
54 lines (40 loc) · 1.95 KB

setup_gcp.md

File metadata and controls

54 lines (40 loc) · 1.95 KB

GCP

Create a GCP account

Google provides 300USD free credit available for 90 days to new accounts.

Create a new project in GCP

When creating a project, use a project id that is unique, edit it since it can not be modified later on. Use the following project name and id: Project name = project id = ghcn-d Select the project

Create a service account

Note: Service account authorize applications to perform authorized API calls. They are not user accounts of Google Workspace Domain
Go to IAM -> Service accounts

  • Add one service account
    • Fill the details
    • Add Viewer role (plain viewer role)
    • No need to grant access to multiple users
  • Create keys in the service account
    • Actions icon -> Manage Keys -> AddKey -> Create new key -> Create
    • Save the json in a safe directory in your local computer.
      • Windows: C:\Users\USERNAME\.google\credentials\...json
      • Linux: ${HOME}/.google/credentials/...json

Set up permissions to the service account for GCS y Big Query

  • Go to IAM & Admin -> IAM
  • Edit the service account icon -> Edit principal
  • Add the following roles:
    • Storage Admin
    • Storage Object Admin
    • BigQuery Admin
    • Viewer (just 'Viewer')

If you which to run the option B of the transformation stage (DataProc), please, add also:

  • DataProc Administrator
  • Service Account User (explanation here )

Enable IAM API for the SDK to communicate though IAM

https://console.cloud.google.com/apis/library/iam.googleapis.com

Enable the rest of the APIs

Be sure to have enabled the following APIs for your project in the GCP account.

If you wish to run the option B for the transformation stage (DataProc), please, add also:

  • DataProc