BigQuery

In order to write Data into your BigQuery warehouse, Whaly needs additional configuration on Google Cloud side. This guide will details the necessary steps:

1. Creation of a Google Cloud Storage Bucket

2. Giving permissions to your service account to the Storage Bucket

Steps where you need to paste info from the google cloud console to Whaly are identified with a ✂️

Prerequisites

To connect BigQuery to Whaly, you need the following:

• A Google Cloud Project

• Billing enabled on your Google Cloud Project

• Admin rights on the Google Cloud Console

• A Service Account already configured in Whaly

1. Create a Google Cloud Storage bucket

In Google Cloud, Cloud Storage buckets are data repositories that are used to load or save data within Google Cloud. Whaly is using a Google Cloud Storage bucket to load data from its connector into your BigQuery tables.

• Go to the Cloud Storage tab, and go to the browser page.

• Click on "Create Bucket"

• Create the bucket:

  • Name: The name that you want to keep, ex. "whaly-connectors-loading-deck"

  • Location type: We advise "Multi-region" for maximum reliability

  • Location: The region in which your BigQuery data is (EU / US) --> ✂️Set the same value in the Whaly form.

  • Storage class: Standard

  • Access control: Fine grained

  • Protection tool: None

• ✂️Open the details for the bucket you've just created, open the configuration tab, and paste the gsutil URI into Whaly:

2. Give permissions to the Whaly Service Account on the Cloud Storage Bucket

You must give the service account (in the setup form) Storage Admin permission for the bucket, so that it can read and write the data from the bucket.

• In your Google Cloud Console, go Storage > Browser to see the list of buckets in your current project.

• Select the bucket you want to use.

• Go to Permissions and then click Add Members.

• In the Add members window, enter the Whaly service account email.

• From the Select a role dropdown, select Storage Admin

3. In Whaly, go in your "Warehouse" page in the Settings and paste the gsutil URI value in the "GCS Bucket Name" field.

That's it, your BigQuery setup is all set for being used with Whaly connectors 🎉