Connect your BigQuery
In order to connect your BigQuery instance, Whaly needs to be connected with your Google Cloud Instance. This guide will details the necessary steps:
- 1.Finding your Google Cloud Project ID
- 2.Creation of a Google Cloud Service Account
- 3.Creation of a Google Cloud Storage Bucket
- 4.Giving permissions to your service account to access BigQuery and the Storage Bucket
To connect BigQuery to Whaly, you need the following:
- A Google Cloud Project
- Billing enabled on your Google Cloud Project
- Admin rights on the Google Cloud Console
You need to grant Whaly access to your BigQuery cluster so we can create and manage tables for your data, and periodically load data into those tables.
In order to give Whaly access to a subset of your Google Cloud account, you have to create a Service Account. In Google Cloud, a service account is a technical user that will have some permissions and credentials to access your cloud ressources.
A. Create the service account
B. Make the service account a BigQuery admin
- In the New Members field, enter the service account you created in Step 2.A. The service account is the entire email address.
- Click Select a role > BigQuery > BigQuery Admin.
C. Download the service account private key
In Google Cloud, Cloud Storage buckets are data repositories that are used to load or save data within Google Cloud. Whaly is using a Google Cloud Storage bucket to load data from its connector into your BigQuery tables.
- Create the bucket:
- Name: The name that you want to keep, ex. "whaly-connectors-loading-deck"
- Location type: We advise "Multi-region" for maximum reliability
- Location: The region in which your BigQuery data is (EU / US) -->Set the same value in the Whaly form.✂
- Storage class: Standard
- Access control: Fine grained
- Protection tool: None
- Open the details for the bucket you've just created, open the configuration tab, and paste the gsutil URI into Whaly :✂
You must give the service account (in the setup form) Storage Admin permission for the bucket, so that it can read and write the data from the bucket.
- Go to Permissions and then click Add Members.
- In the Add members window, enter the Whaly service account you created in Step 3.
- From the Select a role dropdown, select Storage Admin
That's it, your cloud console is all set for Whaly