BigQuery
Google BigQuery is a fully-managed, serverless data warehouse that allows you to run super-fast SQL queries on large datasets. It’s designed to handle enormous volumes of data efficiently.
A. In order to connect to BigQuery, follow these steps:
-
Set Up Google Cloud Project: Create or select a project in the Google Cloud Console. Ensure you have billing enabled for the project.
-
Enable BigQuery API: Go to the APIs & Services dashboard and enable the BigQuery API for your project.
-
Create a Service Account: In the IAM & Admin section, create a service account with appropriate permissions. Download the service account key file (JSON format).
-
Install BigQuery Client Library: Depending on your programming environment, install the BigQuery client library.
-
Authenticate: Set up authentication using the service account key. For example, set the GOOGLE_APPLICATION_CREDENTIALS environment variable to the path of your JSON key file.
-
Connect and Query: Use the client library to connect and run queries.
B. Next, here are the steps required in order to connect to BigQuery via Rapidi:
Note: All parameters should be separated by a semi-colon(;)
- Select ODBC as the connection type;
- Add a description such as Google BigQuery service account;
- Add 3.0 Driver as the ODBC Version;
- Add the following string (in the indicated order) into the Server Connect field:
- Simba ODBC Driver for Google BigQuery
- OAuthMechanism=0
- Email= The service account email address
- KeyFilePath=/dbb_config/service1234-dbb123/bigquery_access.json ( Rapidi to add the service ID and the DBB ID where this connection is being set up).
Important: Please provide Rapidi with the Service Account Key file(jSON format).
- Catalog= BigQuery Project ID
- EnableSession=1
- DefaultDataset= BigQuery Dataset ID
Server Connect string Example:
Simba ODBC Driver for Google BigQuery;OAuthMechanism=0;Email=rapidi-test-2024@rapidi-project-2024-428813.iam.gserviceaccount.com;KeyFilePath=/dbb_config/service1362-dbb825/bigquery_access.json;Catalog=rapidi-project-2024-428813;EnableSession=1;DefaultDataset=rapidi-project-2024-428813.198901;
5. Click on Test and then on Read Design to finalise the connection setup.