Google BigQuery conector

Index your data from a Google BigQuery table.

The BigQuery connector lets you read data from a BigQuery table and store it in an Algolia .

Authentication

To authenticate the connector, you need a Google service account with the following permissions:

bigquery.datasets.get
bigquery.datasets.getIamPolicy
bigquery.jobs.create
bigquery.models.export
bigquery.models.getData
bigquery.models.getMetadata
bigquery.models.list
bigquery.routines.get
bigquery.routines.list
bigquery.tables.createSnapshot
bigquery.tables.export
bigquery.tables.get
bigquery.tables.getData
bigquery.tables.getIamPolicy
bigquery.tables.list
resourcemanager.projects.get
storage.folders.get
storage.objects.get
storage.objects.list

If your BigQuery table uses Google Cloud Storage (GCS) or BigLake formats like Apache Iceberg or Delta Lake, you need to configure storage permissions to let the BigQuery Storage API speed up indexing.

Custom SQL statement

The connector imports your selected table by default. To use a custom SQL statement, replace your table name with %s:

SQL

SELECT * FROM %s WHERE Status="Available"

Each row must have a unique identifier that Algolia uses as the object ID.

To stay within your BigQuery quota, don’t schedule tasks to run at most once per day.

Limitations

This connector is subject to the following limitations:

• Connectors limits
• Transformation limits