Skip to content
Book a demoStart free
Connectors

Airbyte connector

Set up the Airbyte connector in Kaivo: authentication, configuration, the 3 BigQuery tables it syncs, and answers to common questions.

Airbyte connector pricing, tier and credits on kaivo.io

Kaivo is a fully managed data platform that syncs your Airbyte data into a Google BigQuery warehouse and keeps it up to date automatically. There is no pipeline to build and no infrastructure to run, so you can spend your time analysing your data from Airbyte instead of moving it.

Sync your Airbyte jobs, connections, and workspaces into BigQuery with Kaivo to monitor sync volume, reliability, and cost across your data pipelines.

CategoryTech
AuthenticationAPI key
SetupSelf-service

Getting started with the Airbyte connector

Section titled “Getting started with the Airbyte connector”
  1. Sign up for Kaivo and create a workspace.
  2. Connect your Airbyte account.
  3. Choose which tables to sync.
  4. Wait for the initial sync to finish.
  5. Query your data in BigQuery or your favourite AI or BI tool.

Authenticate with your Client Secret.

Field Description
Client Secret
The Client Secret shown alongside the Client ID for your application under Settings → Applications.

|

Prerequisites

This connector requires API application credentials from your Airbyte workspace:

  1. In your workspace settings, navigate to Settings → Applications.
  2. Create a new application and copy the Client ID and Client Secret.

Need help? Reach our team via the chat in the bottom-right corner.

When you set up the connector, you provide:

Field Description
Client ID
Create an application under Settings → Applications in your Airbyte workspace, then copy its Client ID.

| | Start Date |

Any data before this date will not be fetched.

| | Self-Managed Host |

The hostname of your self-managed Airbyte deployment (e.g. data.mycompany.com). Leave empty to use Airbyte Cloud.

|

Kaivo syncs 3 tables from Airbyte into a dedicated dataset in your BigQuery warehouse. Click any table to see its columns and types.

Connections (17 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
connection_id STRING
created_at FLOAT64
data_residency STRING
destination_id STRING
name STRING
namespace_definition STRING
namespace_format STRING
non_breaking_schema_updates_behavior STRING
prefix STRING
schedule__basic_timing STRING
schedule__cron_expression STRING
schedule__schedule_type STRING
source_id STRING
status STRING
workspace_id STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: Connections__configurations__streams

Section titled “Subtable: Connections__configurations__streams”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
name STRING
sync_mode STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: Connections__configurations__streams__cursor_field

Section titled “Subtable: Connections__configurations__streams__cursor_field”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: Connections__configurations__streams__mappers

Section titled “Subtable: Connections__configurations__streams__mappers”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value JSON
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: Connections__configurations__streams__primary_key

Section titled “Subtable: Connections__configurations__streams__primary_key”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: Connections__configurations__streams__primary_key__list

Section titled “Subtable: Connections__configurations__streams__primary_key__list”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: Connections__configurations__streams__selected_fields

Section titled “Subtable: Connections__configurations__streams__selected_fields”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value JSON
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value JSON
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Jobs (11 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
bytes_synced FLOAT64
connection_id STRING
duration STRING
job_id FLOAT64
job_type STRING
last_updated_at STRING
rows_synced FLOAT64
start_time STRING
status STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Workspaces (17 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
data_residency STRING
name STRING
notifications__connection_update__email__enabled BOOL
notifications__connection_update__webhook__enabled BOOL
notifications__connection_update_action_required__email__enabled BOOL
notifications__connection_update_action_required__webhook__enabled BOOL
notifications__failure__email__enabled BOOL
notifications__failure__webhook__enabled BOOL
notifications__success__email__enabled BOOL
notifications__success__webhook__enabled BOOL
notifications__sync_disabled__email__enabled BOOL
notifications__sync_disabled__webhook__enabled BOOL
notifications__sync_disabled_warning__email__enabled BOOL
notifications__sync_disabled_warning__webhook__enabled BOOL
workspace_id STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

After the first load, Kaivo keeps your BigQuery warehouse up to date for you. Where Airbyte supports it, each sync pulls only new and changed records so it stays fast; otherwise it refreshes the whole table. Every record keeps its original ID, so you won’t get duplicate rows.

How long does the initial sync take for Airbyte?

Section titled “How long does the initial sync take for Airbyte?”

It depends on how much history is in your Airbyte account. Most initial syncs finish within minutes, while large accounts can take a few hours. After that, syncs only fetch new and changed records, so they’re much faster.

Yes. You pick which tables to sync when you set up the connection and can change the selection later. Tables you don’t select are never copied to your warehouse.

What happens when Airbyte’s schema changes?

Section titled “What happens when Airbyte’s schema changes?”

New fields are never added automatically. You choose which fields to sync, so data you haven’t selected (sensitive personal data, for example) never lands in your warehouse. When a new field appears, it becomes available for you to add. What happens to removed or renamed fields depends on a table’s sync mode: full-refresh tables always match what’s currently in Airbyte, so dropped fields disappear, while incremental tables keep their existing columns and history, so an old field stays and newly added fields fill in over time.

How do I handle GDPR or data deletion requests?

Section titled “How do I handle GDPR or data deletion requests?”

Your data lives in your own Kaivo-managed BigQuery warehouse, so the most direct option is to delete or anonymise specific records right in BigQuery. If you delete data in Airbyte instead, full-refresh tables drop it on the next sync, while incremental tables keep it, so you would remove the row in BigQuery or ask us to run a full refresh. To remove everything, delete the Airbyte connector in Kaivo and all of its synced data is deleted with it.

Use Jobs with rowsSynced and bytesSynced to track how much data moves and how long each sync takes.

Break Jobs down by jobType and status to spot failing or slow connections early.

Report on Connections by workspace and destination to see what is running and where.

Track bytesSynced over time to understand growth and plan capacity.

Once Airbyte data lands in your Kaivo-managed BigQuery warehouse, you can explore it with AI tools or any BI tool that connects to BigQuery. Here’s how the most common destinations work with Airbyte data.

Use Kaivo’s MCP server to give Claude secure, workspace-scoped access to your data. Setup guide →

Microsoft’s BI tool with a native BigQuery connector. Supports direct query and scheduled refresh. Setup guide →

Free Google BI tool with native BigQuery support. One-click connection to your Kaivo warehouse; great for SMB teams on Google Workspace. Setup guide →

The premium analytics standard, with native BigQuery integration. Setup guide →

Use Connected Sheets to query BigQuery directly from a spreadsheet, with no SQL. Setup guide →

Connect via Power Query’s BigQuery connector. Setup guide →

Open-source BI tool with strong BigQuery support. Setup guide →

See our pricing page for Airbyte connector pricing and plan details.

  • Adform: Sync Adform to BigQuery.
  • Amplitude: Sync Amplitude to BigQuery.
  • Auth0: Sync Auth0 to BigQuery.
  • Convex: Sync Convex to BigQuery.
  • GitHub: Sync GitHub to BigQuery.
  • GitLab: Sync GitLab to BigQuery.