dbt connector

Set up the dbt connector in Kaivo: authentication, configuration, the 5 BigQuery tables it syncs, and answers to common questions.

Written By Lauri Raivio

Last updated 16 days ago

Kaivo is a fully managed data platform that syncs your dbt data into a Google BigQuery warehouse and keeps it up to date automatically. There is no pipeline to build and no infrastructure to run, so you can spend your time analysing your data from dbt instead of moving it.

What is the dbt connector

Sync your dbt Cloud runs, projects, and environments into BigQuery with Kaivo to monitor your data pipelines alongside the rest of your data.

Category	Tech
Authentication	API key
Setup	Self-service

Getting started with the dbt connector

Sign up for Kaivo and create a workspace.
Connect your dbt account.
Choose which tables to sync.
Wait for the initial sync to finish.
Query your data in BigQuery or your favourite AI or BI tool.

Authenticating dbt

Authenticate with your Token.

Field	Description
Token	A dbt Cloud service token. Create one in dbt Cloud under Account settings → Service tokens with the Read-only permission set, applied to the projects you want to sync. The token is shown only once, when you create it.

Configuring the dbt connector

When you set up the connector, you provide:

Field	Description
Account ID	Your dbt Cloud account ID — the number in your dbt Cloud URL right after `/accounts/` (e.g. `12345`). Also shown in Account settings.
Access URL	The start of your dbt Cloud URL, up to the domain — copy it from your browser's address bar (e.g. `https://cloud.getdbt.com`). The default suits standard multi-tenant accounts; single-tenant or other-region accounts use their own (e.g. `https://abc123.us1.dbt.com`).

Tables and columns synced from dbt

Kaivo syncs 5 tables from dbt into a dedicated dataset in your BigQuery warehouse. Click any table to see its columns and types.

environments (98 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`type`	`STRING`
`account_id`	`FLOAT64`
`connection_id`	`FLOAT64`
`created_at`	`STRING`
`credentials__type`	`STRING`
`credentials__account_id`	`FLOAT64`
`credentials__adapter_version`	`STRING`
`credentials__auth_type`	`STRING`
`credentials__created_at`	`STRING`
`credentials__database`	`STRING`
`credentials__has_refresh_token`	`BOOL`
`credentials__id`	`FLOAT64`
`credentials__is_configured_for_oauth`	`BOOL`
`credentials__project_id`	`FLOAT64`
`credentials__role`	`STRING`
`credentials__schema`	`STRING`
`credentials__state`	`FLOAT64`
`credentials__target_name`	`STRING`
`credentials__threads`	`FLOAT64`
`credentials__updated_at`	`STRING`
`credentials__user`	`STRING`
`credentials__warehouse`	`STRING`
`credentials_id`	`FLOAT64`
`dbt_version`	`STRING`
`deployment_type`	`STRING`
`enable_model_query_history`	`BOOL`
`extended_attributes_id`	`FLOAT64`
`id`	`FLOAT64`
`name`	`STRING`
`project__description`	`STRING`
`project__account_id`	`FLOAT64`
`project__connection__type`	`STRING`
`project__connection__account_id`	`FLOAT64`
`project__connection__adapter_version`	`STRING`
`project__connection__created_at`	`STRING`
`project__connection__created_by_id`	`FLOAT64`
`project__connection__details__account`	`STRING`
`project__connection__details__allow_sso`	`BOOL`
`project__connection__details__auth_provider_x509_cert_url`	`STRING`
`project__connection__details__auth_uri`	`STRING`
`project__connection__details__client_email`	`STRING`
`project__connection__details__client_id`	`STRING`
`project__connection__details__client_session_keep_alive`	`BOOL`
`project__connection__details__client_x509_cert_url`	`STRING`
`project__connection__details__database`	`STRING`
`project__connection__details__is_configured_for_oauth`	`BOOL`
`project__connection__details__maximum_bytes_billed`	`FLOAT64`
`project__connection__details__private_key_id`	`STRING`
`project__connection__details__project_id`	`STRING`
`project__connection__details__retries`	`FLOAT64`
`project__connection__details__role`	`STRING`
`project__connection__details__timeout_seconds`	`FLOAT64`
`project__connection__details__token_uri`	`STRING`
`project__connection__details__warehouse`	`STRING`
`project__connection__id`	`FLOAT64`
`project__connection__name`	`STRING`
`project__connection__oauth_redirect_uri`	`STRING`
`project__connection__project_id`	`FLOAT64`
`project__connection__state`	`FLOAT64`
`project__connection__updated_at`	`STRING`
`project__connection_id`	`FLOAT64`
`project__created_at`	`STRING`
`project__dbt_project_subdirectory`	`STRING`
`project__docs_job_id`	`FLOAT64`
`project__id`	`FLOAT64`
`project__name`	`STRING`
`project__repository__account_id`	`FLOAT64`
`project__repository__created_at`	`STRING`
`project__repository__deploy_key__account_id`	`FLOAT64`
`project__repository__deploy_key__id`	`FLOAT64`
`project__repository__deploy_key__public_key`	`STRING`
`project__repository__deploy_key__state`	`FLOAT64`
`project__repository__deploy_key_id`	`FLOAT64`
`project__repository__full_name`	`STRING`
`project__repository__git_clone_strategy`	`STRING`
`project__repository__git_provider_id`	`FLOAT64`
`project__repository__github_installation_id`	`FLOAT64`
`project__repository__github_repo`	`STRING`
`project__repository__id`	`FLOAT64`
`project__repository__name`	`STRING`
`project__repository__project_id`	`FLOAT64`
`project__repository__pull_request_url_template`	`STRING`
`project__repository__remote_backend`	`STRING`
`project__repository__remote_url`	`STRING`
`project__repository__state`	`FLOAT64`
`project__repository__updated_at`	`STRING`
`project__repository_id`	`FLOAT64`
`project__skipped_setup`	`BOOL`
`project__state`	`FLOAT64`
`project__updated_at`	`STRING`
`project_id`	`FLOAT64`
`raw_dbt_version`	`STRING`
`state`	`FLOAT64`
`supports_docs`	`BOOL`
`updated_at`	`STRING`
`use_custom_branch`	`BOOL`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: environmentsprojectconnectiondetailsscopes

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`value`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

projects (90 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`description`	`STRING`
`account_id`	`FLOAT64`
`connection__type`	`STRING`
`connection__account_id`	`FLOAT64`
`connection__adapter_version`	`STRING`
`connection__created_at`	`STRING`
`connection__created_by_id`	`FLOAT64`
`connection__details__account`	`STRING`
`connection__details__allow_sso`	`BOOL`
`connection__details__auth_provider_x509_cert_url`	`STRING`
`connection__details__auth_uri`	`STRING`
`connection__details__client_email`	`STRING`
`connection__details__client_id`	`STRING`
`connection__details__client_session_keep_alive`	`BOOL`
`connection__details__client_x509_cert_url`	`STRING`
`connection__details__database`	`STRING`
`connection__details__is_configured_for_oauth`	`BOOL`
`connection__details__maximum_bytes_billed`	`FLOAT64`
`connection__details__private_key_id`	`STRING`
`connection__details__project_id`	`STRING`
`connection__details__retries`	`FLOAT64`
`connection__details__role`	`STRING`
`connection__details__timeout_seconds`	`FLOAT64`
`connection__details__token_uri`	`STRING`
`connection__details__warehouse`	`STRING`
`connection__id`	`FLOAT64`
`connection__name`	`STRING`
`connection__oauth_redirect_uri`	`STRING`
`connection__project_id`	`FLOAT64`
`connection__state`	`FLOAT64`
`connection__updated_at`	`STRING`
`connection_id`	`FLOAT64`
`created_at`	`STRING`
`dbt_project_subdirectory`	`STRING`
`docs_job__description`	`STRING`
`docs_job__account_id`	`FLOAT64`
`docs_job__created_at`	`STRING`
`docs_job__deactivated`	`BOOL`
`docs_job__environment_id`	`FLOAT64`
`docs_job__errors_on_lint_failure`	`BOOL`
`docs_job__execution__timeout_seconds`	`FLOAT64`
`docs_job__generate_docs`	`BOOL`
`docs_job__id`	`FLOAT64`
`docs_job__job_type`	`STRING`
`docs_job__name`	`STRING`
`docs_job__project_id`	`FLOAT64`
`docs_job__run_compare_changes`	`BOOL`
`docs_job__run_failure_count`	`FLOAT64`
`docs_job__run_generate_sources`	`BOOL`
`docs_job__run_lint`	`BOOL`
`docs_job__schedule__cron`	`STRING`
`docs_job__schedule__date`	`STRING`
`docs_job__schedule__time`	`STRING`
`docs_job__settings__target_name`	`STRING`
`docs_job__settings__threads`	`FLOAT64`
`docs_job__state`	`FLOAT64`
`docs_job__triggers__git_provider_webhook`	`BOOL`
`docs_job__triggers__github_webhook`	`BOOL`
`docs_job__triggers__schedule`	`BOOL`
`docs_job__triggers_on_draft_pr`	`BOOL`
`docs_job__updated_at`	`STRING`
`docs_job_id`	`FLOAT64`
`id`	`FLOAT64`
`name`	`STRING`
`repository__account_id`	`FLOAT64`
`repository__created_at`	`STRING`
`repository__deploy_key__account_id`	`FLOAT64`
`repository__deploy_key__id`	`FLOAT64`
`repository__deploy_key__public_key`	`STRING`
`repository__deploy_key__state`	`FLOAT64`
`repository__deploy_key_id`	`FLOAT64`
`repository__full_name`	`STRING`
`repository__git_clone_strategy`	`STRING`
`repository__git_provider_id`	`FLOAT64`
`repository__github_installation_id`	`FLOAT64`
`repository__github_repo`	`STRING`
`repository__id`	`FLOAT64`
`repository__name`	`STRING`
`repository__project_id`	`FLOAT64`
`repository__pull_request_url_template`	`STRING`
`repository__remote_backend`	`STRING`
`repository__remote_url`	`STRING`
`repository__state`	`FLOAT64`
`repository__updated_at`	`STRING`
`repository_id`	`FLOAT64`
`skipped_setup`	`BOOL`
`state`	`FLOAT64`
`updated_at`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: projectsconnectiondetails__scopes

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`value`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: projects__docs_job__execute_steps

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`value`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: projects__group_permissions

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`value`	`JSON`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

repositories (22 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`account_id`	`FLOAT64`
`created_at`	`STRING`
`deploy_key__account_id`	`FLOAT64`
`deploy_key__id`	`FLOAT64`
`deploy_key__public_key`	`STRING`
`deploy_key__state`	`FLOAT64`
`deploy_key_id`	`FLOAT64`
`full_name`	`STRING`
`git_clone_strategy`	`STRING`
`git_provider_id`	`FLOAT64`
`github_installation_id`	`FLOAT64`
`github_repo`	`STRING`
`id`	`FLOAT64`
`name`	`STRING`
`project_id`	`FLOAT64`
`pull_request_url_template`	`STRING`
`remote_backend`	`STRING`
`remote_url`	`STRING`
`state`	`FLOAT64`
`updated_at`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

runs (45 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`account_id`	`FLOAT64`
`artifact_s3_path`	`STRING`
`artifacts_saved`	`BOOL`
`can_retry`	`BOOL`
`created_at`	`STRING`
`created_at_humanized`	`STRING`
`dbt_version`	`STRING`
`dequeued_at`	`STRING`
`duration`	`STRING`
`duration_humanized`	`STRING`
`environment_id`	`FLOAT64`
`executed_by_thread_id`	`STRING`
`finished_at`	`STRING`
`finished_at_humanized`	`STRING`
`git_branch`	`STRING`
`git_sha`	`STRING`
`has_docs_generated`	`BOOL`
`has_sources_generated`	`BOOL`
`href`	`STRING`
`id`	`FLOAT64`
`in_progress`	`BOOL`
`is_cancelled`	`BOOL`
`is_complete`	`BOOL`
`is_error`	`BOOL`
`is_success`	`BOOL`
`job_definition_id`	`FLOAT64`
`job_id`	`FLOAT64`
`last_checked_at`	`STRING`
`last_heartbeat_at`	`STRING`
`notifications_sent`	`BOOL`
`project_id`	`FLOAT64`
`queued_duration`	`STRING`
`queued_duration_humanized`	`STRING`
`retry_not_supported_reason`	`STRING`
`run_duration`	`STRING`
`run_duration_humanized`	`STRING`
`should_start_at`	`STRING`
`started_at`	`STRING`
`status`	`FLOAT64`
`status_humanized`	`STRING`
`status_message`	`STRING`
`trigger_id`	`FLOAT64`
`updated_at`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: runs__blocked_by

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`value`	`FLOAT64`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: runs__run_steps

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`value`	`JSON`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

users (49 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`apitoken_last_used`	`STRING`
`created_at`	`STRING`
`email`	`STRING`
`email_verified`	`BOOL`
`first_name`	`STRING`
`fullname`	`STRING`
`id`	`FLOAT64`
`is_active`	`BOOL`
`is_staff`	`BOOL`
`last_login`	`STRING`
`last_name`	`STRING`
`licenses___16791__account_id`	`FLOAT64`
`licenses___16791__created_at`	`STRING`
`licenses___16791__id`	`FLOAT64`
`licenses___16791__license_type`	`STRING`
`licenses___16791__state`	`FLOAT64`
`licenses___16791__updated_at`	`STRING`
`licenses___16791__user_id`	`FLOAT64`
`licenses___112186__account_id`	`FLOAT64`
`licenses___112186__created_at`	`STRING`
`licenses___112186__id`	`FLOAT64`
`licenses___112186__license_type`	`STRING`
`licenses___112186__state`	`FLOAT64`
`licenses___112186__updated_at`	`STRING`
`licenses___112186__user_id`	`FLOAT64`
`licenses___150670__account_id`	`FLOAT64`
`licenses___150670__created_at`	`STRING`
`licenses___150670__id`	`FLOAT64`
`licenses___150670__license_type`	`STRING`
`licenses___150670__state`	`FLOAT64`
`licenses___150670__updated_at`	`STRING`
`licenses___150670__user_id`	`FLOAT64`
`licenses___193777__account_id`	`FLOAT64`
`licenses___193777__created_at`	`STRING`
`licenses___193777__id`	`FLOAT64`
`licenses___193777__license_type`	`STRING`
`licenses___193777__state`	`FLOAT64`
`licenses___193777__updated_at`	`STRING`
`licenses___193777__user_id`	`FLOAT64`
`licenses___257730__account_id`	`FLOAT64`
`licenses___257730__created_at`	`STRING`
`licenses___257730__id`	`FLOAT64`
`licenses___257730__license_type`	`STRING`
`licenses___257730__state`	`FLOAT64`
`licenses___257730__updated_at`	`STRING`
`licenses___257730__user_id`	`FLOAT64`
`show_existing_user_email_verification`	`BOOL`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: userslicenses_16791__groups

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`value`	`JSON`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: userslicenses_112186__groups

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`value`	`JSON`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: userslicenses_150670__groups

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`value`	`JSON`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: userslicenses_193777__groups

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`value`	`JSON`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: userslicenses_257730__groups

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`value`	`JSON`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: users__permissions

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`account_id`	`FLOAT64`
`created_at`	`STRING`
`id`	`FLOAT64`
`license_type`	`STRING`
`state`	`FLOAT64`
`updated_at`	`STRING`
`user_id`	`FLOAT64`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: userspermissionsgroups

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`account_id`	`FLOAT64`
`assign_by_default`	`BOOL`
`created_at`	`STRING`
`id`	`FLOAT64`
`name`	`STRING`
`state`	`FLOAT64`
`updated_at`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: userspermissionsgroups__group_permissions

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`account_id`	`FLOAT64`
`all_projects`	`BOOL`
`created_at`	`STRING`
`group_id`	`FLOAT64`
`id`	`FLOAT64`
`permission_set`	`STRING`
`state`	`FLOAT64`
`updated_at`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: userspermissionsgroups__group_permissions__writable_environment_categories

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`value`	`JSON`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: userspermissionsgroups__sso_mapping_groups

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`value`	`JSON`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: userspermissionspermission_statements

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`all_resources`	`BOOL`
`permission`	`STRING`
`target_resource`	`FLOAT64`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: userspermissionspermission_statements__writable_environment_categories

Column	Type	Description
`_kaivo_parent_id`	`STRING`	Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`value`	`JSON`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

How the dbt sync works

After the first load, Kaivo keeps your BigQuery warehouse up to date for you. Where dbt supports it, each sync pulls only new and changed records so it stays fast; otherwise it refreshes the whole table. Every record keeps its original ID, so you won't get duplicate rows.

Frequently asked questions

How long does the initial sync take for dbt?

It depends on how much history is in your dbt account. Most initial syncs finish within minutes, while large accounts can take a few hours. After that, syncs only fetch new and changed records, so they're much faster.

Can I sync only some tables or columns?

Yes. You pick which tables to sync when you set up the connection and can change the selection later. Tables you don't select are never copied to your warehouse.

What happens when dbt's schema changes?

New fields are never added automatically. You choose which fields to sync, so data you haven't selected (sensitive personal data, for example) never lands in your warehouse. When a new field appears, it becomes available for you to add. What happens to removed or renamed fields depends on a table's sync mode: full-refresh tables always match what's currently in dbt, so dropped fields disappear, while incremental tables keep their existing columns and history, so an old field stays and newly added fields fill in over time.

Your data lives in your own Kaivo-managed BigQuery warehouse, so the most direct option is to delete or anonymise specific records right in BigQuery. If you delete data in dbt instead, full-refresh tables drop it on the next sync, while incremental tables keep it, so you would remove the row in BigQuery or ask us to run a full refresh. To remove everything, delete the dbt connector in Kaivo and all of its synced data is deleted with it.

Common use cases for dbt data

Run monitoring

Track runs over time to monitor build success, failures, and run duration.

Project health

Analyse runs by project and environment to find slow or failing models.

Team activity

Use users and projects to see who is running what across your dbt account.

Reliability trends

Report on run outcomes to measure pipeline reliability over time.

Use dbt data in your AI and BI tools

Once dbt data lands in your Kaivo-managed BigQuery warehouse, you can explore it with AI tools or any BI tool that connects to BigQuery. Here's how the most common destinations work with dbt data.

Claude

Use Kaivo's MCP server to give Claude secure, workspace-scoped access to your data. Setup guide →

Power BI

Microsoft's BI tool with a native BigQuery connector. Supports direct query and scheduled refresh. Setup guide →

Data Studio

Free Google BI tool with native BigQuery support. One-click connection to your Kaivo warehouse; great for SMB teams on Google Workspace. Setup guide →

Tableau

The premium analytics standard, with native BigQuery integration. Setup guide →

Google Sheets

Use Connected Sheets to query BigQuery directly from a spreadsheet, with no SQL. Setup guide →

Excel

Connect via Power Query's BigQuery connector. Setup guide →

Metabase

Open-source BI tool with strong BigQuery support. Setup guide →

See our pricing page for dbt connector pricing and plan details.

Adform: Sync Adform to BigQuery.
Amplitude: Sync Amplitude to BigQuery.
Auth0: Sync Auth0 to BigQuery.
Convex: Sync Convex to BigQuery.
GitHub: Sync GitHub to BigQuery.
GitLab: Sync GitLab to BigQuery.

Was this helpful?

Still need help? Share an idea