Skip to content
Book a demoStart free
Connectors

dbt connector

Set up the dbt connector in Kaivo: authentication, configuration, the 5 BigQuery tables it syncs, and answers to common questions.

dbt connector pricing, tier and credits on kaivo.io

Kaivo is a fully managed data platform that syncs your dbt data into a Google BigQuery warehouse and keeps it up to date automatically. There is no pipeline to build and no infrastructure to run, so you can spend your time analysing your data from dbt instead of moving it.

Sync your dbt Cloud runs, projects, and environments into BigQuery with Kaivo to monitor your data pipelines alongside the rest of your data.

CategoryTech
AuthenticationAPI key
SetupSelf-service
  1. Sign up for Kaivo and create a workspace.
  2. Connect your dbt account.
  3. Choose which tables to sync.
  4. Wait for the initial sync to finish.
  5. Query your data in BigQuery or your favourite AI or BI tool.

Authenticate with your Token.

Field Description
Token
A dbt Cloud service token. Create one in dbt Cloud under Account settings → Service tokens with the Read-only permission set, applied to the projects you want to sync. The token is shown only once, when you create it.

|

When you set up the connector, you provide:

Field Description
Account ID
Your dbt Cloud account ID — the number in your dbt Cloud URL right after /accounts/ (e.g. 12345). Also shown in Account settings.

| | Access URL |

The start of your dbt Cloud URL, up to the domain — copy it from your browser’s address bar (e.g. https://cloud.getdbt.com). The default suits standard multi-tenant accounts; single-tenant or other-region accounts use their own (e.g. https://abc123.us1.dbt.com).

|

Kaivo syncs 5 tables from dbt into a dedicated dataset in your BigQuery warehouse. Click any table to see its columns and types.

environments (98 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
type STRING
account_id FLOAT64
connection_id FLOAT64
created_at STRING
credentials__type STRING
credentials__account_id FLOAT64
credentials__adapter_version STRING
credentials__auth_type STRING
credentials__created_at STRING
credentials__database STRING
credentials__has_refresh_token BOOL
credentials__id FLOAT64
credentials__is_configured_for_oauth BOOL
credentials__project_id FLOAT64
credentials__role STRING
credentials__schema STRING
credentials__state FLOAT64
credentials__target_name STRING
credentials__threads FLOAT64
credentials__updated_at STRING
credentials__user STRING
credentials__warehouse STRING
credentials_id FLOAT64
dbt_version STRING
deployment_type STRING
enable_model_query_history BOOL
extended_attributes_id FLOAT64
id FLOAT64
name STRING
project__description STRING
project__account_id FLOAT64
project__connection__type STRING
project__connection__account_id FLOAT64
project__connection__adapter_version STRING
project__connection__created_at STRING
project__connection__created_by_id FLOAT64
project__connection__details__account STRING
project__connection__details__allow_sso BOOL
project__connection__details__auth_provider_x509_cert_url STRING
project__connection__details__auth_uri STRING
project__connection__details__client_email STRING
project__connection__details__client_id STRING
project__connection__details__client_session_keep_alive BOOL
project__connection__details__client_x509_cert_url STRING
project__connection__details__database STRING
project__connection__details__is_configured_for_oauth BOOL
project__connection__details__maximum_bytes_billed FLOAT64
project__connection__details__private_key_id STRING
project__connection__details__project_id STRING
project__connection__details__retries FLOAT64
project__connection__details__role STRING
project__connection__details__timeout_seconds FLOAT64
project__connection__details__token_uri STRING
project__connection__details__warehouse STRING
project__connection__id FLOAT64
project__connection__name STRING
project__connection__oauth_redirect_uri STRING
project__connection__project_id FLOAT64
project__connection__state FLOAT64
project__connection__updated_at STRING
project__connection_id FLOAT64
project__created_at STRING
project__dbt_project_subdirectory STRING
project__docs_job_id FLOAT64
project__id FLOAT64
project__name STRING
project__repository__account_id FLOAT64
project__repository__created_at STRING
project__repository__deploy_key__account_id FLOAT64
project__repository__deploy_key__id FLOAT64
project__repository__deploy_key__public_key STRING
project__repository__deploy_key__state FLOAT64
project__repository__deploy_key_id FLOAT64
project__repository__full_name STRING
project__repository__git_clone_strategy STRING
project__repository__git_provider_id FLOAT64
project__repository__github_installation_id FLOAT64
project__repository__github_repo STRING
project__repository__id FLOAT64
project__repository__name STRING
project__repository__project_id FLOAT64
project__repository__pull_request_url_template STRING
project__repository__remote_backend STRING
project__repository__remote_url STRING
project__repository__state FLOAT64
project__repository__updated_at STRING
project__repository_id FLOAT64
project__skipped_setup BOOL
project__state FLOAT64
project__updated_at STRING
project_id FLOAT64
raw_dbt_version STRING
state FLOAT64
supports_docs BOOL
updated_at STRING
use_custom_branch BOOL
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: environments__project__connection__details__scopes

Section titled “Subtable: environments__project__connection__details__scopes”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
projects (90 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
description STRING
account_id FLOAT64
connection__type STRING
connection__account_id FLOAT64
connection__adapter_version STRING
connection__created_at STRING
connection__created_by_id FLOAT64
connection__details__account STRING
connection__details__allow_sso BOOL
connection__details__auth_provider_x509_cert_url STRING
connection__details__auth_uri STRING
connection__details__client_email STRING
connection__details__client_id STRING
connection__details__client_session_keep_alive BOOL
connection__details__client_x509_cert_url STRING
connection__details__database STRING
connection__details__is_configured_for_oauth BOOL
connection__details__maximum_bytes_billed FLOAT64
connection__details__private_key_id STRING
connection__details__project_id STRING
connection__details__retries FLOAT64
connection__details__role STRING
connection__details__timeout_seconds FLOAT64
connection__details__token_uri STRING
connection__details__warehouse STRING
connection__id FLOAT64
connection__name STRING
connection__oauth_redirect_uri STRING
connection__project_id FLOAT64
connection__state FLOAT64
connection__updated_at STRING
connection_id FLOAT64
created_at STRING
dbt_project_subdirectory STRING
docs_job__description STRING
docs_job__account_id FLOAT64
docs_job__created_at STRING
docs_job__deactivated BOOL
docs_job__environment_id FLOAT64
docs_job__errors_on_lint_failure BOOL
docs_job__execution__timeout_seconds FLOAT64
docs_job__generate_docs BOOL
docs_job__id FLOAT64
docs_job__job_type STRING
docs_job__name STRING
docs_job__project_id FLOAT64
docs_job__run_compare_changes BOOL
docs_job__run_failure_count FLOAT64
docs_job__run_generate_sources BOOL
docs_job__run_lint BOOL
docs_job__schedule__cron STRING
docs_job__schedule__date STRING
docs_job__schedule__time STRING
docs_job__settings__target_name STRING
docs_job__settings__threads FLOAT64
docs_job__state FLOAT64
docs_job__triggers__git_provider_webhook BOOL
docs_job__triggers__github_webhook BOOL
docs_job__triggers__schedule BOOL
docs_job__triggers_on_draft_pr BOOL
docs_job__updated_at STRING
docs_job_id FLOAT64
id FLOAT64
name STRING
repository__account_id FLOAT64
repository__created_at STRING
repository__deploy_key__account_id FLOAT64
repository__deploy_key__id FLOAT64
repository__deploy_key__public_key STRING
repository__deploy_key__state FLOAT64
repository__deploy_key_id FLOAT64
repository__full_name STRING
repository__git_clone_strategy STRING
repository__git_provider_id FLOAT64
repository__github_installation_id FLOAT64
repository__github_repo STRING
repository__id FLOAT64
repository__name STRING
repository__project_id FLOAT64
repository__pull_request_url_template STRING
repository__remote_backend STRING
repository__remote_url STRING
repository__state FLOAT64
repository__updated_at STRING
repository_id FLOAT64
skipped_setup BOOL
state FLOAT64
updated_at STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: projects__connection__details__scopes

Section titled “Subtable: projects__connection__details__scopes”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: projects__docs_job__execute_steps

Section titled “Subtable: projects__docs_job__execute_steps”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value JSON
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
repositories (22 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
account_id FLOAT64
created_at STRING
deploy_key__account_id FLOAT64
deploy_key__id FLOAT64
deploy_key__public_key STRING
deploy_key__state FLOAT64
deploy_key_id FLOAT64
full_name STRING
git_clone_strategy STRING
git_provider_id FLOAT64
github_installation_id FLOAT64
github_repo STRING
id FLOAT64
name STRING
project_id FLOAT64
pull_request_url_template STRING
remote_backend STRING
remote_url STRING
state FLOAT64
updated_at STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
runs (45 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
account_id FLOAT64
artifact_s3_path STRING
artifacts_saved BOOL
can_retry BOOL
created_at STRING
created_at_humanized STRING
dbt_version STRING
dequeued_at STRING
duration STRING
duration_humanized STRING
environment_id FLOAT64
executed_by_thread_id STRING
finished_at STRING
finished_at_humanized STRING
git_branch STRING
git_sha STRING
has_docs_generated BOOL
has_sources_generated BOOL
href STRING
id FLOAT64
in_progress BOOL
is_cancelled BOOL
is_complete BOOL
is_error BOOL
is_success BOOL
job_definition_id FLOAT64
job_id FLOAT64
last_checked_at STRING
last_heartbeat_at STRING
notifications_sent BOOL
project_id FLOAT64
queued_duration STRING
queued_duration_humanized STRING
retry_not_supported_reason STRING
run_duration STRING
run_duration_humanized STRING
should_start_at STRING
started_at STRING
status FLOAT64
status_humanized STRING
status_message STRING
trigger_id FLOAT64
updated_at STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value FLOAT64
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value JSON
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
users (49 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
apitoken_last_used STRING
created_at STRING
email STRING
email_verified BOOL
first_name STRING
fullname STRING
id FLOAT64
is_active BOOL
is_staff BOOL
last_login STRING
last_name STRING
licenses___16791__account_id FLOAT64
licenses___16791__created_at STRING
licenses___16791__id FLOAT64
licenses___16791__license_type STRING
licenses___16791__state FLOAT64
licenses___16791__updated_at STRING
licenses___16791__user_id FLOAT64
licenses___112186__account_id FLOAT64
licenses___112186__created_at STRING
licenses___112186__id FLOAT64
licenses___112186__license_type STRING
licenses___112186__state FLOAT64
licenses___112186__updated_at STRING
licenses___112186__user_id FLOAT64
licenses___150670__account_id FLOAT64
licenses___150670__created_at STRING
licenses___150670__id FLOAT64
licenses___150670__license_type STRING
licenses___150670__state FLOAT64
licenses___150670__updated_at STRING
licenses___150670__user_id FLOAT64
licenses___193777__account_id FLOAT64
licenses___193777__created_at STRING
licenses___193777__id FLOAT64
licenses___193777__license_type STRING
licenses___193777__state FLOAT64
licenses___193777__updated_at STRING
licenses___193777__user_id FLOAT64
licenses___257730__account_id FLOAT64
licenses___257730__created_at STRING
licenses___257730__id FLOAT64
licenses___257730__license_type STRING
licenses___257730__state FLOAT64
licenses___257730__updated_at STRING
licenses___257730__user_id FLOAT64
show_existing_user_email_verification BOOL
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value JSON
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: users__licenses___112186__groups

Section titled “Subtable: users__licenses___112186__groups”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value JSON
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: users__licenses___150670__groups

Section titled “Subtable: users__licenses___150670__groups”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value JSON
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: users__licenses___193777__groups

Section titled “Subtable: users__licenses___193777__groups”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value JSON
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: users__licenses___257730__groups

Section titled “Subtable: users__licenses___257730__groups”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value JSON
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
account_id FLOAT64
created_at STRING
id FLOAT64
license_type STRING
state FLOAT64
updated_at STRING
user_id FLOAT64
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
account_id FLOAT64
assign_by_default BOOL
created_at STRING
id FLOAT64
name STRING
state FLOAT64
updated_at STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: users__permissions__groups__group_permissions

Section titled “Subtable: users__permissions__groups__group_permissions”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
account_id FLOAT64
all_projects BOOL
created_at STRING
group_id FLOAT64
id FLOAT64
permission_set STRING
state FLOAT64
updated_at STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: users__permissions__groups__group_permissions__writable_environment_categories

Section titled “Subtable: users__permissions__groups__group_permissions__writable_environment_categories”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value JSON
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: users__permissions__groups__sso_mapping_groups

Section titled “Subtable: users__permissions__groups__sso_mapping_groups”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value JSON
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: users__permissions__permission_statements

Section titled “Subtable: users__permissions__permission_statements”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
all_resources BOOL
permission STRING
target_resource FLOAT64
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Subtable: users__permissions__permission_statements__writable_environment_categories

Section titled “Subtable: users__permissions__permission_statements__writable_environment_categories”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value JSON
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

After the first load, Kaivo keeps your BigQuery warehouse up to date for you. Where dbt supports it, each sync pulls only new and changed records so it stays fast; otherwise it refreshes the whole table. Every record keeps its original ID, so you won’t get duplicate rows.

How long does the initial sync take for dbt?

Section titled “How long does the initial sync take for dbt?”

It depends on how much history is in your dbt account. Most initial syncs finish within minutes, while large accounts can take a few hours. After that, syncs only fetch new and changed records, so they’re much faster.

Yes. You pick which tables to sync when you set up the connection and can change the selection later. Tables you don’t select are never copied to your warehouse.

New fields are never added automatically. You choose which fields to sync, so data you haven’t selected (sensitive personal data, for example) never lands in your warehouse. When a new field appears, it becomes available for you to add. What happens to removed or renamed fields depends on a table’s sync mode: full-refresh tables always match what’s currently in dbt, so dropped fields disappear, while incremental tables keep their existing columns and history, so an old field stays and newly added fields fill in over time.

How do I handle GDPR or data deletion requests?

Section titled “How do I handle GDPR or data deletion requests?”

Your data lives in your own Kaivo-managed BigQuery warehouse, so the most direct option is to delete or anonymise specific records right in BigQuery. If you delete data in dbt instead, full-refresh tables drop it on the next sync, while incremental tables keep it, so you would remove the row in BigQuery or ask us to run a full refresh. To remove everything, delete the dbt connector in Kaivo and all of its synced data is deleted with it.

Track runs over time to monitor build success, failures, and run duration.

Analyse runs by project and environment to find slow or failing models.

Use users and projects to see who is running what across your dbt account.

Report on run outcomes to measure pipeline reliability over time.

Once dbt data lands in your Kaivo-managed BigQuery warehouse, you can explore it with AI tools or any BI tool that connects to BigQuery. Here’s how the most common destinations work with dbt data.

Use Kaivo’s MCP server to give Claude secure, workspace-scoped access to your data. Setup guide →

Microsoft’s BI tool with a native BigQuery connector. Supports direct query and scheduled refresh. Setup guide →

Free Google BI tool with native BigQuery support. One-click connection to your Kaivo warehouse; great for SMB teams on Google Workspace. Setup guide →

The premium analytics standard, with native BigQuery integration. Setup guide →

Use Connected Sheets to query BigQuery directly from a spreadsheet, with no SQL. Setup guide →

Connect via Power Query’s BigQuery connector. Setup guide →

Open-source BI tool with strong BigQuery support. Setup guide →

See our pricing page for dbt connector pricing and plan details.

  • Adform: Sync Adform to BigQuery.
  • Amplitude: Sync Amplitude to BigQuery.
  • Auth0: Sync Auth0 to BigQuery.
  • Convex: Sync Convex to BigQuery.
  • GitHub: Sync GitHub to BigQuery.
  • GitLab: Sync GitLab to BigQuery.