Codefresh connector

Set up the Codefresh connector in Kaivo: authentication, configuration, the 13 BigQuery tables it syncs, and answers to common questions.

Written By Lauri Raivio

Last updated 15 days ago

Kaivo is a fully managed data platform that syncs your Codefresh data into a Google BigQuery warehouse and keeps it up to date automatically. There is no pipeline to build and no infrastructure to run, so you can spend your time analysing your data from Codefresh instead of moving it.

What is the Codefresh connector

Sync your Codefresh CI data into BigQuery with Kaivo to analyse build performance, pipeline reliability, and delivery speed by project.

Category	Tech
Authentication	API key
Setup	Self-service

Getting started with the Codefresh connector

Sign up for Kaivo and create a workspace.
Connect your Codefresh account.
Choose which tables to sync.
Wait for the initial sync to finish.
Query your data in BigQuery or your favourite AI or BI tool.

Authenticating Codefresh

Authenticate with your API Key.

Field	Description
API Key	API key for the Codefresh API. Generate one under your avatar → User Settings → API Keys in the Codefresh UI. The token is only shown once.

Configuring the Codefresh connector

When you set up the connector, you provide:

Field	Description
Account ID	The ID of the Codefresh account to sync.
Report Granularity	Optional. Time grouping for the analytics reports stream. Leave unset for no time-based grouping. Note: each report supports different granularities, so a value valid for one report may be rejected by another.
Report Date Range	Optional. Date range for the analytics reports stream as two `YYYY-MM-DD` values: the start date followed by the end date. Only affects the analytics reports stream.
Start Date	Any data before this date will not be fetched.

Tables and columns synced from Codefresh

Kaivo syncs 13 tables from Codefresh into a dedicated dataset in your BigQuery warehouse. Click any table to see its columns and types.

account_settings (7 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`v`	`FLOAT64`
`_id`	`STRING`
`created_at`	`STRING`
`schema_version`	`STRING`
`updated_at`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Nested subtables

Repeating fields are split into their own tables, listed here with their column counts.

account_settings__settings__modules (4 columns)

accounts (22 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`_id`	`STRING`
`default_account`	`FLOAT64`
`email`	`STRING`
`has_password`	`BOOL`
`last_login_date`	`STRING`
`notification_email`	`STRING`
`register_date`	`STRING`
`settings__allow_admin_to_login`	`BOOL`
`settings__date_format`	`STRING`
`settings__display_welcome_screen`	`BOOL`
`settings__filter_inaccessible_kubernetes`	`BOOL`
`settings__send_weekly_report`	`BOOL`
`settings__theme`	`STRING`
`settings__time_format`	`STRING`
`short_profile__user_name`	`STRING`
`status`	`STRING`
`user_name`	`STRING`
`user_data__email`	`STRING`
`user_data__image`	`STRING`
`user_data__name`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Nested subtables

Repeating fields are split into their own tables, listed here with their column counts.

accounts__account (4 columns)
accounts__git_ops_settings (4 columns)
accounts__logins (7 columns)
accounts__logins__permissions (4 columns)
accounts__notifications (4 columns)
accounts__notifications__events (4 columns)
accounts__roles (4 columns)
accounts__user_data__emails (4 columns)

agents (9 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`account`	`STRING`
`id`	`STRING`
`name`	`STRING`
`status__health_status`	`STRING`
`status__message`	`STRING`
`status__reported_at`	`STRING`
`token_name`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Nested subtables

Repeating fields are split into their own tables, listed here with their column counts.

agents__runtimes (4 columns)

analytics_metadata (5 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`type`	`STRING`
`description`	`STRING`
`report_name`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Nested subtables

Repeating fields are split into their own tables, listed here with their column counts.

analytics_metadata__filters (6 columns)
analytics_metadata__mandatory_non_user_filters (5 columns)
analytics_metadata__members (5 columns)
analytics_metadata__supported_time_dimensions (6 columns)

analytics_reports (6 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`key`	`STRING`
`report_name`	`STRING`
`time`	`STRING`
`value`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

audit (20 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`account_id`	`STRING`
`action`	`STRING`
`correlation_id`	`STRING`
`created_at`	`STRING`
`entity`	`STRING`
`entity_id`	`STRING`
`entity_name`	`STRING`
`id`	`FLOAT64`
`ip`	`STRING`
`req_body`	`STRING`
`req_params`	`STRING`
`req_query`	`STRING`
`req_url`	`STRING`
`res_body`	`STRING`
`rs_status`	`FLOAT64`
`user_email`	`STRING`
`user_id`	`STRING`
`user_name`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

builds (53 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`account`	`STRING`
`auto_generated_yaml`	`BOOL`
`branch_name`	`STRING`
`branch_url`	`STRING`
`build_strategy`	`STRING`
`commit_message`	`STRING`
`commit_url`	`STRING`
`committer`	`STRING`
`committer_avatar`	`STRING`
`created`	`STRING`
`delayed`	`FLOAT64`
`event`	`STRING`
`event_label`	`STRING`
`event_name`	`STRING`
`final_workflow_yaml`	`STRING`
`finished`	`STRING`
`has_extended_yaml`	`BOOL`
`has_implicit_git_clone_step`	`BOOL`
`id`	`STRING`
`initiator`	`STRING`
`initiator_avatar`	`STRING`
`keep_pv_cs_for_pending_approval`	`BOOL`
`pack_id`	`STRING`
`pending_approval_concurrency_applied`	`BOOL`
`pending_license`	`BOOL`
`pending_reason`	`STRING`
`permit_restart_from_failed_steps`	`BOOL`
`pipeline_name`	`STRING`
`pipeline_trigger_id`	`STRING`
`pipeline_trigger_name`	`STRING`
`progress`	`STRING`
`project`	`STRING`
`project_id`	`STRING`
`provider`	`STRING`
`repo_name`	`STRING`
`repo_owner`	`STRING`
`repo_url`	`STRING`
`request`	`STRING`
`revision`	`STRING`
`runtime__scheduler_config__type`	`STRING`
`service_id`	`STRING`
`service_name`	`STRING`
`started`	`STRING`
`status`	`STRING`
`trigger`	`STRING`
`trigger_type`	`STRING`
`triggered_by`	`STRING`
`triggers_count`	`FLOAT64`
`use_debugger`	`BOOL`
`user_yaml_descriptor`	`STRING`
`webhook_triggered`	`BOOL`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Nested subtables

Repeating fields are split into their own tables, listed here with their column counts.

builds__annotations (9 columns)
builds__exposed_variables__pipeline (5 columns)
builds__exposed_variables__pipeline_trigger (5 columns)
builds__exposed_variables__pipeline_trigger_shared (4 columns)
builds__exposed_variables__project (4 columns)
builds__exposed_variables__shared (4 columns)
builds__pending_approvals (4 columns)
builds__steps (4 columns)
builds__system_events (10 columns)
builds__termination_request (9 columns)

contexts (14 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`spec__type`	`STRING`
`spec__data__auth__type`	`STRING`
`spec__data__auth__idp_id`	`STRING`
`spec__data__auth__password`	`STRING`
`spec__data__repository_url`	`STRING`
`spec__data__sharing_policy`	`STRING`
`metadata__default`	`BOOL`
`metadata__name`	`STRING`
`metadata__system`	`BOOL`
`api_version`	`STRING`
`kind`	`STRING`
`owner`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Nested subtables

Repeating fields are split into their own tables, listed here with their column counts.

contexts__spec__data__auth__permissions (4 columns)
contexts__spec__data__secret_store_references (4 columns)

execution_contexts (10 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`description`	`STRING`
`v`	`FLOAT64`
`_id`	`STRING`
`account`	`STRING`
`account_default`	`BOOL`
`created_at`	`STRING`
`name`	`STRING`
`updated_at`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Nested subtables

Repeating fields are split into their own tables, listed here with their column counts.

execution_contexts__tags (4 columns)

helm_repos (6 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`created_at`	`STRING`
`name`	`STRING`
`public`	`BOOL`
`updated_at`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

pipelines (36 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`version`	`STRING`
`spec__runtime_environment__cpu`	`STRING`
`spec__runtime_environment__memory`	`STRING`
`spec__runtime_environment__name`	`STRING`
`spec__steps__build__type`	`STRING`
`spec__steps__build__dockerfile`	`STRING`
`spec__steps__build__image_name`	`STRING`
`spec__steps__build__stage`	`STRING`
`spec__steps__build__tag`	`STRING`
`spec__steps__build__title`	`STRING`
`spec__steps__build__working_directory`	`STRING`
`spec__steps__clone__type`	`STRING`
`spec__steps__clone__git`	`STRING`
`spec__steps__clone__repo`	`STRING`
`spec__steps__clone__revision`	`STRING`
`spec__steps__clone__stage`	`STRING`
`spec__steps__clone__title`	`STRING`
`spec__steps__test__type`	`STRING`
`spec__steps__test__image`	`STRING`
`spec__steps__test__stage`	`STRING`
`spec__steps__test__title`	`STRING`
`spec__steps__test__working_directory`	`STRING`
`metadata__account_id`	`STRING`
`metadata__created_at`	`STRING`
`metadata__id`	`STRING`
`metadata__name`	`STRING`
`metadata__original_yaml_string`	`STRING`
`metadata__project`	`STRING`
`metadata__project_id`	`STRING`
`metadata__revision`	`FLOAT64`
`metadata__short_name`	`STRING`
`metadata__updated_at`	`STRING`
`kind`	`STRING`
`last_executed`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Nested subtables

Repeating fields are split into their own tables, listed here with their column counts.

pipelines__spec__contexts (4 columns)
pipelines__spec__external_resources (4 columns)
pipelines__spec__stages (4 columns)
pipelines__spec__steps__test__commands (4 columns)
pipelines__spec__termination_policy (4 columns)
pipelines__spec__triggers (20 columns)
pipelines__spec__triggers__contexts (4 columns)
pipelines__spec__triggers__events (4 columns)
pipelines__spec__triggers__gerrit_ci_status_labels (4 columns)
pipelines__spec__variables (4 columns)
pipelines__metadata__labels__tags (4 columns)

projects (10 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`metadata__created_at`	`STRING`
`account_id`	`STRING`
`favorite`	`BOOL`
`id`	`STRING`
`image`	`STRING`
`pipelines_number`	`FLOAT64`
`project_name`	`STRING`
`updated_at`	`STRING`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Nested subtables

Repeating fields are split into their own tables, listed here with their column counts.

projects__tags (4 columns)
projects__variables (4 columns)

step_types (117 columns)

Column	Type	Description
`_kaivo_id`	`STRING`	Primary key that uniquely identifies the row. Auto-generated by Kaivo.
`version`	`STRING`
`spec__arguments`	`STRING`
`spec__delimiters__left`	`STRING`
`spec__delimiters__right`	`STRING`
`spec__returns`	`STRING`
`spec__steps__bump__image`	`STRING`
`spec__steps__bump__name`	`STRING`
`spec__steps__bump__shell`	`STRING`
`spec__steps__bump__title`	`STRING`
`spec__steps__bump__working_directory`	`STRING`
`spec__steps__clone__type`	`STRING`
`spec__steps__clone__git`	`STRING`
`spec__steps__clone__repo`	`STRING`
`spec__steps__clone__revision`	`STRING`
`spec__steps__clone__stage`	`STRING`
`spec__steps__clone__title`	`STRING`
`spec__steps__commit_and_push__image`	`STRING`
`spec__steps__commit_and_push__shell`	`STRING`
`spec__steps__commit_and_push__title`	`STRING`
`spec__steps__create_pr_comment__image`	`STRING`
`spec__steps__create_pr_comment__title`	`STRING`
`spec__steps__execute_argo_cd__image`	`STRING`
`spec__steps__execute_argo_cd__title`	`STRING`
`spec__steps__export_access_token__image`	`STRING`
`spec__steps__export_access_token__title`	`STRING`
`spec__steps__first__image`	`STRING`
`spec__steps__first__title`	`STRING`
`spec__steps__get_current_version__image`	`STRING`
`spec__steps__get_github_token__image`	`STRING`
`spec__steps__get_github_token__title`	`STRING`
`spec__steps__heroku_deployer__image`	`STRING`
`spec__steps__heroku_deployer__title`	`STRING`
`spec__steps__main__twistlock_scan_image__type`	`STRING`
`spec__steps__main__twistlock_scan_image__add_flow_volume_to_composition`	`BOOL`
`spec__steps__main__twistlock_scan_image__composition__version`	`STRING`
`spec__steps__main__twistlock_scan_image__composition__services__targetimage__command`	`STRING`
`spec__steps__main__twistlock_scan_image__composition__services__targetimage__image`	`STRING`
`spec__steps__main__twistlock_scan_image__composition__services__targetimage__labels__build_image_id`	`STRING`
`spec__steps__main__twistlock_scan_image__composition_candidates__scan_service__command`	`STRING`
`spec__steps__main__twistlock_scan_image__composition_candidates__scan_service__image`	`STRING`
`spec__steps__main__cmd`	`STRING`
`spec__steps__main__image`	`STRING`
`spec__steps__main__name`	`STRING`
`spec__steps__main__shell`	`STRING`
`spec__steps__main__title`	`STRING`
`spec__steps__main__working_directory`	`STRING`
`spec__steps__main_clone__type`	`STRING`
`spec__steps__main_clone__repo`	`STRING`
`spec__steps__main_clone__revision`	`STRING`
`spec__steps__mainbbb__image`	`STRING`
`spec__steps__mainbbb__name`	`STRING`
`spec__steps__mainbbb__services__composition__clair__image`	`STRING`
`spec__steps__mainbbb__services__composition__clair__restart`	`STRING`
`spec__steps__mainbbb__services__composition__postgres__image`	`STRING`
`spec__steps__mainbbb__services__composition__postgres__user`	`STRING`
`spec__steps__mainbbb__services__name`	`STRING`
`spec__steps__mainbbb__services__readiness__image`	`STRING`
`spec__steps__mainbbb__services__readiness__timeout_seconds`	`FLOAT64`
`spec__steps__merge__image`	`STRING`
`spec__steps__merge__working_directory`	`STRING`
`spec__steps__next_version__image`	`STRING`
`spec__steps__release__git`	`STRING`
`spec__steps__release__image`	`STRING`
`spec__steps__release__shell`	`STRING`
`spec__steps__release__title`	`STRING`
`spec__steps__rollback__image`	`STRING`
`spec__steps__rollback__title`	`STRING`
`spec__steps__run_argo_cd__image`	`STRING`
`spec__steps__run_argo_cd__title`	`STRING`
`spec__steps__run_kyml__image`	`STRING`
`spec__steps__run_kyml__title`	`STRING`
`spec__steps__run_unit_tests__image`	`STRING`
`spec__steps__run_unit_tests__title`	`STRING`
`spec__steps__run_unit_tests__working_directory`	`STRING`
`spec__steps__runner__image`	`STRING`
`spec__steps__runner__title`	`STRING`
`spec__steps__second__image`	`STRING`
`spec__steps__second__name`	`STRING`
`spec__steps__send_message__image`	`STRING`
`spec__steps__send_message__name`	`STRING`
`spec__steps__step1__image`	`STRING`
`spec__steps__step1__name`	`STRING`
`spec__steps__step2__image`	`STRING`
`spec__steps__step2__name`	`STRING`
`spec__steps__step3__image`	`STRING`
`spec__steps__step3__name`	`STRING`
`spec__steps__step4__image`	`STRING`
`spec__steps__step4__name`	`STRING`
`spec__steps__step4__when__condition__all__changes_exist`	`STRING`
`spec__steps__verify__image`	`STRING`
`spec__steps__verify__title`	`STRING`
`spec__steps__where_am_i__image`	`STRING`
`spec__steps__where_am_i__title`	`STRING`
`spec__steps_template`	`STRING`
`metadata__version`	`STRING`
`metadata__description`	`STRING`
`metadata__account_id`	`STRING`
`metadata__created_at`	`STRING`
`metadata__icon__type`	`STRING`
`metadata__icon__background`	`STRING`
`metadata__icon__color`	`STRING`
`metadata__icon__name`	`STRING`
`metadata__icon__size__large__url`	`STRING`
`metadata__icon__url`	`STRING`
`metadata__id`	`STRING`
`metadata__is_public`	`BOOL`
`metadata__latest`	`BOOL`
`metadata__name`	`STRING`
`metadata__official`	`BOOL`
`metadata__source_url`	`STRING`
`metadata__stage`	`STRING`
`metadata__title`	`STRING`
`metadata__updated_at`	`STRING`
`kind`	`STRING`
`metrics__finished`	`FLOAT64`
`_kaivo_extracted_at`	`TIMESTAMP`	Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Nested subtables

Repeating fields are split into their own tables, listed here with their column counts.

step_types__spec__steps__bump__commands (4 columns)
step_types__spec__steps__commit_and_push__commands (4 columns)
step_types__spec__steps__commit_and_push__environment (4 columns)
step_types__spec__steps__create_pr_comment__commands (4 columns)
step_types__spec__steps__create_pr_comment__environment (4 columns)
step_types__spec__steps__execute_argo_cd__commands (4 columns)
step_types__spec__steps__export_access_token__commands (4 columns)
step_types__spec__steps__export_access_token__environment (4 columns)
step_types__spec__steps__first__commands (4 columns)
step_types__spec__steps__first__environment (4 columns)
step_types__spec__steps__get_current_version__commands (4 columns)
step_types__spec__steps__get_github_token__commands (4 columns)
step_types__spec__steps__get_github_token__environment (4 columns)
step_types__spec__steps__heroku_deployer__commands (4 columns)
step_types__spec__steps__main__twistlock_scan_image__composition_candidates__scan_service__depends_on (4 columns)
step_types__spec__steps__main__twistlock_scan_image__composition_candidates__scan_service__environment (4 columns)
step_types__spec__steps__main__twistlock_scan_image__composition_candidates__scan_service__volumes (4 columns)
step_types__spec__steps__main__commands (4 columns)
step_types__spec__steps__main__environment (4 columns)
step_types__spec__steps__mainbbb__environment (4 columns)
step_types__spec__steps__mainbbb__services__composition__clair__depends_on (4 columns)
step_types__spec__steps__mainbbb__services__composition__clair__ports (4 columns)
step_types__spec__steps__mainbbb__services__composition__postgres__ports (4 columns)
step_types__spec__steps__mainbbb__services__readiness__commands (4 columns)
step_types__spec__steps__merge__commands (4 columns)
step_types__spec__steps__merge__environment (4 columns)
step_types__spec__steps__next_version__commands (4 columns)
step_types__spec__steps__release__commands (4 columns)
step_types__spec__steps__release__environment (4 columns)
step_types__spec__steps__rollback__commands (4 columns)
step_types__spec__steps__run_argo_cd__commands (4 columns)
step_types__spec__steps__run_kyml__commands (4 columns)
step_types__spec__steps__run_unit_tests__commands (4 columns)
step_types__spec__steps__runner__environment (4 columns)
step_types__spec__steps__second__commands (4 columns)
step_types__spec__steps__second__environment (4 columns)
step_types__spec__steps__send_message__commands (4 columns)
step_types__spec__steps__send_message__environment (4 columns)
step_types__spec__steps__step1__commands (4 columns)
step_types__spec__steps__step1__environment (4 columns)
step_types__spec__steps__step2__commands (4 columns)
step_types__spec__steps__step3__commands (4 columns)
step_types__spec__steps__step4__commands (4 columns)
step_types__spec__steps__verify__commands (4 columns)
step_types__spec__steps__verify__environment (4 columns)
step_types__spec__steps__where_am_i__commands (4 columns)
step_types__metadata__categories (4 columns)
step_types__metadata__examples (1265 columns)
step_types__metadata__examples__workflow__composition__arguments__composition_candidates__test_service__environment (4 columns)
step_types__metadata__examples__workflow__defacte_dojo__arguments__parameters (4 columns)
step_types__metadata__examples__workflow__edit_yaml_file__arguments__keyvalue_pairs (4 columns)
step_types__metadata__examples__workflow__edit_yaml_file__arguments__key_sets (4 columns)
step_types__metadata__examples__workflow__fetch_secrets__arguments__secrets (6 columns)
step_types__metadata__examples__workflow__freestyle__arguments__commands (4 columns)
step_types__metadata__examples__workflow__get_azure_secret__arguments__secrets (4 columns)
step_types__metadata__examples__workflow__jira_issue_create__arguments__issue_customfields (4 columns)
step_types__metadata__examples__workflow__pull_request_scan__arguments__sonar_analysis_parameters (4 columns)
step_types__metadata__examples__workflow__run_jenkins__arguments__jenkins_build_params (4 columns)
step_types__metadata__examples__workflow__sam_deploy__arguments__parameters (4 columns)
step_types__metadata__examples__workflow__sam_deploy__arguments__tags (4 columns)
step_types__metadata__examples__workflow__sonarqube_custom_dotnet_scan__arguments__dotnet_commands (4 columns)
step_types__metadata__examples__workflow__sonarqube_custom_dotnet_scan__arguments__sonar_analysis_parameters (4 columns)
step_types__metadata__examples__workflow__vault_to_env__arguments__secrets (4 columns)
step_types__metadata__examples__workflow__astra_control_toolkit__arguments__commands (4 columns)
step_types__metadata__examples__workflow__check_version__commands (4 columns)
step_types__metadata__examples__workflow__check_files_changed__arguments__modified_files (4 columns)
step_types__metadata__examples__workflow__codefresh_run__arguments__variable (4 columns)
step_types__metadata__examples__workflow__commit_and_push__arguments__add (4 columns)
step_types__metadata__examples__workflow__create_package__arguments__include (4 columns)
step_types__metadata__examples__workflow__create_release__arguments__packages (4 columns)
step_types__metadata__examples__workflow__delete_merged_branch__commands (4 columns)
step_types__metadata__examples__workflow__deploy__arguments__commands (4 columns)
step_types__metadata__examples__workflow__deploy__arguments__custom_value_files (4 columns)
step_types__metadata__examples__workflow__deploy__arguments__custom_values (4 columns)
step_types__metadata__examples__workflow__deploy_release__arguments__environments (4 columns)
step_types__metadata__examples__workflow__deploy_release__arguments__variables (4 columns)
step_types__metadata__examples__workflow__deploy_release_tenanted__arguments__tenants (4 columns)
step_types__metadata__examples__workflow__deploy_release_tenanted__arguments__tenant_tags (4 columns)
step_types__metadata__examples__workflow__deploy_release_tenanted__arguments__variables (4 columns)
step_types__metadata__examples__workflow__github_release__arguments__commands (4 columns)
step_types__metadata__examples__workflow__github_release__arguments__files (4 columns)
step_types__metadata__examples__workflow__gpg_signed_commit__arguments__add (4 columns)
step_types__metadata__examples__workflow__next_step__commands (4 columns)
step_types__metadata__examples__workflow__next_step_after_that__commands (4 columns)
step_types__metadata__examples__workflow__prepare_credentials__commands (4 columns)
step_types__metadata__examples__workflow__push_build_information__arguments__package_ids (4 columns)
step_types__metadata__examples__workflow__push_package__arguments__packages (4 columns)
step_types__metadata__examples__workflow__run_runbook__arguments__environments (4 columns)
step_types__metadata__examples__workflow__run_runbook__arguments__tenants (4 columns)
step_types__metadata__examples__workflow__run_runbook__arguments__tenant_tags (4 columns)
step_types__metadata__examples__workflow__run_runbook__arguments__variables (4 columns)
step_types__metadata__examples__workflow__scan__arguments__images_list (4 columns)
step_types__metadata__examples__workflow__send_message__arguments__telegram_images (4 columns)
step_types__metadata__examples__workflow__send_message__arguments__telegram_to (4 columns)
step_types__metadata__examples__workflow__steps__check_violations__commands (4 columns)
step_types__metadata__examples__workflow__steps__checkout_many_projects__arguments__git_projects (4 columns)
step_types__metadata__examples__workflow__steps__checkout_many_projects__arguments__projects (4 columns)
step_types__metadata__examples__workflow__steps__generate_helm_manifest__commands (4 columns)
step_types__metadata__examples__workflow__steps__generate_terraform_plan__commands (4 columns)
step_types__metadata__examples__workflow__steps__print_app_version__commands (4 columns)
step_types__metadata__examples__workflow__steps__print_my_variables__commands (4 columns)
step_types__metadata__examples__workflow__steps__print_output__commands (4 columns)
step_types__metadata__examples__workflow__steps__print_tag__commands (4 columns)
step_types__metadata__examples__workflow__steps__print_violations__commands (4 columns)
step_types__metadata__examples__workflow__steps__s3_list_objects__commands (4 columns)
step_types__metadata__examples__workflow__steps__save_reports_and_payload__arguments__add (4 columns)
step_types__metadata__examples__workflow__steps__save_reports_in_s3_bucket__commands (4 columns)
step_types__metadata__examples__workflow__steps__say_hello__arguments__app_dirs (4 columns)
step_types__metadata__examples__workflow__steps__say_hello__arguments__app_names (4 columns)
step_types__metadata__examples__workflow__steps__say_hello__arguments__commands (4 columns)
step_types__metadata__examples__workflow__steps__say_hello__arguments__depends (4 columns)
step_types__metadata__examples__workflow__steps__say_hello__arguments__environment (4 columns)
step_types__metadata__examples__workflow__test_report_uploader__arguments__commands (4 columns)
step_types__metadata__examples__workflow__test_report_uploader__arguments__environment (4 columns)
step_types__metadata__examples__workflow__trivy_image_scan__arguments__flags (4 columns)
step_types__metadata__examples__workflow__upload__arguments__files (4 columns)
step_types__metadata__examples__workflow__use_cluster__commands (4 columns)
step_types__metadata__maintainers (5 columns)
step_types__metadata__sources (4 columns)
step_types__metadata__tags (4 columns)

How the Codefresh sync works

After the first load, Kaivo keeps your BigQuery warehouse up to date for you. Where Codefresh supports it, each sync pulls only new and changed records so it stays fast; otherwise it refreshes the whole table. Every record keeps its original ID, so you won't get duplicate rows.

Frequently asked questions

How long does the initial sync take for Codefresh?

It depends on how much history is in your Codefresh account. Most initial syncs finish within minutes, while large accounts can take a few hours. After that, syncs only fetch new and changed records, so they're much faster.

Can I sync only some tables or columns?

Yes. You pick which tables to sync when you set up the connection and can change the selection later. Tables you don't select are never copied to your warehouse.

What happens when Codefresh's schema changes?

New fields are never added automatically. You choose which fields to sync, so data you haven't selected (sensitive personal data, for example) never lands in your warehouse. When a new field appears, it becomes available for you to add. What happens to removed or renamed fields depends on a table's sync mode: full-refresh tables always match what's currently in Codefresh, so dropped fields disappear, while incremental tables keep their existing columns and history, so an old field stays and newly added fields fill in over time.

Your data lives in your own Kaivo-managed BigQuery warehouse, so the most direct option is to delete or anonymise specific records right in BigQuery. If you delete data in Codefresh instead, full-refresh tables drop it on the next sync, while incremental tables keep it, so you would remove the row in BigQuery or ask us to run a full refresh. To remove everything, delete the Codefresh connector in Kaivo and all of its synced data is deleted with it.

Common use cases for Codefresh data

Build performance

Use builds to track duration, frequency, and failures over time.

Pipeline reliability

Join pipelines with builds to find the pipelines that fail or run slowest.

Project view

Use projects to compare CI health across your repositories.

Use Codefresh data in your AI and BI tools

Once Codefresh data lands in your Kaivo-managed BigQuery warehouse, you can explore it with AI tools or any BI tool that connects to BigQuery. Here's how the most common destinations work with Codefresh data.

Claude

Use Kaivo's MCP server to give Claude secure, workspace-scoped access to your data. Setup guide →

Power BI

Microsoft's BI tool with a native BigQuery connector. Supports direct query and scheduled refresh. Setup guide →

Data Studio

Free Google BI tool with native BigQuery support. One-click connection to your Kaivo warehouse; great for SMB teams on Google Workspace. Setup guide →

Tableau

The premium analytics standard, with native BigQuery integration. Setup guide →

Google Sheets

Use Connected Sheets to query BigQuery directly from a spreadsheet, with no SQL. Setup guide →

Excel

Connect via Power Query's BigQuery connector. Setup guide →

Metabase

Open-source BI tool with strong BigQuery support. Setup guide →

See our pricing page for Codefresh connector pricing and plan details.

Adform: Sync Adform to BigQuery.
Amplitude: Sync Amplitude to BigQuery.
Auth0: Sync Auth0 to BigQuery.
Convex: Sync Convex to BigQuery.
GitHub: Sync GitHub to BigQuery.
GitLab: Sync GitLab to BigQuery.

Was this helpful?

Still need help? Share an idea

What is the Codefresh connector

Getting started with the Codefresh connector

Authenticating Codefresh

Configuring the Codefresh connector

Tables and columns synced from Codefresh

Nested subtables

Nested subtables

Nested subtables

Nested subtables

Nested subtables

Nested subtables

Nested subtables

Nested subtables

Nested subtables

Nested subtables

How the Codefresh sync works

Frequently asked questions

How long does the initial sync take for Codefresh?

Can I sync only some tables or columns?

What happens when Codefresh's schema changes?

How do I handle GDPR or data deletion requests?

Common use cases for Codefresh data

Build performance

Pipeline reliability

Project view

Use Codefresh data in your AI and BI tools

Claude

Power BI

Data Studio

Tableau

Google Sheets

Excel

Metabase

Related connectors