Skip to content
Book a demoStart free
Connectors

Codefresh connector

Set up the Codefresh connector in Kaivo: authentication, configuration, the 13 BigQuery tables it syncs, and answers to common questions.

Codefresh connector pricing, tier and credits on kaivo.io

Kaivo is a fully managed data platform that syncs your Codefresh data into a Google BigQuery warehouse and keeps it up to date automatically. There is no pipeline to build and no infrastructure to run, so you can spend your time analysing your data from Codefresh instead of moving it.

Sync your Codefresh CI data into BigQuery with Kaivo to analyse build performance, pipeline reliability, and delivery speed by project.

CategoryTech
AuthenticationAPI key
SetupSelf-service

Getting started with the Codefresh connector

Section titled “Getting started with the Codefresh connector”
  1. Sign up for Kaivo and create a workspace.
  2. Connect your Codefresh account.
  3. Choose which tables to sync.
  4. Wait for the initial sync to finish.
  5. Query your data in BigQuery or your favourite AI or BI tool.

Authenticate with your API Key.

Field Description
API Key
API key for the Codefresh API. Generate one under your avatar → User Settings → API Keys in the Codefresh UI. The token is only shown once.

|

When you set up the connector, you provide:

Field Description
Account ID
The ID of the Codefresh account to sync.

| | Report Granularity |

Optional. Time grouping for the analytics reports stream. Leave unset for no time-based grouping. Note: each report supports different granularities, so a value valid for one report may be rejected by another.

| | Report Date Range |

Optional. Date range for the analytics reports stream as two YYYY-MM-DD values: the start date followed by the end date. Only affects the analytics reports stream.

| | Start Date |

Any data before this date will not be fetched.

|

Kaivo syncs 13 tables from Codefresh into a dedicated dataset in your BigQuery warehouse. Click any table to see its columns and types.

account_settings (7 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
v FLOAT64
_id STRING
created_at STRING
schema_version STRING
updated_at STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • account_settings__settings__modules (4 columns)
accounts (22 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
_id STRING
default_account FLOAT64
email STRING
has_password BOOL
last_login_date STRING
notification_email STRING
register_date STRING
settings__allow_admin_to_login BOOL
settings__date_format STRING
settings__display_welcome_screen BOOL
settings__filter_inaccessible_kubernetes BOOL
settings__send_weekly_report BOOL
settings__theme STRING
settings__time_format STRING
short_profile__user_name STRING
status STRING
user_name STRING
user_data__email STRING
user_data__image STRING
user_data__name STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • accounts__account (4 columns)
  • accounts__git_ops_settings (4 columns)
  • accounts__logins (7 columns)
  • accounts__logins__permissions (4 columns)
  • accounts__notifications (4 columns)
  • accounts__notifications__events (4 columns)
  • accounts__roles (4 columns)
  • accounts__user_data__emails (4 columns)
agents (9 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
account STRING
id STRING
name STRING
status__health_status STRING
status__message STRING
status__reported_at STRING
token_name STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • agents__runtimes (4 columns)
analytics_metadata (5 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
type STRING
description STRING
report_name STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • analytics_metadata__filters (6 columns)
  • analytics_metadata__mandatory_non_user_filters (5 columns)
  • analytics_metadata__members (5 columns)
  • analytics_metadata__supported_time_dimensions (6 columns)
analytics_reports (6 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
key STRING
report_name STRING
time STRING
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
audit (20 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
account_id STRING
action STRING
correlation_id STRING
created_at STRING
entity STRING
entity_id STRING
entity_name STRING
id FLOAT64
ip STRING
req_body STRING
req_params STRING
req_query STRING
req_url STRING
res_body STRING
rs_status FLOAT64
user_email STRING
user_id STRING
user_name STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
builds (53 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
account STRING
auto_generated_yaml BOOL
branch_name STRING
branch_url STRING
build_strategy STRING
commit_message STRING
commit_url STRING
committer STRING
committer_avatar STRING
created STRING
delayed FLOAT64
event STRING
event_label STRING
event_name STRING
final_workflow_yaml STRING
finished STRING
has_extended_yaml BOOL
has_implicit_git_clone_step BOOL
id STRING
initiator STRING
initiator_avatar STRING
keep_pv_cs_for_pending_approval BOOL
pack_id STRING
pending_approval_concurrency_applied BOOL
pending_license BOOL
pending_reason STRING
permit_restart_from_failed_steps BOOL
pipeline_name STRING
pipeline_trigger_id STRING
pipeline_trigger_name STRING
progress STRING
project STRING
project_id STRING
provider STRING
repo_name STRING
repo_owner STRING
repo_url STRING
request STRING
revision STRING
runtime__scheduler_config__type STRING
service_id STRING
service_name STRING
started STRING
status STRING
trigger STRING
trigger_type STRING
triggered_by STRING
triggers_count FLOAT64
use_debugger BOOL
user_yaml_descriptor STRING
webhook_triggered BOOL
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • builds__annotations (9 columns)
  • builds__exposed_variables__pipeline (5 columns)
  • builds__exposed_variables__pipeline_trigger (5 columns)
  • builds__exposed_variables__pipeline_trigger_shared (4 columns)
  • builds__exposed_variables__project (4 columns)
  • builds__exposed_variables__shared (4 columns)
  • builds__pending_approvals (4 columns)
  • builds__steps (4 columns)
  • builds__system_events (10 columns)
  • builds__termination_request (9 columns)
contexts (14 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
spec__type STRING
spec__data__auth__type STRING
spec__data__auth__idp_id STRING
spec__data__auth__password STRING
spec__data__repository_url STRING
spec__data__sharing_policy STRING
metadata__default BOOL
metadata__name STRING
metadata__system BOOL
api_version STRING
kind STRING
owner STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • contexts__spec__data__auth__permissions (4 columns)
  • contexts__spec__data__secret_store_references (4 columns)
execution_contexts (10 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
description STRING
v FLOAT64
_id STRING
account STRING
account_default BOOL
created_at STRING
name STRING
updated_at STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • execution_contexts__tags (4 columns)
helm_repos (6 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
created_at STRING
name STRING
public BOOL
updated_at STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
pipelines (36 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
version STRING
spec__runtime_environment__cpu STRING
spec__runtime_environment__memory STRING
spec__runtime_environment__name STRING
spec__steps__build__type STRING
spec__steps__build__dockerfile STRING
spec__steps__build__image_name STRING
spec__steps__build__stage STRING
spec__steps__build__tag STRING
spec__steps__build__title STRING
spec__steps__build__working_directory STRING
spec__steps__clone__type STRING
spec__steps__clone__git STRING
spec__steps__clone__repo STRING
spec__steps__clone__revision STRING
spec__steps__clone__stage STRING
spec__steps__clone__title STRING
spec__steps__test__type STRING
spec__steps__test__image STRING
spec__steps__test__stage STRING
spec__steps__test__title STRING
spec__steps__test__working_directory STRING
metadata__account_id STRING
metadata__created_at STRING
metadata__id STRING
metadata__name STRING
metadata__original_yaml_string STRING
metadata__project STRING
metadata__project_id STRING
metadata__revision FLOAT64
metadata__short_name STRING
metadata__updated_at STRING
kind STRING
last_executed STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • pipelines__spec__contexts (4 columns)
  • pipelines__spec__external_resources (4 columns)
  • pipelines__spec__stages (4 columns)
  • pipelines__spec__steps__test__commands (4 columns)
  • pipelines__spec__termination_policy (4 columns)
  • pipelines__spec__triggers (20 columns)
  • pipelines__spec__triggers__contexts (4 columns)
  • pipelines__spec__triggers__events (4 columns)
  • pipelines__spec__triggers__gerrit_ci_status_labels (4 columns)
  • pipelines__spec__variables (4 columns)
  • pipelines__metadata__labels__tags (4 columns)
projects (10 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
metadata__created_at STRING
account_id STRING
favorite BOOL
id STRING
image STRING
pipelines_number FLOAT64
project_name STRING
updated_at STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • projects__tags (4 columns)
  • projects__variables (4 columns)
step_types (117 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
version STRING
spec__arguments STRING
spec__delimiters__left STRING
spec__delimiters__right STRING
spec__returns STRING
spec__steps__bump__image STRING
spec__steps__bump__name STRING
spec__steps__bump__shell STRING
spec__steps__bump__title STRING
spec__steps__bump__working_directory STRING
spec__steps__clone__type STRING
spec__steps__clone__git STRING
spec__steps__clone__repo STRING
spec__steps__clone__revision STRING
spec__steps__clone__stage STRING
spec__steps__clone__title STRING
spec__steps__commit_and_push__image STRING
spec__steps__commit_and_push__shell STRING
spec__steps__commit_and_push__title STRING
spec__steps__create_pr_comment__image STRING
spec__steps__create_pr_comment__title STRING
spec__steps__execute_argo_cd__image STRING
spec__steps__execute_argo_cd__title STRING
spec__steps__export_access_token__image STRING
spec__steps__export_access_token__title STRING
spec__steps__first__image STRING
spec__steps__first__title STRING
spec__steps__get_current_version__image STRING
spec__steps__get_github_token__image STRING
spec__steps__get_github_token__title STRING
spec__steps__heroku_deployer__image STRING
spec__steps__heroku_deployer__title STRING
spec__steps__main__twistlock_scan_image__type STRING
spec__steps__main__twistlock_scan_image__add_flow_volume_to_composition BOOL
spec__steps__main__twistlock_scan_image__composition__version STRING
spec__steps__main__twistlock_scan_image__composition__services__targetimage__command STRING
spec__steps__main__twistlock_scan_image__composition__services__targetimage__image STRING
spec__steps__main__twistlock_scan_image__composition__services__targetimage__labels__build_image_id STRING
spec__steps__main__twistlock_scan_image__composition_candidates__scan_service__command STRING
spec__steps__main__twistlock_scan_image__composition_candidates__scan_service__image STRING
spec__steps__main__cmd STRING
spec__steps__main__image STRING
spec__steps__main__name STRING
spec__steps__main__shell STRING
spec__steps__main__title STRING
spec__steps__main__working_directory STRING
spec__steps__main_clone__type STRING
spec__steps__main_clone__repo STRING
spec__steps__main_clone__revision STRING
spec__steps__mainbbb__image STRING
spec__steps__mainbbb__name STRING
spec__steps__mainbbb__services__composition__clair__image STRING
spec__steps__mainbbb__services__composition__clair__restart STRING
spec__steps__mainbbb__services__composition__postgres__image STRING
spec__steps__mainbbb__services__composition__postgres__user STRING
spec__steps__mainbbb__services__name STRING
spec__steps__mainbbb__services__readiness__image STRING
spec__steps__mainbbb__services__readiness__timeout_seconds FLOAT64
spec__steps__merge__image STRING
spec__steps__merge__working_directory STRING
spec__steps__next_version__image STRING
spec__steps__release__git STRING
spec__steps__release__image STRING
spec__steps__release__shell STRING
spec__steps__release__title STRING
spec__steps__rollback__image STRING
spec__steps__rollback__title STRING
spec__steps__run_argo_cd__image STRING
spec__steps__run_argo_cd__title STRING
spec__steps__run_kyml__image STRING
spec__steps__run_kyml__title STRING
spec__steps__run_unit_tests__image STRING
spec__steps__run_unit_tests__title STRING
spec__steps__run_unit_tests__working_directory STRING
spec__steps__runner__image STRING
spec__steps__runner__title STRING
spec__steps__second__image STRING
spec__steps__second__name STRING
spec__steps__send_message__image STRING
spec__steps__send_message__name STRING
spec__steps__step1__image STRING
spec__steps__step1__name STRING
spec__steps__step2__image STRING
spec__steps__step2__name STRING
spec__steps__step3__image STRING
spec__steps__step3__name STRING
spec__steps__step4__image STRING
spec__steps__step4__name STRING
spec__steps__step4__when__condition__all__changes_exist STRING
spec__steps__verify__image STRING
spec__steps__verify__title STRING
spec__steps__where_am_i__image STRING
spec__steps__where_am_i__title STRING
spec__steps_template STRING
metadata__version STRING
metadata__description STRING
metadata__account_id STRING
metadata__created_at STRING
metadata__icon__type STRING
metadata__icon__background STRING
metadata__icon__color STRING
metadata__icon__name STRING
metadata__icon__size__large__url STRING
metadata__icon__url STRING
metadata__id STRING
metadata__is_public BOOL
metadata__latest BOOL
metadata__name STRING
metadata__official BOOL
metadata__source_url STRING
metadata__stage STRING
metadata__title STRING
metadata__updated_at STRING
kind STRING
metrics__finished FLOAT64
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • step_types__spec__steps__bump__commands (4 columns)
  • step_types__spec__steps__commit_and_push__commands (4 columns)
  • step_types__spec__steps__commit_and_push__environment (4 columns)
  • step_types__spec__steps__create_pr_comment__commands (4 columns)
  • step_types__spec__steps__create_pr_comment__environment (4 columns)
  • step_types__spec__steps__execute_argo_cd__commands (4 columns)
  • step_types__spec__steps__export_access_token__commands (4 columns)
  • step_types__spec__steps__export_access_token__environment (4 columns)
  • step_types__spec__steps__first__commands (4 columns)
  • step_types__spec__steps__first__environment (4 columns)
  • step_types__spec__steps__get_current_version__commands (4 columns)
  • step_types__spec__steps__get_github_token__commands (4 columns)
  • step_types__spec__steps__get_github_token__environment (4 columns)
  • step_types__spec__steps__heroku_deployer__commands (4 columns)
  • step_types__spec__steps__main__twistlock_scan_image__composition_candidates__scan_service__depends_on (4 columns)
  • step_types__spec__steps__main__twistlock_scan_image__composition_candidates__scan_service__environment (4 columns)
  • step_types__spec__steps__main__twistlock_scan_image__composition_candidates__scan_service__volumes (4 columns)
  • step_types__spec__steps__main__commands (4 columns)
  • step_types__spec__steps__main__environment (4 columns)
  • step_types__spec__steps__mainbbb__environment (4 columns)
  • step_types__spec__steps__mainbbb__services__composition__clair__depends_on (4 columns)
  • step_types__spec__steps__mainbbb__services__composition__clair__ports (4 columns)
  • step_types__spec__steps__mainbbb__services__composition__postgres__ports (4 columns)
  • step_types__spec__steps__mainbbb__services__readiness__commands (4 columns)
  • step_types__spec__steps__merge__commands (4 columns)
  • step_types__spec__steps__merge__environment (4 columns)
  • step_types__spec__steps__next_version__commands (4 columns)
  • step_types__spec__steps__release__commands (4 columns)
  • step_types__spec__steps__release__environment (4 columns)
  • step_types__spec__steps__rollback__commands (4 columns)
  • step_types__spec__steps__run_argo_cd__commands (4 columns)
  • step_types__spec__steps__run_kyml__commands (4 columns)
  • step_types__spec__steps__run_unit_tests__commands (4 columns)
  • step_types__spec__steps__runner__environment (4 columns)
  • step_types__spec__steps__second__commands (4 columns)
  • step_types__spec__steps__second__environment (4 columns)
  • step_types__spec__steps__send_message__commands (4 columns)
  • step_types__spec__steps__send_message__environment (4 columns)
  • step_types__spec__steps__step1__commands (4 columns)
  • step_types__spec__steps__step1__environment (4 columns)
  • step_types__spec__steps__step2__commands (4 columns)
  • step_types__spec__steps__step3__commands (4 columns)
  • step_types__spec__steps__step4__commands (4 columns)
  • step_types__spec__steps__verify__commands (4 columns)
  • step_types__spec__steps__verify__environment (4 columns)
  • step_types__spec__steps__where_am_i__commands (4 columns)
  • step_types__metadata__categories (4 columns)
  • step_types__metadata__examples (1265 columns)
  • step_types__metadata__examples__workflow__composition__arguments__composition_candidates__test_service__environment (4 columns)
  • step_types__metadata__examples__workflow__defacte_dojo__arguments__parameters (4 columns)
  • step_types__metadata__examples__workflow__edit_yaml_file__arguments__keyvalue_pairs (4 columns)
  • step_types__metadata__examples__workflow__edit_yaml_file__arguments__key_sets (4 columns)
  • step_types__metadata__examples__workflow__fetch_secrets__arguments__secrets (6 columns)
  • step_types__metadata__examples__workflow__freestyle__arguments__commands (4 columns)
  • step_types__metadata__examples__workflow__get_azure_secret__arguments__secrets (4 columns)
  • step_types__metadata__examples__workflow__jira_issue_create__arguments__issue_customfields (4 columns)
  • step_types__metadata__examples__workflow__pull_request_scan__arguments__sonar_analysis_parameters (4 columns)
  • step_types__metadata__examples__workflow__run_jenkins__arguments__jenkins_build_params (4 columns)
  • step_types__metadata__examples__workflow__sam_deploy__arguments__parameters (4 columns)
  • step_types__metadata__examples__workflow__sam_deploy__arguments__tags (4 columns)
  • step_types__metadata__examples__workflow__sonarqube_custom_dotnet_scan__arguments__dotnet_commands (4 columns)
  • step_types__metadata__examples__workflow__sonarqube_custom_dotnet_scan__arguments__sonar_analysis_parameters (4 columns)
  • step_types__metadata__examples__workflow__vault_to_env__arguments__secrets (4 columns)
  • step_types__metadata__examples__workflow__astra_control_toolkit__arguments__commands (4 columns)
  • step_types__metadata__examples__workflow__check_version__commands (4 columns)
  • step_types__metadata__examples__workflow__check_files_changed__arguments__modified_files (4 columns)
  • step_types__metadata__examples__workflow__codefresh_run__arguments__variable (4 columns)
  • step_types__metadata__examples__workflow__commit_and_push__arguments__add (4 columns)
  • step_types__metadata__examples__workflow__create_package__arguments__include (4 columns)
  • step_types__metadata__examples__workflow__create_release__arguments__packages (4 columns)
  • step_types__metadata__examples__workflow__delete_merged_branch__commands (4 columns)
  • step_types__metadata__examples__workflow__deploy__arguments__commands (4 columns)
  • step_types__metadata__examples__workflow__deploy__arguments__custom_value_files (4 columns)
  • step_types__metadata__examples__workflow__deploy__arguments__custom_values (4 columns)
  • step_types__metadata__examples__workflow__deploy_release__arguments__environments (4 columns)
  • step_types__metadata__examples__workflow__deploy_release__arguments__variables (4 columns)
  • step_types__metadata__examples__workflow__deploy_release_tenanted__arguments__tenants (4 columns)
  • step_types__metadata__examples__workflow__deploy_release_tenanted__arguments__tenant_tags (4 columns)
  • step_types__metadata__examples__workflow__deploy_release_tenanted__arguments__variables (4 columns)
  • step_types__metadata__examples__workflow__github_release__arguments__commands (4 columns)
  • step_types__metadata__examples__workflow__github_release__arguments__files (4 columns)
  • step_types__metadata__examples__workflow__gpg_signed_commit__arguments__add (4 columns)
  • step_types__metadata__examples__workflow__next_step__commands (4 columns)
  • step_types__metadata__examples__workflow__next_step_after_that__commands (4 columns)
  • step_types__metadata__examples__workflow__prepare_credentials__commands (4 columns)
  • step_types__metadata__examples__workflow__push_build_information__arguments__package_ids (4 columns)
  • step_types__metadata__examples__workflow__push_package__arguments__packages (4 columns)
  • step_types__metadata__examples__workflow__run_runbook__arguments__environments (4 columns)
  • step_types__metadata__examples__workflow__run_runbook__arguments__tenants (4 columns)
  • step_types__metadata__examples__workflow__run_runbook__arguments__tenant_tags (4 columns)
  • step_types__metadata__examples__workflow__run_runbook__arguments__variables (4 columns)
  • step_types__metadata__examples__workflow__scan__arguments__images_list (4 columns)
  • step_types__metadata__examples__workflow__send_message__arguments__telegram_images (4 columns)
  • step_types__metadata__examples__workflow__send_message__arguments__telegram_to (4 columns)
  • step_types__metadata__examples__workflow__steps__check_violations__commands (4 columns)
  • step_types__metadata__examples__workflow__steps__checkout_many_projects__arguments__git_projects (4 columns)
  • step_types__metadata__examples__workflow__steps__checkout_many_projects__arguments__projects (4 columns)
  • step_types__metadata__examples__workflow__steps__generate_helm_manifest__commands (4 columns)
  • step_types__metadata__examples__workflow__steps__generate_terraform_plan__commands (4 columns)
  • step_types__metadata__examples__workflow__steps__print_app_version__commands (4 columns)
  • step_types__metadata__examples__workflow__steps__print_my_variables__commands (4 columns)
  • step_types__metadata__examples__workflow__steps__print_output__commands (4 columns)
  • step_types__metadata__examples__workflow__steps__print_tag__commands (4 columns)
  • step_types__metadata__examples__workflow__steps__print_violations__commands (4 columns)
  • step_types__metadata__examples__workflow__steps__s3_list_objects__commands (4 columns)
  • step_types__metadata__examples__workflow__steps__save_reports_and_payload__arguments__add (4 columns)
  • step_types__metadata__examples__workflow__steps__save_reports_in_s3_bucket__commands (4 columns)
  • step_types__metadata__examples__workflow__steps__say_hello__arguments__app_dirs (4 columns)
  • step_types__metadata__examples__workflow__steps__say_hello__arguments__app_names (4 columns)
  • step_types__metadata__examples__workflow__steps__say_hello__arguments__commands (4 columns)
  • step_types__metadata__examples__workflow__steps__say_hello__arguments__depends (4 columns)
  • step_types__metadata__examples__workflow__steps__say_hello__arguments__environment (4 columns)
  • step_types__metadata__examples__workflow__test_report_uploader__arguments__commands (4 columns)
  • step_types__metadata__examples__workflow__test_report_uploader__arguments__environment (4 columns)
  • step_types__metadata__examples__workflow__trivy_image_scan__arguments__flags (4 columns)
  • step_types__metadata__examples__workflow__upload__arguments__files (4 columns)
  • step_types__metadata__examples__workflow__use_cluster__commands (4 columns)
  • step_types__metadata__maintainers (5 columns)
  • step_types__metadata__sources (4 columns)
  • step_types__metadata__tags (4 columns)

After the first load, Kaivo keeps your BigQuery warehouse up to date for you. Where Codefresh supports it, each sync pulls only new and changed records so it stays fast; otherwise it refreshes the whole table. Every record keeps its original ID, so you won’t get duplicate rows.

How long does the initial sync take for Codefresh?

Section titled “How long does the initial sync take for Codefresh?”

It depends on how much history is in your Codefresh account. Most initial syncs finish within minutes, while large accounts can take a few hours. After that, syncs only fetch new and changed records, so they’re much faster.

Yes. You pick which tables to sync when you set up the connection and can change the selection later. Tables you don’t select are never copied to your warehouse.

What happens when Codefresh’s schema changes?

Section titled “What happens when Codefresh’s schema changes?”

New fields are never added automatically. You choose which fields to sync, so data you haven’t selected (sensitive personal data, for example) never lands in your warehouse. When a new field appears, it becomes available for you to add. What happens to removed or renamed fields depends on a table’s sync mode: full-refresh tables always match what’s currently in Codefresh, so dropped fields disappear, while incremental tables keep their existing columns and history, so an old field stays and newly added fields fill in over time.

How do I handle GDPR or data deletion requests?

Section titled “How do I handle GDPR or data deletion requests?”

Your data lives in your own Kaivo-managed BigQuery warehouse, so the most direct option is to delete or anonymise specific records right in BigQuery. If you delete data in Codefresh instead, full-refresh tables drop it on the next sync, while incremental tables keep it, so you would remove the row in BigQuery or ask us to run a full refresh. To remove everything, delete the Codefresh connector in Kaivo and all of its synced data is deleted with it.

Use builds to track duration, frequency, and failures over time.

Join pipelines with builds to find the pipelines that fail or run slowest.

Use projects to compare CI health across your repositories.

Use Codefresh data in your AI and BI tools

Section titled “Use Codefresh data in your AI and BI tools”

Once Codefresh data lands in your Kaivo-managed BigQuery warehouse, you can explore it with AI tools or any BI tool that connects to BigQuery. Here’s how the most common destinations work with Codefresh data.

Use Kaivo’s MCP server to give Claude secure, workspace-scoped access to your data. Setup guide →

Microsoft’s BI tool with a native BigQuery connector. Supports direct query and scheduled refresh. Setup guide →

Free Google BI tool with native BigQuery support. One-click connection to your Kaivo warehouse; great for SMB teams on Google Workspace. Setup guide →

The premium analytics standard, with native BigQuery integration. Setup guide →

Use Connected Sheets to query BigQuery directly from a spreadsheet, with no SQL. Setup guide →

Connect via Power Query’s BigQuery connector. Setup guide →

Open-source BI tool with strong BigQuery support. Setup guide →

See our pricing page for Codefresh connector pricing and plan details.

  • Adform: Sync Adform to BigQuery.
  • Amplitude: Sync Amplitude to BigQuery.
  • Auth0: Sync Auth0 to BigQuery.
  • Convex: Sync Convex to BigQuery.
  • GitHub: Sync GitHub to BigQuery.
  • GitLab: Sync GitLab to BigQuery.