Skip to content
Book a demoStart free
Connectors

GitLab connector

Set up the GitLab connector in Kaivo: authentication, configuration, the 23 BigQuery tables it syncs, and answers to common questions.

GitLab connector pricing, tier and credits on kaivo.io

Kaivo is a fully managed data platform that syncs your GitLab data into a Google BigQuery warehouse and keeps it up to date automatically. There is no pipeline to build and no infrastructure to run, so you can spend your time analysing your project management data instead of moving it.

Sync your GitLab projects, issues, epics, and releases into BigQuery with Kaivo to report on engineering delivery alongside the rest of your data.

CategoryTech, Project Management
AuthenticationAPI key
SetupSelf-service
  1. Sign up for Kaivo and create a workspace.
  2. Connect your GitLab account.
  3. Choose which tables to sync.
  4. Wait for the initial sync to finish.
  5. Query your data in BigQuery or your favourite AI or BI tool.

Authenticate with your Private Token.

Field Description
Private Token
Log into your GitLab account and then generate a personal Access Token.

|

When you set up the connector, you provide:

Field Description
Start Date
Any data before this date will not be fetched.

| | API URL |

Please enter your basic URL from GitLab instance.

| | Groups |

List of GitLab groups. e.g. my-group.

| | Projects |

List of GitLab projects. e.g. my-group/my-project.

|

Kaivo syncs 23 tables from GitLab into a dedicated dataset in your BigQuery warehouse. Click any table to see its columns and types.

branches (12 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
project_id INT64 ID of the project to which this branch belongs.
name STRING Name of the branch.
merged BOOL Indicates if the changes in this branch have been merged into another branch.
protected BOOL Indicates if the branch is protected to prevent direct pushes.
developers_can_push BOOL Indicates if developers can push changes to this branch.
developers_can_merge BOOL Indicates if developers can merge changes to this branch.
can_push BOOL Indicates if the user has permission to push changes to this branch.
default BOOL Indicates if this is the default branch of the project.
web_url STRING URL to view the branch in a web browser.
commit_id STRING ID of the commit associated with this branch.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
commits (18 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
project_id INT64 ID of the project to which the commit belongs.
id STRING Unique identifier of the commit.
short_id STRING Shortened version of the commit’s unique identifier.
created_at TIMESTAMP Date and time when the commit record was created.
title STRING Title or summary of the commit message.
message STRING Description or text message associated with the commit.
author_name STRING Name of the author who created the commit.
author_email STRING Email of the author who created the commit.
authored_date TIMESTAMP Date and time when the commit was authored.
committer_name STRING Name of the committer who committed the changes.
committer_email STRING Email of the committer who committed the changes.
committed_date TIMESTAMP Date and time when the commit was committed.
web_url STRING URL link to view the commit details in a web browser.
stats__additions INT64 Number of lines added in the commit.
stats__deletions INT64 Number of lines deleted in the commit.
stats__total INT64 Total number of lines changed in the commit.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • commits__parent_ids (4 columns)
  • commits__extended_trailers__cc (4 columns)
deployments (56 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
id INT64 Unique identifier of the deployment
iid INT64 Identification number of the deployment
status STRING Status of the deployment
ref STRING Reference of the deployment
sha STRING SHA of the deployment
environment_name STRING Name of the environment
created_at TIMESTAMP The timestamp when the deployment was created
updated_at TIMESTAMP Timestamp when the deployment was last updated
user_full_name STRING Full name of the user associated with the deployment
user_username STRING Username of the user associated with the deployment
user_id INT64 Unique identifier of the user associated with the deployment
environment_id INT64 Unique identifier of the environment
project_id INT64 Unique identifier of the project
deployable__commit__author_email STRING Email of the author of the commit
deployable__commit__author_name STRING Name of the author of the commit
deployable__commit__created_at TIMESTAMP Timestamp when the commit was created
deployable__commit__id STRING Unique identifier of the commit
deployable__commit__message STRING Message associated with the commit
deployable__commit__short_id STRING Short identifier of the commit
deployable__commit__title STRING Title of the commit
deployable__coverage STRING Coverage information of the deployment
deployable__created_at TIMESTAMP Timestamp when the deployment was created
deployable__finished_at TIMESTAMP Timestamp when the deployment was finished
deployable__id INT64 Unique identifier of the deployment
deployable__name STRING Name of the deployment
deployable__ref STRING Reference of the deployment
deployable__runner STRING Runner information for the deployment
deployable__stage STRING Stage of the deployment
deployable__started_at TIMESTAMP Timestamp when the deployment was started
deployable__status STRING Status of the deployment
deployable__tag BOOL Tag information for the deployment
deployable__project__ci_job_token_scope_enabled BOOL Flag indicating if the CI job token scope is enabled for the project
deployable__user__id INT64 Unique identifier of the user
deployable__user__name STRING Name of the user
deployable__user__username STRING Username of the user
deployable__user__state STRING State information of the user
deployable__user__avatar_url STRING URL of the user’s avatar
deployable__user__web_url STRING URL for accessing the user’s information
deployable__user__created_at TIMESTAMP Timestamp when the user was created
deployable__user__bio STRING Bio information of the user
deployable__user__location STRING Location information of the user
deployable__user__public_email STRING Public email of the user
deployable__user__skype STRING Skype ID of the user
deployable__user__linkedin STRING Linkedin profile of the user
deployable__user__twitter STRING Twitter handle of the user
deployable__user__website_url STRING URL for the user’s website
deployable__user__organization STRING Organization information of the user
deployable__pipeline__created_at TIMESTAMP Timestamp when the pipeline associated with the deployment was created
deployable__pipeline__id INT64 Unique identifier of the pipeline
deployable__pipeline__ref STRING Reference of the pipeline
deployable__pipeline__sha STRING SHA of the pipeline
deployable__pipeline__status STRING Status of the pipeline
deployable__pipeline__updated_at TIMESTAMP Timestamp when the pipeline associated with the deployment was last updated
deployable__pipeline__web_url STRING URL for accessing the pipeline in a web browser
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
epic_issues (64 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
id INT64 ID of the epic issue.
iid INT64 Internal ID of the epic issue.
project_id INT64 ID of the project the epic issue belongs to.
title STRING Title of the epic issue.
description STRING Description of the epic issue.
state STRING State of the epic issue.
created_at TIMESTAMP Timestamp when the epic issue was created.
updated_at TIMESTAMP Timestamp when the epic issue was last updated.
closed_at TIMESTAMP Timestamp when the epic issue was closed.
milestone_id INT64 ID of the milestone associated with the epic issue.
assignee_id INT64 ID of the user assigned to the epic issue.
author_id INT64 ID of the user who authored the epic issue.
user_notes_count INT64 Number of user notes added to the epic issue.
upvotes INT64 Number of upvotes received for the epic issue.
downvotes INT64 Number of downvotes received for the epic issue.
due_date DATE Due date set for the epic issue.
confidential BOOL Indicates if the epic issue is confidential.
weight INT64 Weight assigned to the epic issue.
discussion_locked BOOL Indicates if the discussion on the epic issue is locked.
web_url STRING URL link to access the epic issue.
epic_issue_id INT64 ID of the epic issue.
merge_requests_count INT64 Number of merge requests related to the epic issue.
type STRING Type of the epic issue.
task_status STRING Status of tasks associated with the epic issue.
moved_to_id INT64 ID of the epic issue it was moved to.
iteration__id INT64
iteration__iid INT64
iteration__sequence INT64
iteration__group_id INT64
iteration__title STRING
iteration__description STRING
iteration__state INT64
iteration__created_at TIMESTAMP Timestamp when the iteration was created.
iteration__updated_at TIMESTAMP Timestamp when the iteration was last updated.
iteration__start_date DATE Start date of the iteration.
iteration__due_date DATE Due date set for the iteration.
iteration__web_url STRING
has_tasks BOOL Indicates if the epic issue has associated tasks.
blocking_issues_count INT64 Number of blocking issues related to the epic issue.
closed_by__state STRING
closed_by__web_url STRING
closed_by__avatar_url STRING
closed_by__username STRING
closed_by__id INT64
closed_by__name STRING
references__full STRING
references__relative STRING
references__short STRING
epic__id INT64
epic__iid INT64
epic__title STRING
epic__url STRING
epic__group_id INT64
epic__human_readable_end_date STRING
epic__human_readable_timestamp STRING
issue_type STRING Type of the epic issue.
severity STRING Severity level of the epic issue.
service_desk_reply_to STRING ID of the service desk reply related to the epic issue.
task_completion_status__count INT64 Total count of tasks.
task_completion_status__completed_count INT64 Number of completed tasks.
relative_position INT64 Relative position of the epic issue.
epic_iid INT64 Internal ID of the epic the issue belongs to.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • epic_issues__labels (4 columns)
  • epic_issues__assignees (4 columns)
epics (37 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
id INT64 Unique ID of the epic
iid INT64 Internal ID of the epic
group_id INT64 ID of the group to which the epic belongs
parent_id INT64 ID of the parent epic, if any
title STRING Title of the epic
description STRING Description of the epic
state STRING Current state of the epic
confidential BOOL Flag indicating if the epic is confidential
web_url STRING URL for viewing the epic in a web browser
reference STRING Reference for the epic
author_id INT64 ID of the author
start_date STRING Start date of the epic
start_date_is_fixed BOOL Flag indicating if the start date is fixed
start_date_fixed DATE Fixed start date of the epic
start_date_from_inherited_source STRING Start date inherited from another source
end_date STRING End date of the epic
due_date STRING Due date of the epic
due_date_is_fixed BOOL Flag indicating if the due date is fixed
due_date_fixed DATE Fixed due date of the epic
due_date_from_inherited_source STRING Due date inherited from another source
created_at TIMESTAMP Date and time when the epic was created
updated_at TIMESTAMP Date and time when the epic was last updated
closed_at TIMESTAMP Date and time when the epic was closed
upvotes INT64 Number of upvotes received by the epic
downvotes INT64 Number of downvotes received by the epic
parent_iid INT64 Internal ID of the parent epic
color STRING Color associated with the epic
text_color STRING Text color associated with the epic
web_edit_url STRING URL for editing the epic in a web browser
due_date_from_milestones DATE Due date linked to milestone
_links__self STRING Link to the epic resource itself
_links__epic_issues STRING Link to the list of issues associated with the epic
_links__group STRING Link to the group to which the epic belongs
_links__parent STRING Link to the parent epic, if any
start_date_from_milestones DATE Start date linked to milestone
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • epics__labels (4 columns)
group_issue_boards (11 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
id INT64 The unique identifier of the board.
name STRING The name of the board.
hide_backlog_list BOOL Flag indicating whether the backlog list is hidden.
hide_closed_list BOOL Flag indicating whether the closed list is hidden.
project INT64 Additional information or settings related to the project.
group_id INT64 The ID of the group to which the board belongs.
group__id INT64 The ID of the group to which the board belongs.
group__name STRING The name of the group to which the board belongs.
group__web_url STRING The URL of the group’s web interface.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • group_issue_boards__lists (11 columns)
group_labels (13 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
group_id INT64 The unique identifier of the group to which the label belongs.
id INT64 The unique identifier of the group label.
name STRING The name of the group label.
color STRING The color associated with the group label for visual identification.
description STRING The short description of the group label.
description_html STRING The HTML formatted description of the group label.
text_color STRING The text color used for the group label.
subscribed BOOL Indicates if the user is subscribed to notifications for this group label.
open_issues_count INT64 The total number of open issues in the group label.
closed_issues_count INT64 The total number of closed issues in the group label.
open_merge_requests_count INT64 The total number of open merge requests in the group label.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
group_members (15 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
group_id INT64
id INT64
name STRING
username STRING
state STRING
membership_state STRING
avatar_url STRING
web_url STRING
access_level INT64
created_at TIMESTAMP
expires_at TIMESTAMP
created_by JSON
locked BOOL
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
group_milestones (14 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
id INT64 The unique identifier of the milestone
iid INT64 The internal identifier of the milestone
group_id INT64 The unique identifier of the group to which the milestone belongs
title STRING The title or name of the milestone
description STRING The detailed description of the milestone
state STRING The current state of the milestone (e.g., open, closed)
created_at TIMESTAMP The datetime when the milestone was created
updated_at TIMESTAMP The datetime when the milestone was last updated
due_date DATE The date by which the milestone is expected to be completed
start_date DATE The date when the milestone is scheduled to start
expired BOOL Indicates whether the milestone has expired
web_url STRING The URL to access the milestone in the web interface
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
groups (43 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
id INT64 Unique identifier for the group.
organization_id INT64 Identifier of the organization to which the group belongs.
default_branch_protection_defaults__allow_force_push BOOL Indicates if force push is allowed.
web_url STRING URL for accessing the group via web.
name STRING Name of the group.
path STRING Path of the group.
description STRING Description of the group.
visibility STRING Visibility level of the group.
share_with_group_lock BOOL Indicates if sharing with group is locked.
require_two_factor_authentication BOOL Indicates if two-factor authentication is required.
two_factor_grace_period INT64 Grace period for two-factor authentication.
project_creation_level STRING Project creation level for the group.
auto_devops_enabled BOOL Indicates if Auto DevOps is enabled for this group.
subgroup_creation_level STRING Subgroup creation level for the group.
enabled_git_access_protocol STRING Indicates the enabled Git access protocol for the group.
emails_disabled BOOL Indicates if emails are disabled for the group.
emails_enabled BOOL Indicates if emails are enabled for the group.
mentions_disabled BOOL Indicates if mentions are disabled for the group.
lfs_enabled BOOL Indicates if LFS is enabled for the group.
default_branch_protection INT64 Indicates the default branch protection level for the group.
avatar_url STRING URL of the group’s avatar.
request_access_enabled BOOL Indicates if request access is enabled for the group.
full_name STRING Full name of the group.
full_path STRING Full path of the group.
created_at TIMESTAMP Timestamp when the group was created.
parent_id INT64 Identifier of the parent group.
ldap_cn STRING LDAP CN for the group.
ldap_access STRING Indicates LDAP access for the group.
runners_token STRING Token used for shared runners.
shared_runners_minutes_limit INT64 Shared runners minutes limit for the group.
extra_shared_runners_minutes_limit INT64 Extra shared runners minutes limit for the group.
prevent_forking_outside_group BOOL Indicates if forking outside the group is prevented.
wiki_access_level STRING Access level for wiki in the group.
marked_for_deletion_on DATE Date when the group was marked for deletion.
prevent_sharing_groups_outside_hierarchy BOOL Indicates if sharing groups outside hierarchy is prevented.
membership_lock BOOL Indicates if membership is locked for the group.
ip_restriction_ranges STRING IP restriction ranges for the group.
shared_runners_setting STRING Setting for shared runners.
service_access_tokens_expiration_enforced BOOL Indicates if service access tokens expiration is enforced.
lock_math_rendering_limits_enabled BOOL Indicates if math rendering limits are locked.
math_rendering_limits_enabled BOOL Indicates if math rendering limits are enabled.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • groups__projects (5 columns)
  • groups__default_branch_protection_defaults__allowed_to_merge (4 columns)
  • groups__default_branch_protection_defaults__allowed_to_push (4 columns)
  • groups__shared_with_groups (4 columns)
  • groups__shared_projects (4 columns)
issues (77 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
id INT64 ID of the issue.
iid INT64 Internal ID of the issue.
project_id INT64 ID of the project to which the issue belongs.
title STRING Title of the issue.
description STRING Description of the issue.
state STRING State of the issue.
created_at TIMESTAMP Date and time when the issue was created.
updated_at TIMESTAMP Date and time when the issue was last updated.
closed_at TIMESTAMP Date and time when the issue was closed.
type STRING Type of the issue.
user_notes_count INT64 Number of user notes added to the issue.
merge_requests_count INT64 Number of merge requests associated with the issue.
upvotes INT64 Number of upvotes for the issue.
downvotes INT64 Number of downvotes for the issue.
due_date STRING Due date set for the issue.
confidential BOOL Indicates if the issue is confidential.
discussion_locked BOOL Indicates if discussion is locked for the issue.
issue_type STRING Type of issue.
web_url STRING URL of the issue in GitLab.
blocking_issues_count INT64 Number of blocking issues for this issue.
has_tasks BOOL Indicates if the issue has tasks.
moved_to_id STRING ID of the issue to which this issue has been moved.
service_desk_reply_to STRING Service desk reply to information for the issue.
author__state STRING State of the author’s account.
author__name STRING Name of the author.
author__web_url STRING URL of the author’s GitLab profile.
author__avatar_url STRING URL of the author’s avatar image.
author__username STRING Username of the author.
author__id INT64 ID of the author.
author__locked BOOL Indicates if the author’s account is locked.
author_id INT64 ID of the author of the issue.
assignee__state STRING State of the assignee account.
assignee__name STRING Name of the assignee.
assignee__web_url STRING URL of the assignee’s GitLab profile.
assignee__avatar_url STRING URL of the assignee’s avatar image.
assignee__username STRING Username of the assignee.
assignee__id INT64 ID of the assignee.
assignee__locked BOOL Indicates if the assignee account is locked.
assignee_id INT64 ID of the user assigned to the issue.
closed_by__state STRING State of the user’s account who closed the issue.
closed_by__name STRING Name of the user who closed the issue.
closed_by__web_url STRING URL of the user’s GitLab profile who closed the issue.
closed_by__avatar_url STRING URL of the user’s avatar image.
closed_by__username STRING Username of the user who closed the issue.
closed_by__human_readable_end_date STRING Human-readable end date of the user.
closed_by__human_readable_timestamp STRING Human-readable timestamp of the user.
closed_by__id INT64 ID of the user who closed the issue.
closed_by__locked BOOL Indicates if the user’s account is locked.
closed_by_id INT64 ID of the user who closed the issue.
milestone_id INT64 ID of the milestone associated with the issue.
subscribed BOOL Indicates if the user is subscribed to the issue.
weight INT64 Weight assigned to the issue.
task_status STRING Status of tasks associated with the issue.
severity STRING Severity level of the issue.
iteration__id INT64 ID of the iteration.
iteration__iid INT64 Internal ID of the iteration.
iteration__sequence INT64 Order sequence of the iteration.
iteration__group_id INT64 ID of the group to which the iteration belongs.
iteration__title STRING Title of the iteration.
iteration__description STRING Description of the iteration.
iteration__state INT64 State of the iteration.
iteration__created_at TIMESTAMP Date and time when the iteration was created.
iteration__updated_at TIMESTAMP Date and time when the iteration was last updated.
iteration__start_date TIMESTAMP Start date of the iteration.
iteration__due_date TIMESTAMP Due date set for the iteration.
iteration__web_url STRING URL of the iteration in GitLab.
epic__id INT64 ID of the epic.
epic__iid INT64 Internal ID of the epic.
epic__title STRING Title of the epic.
epic__url STRING URL of the epic in GitLab.
epic__group_id INT64 ID of the group to which the epic belongs.
epic__locked BOOL Indicates if the epic is locked.
epic__human_readable_end_date STRING Human-readable end date of the epic.
epic__human_readable_timestamp STRING Human-readable timestamp of the epic.
epic_iid INT64 Internal ID of the epic the issue belongs to.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • issues__labels (4 columns)
  • issues__assignees (4 columns)
jobs (26 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
id INT64 Unique identifier for the job.
status STRING Current status of the job.
stage STRING Stage to which the job belongs in the pipeline.
archived BOOL Indicates if the job has been archived.
name STRING Name of the job.
ref STRING Reference or branch for which the job was triggered.
tag BOOL Indicates if the job is tagged.
coverage STRING Code coverage achieved by the job.
allow_failure BOOL Specifies if the job is allowed to fail.
created_at TIMESTAMP Date and time when the job was created.
started_at TIMESTAMP Date and time when the job execution started.
finished_at TIMESTAMP Date and time when the job finished execution.
duration FLOAT64 Duration of the job execution.
queued_duration FLOAT64 Duration for which the job was in the queue.
web_url STRING URL to access the job details on the web platform.
artifacts_expire_at TIMESTAMP Date and time when artifacts will expire.
user_id INT64 ID of the user who triggered the job.
pipeline_id INT64 ID of the pipeline to which the job belongs.
runner_id INT64 ID of the runner on which the job is executed.
commit_id STRING ID of the commit associated with the job.
project_id INT64 ID of the project to which the job belongs.
erased_at TIMESTAMP Date and time when the job was erased.
failure_reason STRING Reason for job failure, if applicable.
project__ci_job_token_scope_enabled BOOL Indicates if the CI job token scope is enabled for the project.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • jobs__artifacts (4 columns)
  • jobs__tag_list (4 columns)
merge_request_commits (19 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
project_id INT64 Identifier of the project where the commit was made
id STRING Unique identifier for the commit
short_id STRING Shortened version of the commit ID
created_at TIMESTAMP Date and time when the commit was created
title STRING Title of the commit representing the changes made
message STRING The commit message describing the changes made
author_name STRING Name of the author who made the commit
author_email STRING Email of the author who made the commit
authored_date TIMESTAMP Date and time the commit was authored
committer_name STRING Name of the committer who committed the changes
committer_email STRING Email of the committer who committed the changes
committed_date TIMESTAMP Date and time the commit was committed
web_url STRING URL to view the commit details in a web browser
stats__additions INT64 Number of lines added in the commit
stats__deletions INT64 Number of lines deleted in the commit
stats__total INT64 Total number of lines changed in the commit
merge_request_iid INT64 Identifier of the merge request associated with the commit
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • merge_request_commits__parent_ids (4 columns)
  • merge_request_commits__extended_trailers__cc (4 columns)
merge_requests (49 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
id INT64 ID of the merge request.
iid INT64 Internal ID of the merge request.
project_id INT64 ID of the project to which the merge request belongs.
title STRING Title of the merge request.
description STRING Description of the merge request.
state STRING State of the merge request.
created_at TIMESTAMP Timestamp when the merge request was created.
prepared_at TIMESTAMP Timestamp when the merge request was prepared.
updated_at TIMESTAMP Timestamp when the merge request was last updated.
merged_at TIMESTAMP Timestamp when the merge request was merged.
closed_at TIMESTAMP Timestamp when the merge request was closed.
target_branch STRING Name of the target branch for the merge request.
source_branch STRING Name of the source branch for the merge request.
user_notes_count INT64 Total count of user notes on the merge request.
upvotes INT64 Number of upvotes for the merge request.
downvotes INT64 Number of downvotes for the merge request.
source_project_id INT64 ID of the source project for the merge request.
target_project_id INT64 ID of the target project for the merge request.
work_in_progress BOOL Flag indicating if the merge request is a work in progress.
merge_when_pipeline_succeeds BOOL Flag indicating if the merge should happen when the pipeline succeeds.
merge_status STRING Status of the merge request.
sha STRING SHA of the merge request.
merge_commit_sha STRING SHA of the merge commit.
squash_commit_sha STRING SHA of the squashed commit.
discussion_locked BOOL Flag indicating if discussions are locked.
should_remove_source_branch BOOL Flag indicating if the source branch should be removed after merging.
force_remove_source_branch BOOL Flag indicating if the source branch should be removed after merging.
reference STRING Reference of the merge request.
web_url STRING URL to view the merge request in the GitLab UI.
squash BOOL Flag indicating if squashing should be performed.
has_conflicts BOOL Flag indicating if the merge request has conflicts.
blocking_discussions_resolved BOOL Flag indicating if all blocking discussions are resolved.
author_id INT64 ID of the author of the merge request.
assignee_id INT64 ID of the user assigned to this merge request.
closed_by_id INT64 ID of the user who closed the merge request.
milestone_id INT64 ID of the milestone associated with the merge request.
merged_by_id INT64 ID of the user who merged the merge request.
draft BOOL Flag indicating if the merge request is a draft.
detailed_merge_status STRING Detailed status of the merge request.
squash_on_merge BOOL Flag indicating if squashing should be done on merge.
merge_user__id INT64 ID of the user who performed the merge.
merge_user__name STRING Name of the user.
merge_user__username STRING Username of the user.
merge_user__state STRING State of the user account.
merge_user__avatar_url STRING URL of the user’s avatar.
merge_user__web_url STRING URL to the user’s profile.
merge_user__locked BOOL Flag indicating if the user account is locked.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • merge_requests__assignees (4 columns)
  • merge_requests__reviewers (4 columns)
  • merge_requests__labels (4 columns)
pipelines (13 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
id INT64 Unique identifier for the pipeline
iid INT64 Internal identifier for the pipeline within the project
project_id INT64 Unique identifier for the project where the pipeline belongs
sha STRING Commit SHA associated with the pipeline
source STRING Source that triggered the pipeline (e.g., web, push, schedule)
ref STRING Reference (branch or tag) for which the pipeline was triggered
status STRING Current status of the pipeline (e.g., running, passed, failed)
created_at TIMESTAMP The timestamp when the pipeline was created
updated_at TIMESTAMP The timestamp when the pipeline was last updated
web_url STRING URL to view the pipeline details on the web interface
name STRING Name of the pipeline
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
pipelines_extended (29 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
id INT64 Unique identifier of the pipeline
iid INT64 Internal ID of the pipeline
project_id INT64 ID of the project associated with the pipeline
sha STRING The commit SHA of the current state triggering the pipeline
source STRING Source that triggered the pipeline (e.g., push, webhook)
ref STRING Branch or tag name for which the pipeline was triggered
status STRING Current status of the pipeline (e.g., running, success, failed)
created_at TIMESTAMP The date and time when the pipeline was created
updated_at TIMESTAMP The date and time when pipeline information was last updated
web_url STRING URL to view the pipeline details on the web interface
before_sha STRING The commit SHA of the previous state before the pipeline was triggered
tag BOOL Boolean indicating if the pipeline was triggered by a tag
yaml_errors STRING Any errors encountered in the pipeline configuration YAML
user__id INT64 Unique identifier of the user
user__name STRING Name of the user
user__username STRING Username of the user
user__state STRING State of the user account (e.g., active, blocked)
user__avatar_url STRING URL of the user’s avatar
user__web_url STRING URL to the user’s profile
user__locked BOOL Boolean indicating if the user account is locked
started_at TIMESTAMP The date and time when the pipeline execution started
finished_at TIMESTAMP The date and time when the pipeline execution was finished
committed_at TIMESTAMP The date and time when the commit was made
duration INT64 The total duration of the pipeline execution in seconds
queued_duration STRING The duration the pipeline spent in the queue before execution
coverage STRING The code coverage percentage achieved in the pipeline
name STRING Name of the pipeline
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
project_labels (15 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
project_id INT64 The unique identifier of the project to which the label belongs.
id INT64 The unique identifier for the label within the project.
name STRING The name or title of the label for easy identification.
color STRING The color code representation of the label for visual identification.
description STRING The textual description of the label indicating its purpose or meaning.
description_html STRING The HTML formatted description of the label for display purposes.
text_color STRING The color code representation for the text color of the label for contrast.
subscribed BOOL A flag indicating whether the user is subscribed to notifications for this label.
priority INT64 The priority level assigned to the label, if applicable.
is_project_label BOOL A flag indicating whether the label is specifically created for the project.
open_issues_count INT64 The total count of open issues associated with this label.
closed_issues_count INT64 The total count of closed issues associated with this label.
open_merge_requests_count INT64 The total count of open merge requests associated with this label.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
project_members (15 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
project_id INT64
id INT64
name STRING
username STRING
state STRING
membership_state STRING
avatar_url STRING
web_url STRING
access_level INT64
created_at TIMESTAMP
expires_at TIMESTAMP
created_by JSON
locked BOOL
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
project_milestones (14 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
id INT64 Unique identifier for the milestone.
iid INT64 Internal identifier for the milestone.
project_id INT64 Identifier of the project that the milestone belongs to.
title STRING The title or name of the milestone.
description STRING A brief summary or goal of the milestone.
state STRING Current state of the milestone (e.g., open, closed).
created_at TIMESTAMP The date and time when the milestone was created.
updated_at TIMESTAMP The date and time when the milestone was last updated.
due_date DATE The target date for completion of the milestone.
start_date DATE The date when work on the milestone is scheduled to start.
expired BOOL Indicates if the milestone has expired or not.
web_url STRING URL to access the milestone on the web platform.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
projects (153 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
id INT64 ID of the project
description STRING Description of the project
description_html STRING HTML formatted project description
name STRING Name of the project
name_with_namespace STRING Name of the project with namespace
path STRING Path of the project
path_with_namespace STRING Path of the project with namespace
created_at TIMESTAMP Date and time of project creation
updated_at TIMESTAMP Date and time of last update
default_branch STRING Default branch of the project
ssh_url_to_repo STRING SSH URL to project repository
http_url_to_repo STRING HTTP URL to project repository
web_url STRING URL of the project
readme_url STRING URL for project readme
avatar_url STRING URL for project avatar
forks_count INT64 Number of forks for the project
star_count INT64 Number of stars for the project
last_activity_at TIMESTAMP Date and time of last activity
namespace__id INT64 ID of the namespace
namespace__name STRING Name of the namespace
namespace__path STRING Path of the namespace
namespace__kind STRING Kind of namespace
namespace__full_path STRING Full path of the namespace
namespace__parent_id INT64 ID of the parent namespace
namespace__avatar_url STRING URL for namespace avatar
namespace__web_url STRING Web URL of the namespace
container_registry_image_prefix STRING Prefix for container registry images
_links__self STRING URL for the project itself
_links__issues STRING URL for project issues
_links__merge_requests STRING URL for project merge requests
_links__repo_branches STRING URL for project repository branches
_links__labels STRING URL for project labels
_links__events STRING URL for events related to the project
_links__members STRING URL for project members
_links__cluster_agents STRING URL for cluster agents
packages_enabled BOOL Flag indicating if packages are enabled
empty_repo BOOL Flag indicating if repository is empty
archived BOOL Flag indicating if project is archived
visibility STRING Visibility level of the project
resolve_outdated_diff_discussions BOOL Resolve outdated diff discussions
container_registry_enabled BOOL Flag indicating if container registry is enabled
container_expiration_policy__cadence STRING Expiration cadence
container_expiration_policy__enabled BOOL Flag indicating if expiration policy is enabled
container_expiration_policy__keep_n INT64 Number of containers to keep
container_expiration_policy__older_than STRING Age threshold for expiration
container_expiration_policy__name_regex STRING Regex for container name
container_expiration_policy__name_regex_keep STRING Regex for container name to keep
container_expiration_policy__next_run_at TIMESTAMP Next scheduled run for expiration policy
issues_enabled BOOL Flag indicating if issues are enabled
merge_requests_enabled BOOL Flag indicating if merge requests are enabled
wiki_enabled BOOL Flag indicating if wiki is enabled
jobs_enabled BOOL Flag indicating if jobs are enabled
snippets_enabled BOOL Flag indicating if snippets are enabled
service_desk_enabled BOOL Flag indicating if service desk is enabled
service_desk_address STRING Address for service desk
can_create_merge_request_in BOOL Locations where merge requests can be created
issues_access_level STRING Access level for issues
repository_access_level STRING Access level for repository
merge_requests_access_level STRING Access level for merge requests
forking_access_level STRING Access level for forking projects
wiki_access_level STRING Access level for wiki
builds_access_level STRING Access level for builds
snippets_access_level STRING Access level for snippets
pages_access_level STRING Access level for project pages
operations_access_level STRING Access level for operations
analytics_access_level STRING Access level for analytics
emails_disabled BOOL Flag indicating if emails are disabled
shared_runners_enabled BOOL Flag indicating if shared runners are enabled
lfs_enabled BOOL Flag indicating if Git LFS is enabled
creator_id INT64 ID of the project creator
import_status STRING Status of project import
import_error STRING Error message if import failed
open_issues_count INT64 Count of open issues
runners_token STRING Token for runners
ci_default_git_depth INT64 Default git depth for CI
ci_forward_deployment_enabled BOOL Flag for forward deployment enabled in CI
public_jobs BOOL Flag indicating if jobs are public
build_git_strategy STRING Git strategy for build
build_timeout INT64 Timeout for build
auto_cancel_pending_pipelines STRING Automatically cancel pending pipelines
build_coverage_regex STRING Regex for build coverage
ci_config_path STRING Path for CI configuration
only_allow_merge_if_pipeline_succeeds BOOL Only allow merge if pipeline succeeds
allow_merge_on_skipped_pipeline BOOL Allow merge on skipped pipeline
restrict_user_defined_variables BOOL Restrict user-defined variables
request_access_enabled BOOL Flag indicating if request access is enabled
only_allow_merge_if_all_discussions_are_resolved BOOL Only allow merge if all discussions are resolved
remove_source_branch_after_merge BOOL Remove source branch after merge
printing_merge_request_link_enabled BOOL Enable printing merge request link
merge_method STRING Method used for merges
suggestion_commit_message STRING Commit message suggestion
statistics__commit_count INT64 Number of commits
statistics__storage_size INT64 Total storage size
statistics__repository_size INT64 Size of repository
statistics__wiki_size INT64 Size of wiki
statistics__lfs_objects_size INT64 Size of LFS objects
statistics__job_artifacts_size INT64 Size of job artifacts
statistics__snippets_size INT64 Size of snippets
statistics__packages_size INT64 Size of packages
statistics__container_registry_size INT64 Size of container registry
statistics__pipeline_artifacts_size INT64 Size of pipeline artifacts
statistics__uploads_size INT64 Size of uploads
auto_devops_enabled BOOL Flag indicating if Auto DevOps is enabled
auto_devops_deploy_strategy STRING Auto DevOps deployment strategy
autoclose_referenced_issues BOOL Automatically close referenced issues
external_authorization_classification_label STRING Label for external authorization classification
requirements_enabled BOOL Flag indicating if requirements are enabled
security_and_compliance_enabled BOOL Flag indicating if security and compliance are enabled
permissions__project_access__access_level INT64 Access level for project
permissions__project_access__notification_level INT64 Notification level for project
permissions__group_access__access_level INT64 Access level for groups
permissions__group_access__notification_level INT64 Notification level for groups
feature_flags_access_level STRING Access level for feature flags
group_runners_enabled BOOL Flag indicating if group runners are enabled
enforce_auth_checks_on_uploads BOOL Enforce authentication checks on uploads
monitor_access_level STRING Access level for monitoring tools
container_registry_access_level STRING Access level for container registry
import_type STRING Type of project import
ci_job_token_scope_enabled BOOL Enable job token scope in CI
requirements_access_level STRING Access level for requirements
releases_access_level STRING Access level for project releases
runner_token_expiration_interval STRING Token expiration interval for runners
squash_option STRING Squash option for merges
squash_commit_template STRING Template for squash commits
issue_branch_template STRING Template for issue branches
keep_latest_artifact BOOL Keep latest artifact
import_url STRING URL for project import
ci_separated_caches BOOL Use separated caches in CI
security_and_compliance_access_level STRING Access level for security and compliance
infrastructure_access_level STRING Access level for infrastructure settings
merge_commit_template STRING Template for merge commits
ci_allow_fork_pipelines_to_run_in_parent_project BOOL Allow fork pipelines to run in parent project
environments_access_level STRING Access level for environments
approvals_before_merge INT64 Number of approvals required before merge
marked_for_deletion_at DATE Date marked for deletion
merge_trains_enabled BOOL Flag indicating if merge trains are enabled
mirror BOOL Flag indicating if project is mirrored
issues_template STRING Template for issues
merge_pipelines_enabled BOOL Flag indicating if merge pipelines are enabled
merge_requests_template STRING Template for merge requests
allow_pipeline_trigger_approve_deployment BOOL Allow pipeline trigger to approve deployment
marked_for_deletion_on DATE Date marked for deletion
ci_forward_deployment_rollback_allowed BOOL Allow rollback in forward deployment CI
emails_enabled BOOL Flag indicating if emails are enabled
model_experiments_access_level STRING Access level for model experiments
merge_trains_skip_train_allowed BOOL Allow skipping merge trains
code_suggestions BOOL Enable code suggestions
model_registry_access_level STRING Access level for model registry
ci_restrict_pipeline_cancellation_role STRING Role allowed to restrict pipeline cancellation in CI
repository_object_format STRING Format of repository object
warn_about_potentially_unwanted_characters BOOL Warn about potentially unwanted characters
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • projects__tag_list (4 columns)
  • projects__topics (4 columns)
  • projects__shared_with_groups (4 columns)
  • projects__compliance_frameworks (4 columns)
releases (14 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
name STRING Name of the release
tag_name STRING Name of the tag associated with the release
description STRING Description of the release
created_at TIMESTAMP Date and time when the release was created
released_at TIMESTAMP Date and time when the release was published
upcoming_release BOOL Indicator if the release is an upcoming release
commit_path STRING Path to the commit related to the release
tag_path STRING Path to the tag associated with the release
assets__count INT64 Number of assets in the release
author_id INT64 ID of the author of the release
commit_id STRING ID of the commit related to the release
project_id INT64 ID of the project associated with the release
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

Repeating fields are split into their own tables, listed here with their column counts.

  • releases__milestones (4 columns)
  • releases__assets__sources (5 columns)
  • releases__assets__links (4 columns)
  • releases__evidences (4 columns)
tags (10 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
name STRING The name of the tag.
message STRING The message or description of the tag.
target STRING The target or object that the tag points to.
release__tag_name STRING The name of the release tag.
release__description STRING Description of the release.
protected BOOL Indicates whether the tag is protected.
commit_id STRING Unique identifier for the commit associated with the tag.
project_id INT64 Unique identifier of the project to which the tag belongs.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
users (9 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
id INT64 Unique identification number for the user
name STRING Full name of the user
username STRING Unique username chosen by the user
state STRING Current state of the user’s account (e.g., active, blocked)
avatar_url STRING URL of the user’s avatar image
web_url STRING URL of the user’s profile page on the Gitlab platform
locked BOOL Boolean flag indicating if the user’s account is locked
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

After the first load, Kaivo keeps your BigQuery warehouse up to date for you. Where GitLab supports it, each sync pulls only new and changed records so it stays fast; otherwise it refreshes the whole table. Every record keeps its original ID, so you won’t get duplicate rows.

How long does the initial sync take for GitLab?

Section titled “How long does the initial sync take for GitLab?”

It depends on how much history is in your GitLab account. Most initial syncs finish within minutes, while large accounts can take a few hours. After that, syncs only fetch new and changed records, so they’re much faster.

Yes. You pick which tables to sync when you set up the connection and can change the selection later. Tables you don’t select are never copied to your warehouse.

What happens when GitLab’s schema changes?

Section titled “What happens when GitLab’s schema changes?”

New fields are never added automatically. You choose which fields to sync, so data you haven’t selected (sensitive personal data, for example) never lands in your warehouse. When a new field appears, it becomes available for you to add. What happens to removed or renamed fields depends on a table’s sync mode: full-refresh tables always match what’s currently in GitLab, so dropped fields disappear, while incremental tables keep their existing columns and history, so an old field stays and newly added fields fill in over time.

How do I handle GDPR or data deletion requests?

Section titled “How do I handle GDPR or data deletion requests?”

Your data lives in your own Kaivo-managed BigQuery warehouse, so the most direct option is to delete or anonymise specific records right in BigQuery. If you delete data in GitLab instead, full-refresh tables drop it on the next sync, while incremental tables keep it, so you would remove the row in BigQuery or ask us to run a full refresh. To remove everything, delete the GitLab connector in Kaivo and all of its synced data is deleted with it.

Track issues and projects to measure throughput and what is shipping across groups.

Use epics, epic_issues, and milestones to report on progress against larger initiatives.

Analyse releases and tags to see how often you ship and what went into each release.

Report on group_members and project_members to see contribution across teams.

Once GitLab data lands in your Kaivo-managed BigQuery warehouse, you can explore it with AI tools or any BI tool that connects to BigQuery. Here’s how the most common destinations work with GitLab data.

Use Kaivo’s MCP server to give Claude secure, workspace-scoped access to your data. Setup guide →

Microsoft’s BI tool with a native BigQuery connector. Supports direct query and scheduled refresh. Setup guide →

Free Google BI tool with native BigQuery support. One-click connection to your Kaivo warehouse; great for SMB teams on Google Workspace. Setup guide →

The premium analytics standard, with native BigQuery integration. Setup guide →

Use Connected Sheets to query BigQuery directly from a spreadsheet, with no SQL. Setup guide →

Connect via Power Query’s BigQuery connector. Setup guide →

Open-source BI tool with strong BigQuery support. Setup guide →

See our pricing page for GitLab connector pricing and plan details.

  • Adform: Sync Adform to BigQuery.
  • Amplitude: Sync Amplitude to BigQuery.
  • Auth0: Sync Auth0 to BigQuery.
  • ClickUp: Sync ClickUp to BigQuery.
  • Convex: Sync Convex to BigQuery.
  • GitHub: Sync GitHub to BigQuery.