Skip to content
Book a demoStart free
Connectors

New York Times connector

Set up the New York Times connector in Kaivo: authentication, configuration, the 4 BigQuery tables it syncs, and answers to common questions.

New York Times connector pricing, tier and credits on kaivo.io

Kaivo is a fully managed data platform that syncs your New York Times data into a Google BigQuery warehouse and keeps it up to date automatically. There is no pipeline to build and no infrastructure to run, so you can spend your time analysing your data from New York Times instead of moving it.

Sync New York Times articles and most-popular lists into BigQuery with Kaivo to analyse coverage and track what readers engage with.

CategoryOther
AuthenticationAPI key
SetupSelf-service

Getting started with the New York Times connector

Section titled “Getting started with the New York Times connector”
  1. Sign up for Kaivo and create a workspace.
  2. Connect your New York Times account.
  3. Choose which tables to sync.
  4. Wait for the initial sync to finish.
  5. Query your data in BigQuery or your favourite AI or BI tool.

Authenticate with your API Key.

Field Description
API Key
Your New York Times API key.

|

When you set up the connector, you provide:

Field Description
Start Date
Any data before this date will not be fetched.

| | End Date |

Any data after this date will not be fetched.

| | Period |

Period of time in days for Most Popular streams.

| | Share Type |

Share type for the Most Popular Shared stream.

|

Tables and columns synced from New York Times

Section titled “Tables and columns synced from New York Times”

Kaivo syncs 4 tables from New York Times into a dedicated dataset in your BigQuery warehouse. Click any table to see its columns and types.

archive (24 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
web_url STRING Article URL.
snippet STRING Brief excerpt or summary of the article content
print_page STRING Page in print (e.g. 1).
print_section STRING Section in print (e.g. A).
source STRING Source where the article originated
headline__main STRING Main headline of the article
headline__kicker STRING Brief headline summary
headline__content_kicker STRING Additional information before the main headline
headline__print_headline STRING Headline formatted for printing
headline__name STRING Name related to the headline
headline__seo STRING SEO-friendly headline
headline__sub STRING Subheadline or secondary headline
pub_date STRING Publication date.
document_type STRING Document type (article, multimedia).
news_desk STRING Desk in the newsroom that worked on the story (Foreign, Metro, Sports, …).
section_name STRING Section that the article appeared in (New York, Sports, World, …).
byline__original STRING Original byline as provided
byline__organization STRING Name of the organization(s) associated with the author(s)
type_of_material STRING Type of asset (Correction, News, Op-Ed, Review, Video, …).
_id STRING Unique identifier for the article
word_count INT64 Number of words in the article.
uri STRING Uniquely identifies an asset.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
rank INT64 Rank or order of importance of the multimedia content
subtype STRING Subtype of the multimedia content
caption STRING Textual description of the multimedia content
credit STRING Credit information for the multimedia content
type STRING Type of multimedia content
url STRING URL of the multimedia content
height INT64 Height of the multimedia content
width INT64 Width of the multimedia content
legacy__xlarge STRING URL for the xlarge version of the multimedia content
legacy__xlargewidth INT64 Width of the xlarge multimedia content
legacy__xlargeheight INT64 Height of the xlarge multimedia content
crop_name STRING Name of the cropping style used
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
name STRING Name of the keyword
value STRING Value or content of the keyword
rank INT64 Rank or order of importance of the keyword
major STRING Flag indicating if the keyword is major
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
firstname STRING First name of the person
middlename STRING Middle name of the person
lastname STRING Last name of the person
qualifier STRING Qualifications of the person
title STRING Title or designation of the person
role STRING Role of the person in relation to the article
organization STRING Name of the organization the person belongs to
rank INT64 Rank or order of the person’s contribution
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
most_popular_emailed (19 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
url STRING Article’s URL.
adx_keywords STRING Semicolon separated list of keywords.
subsection STRING Article’s subsection (e.g. Politics). Can be empty string.
column STRING Deprecated. Set to null.
eta_id INT64 Deprecated. Set to 0.
section STRING Article’s section (e.g. Sports).
id INT64 Asset ID number (e.g. 100000007772696).
asset_id INT64 Asset ID number (e.g. 100000007772696).
nytdsection STRING Article’s section (e.g. sports).
byline STRING Article’s byline (e.g. By Thomas L. Friedman).
type STRING Asset type (e.g. Article, Interactive, …).
title STRING Article’s headline (e.g. When the Cellos Play, the Cows Come Home).
abstract STRING Brief summary of the article.
published_date STRING When the article was published on the web (e.g. 2021-04-19).
source STRING Publisher (e.g. New York Times).
updated STRING When the article was last updated (e.g. 2021-05-12 06:32:03).
uri STRING An article’s globally unique identifier.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
type STRING Asset type (e.g. image).
subtype STRING Asset subtype (e.g. photo).
caption STRING Media caption.
copyright STRING Media credit.
approved_for_syndication INT64 Whether media is approved for syndication.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Section titled “Subtable: most_popular_emailed__media__media_metadata”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
url STRING Image’s URL.
format STRING Image’s crop name.
height INT64 Image’s height (e.g. 293).
width INT64 Image’s width (e.g. 440).
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
most_popular_shared (19 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
url STRING Article’s URL.
adx_keywords STRING Semicolon separated list of keywords.
subsection STRING Article’s subsection (e.g. Politics). Can be empty string.
column STRING Deprecated. Set to null.
eta_id INT64 Deprecated. Set to 0.
section STRING Article’s section (e.g. Sports).
id INT64 Asset ID number (e.g. 100000007772696).
asset_id INT64 Asset ID number (e.g. 100000007772696).
nytdsection STRING Article’s section (e.g. sports).
byline STRING Article’s byline (e.g. By Thomas L. Friedman).
type STRING Asset type (e.g. Article, Interactive, …).
title STRING Article’s headline (e.g. When the Cellos Play, the Cows Come Home).
abstract STRING Brief summary of the article.
published_date STRING When the article was published on the web (e.g. 2021-04-19).
source STRING Publisher (e.g. New York Times).
updated STRING When the article was last updated (e.g. 2021-05-12 06:32:03).
uri STRING An article’s globally unique identifier.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
type STRING Asset type (e.g. image).
subtype STRING Asset subtype (e.g. photo).
caption STRING Media caption.
copyright STRING Media credit.
approved_for_syndication INT64 Whether media is approved for syndication.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Section titled “Subtable: most_popular_shared__media__media_metadata”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
url STRING Image’s URL.
format STRING Image’s crop name.
height INT64 Image’s height (e.g. 293).
width INT64 Image’s width (e.g. 440).
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
most_popular_viewed (15 columns)
Column Type Description
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
url STRING Article’s URL.
adx_keywords STRING Semicolon separated list of keywords.
column STRING Deprecated. Set to null.
section STRING Article’s section (e.g. Sports).
byline STRING Article’s byline (e.g. By Thomas L. Friedman).
type STRING Asset type (e.g. Article, Interactive, …).
title STRING Article’s headline (e.g. When the Cellos Play, the Cows Come Home).
abstract STRING Brief summary of the article.
published_date STRING When the article was published on the web (e.g. 2021-04-19).
source STRING Publisher (e.g. New York Times).
id INT64 Asset ID number (e.g. 100000007772696).
asset_id INT64 Asset ID number (e.g. 100000007772696).
uri STRING An article’s globally unique identifier.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
value STRING
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
type STRING Asset type (e.g. image).
subtype STRING Asset subtype (e.g. photo).
caption STRING Media caption.
copyright STRING Media credit.
approved_for_syndication INT64 Whether media is approved for syndication.
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.
Section titled “Subtable: most_popular_viewed__media__media_metadata”
Column Type Description
_kaivo_parent_id STRING Foreign key referencing _kaivo_id in the parent table. Auto-generated by Kaivo.
_kaivo_id STRING Primary key that uniquely identifies the row. Auto-generated by Kaivo.
url STRING Image’s URL.
format STRING Image’s crop name.
height INT64 Image’s height (e.g. 293).
width INT64 Image’s width (e.g. 440).
_kaivo_extracted_at TIMESTAMP Timestamp that shows when the row was extracted. Auto-generated by Kaivo.

After the first load, Kaivo keeps your BigQuery warehouse up to date for you. Where New York Times supports it, each sync pulls only new and changed records so it stays fast; otherwise it refreshes the whole table. Every record keeps its original ID, so you won’t get duplicate rows.

How long does the initial sync take for New York Times?

Section titled “How long does the initial sync take for New York Times?”

It depends on how much history is in your New York Times account. Most initial syncs finish within minutes, while large accounts can take a few hours. After that, syncs only fetch new and changed records, so they’re much faster.

Yes. You pick which tables to sync when you set up the connection and can change the selection later. Tables you don’t select are never copied to your warehouse.

What happens when New York Times’s schema changes?

Section titled “What happens when New York Times’s schema changes?”

New fields are never added automatically. You choose which fields to sync, so data you haven’t selected (sensitive personal data, for example) never lands in your warehouse. When a new field appears, it becomes available for you to add. What happens to removed or renamed fields depends on a table’s sync mode: full-refresh tables always match what’s currently in New York Times, so dropped fields disappear, while incremental tables keep their existing columns and history, so an old field stays and newly added fields fill in over time.

How do I handle GDPR or data deletion requests?

Section titled “How do I handle GDPR or data deletion requests?”

Your data lives in your own Kaivo-managed BigQuery warehouse, so the most direct option is to delete or anonymise specific records right in BigQuery. If you delete data in New York Times instead, full-refresh tables drop it on the next sync, while incremental tables keep it, so you would remove the row in BigQuery or ask us to run a full refresh. To remove everything, delete the New York Times connector in Kaivo and all of its synced data is deleted with it.

Use archive to study article volume by section and keyword over time.

Compare most_popular_viewed, shared, and emailed to see what resonates.

Group articles by section to follow topic coverage.

Bring articles into BigQuery to build a searchable record.

Use New York Times data in your AI and BI tools

Section titled “Use New York Times data in your AI and BI tools”

Once New York Times data lands in your Kaivo-managed BigQuery warehouse, you can explore it with AI tools or any BI tool that connects to BigQuery. Here’s how the most common destinations work with New York Times data.

Use Kaivo’s MCP server to give Claude secure, workspace-scoped access to your data. Setup guide →

Microsoft’s BI tool with a native BigQuery connector. Supports direct query and scheduled refresh. Setup guide →

Free Google BI tool with native BigQuery support. One-click connection to your Kaivo warehouse; great for SMB teams on Google Workspace. Setup guide →

The premium analytics standard, with native BigQuery integration. Setup guide →

Use Connected Sheets to query BigQuery directly from a spreadsheet, with no SQL. Setup guide →

Connect via Power Query’s BigQuery connector. Setup guide →

Open-source BI tool with strong BigQuery support. Setup guide →

See our pricing page for New York Times connector pricing and plan details.