Services¶
Import data from APIs and services.
Install¶
Persistent.
uv tool install --upgrade 'cratedb-toolkit[io-ingest]'
Ephemeral.
uvx 'cratedb-toolkit[io-ingest]'
Container.
docker run --rm ghcr.io/crate/cratedb-toolkit-ingest ctk
Integrations¶
Examples¶
Airtable
Load data from Airtable into CrateDB.
ctk load \
"airtable://?access_token=<access_token>&table=demo" \
"crate://crate:na@localhost:4200/testdrive/airtable"
Anthropic
Load comprehensive data from the Anthropic Admin API into CrateDB,
including Claude Code usage metrics, API usage reports, cost data,
and organization management information.
See Anthropic entities about any labels you can use for the
table parameter in the source URL.
ctk load \
"anthropic://?api_key=<admin_api_key>&table=claude_code_usage" \
"crate://crate:na@localhost:4200/testdrive/anthropic_claude_code_usage"
Asana
Load data from Asana into CrateDB.
See Asana entities about any labels you can use for the
table parameter in the source URL.
ctk load \
"asana://<workspace_id>?access_token=<access_token>&table=workspaces" \
"crate://crate:na@localhost:4200/testdrive/asana_workspaces"
Attio
Load data from Attio into CrateDB.
See Attio entities about any labels you can use for the
table parameter in the source URL.
ctk load \
"attio://?api_key=<api_key>&table=objects" \
"crate://crate:na@localhost:4200/testdrive/attio_objects"
Facebook Ads
Load data from Facebook Ads into CrateDB.
See Facebook Ads entities about any labels you can use for the table parameter
in the source URL.
ctk load \
"facebookads://?access_token=<access_token>&account_id=<account_id>&table=campaigns" \
"crate://crate:na@localhost:4200/testdrive/facebookads_campaigns"
GitHub
Load data from GitHub into CrateDB.
See GitHub entities about any labels you can use for the table parameter
in the source URL.
ctk load \
"github://?access_token=${GH_TOKEN}&owner=crate&repo=cratedb-toolkit&table=issues" \
"crate://crate:na@localhost:4200/testdrive/github_issues"
Google Ads
Load data from Google Ads into CrateDB.
See Google Ads entities about any labels you can use for the table parameter
in the source URL.
ctk load \
"googleads://<customer_id>?credentials_path=/path/to/service-account.json&dev_token=<dev_token>&table=campaign_report_daily" \
"crate://crate:na@localhost:4200/testdrive/googleads_campaign_report_daily"
Google Analytics
Load data from Google Analytics into CrateDB.
See Google Analytics entities about any labels you can use for the table parameter
in the source URL.
ctk load \
"googleanalytics://?credentials_path=/path/to/service/account.json&property_id=<property_id>&table=realtime" \
"crate://crate:na@localhost:4200/testdrive/googleanalytics_realtime"
ctk load \
"googleanalytics://?credentials_base64=<base64_encoded_credentials>&property_id=<property_id>&table=realtime" \
"crate://crate:na@localhost:4200/testdrive/googleanalytics_realtime"
Google Sheets
Load data from Google Sheets into CrateDB.
ctk load \
"gsheets://?credentials_path=/path/to/service/account.json&table=fkdUQ2bjdNfUq2CA.Sheet1" \
"crate://crate:na@localhost:4200/testdrive/gsheets"
HubSpot
Load data from HubSpot into CrateDB.
See HubSpot entities about any labels you can use for the table parameter
in the source URL.
ctk load \
"hubspot://?api_key=<api-key-here>&table=deals" \
"crate://crate:na@localhost:4200/testdrive/hubspot_deals"
Jira
Load data from Jira into CrateDB.
See Jira entities about any labels you can use for the table parameter
in the source URL.
ctk load \
"jira://your-domain.atlassian.net?email=<email>&api_token=<api_token>&table=issues" \
"crate://crate:na@localhost:4200/testdrive/jira_issues"
Salesforce
Load data from Salesforce into CrateDB.
See Salesforce entities about any labels you can use for the table parameter
in the source URL.
ctk load \
"salesforce://?username=<username>&password=<password>&token=<token>&table=opportunity" \
"crate://crate:na@localhost:4200/testdrive/salesforce_opportunity"
Shopify
Load data from Shopify into CrateDB.
See Shopify entities about any labels you can use for the table parameter
in the source URL.
ctk load \
"shopify://<shopify store URL>?api_key=token&table=orders" \
"crate://crate:na@localhost:4200/testdrive/shopify_orders"
Slack
Load data from Slack into CrateDB.
See Slack entities about any labels you can use for the table parameter
in the source URL.
ctk load \
"slack://?api_key=${SLACK_TOKEN}&table=channels" \
"crate://crate:na@localhost:4200/testdrive/slack_channels"
Stripe
Load data from Stripe into CrateDB.
See Stripe entities about any labels you can use for the table parameter
in the source URL.
ctk load \
"stripe://?api_key=${STRIPE_API_KEY}&table=charge" \
"crate://crate:na@localhost:4200/testdrive/stripe_charges"
Wise
Load data from Wise into CrateDB.
See Wise entities about any labels you can use for the table parameter
in the source URL.
ctk load \
"wise://?api_key=<api_token>&table=transfers" \
"crate://crate:na@localhost:4200/testdrive/wise_transfers"
Zendesk
Load data from Zendesk into CrateDB.
See Zendesk entities about any labels you can use for the table parameter
in the source URL.
ctk load \
"zendesk://:<oauth_token>@<sub-domain>?table=tickets" \
"crate://crate:na@localhost:4200/testdrive/zendesk_tickets"
Zoom
Load data from Zoom into CrateDB.
See Zoom entities about any labels you can use for the table parameter
in the source URL.
ctk load \
"zoom://?client_id=<client_id>&client_secret=<client_secret>&account_id=<account_id>&table=meetings" \
"crate://crate:na@localhost:4200/testdrive/zoom_meetings"