Product and documentation updates from the team at Stitch.
Stay up-to-date by subscribing to our RSS feed.
Amazon S3 CSV (v1) bug fix: Missing documents
We’ve improved our Amazon S3 CSV (v1) integration to fix the following issue:
CSV documents are missing, indicating a potential race condition. These documents were created or modified simultaneously with the extraction process, leading to a situation where the bookmark date advances, causing the documents to be missed during identification.
Hubspot integration: New version (v3) now available!
A new version (v3) of the Hubspot integration is now available!
Changes in this version include:
- Upgrading
ownersAPI endpoint from v2 to v3. - Updating the primary key in the
ownerstable fromownerIdtoid. - Schema modifications to align with the Hubspot API.
Full details can be found on the pull request against the open sourced integration here.
Klaviyo (v1) update: API upgrade
We’ve updated the integration’s API version.
The base URL has been updated for all streams.
The API key authorization has been moved from the query parameters to the request headers.
The schema for all streams has been updated to include all relevant fields.
New tables have been added: subscribed_to_email and subscribed_to_sms.
Mambu (v4) bug fix: Date windowing pagination use
We’ve updated our Mambu (v4) integration to fix issues during the integration execution:
- Out-Of-Memory Issue: Initially, all records from the start date to the current date were pulled, and the integration allowed generator buffers to grow without limit, surpassing the default extraction memory limits rapidly. To address this, we implemented date windowing (default size = 1 day) and pagination for multi-threaded streams, a limited generator buffer growth to finite boundaries and we eliminated performance metrics to reduce performance overheads.
- Execution Time: Previously, to address performance concerns, a single-threaded implementation was adopted, resulting in slow extraction speeds. Multi-threaded execution has been reintroduced to expedite historical sync execution with a maximum thread count equal to 20.
- Data Discrepancy:
Data discrepancies were reported in certain streams after the extraction gets interrupted due to extraction timeout and memory issue.
The bookmark strategy has been revised for multi-threaded generators to address data discrepancies.
We segregated the
LoanAccountssub-stream bookmarking to rectify data inconsistencies.
Intercom (v2) bug fix: Conversations stream bookmarking
We’ve updated our Intercom (v2) integration to fix the following issue during the integration execution.
The conversations records have been updated after the previous synchronization start was missed. This issue has been fixed by bookmarking the last synchronization start time.
A long running synchronization was stuck in loop after interruption because the synchronization was resumed from the start. Nested filters have been added in search_query to resume the synchronization from the last processed conversations record.
LinkedIn Ads (v2) update: API upgrade and new fields
We’ve updated the LinkedIn Ads integration’s API version from 2023-04 to 2024-03.
We’ve updated API endpoints for the following streams: campaign_groups, campaigns, creatives.
A cursor-based pagination has been implemented for the following streams: accounts, campaign_groups, campaigns, creatives.
Unsupported pivot and pivotValue have been removed from the fields query parameters in Analytics API requests.
New fields have been added to the video_ads stream. It now requires the scope r_organization_social to synchronize the records.
Data is not available for change_audit_stamps in the new endpoint.
Facebook Ads (v1) bug fix: Summary param error
We’ve updated our Facebook Ads (v1) integration to fix the following error:
Status: 400
Response:
{
"error": {
"message": "(#100) Cannot include cost_per_inline_post_engagement, unique_inline_link_click_ctr, frequency, video_play_curve_actions, unique_ctr, ctr, spend, unique_clicks, unique_inline_link_clicks, video_p100_watched_actions, campaign_name in summary param because they weren't there while creating the report run. All available values are: ",
"type": "OAuthException",
"code": 100,
"fbtrace_id": "*************"
}
}
While awaiting for Facebook’s fix, a workaround is now available. A new retry logic has been implemented, you can now retry the request for a successful data retrieval.
GitHub (v2) fix: remove uri format from the events url field
We’ve updated our GitHub (v2) integration to fix the following error:
INFO Exit status is: Discovery succeeded. Tap failed with code -15. Target failed with code 1 and error message: "Error persisting data to Stitch: 400: {'error': 'Record 0 for table events did not conform to schema:\n#: #: no subschema matched out of the total 2 subschemas\n#/payload}".
The URI format restriction for the events field has been removed.
Shopify (v1) update: API version upgrade and schema changes
We’ve upgraded our Shopify (v1) integration’s Shopify SDK version to 12.4.0.
We’ve updated the Shopify integration’s API version from 2023-04 to 2024-01.
We’ve removed the currency, accepts_marketing, accepts_marketing_updated_at, and marketing_opt_in_level fields from the abandoned_checkout and customers tables.
New poNumber and taxExempt objects have been added to the orders table.
Amazon S3 CSV (v1) bug fix: Missing type information in JSON schema
We’ve updated our Amazon S3 CSV (v1) integration to fix the following error during the data loading process:
ERROR Target exited abnormally with status 1. Terminating tap.
INFO No tunnel subprocess to tear down
INFO Exit status is: Discovery succeeded. Tap succeeded. Target failed with
code 1 and error message: "Error persisting data to Stitch: 400: {'error': 'Invalid JSON schema: key null: expected type is one of JSONObject, found: String'}".
HubSpot (v2): Custom objects support
We’ve updated our HubSpot (v2) integration to add support for custom objects. You will now be able to replicate a table for each custom object in our HubSpot account.
The custom object tables support both standard and custom properties, and also support associations with emails, meetings, notes, tasks, calls, conversations, contacts, companies, deals, and tickets.
If you already have a HubSpot connection, you will need to re-authorize it to be able to select the new tables.
Outreach (v1) update: Leaving beta!
Our Outreach integration has left open beta and is now generally available! Check out the documentation for more info about this integration.
Google Analytics 4 (v1) update: Leaving beta!
Our Google Analytics 4 integration has left open beta and is now generally available! Check out the documentation for more info about this integration.
Pendo (v1) update: Leaving beta!
Our Pendo integration has left open beta and is now generally available! Check out the documentation for more info about this integration.
New integration: Iterable
A new Iterable integration is now available in beta!
Get started by creating a new Iterable integration or learning more in our documentation.
New version (v4) of Mambu integration
A new version (v4) of our Mambu integration is now available!
Learn more about the integration and these features in our Mambu integration documentation.
New integration: Snapchat Ads
A new Snapchat Ads integration is now available!
Get started by creating a new Snapchat Ads integration or learning more in our documentation.
New integration: TikTok Ads
A new TikTok Ads integration is now available!
Get started by creating a new TikTok Ads integration or learning more in our documentation.
Remove `order` query param from manual_journals request
The Xero API currently has a bug where all manual_journal records created or modified since the last bookmark are returned instead of 100 per page causing, in some instances, API quotas to be exceeded.
Xero support noticed this only happens when order is added as a query parameter in the request. This temporary fix removes the order query parameter when retrieving data for the manual_journals stream until Xero fixes the bug. Data will still be retrieved in it’s expected for the Xero (v1) integration.
Shopify (v1) update: API version upgrade and schema changes
We’ve upgraded our Shopify (v1) integration’s ShopifyAPI and SDK version to 12.0.1.
We’ve removed the last_order_id, last_order_name, orders_count, and total_spent fields from the customer object in the orders table.
A new email_marketing_consent object has been added to the customers and orders tables.
Microsoft SQL Server (v1): Log4j update
We’ve updated the Log4j version in our Microsoft SQL Server (v1) integration due to the vulnerability in CVE-2020-9493.
Typeform (v2): Support submitted landings without answers
We’ve fixed an issue in our Typeform (v2) integration causing the data extraction to fail when at least one submitted landing had no answer. The integration will now check if a stream’s child key is blank before trying to process its children.
New User Role: General User
In an effort to increase account security, we have introduced a new user role: General User. This makes it possible for you to separate users who handle account administration from those who are in the app to manage the Stitch pipeline. A General User can manage sources and destinations but cannot take any action tied to billing or accessing the Stitch account. Check out our team member roles & permissions page to learn more about the General User role.
Mambu (v2) improvement: Timezone improvement
We’ve improved our Mambu date-time fields to eliminate several timezone related issues:
- All
date-timedata has been converted to UTC for processing - Implemented functionality to get the tenant’s timezone so that calculations for the local time are done using the tenant’s, and not the local computer’s
- The following streams now use
date-timeinstead of justdate:clients,communications,deposit_transactions,loan_accounts,loan_transactions
LinkedIn Ads (v1) update: Check existing access tokens
We’ve improved our LinkedIn Ads (v1) integration to avoid generating a new access token when a valid one already exists. The integration now checks the expiration date of an existing token and uses it if it is valid, instead of creating a new one.
Yotpo integration: New version (v2) now available!
A new version (v2) of our Yotpo integration is now available!
We’ve improved the Yotpo integration by updating our tables and fields. See the updates by visiting our documentation!
Mambu (v2) improvement: Changed `deposit_accounts` sorting field
We’ve changed the sorting field from id to lastModifiedDate for the deposit_accounts table in our Mambu integration. The MultithreadedBookmarkGenerator changes the filter at every n records so switching to the lastModifiedDate ensures that we don’t miss older records during the extraction process.
Google Sheets integration: New version (v2) now available!
A new version (v2) of our Google Sheets integration is now available!
We’ve improved the Google Sheets integration by enhancing data type discovery and adding support for shared drives. See the updates by visiting our documentation!
Recharge integration: New version (v2) now available!
A new version (v2) of our Recharge integration is now available!
We’ve improved the Recharge integration by updating our tables and fields. See the updates by visiting our documentation!
New integration: Dixa
A new Dixa integration is now available!
Get started by creating a new Dixa integration or learning more in our documentation.
Stripe integration: New version (v2) now available!
A new version (v2) of our Stripe integration is now available!
We’ve improved the Stripe integration adding a new table and parameter. Here’s a look at what has changed:
- New parameter:
lookback_window. The number of historical days’ worth of data to replicate from thestart_datevalue for each replication job for your streams. The maximum lookback window is600days. - New table:
payment_intents. This table contains information about payments, from creation through checkout, in your Stripe account.
New feature: New Upgraded Plans!
Stitch has brand new upgraded plans!
Check out the new guide for more information.
Google Ads (v1) update: New tables!
We’ve added a lot of new tables to our Google Ads (v1) integration catalog. See the list below for the new tables:
ad_group_criterioncampaign_criterioncarrier_constantfeedfeed_itemlanguage_constantmobile_app_category_constantmobile_device_constantoperating_system_version_constanttopic_constantuser_interestuser_list
Google Ads (v1) improvement: Implement Automatic Keys
We noticed dupilicate results being written for distinct reporting records across our Google Ads (v1) integration reporting tables. This caused some overwritting on records that should not have been overwritten.
To fix this we’ve implemented automatic keys to ensure that data can be loaded and identified downstream as distinct records.
Mambu (v2) update: Continued refactoring and new fields
We’ve made many updates to our Mambu (v2) integration. See the list below for changes:
- Refactoring of the
credit_arrangementsstream - Refactoring of the
usersstream - Refactoring of the
activitiesstream - Refactoring of the
audit_trailstream - Added the
interest_accrual_breakdownstream - Added new fields to the
tasksstream - Added new fields to the
loan_transactionsstream
Mambu (v2) update: Misc bug fixes and feature updates
We’ve made many updates to our Mambu (v2) integration. See the list below for changes:
- added
currencyfield toloan_accounts - added
payment_detailsfield todeposit_transactions - added
statusfield totasksstream - added sorting to
gl_journal_entriesstream - fixed
loan_accountsbeing skipped if updated while the extraction is running - refactored
deposit_accountsandcardsstreams
New feature: Support for SSO with Google Workspace
We’ve expanded our list of supported Identity Providers to include Google Workspace!
Using a generic SAML 2.0 app, you can now configure Stitch to use SSO with your Google Workspace instance. Check out the new step-by-step guide for help getting set up.
Google CloudSQL MySQL integration: New version (v2) now in beta
A new version (v2) of our Amazon Aurora MySQL RDS integration is now in beta!
This version (v2) of Stitch’s Amazon Aurora MySQL RDS integration optimizes replication by utilizing Avro schemas to write and validate data, thereby reducing the amount of time spent on data extraction and preparation. Compared to previous versions of the Amazon Aurora MySQL RDS integration, this version boasts increased performance and overall reduced replication time.
Notable improvements and changes in this version also include:
- New column (field) naming rules. Avro has specific rules that dictate how columns can be named. As a result, column names will be canonicalized to adhere to Avro rules and persisted to your destination using the Avro-friendly name. Refer to the Column name transformations section in the Amazon Aurora MySQL RDS docs for more info.
- Expanded data type support. This version supports additional Amazon Aurora MySQL RDS data types. Refer to the Amazon Aurora MySQL RDS data types documentation for more info.
Note: The following features aren’t currently supported, but will be before the integration leaves beta:
- Custom SSL certificates and certificate authorities
To get a look at how this version compares to the previous version of Amazon Aurora MySQL RDS, refer to the Amazon Aurora MySQL RDS version comparison documentation.
Amazon Aurora MySQL RDS integration: New version (v2) now in beta
A new version (v2) of our Amazon Aurora MySQL RDS integration is now in beta!
This version (v2) of Stitch’s Amazon Aurora MySQL RDS integration optimizes replication by utilizing Avro schemas to write and validate data, thereby reducing the amount of time spent on data extraction and preparation. Compared to previous versions of the Amazon Aurora MySQL RDS integration, this version boasts increased performance and overall reduced replication time.
Notable improvements and changes in this version also include:
- New column (field) naming rules. Avro has specific rules that dictate how columns can be named. As a result, column names will be canonicalized to adhere to Avro rules and persisted to your destination using the Avro-friendly name. Refer to the Column name transformations section in the Amazon Aurora MySQL RDS docs for more info.
- Expanded data type support. This version supports additional Amazon Aurora MySQL RDS data types. Refer to the Amazon Aurora MySQL RDS data types documentation for more info.
Note: The following features aren’t currently supported, but will be before the integration leaves beta:
- Custom SSL certificates and certificate authorities
To get a look at how this version compares to the previous version of Amazon Aurora MySQL RDS, refer to the Amazon Aurora MySQL RDS version comparison documentation.
MariaDB integration: New version (v2) now in beta
A new version (v2) of our MariaDB integration is now in beta!
To get a look at how this version compares to the previous version of MariaDB, refer to the MariaDB version comparison documentation.
Intercom (v1) bug fixes: Fixed breaking changes
We’ve fixed the following issues in our Intercom (v1) integration:
- The
epoch_milliseconds_to_dt_str()function was updated to convert epoch to UTC time. - The
time_extractedelement was added back to thewrite_recordfunction. - The bookmark for the
conversation_partsstream will be updated with the parentconversation’s replication key after the collection of child records.
New feature: Multiple Destinations
Stitch Unlimited and Ulimited Plus accounts can now load data from their integrations into more that one destination! Learn more in the documentation.
Shopify (v1) integration: New Events stream
A new events stream was added to our Shopify (v1) integration.
For more information, see the Shopify documentation.
Mambu (v2) update: Changes in the gl_journal_entries stream
We’ve updated our Mambu (v2) integration to change the replication_keys and bookmark_field for the gl_journal_entries stream from booking_date to creation_date.
This change solves the issue where journal entries were missing when transactions were reversed.
Mixpanel (v1) update: Switch from multipleOf to singer.decimal
We’ve updated our Mixpanel (v1) integration to use the type string and format singer.decimal in funnels and revenue streams, instead of the type number and 'multipleOf': 1e-20.
This change solves the issue where a schema mismatch error would be retuned when a value was out of range.
New integration: Crossbeam
A new Crossbeam integration is now available!
Get started by creating a new Crossbeam integration or learning more in our documentation.
Updated feature: Response for Import API access tokens
We’ve updated the response in the Stitch Connect API when retrieving access token IDs.
The Import API access token ID creation timestamp will now be included in the GET /v4/sources/{source_id}/tokens response. Check our docs to see an example.
Updated feature: Post-Load Webhooks API change
The Stitch Connect API and Application now require that you have a destination to create a post-load webhook.
In the Stitch Connect API, you now need to provide a Destination ID in the POST body. The destination_id parameter value should be the destination that will trigger the webhook. For more information, take a look at our docs on how to create a post-load webhook.
Use one of the following ways to find your Destination ID:
via the Connect API:
Call GET /v4/destinations
via the Web Application:
- Log into your Stitch account.
- Navigate to Destinations.
- Your ID is part of the web URL. Look for
/v2/destinations/<destination_id>/edit.
If you need additional help retrieving your Destination ID, please reach out to Stitch Support.
Stitch Connect JavaScript (Stitch.js) deprecation
As of today, the Stitch Connect JavaScript client, or Stitch.js, has been deprecated.
What does this mean?
Stitch.js will continue to function, but Stitch will no longer formally support its use.
Does this affect the Connect API?
The only endpoint affected by this change is the Create a Session endpoint. All other endpoints in the Connect API remain unchanged.
When will it stop functioning?
We don’t have a sunset, or end-of-life, date set just yet. If and when a sunset date is chosen, we’ll communicate it here and through other support channels.
What should you do instead?
If you’re using Stitch.js, transition to using parallel functionality in the Connect API.
The following table lists all Stitch.js functions, the Connect API endpoint that provides the same functionality, and links to resources that explain how to perform the functions in the API.
| Stitch.js function | Connect API endpoint | How-to guide |
| addSource | POST /v4/sources | |
| authorizeSource | PUT /v4/sources/{source_id} | |
| displayDiscovery | GET /v4/sources/{source_id}/streams | |
| selectStreamsForSource | PUT /v4/sources/{source_id}/streams/metadata | |
| editSource | PUT /v4/sources/{source_id} |
What about performing OAuth for sources?
The Connect API can still perform OAuth for sources that support it. Check out the Configure OAuth for a Data Source with the Connect API guide for step-by-step instructions.
PostgreSQL (v2) update: Google CloudSQL PostgreSQL now available!
A new version (v2) of our Google CloudSQL PostgreSQL integration is now available!
Along with all of the new features in v2 of the PostgreSQL integration (which this integration is based on), we’ve also added support for:
- SSL connections
- Log-based Incremental Replication
Learn more in our Google CloudSQL PostgreSQL integration documentation.
Databricks Delta (v1) update: Leaving beta!
Our Databricks Delta Lake (AWS) destination has left open beta and is now generally available! Check out the documentation for more info about this destination.
Amazon S3 CSV (v1) bug fix: Empty file error handling
Previously, the Amazon S3 CSV integration would not complete a replication job when multiple CSV files in an S3 bucket had empty records - even if there were some files that did have records.
This has been corrected. The integration will now complete replication jobs by ignoring the files without records.
Chargebee (v1) update: New fields!
We’ve added new fields to the events and addons tables.
New to the events table:
show_descriptions_in_invoicesshow_description_in_quotesobjectsubattribute within thetiersattribute
New to the addons table:
show_descriptions_in_invoicesshow_description_in_quotesobjectsubattribute within theprice_in_decimalattribute
Google Search Console (v1) update: New empty response error exception
To improve the experience of our Google Search Console integration, we’ve changed how we handle empty response errors.
Instead of bypassing the error without an explanation, the integration will now raise an error and display it in the Extraction Logs:
HTTP-error-code: 400, Error: The request is missing or has a bad parameter.
GitHub (v1) update: New empty response error exception
To improve the experience of our GitHub integration, we’ve changed how we handle empty response errors.
Instead of bypassing the error without an explanation, the integration will now raise an error and display it in the Extraction Logs:
HTTP-error-code: 400, Error: The request is missing or has a bad parameter.
Facebook Ads (v1) update: Fixed composite primary key for the `ads_insights_country` table
We’ve fixed the ads_insights_country composite primary key. The country field had previously been erroneously excluded.
The composite primary key is now: campaign_id : adset_id : ad_id : date_start : country
This is a breaking change and communiation from Stitch support has been emailed to affected users.
If you are not already including the country field in downstream processes that identify uniqueness of records in the files loaded for this table, this field will need to be added into those processes.
You may also wish to reset this table to have historical data re-replicated and more accurately portrayed, in which case you should:
- Contact our support team to implement a courtesy row-usage exemption for your Facebook Ads integration.
- Within Stitch, navigate to the
ads_insights_countrytable’s Table Settings page. - Use the Reset Table button to queue this table’s reset.
If you have any questions about the change or this process, please reach out to Stitch support via in-app chat.
Shopify (v1) update: Updated setup requirements for Shopify Plus plans
We’ve updated our Shopify documentation to include info about the required permissions for users on Shopify Plus plans.
In general, view-level permissions should be sufficient to allow Stitch to replciate data. We recommend checking out Shopify’s Staff Permissions documentation for details on the permissions available inShopify.
Yotpo (v1) improvement: Error handling and messaging
We’ve made some updates to our Yotpo integration that improves error handling and messaging during Extraction:
-
Fixed a transform error with the
unsubscriberstable. Previously, records without valid Primary Key values would result in a critical error that stopped extraction. Now, these records will be dropped and a message will display in the Extraction Logs. This allows Extraction to continue for records with valid Primary key values. -
Some errors now result in an automatic retry. Previously, if the integration received certain response codes from Yotpo’s API, Stitch would stop Extraction. The following response codes now trigger an exponential backoff and then automatic retry:
Response code Message 401 Invalid authorization credentials. 429 The API rate limit for your organisation/application pairing has been exceeded. 502 Server received an invalid response. 503 API service is currently unavailable. 504 API service time out, please check Yotpo server.
Pipedrive (v1) update: Removed delete_log table
Due to Pipedrive removing support for delete_logs from their API, we’ve removed this table from our Pipedrive integration. We’ve also updated the docs to reflect this.
New documentation: Understanding integration versioning and statuses
After the v2 release of our PostgreSQL integration, we received some questions about how integrations are versioned. Today, we’re adding a new resource to the docs to help answer these questions: Understanding Integration Versioning and Upgrades in Stitch
This new guide contains info about the process each version of our integrations goes through, what each version status (ex: Beta, Released (Testing) means, and how to identify which version of an integration you’re using.
New feature: Connection Cloning
We’ve expanded our Stitch features!
In the web app or with Connect, you can now clone your Stitch connections. Check out the new step-by-step guide for help setting that up.
Chargebee (v1) update: New item tables for Chargebee Product Catalog v2!
We’ve made some big changes to how our Chargebee integration works, along with adding some new tables.
(v1) integrations now use the Product Catalog version for the site to determine which tables to display in Stitch. Some tables and fields are only available if your site is using v1.0 of the Product Catalog, some only on v2.0. We’ve added a new section to the documentation that goes into more detail.
In addition to this change, we’ve added a few new tables which are available if using Product Catalog v2.0:
Note: Stitch’s (v1) integration supports both Product Catalog v1.0 and v2.0. The version of the integration doesn’t refer to support for a specific Product Catalog version.
Outreach (v1) update: New tables and foreign key documentation
We’ve added some new tables to our Outreach (v1) integration:
sequence_statessequence_stepssequence_templatessequences
We’ve also updated the Outreach table documentation to include info about foreign keys and how tables related to each other. Check it out here.
Chargebee (v1) bug fix: Correct issue with cf_company_id data type
Previously, Chargebee integrations could encounter issues related to data typing when replicating the cf_company_id field in the customers and events table. We’ve addressed this by allowing this field to be either an integer or a string.
Harvest Forecast (v1) bug fix: Correct sync_endpoints method
This update fixes an issue in Harvest Forecast integrations where data replication would fail due to incorrectly ordered objects in the integration’s code. Additionally, this change also removes duplicate items from the integration’s output.
Amazon S3 CSV (v1) improvement: Duplicate column headers and extra value support
Our Amazon S3 CSV integration now supports duplicate column headers and extra values in rows. We’ve added an additional system column (_sdc_extra) to support these scenarios.
Check out the Amazon S3 CSV docs for more info and examples.
API documentation update: New guide for creating destinations
We’ve added a new guide to the Connect API resources!
Use the Create a Destination with the Connect API guide to learn how to connect a destination to your Stitch account using the API. You can also use this guide to learn about the process for switching to a different destination.
API documentation update: Improved connection property docs
We’ve moved the documentation for connection property objects out of the Connect API reference and into their own reference: Destination and Source Connection Property API Reference
This new resource includes:
- An explanation of what connection properties are and how to use them
- Info about what connections are available in the API
- Details about the properties required to create and configure each available connection using the API
PostgreSQL (v2) update: Leaving beta!
A new version (v2) of our PostgreSQL integration has left beta and is now generally available!
This version (v2) of Stitch’s PostgreSQL integration optimizes replication by utilizing Avro schemas to write and validate data, thereby reducing the amount of time spent on data extraction and preparation. Compared to previous versions of the PostgreSQL integration, this version boasts increased performance and overall reduced replication time.
Notable improvements and changes in this version also include:
- Expanded data type support. This version supports additional PostgreSQL data types. Refer to the PostgreSQL data types documentation for more info.
- Improved handling of
JSON,JSONB, andHSTOREdata types. In previous versions, these data types were treated as strings. This version will send them to your destination as JSON objects, which may result in de-nesting. - Improved handling of schema changes in tables using Log-based Incremental Replication. Adding and removing columns in these tables will no longer cause extraction errors. Note: This limitation still applies to version 1.
Note: The following features aren’t fully supported, but are being worked on:
- Arrays of
DECIMAL,NUMERIC, andTIMESTAMP(TZ)data types - Support for other flavors of PostgreSQL. We’re in the process of testing this version of our integration with other flavors of PostgreSQL, including Heroku, Google CloudSQL, Amazon Aurora, and Amazon RDS.
To get a look at how this version compares to the previous version of PostgreSQL, refer to the PostgreSQL version comparison documentation.
Chargify (v1) update: New transaction data!
New fields have been added to the transactions table of our Chargify (v1) integration:
period_range_startperiod_range_endprice_point_idprice_point_handlecomponent_handlecomponent_price_point_idcomponent_price_point_handle
Learn more in our documentation.
Chargify (v1) update: New component data!
New fields have been added to the components table of our Chargify (v1) integration:
default_price_point_nameproduct_family_nameprices.idprices.component_idprices.starting_quantityprices.ending_quantityprices.unit_priceprices.price_point_idprices.formatted_unit_price
Learn more in our documentation.
Shopify (v1) update: Product status now available!
A new status field has been added to the products table of our Shopify (v1) integration.
This field indicates the current status of a given product, including as active, archived, and draft.
Klaviyo (v1) update: New campaigns table and field selection support!
We’ve made some updates to our Klaviyo integration:
- Field selection is now supported! Select only the fields you want to replicate in the Tables to Replicate tab.
- New
campaignstable. This table contains info about the campaigns in your Klaviyo account.
Learn more in our documentation.
Freshdesk (v1) improvement: Correct data type for groups table field
We’ve added integer as a valid data type for the groups.auto_ticket_assign field. Previously, the integration would only accept boolean values for this field.
As the Freshdesk API can return boolean or integer values, the integration’s data typing could cause errors or discrepancies. This improvement ensures data is replicated correctly and without issue.
GitHub (v1) update: New table documentation now available
We’ve updated the GitHub (v1) docs with info about the following tables:
commit_commentscommitseventsissue_labelsissue_milestonesproject_cardsproject_columnsprojectspull_request_reviewsteam_membersteam_membershipsteams
Check out the updated docs for more info.
Documentation update: Parent and child table info now available
We’ve updated the integration schema documentation to include info about parent and child tables. Now you can tell, at a glance, if a table is dependent upon another table for replication:
The Parent table field contains the name of the table that must also be selected for the child table to replicate successfully. This info will also be included in the child table’s description. In this example, the teams table must be selected for the team_members table to replicate.
For parent tables, their descriptions will contain info about the child tables that depend on them:
In this example, the team_memberships and team_members tables will only replicate successfully if the teams table is also selected.
We hope this additional info about integration tables provides additional insight into how Stitch replicates data and will help you avoid Extraction errors.
Currently this data is only available in the GitHub (v1) docs, but we’ll roll it out to other integrations as we make updates.
Pipedrive (v1) improvement: Retrieve all organization fields
Previously, fields would be missing from the organizations table if there were more than 100 fields available. We’ve added pagination to the requests the integration makes for organizations data, ensuring all fields will be discovered and replicated correctly.
Slack (v1) update: User email now available in users table
We’ve added a new column to the Slack users table: profile.email. This column contains the email address for the associated user.
Note: To replicate this data, you’ll also need to grant the users:read.email scope to the Stitch app created for the integration.
Typeform (v1) update: New forms table!
We’ve added a new table to our Typeform (v1) integration!
The new forms table contains info about the forms accesible to the user who authorized the Typeform integration in Stitch.
Learn more in our documentation.
Facebook Ads (v1) API upgrade to v10.0
The Facebook Ads integration now replicates data using version 10.0 of the Facebook Marketing API. For more details, view the Facebook API changelog.
Shopify (v1) improvement: Improved data typing for abandoned checkouts
Previously, some users were encountering JSON schema validation errors for the abandoned_checkouts table due to how some columns were being typed. This change types the following columns correctly, eliminating the validation errors:
note_attributesline_items.applied_discountsshipping_lines.applied_discountsshipping_lines.custom_tax_lines
Check out the pull request for more info.
Pendo (v1) update: New setting for including anonymous visitor data
We’ve added a new setting to our Pendo integration: Include Anonymous Visitors
When checked, Stitch will replicate data attributed to anonymous visitors.
Learn more in our Pendo integration documentation.
Microsoft SQL Server (v1) bug fix: Quoting Replication Key columns in incremental queries
Previously, the names of Replication Key columns weren’t being quoted when used in incremental queries. If a column name contained spaces, this would cause an error in the query and extraction to fail. This fix ensures Replication Key columns are properly quoted.
New extraction error reference for Salesforce
We’ve added a new resource for troubleshooting Extraction errors in Salesforce integrations. If Stitch receives an error during Extraction, you can use this reference to locate the error, pinpoint the cause, and identify next steps for resolution.
Intercom (v1): Identified issue with companies endpoint
We’ve identified an issue replicating data for the companies table in Intercom (v1) integrations due to a limit in Intercom’s API.
Currently, Intercom’s API allows an Intercom app to make one request to the Scroll over all companies endpoint at a time. Stitch uses this endpoint to replicate the companies table.
If multiple connections exist and they attempt to use this endpoint at the same time, only the connection who made the request first will succeed.
This means that if Stitch attempts to extract data when another connection is using the endpoint, Extraction will fail and an error will surface in the Extraction Logs.
We’ve updated the Intercom documentation to include this info and how to mitigate it. Additionally, we’ve created a new resource for troubleshooting Intercom Extraction errors.
Shopify (v1) bug fix: Remove duplicates of `build` fields
Due to the case sensitivy of fields during the Shopify replication job, Stitch failed to recognize that build and Build were the same field.
This fix canonicalizes these fields. Whenever Stitch sees Build, it will transform it to build to ensure all build data goes into the same field.
Zuora (v1) update: Enforce use of UTC
Our code is now explicitly forcing the use of UTC for timestamps for our Zuora integration.
Our requests to the Zuora REST API weren’t specifying a timezone while querying, and the integration assumed that no timezone retrieved meant UTC. This update ensures times are consistently recorded in a UTC format.
Shopify (v1) improvement: Improvements to order_refunds and transactions tables
We’ve made some improvements to how the transactions and order_refunds tables replicate in Shopify (v1) integrations:
- Bookmarking has been added to the
order_refundsandtransactionstables - Error handling added to the
transactionstable to avoid 429 errors
Mambu integration: New version (v2) now available!
A new version (v2) of our Mambu integration is now available!
We’ve improved the naming of custom fields by reducing their size. Removing unnecessary characters in these fields improves the Mambu integration’s compatibility with PostgreSQL destinations by reducing the likelihood of field names exceeding the character limit for column names.
Here’s a look at how the schema for custom fields has changed:
| v2 attribute name | v1 attribute name |
|
custom_fields |
custom_field_sets |
|
custom_fields.field_set_id |
custom_field_sets.custom_field_set_id |
|
custom_fields.id |
custom_field_sets.custom_field_values.custom_field_id |
|
custom_fields.value |
custom_field_sets.custom_field_values.custom_field_value |
Learn more in our Mambu integration documentation.
Harvest Forecast (v1) improvement: Corrected replication for Full Table and assignments
This fix addresses a few issues:
-
Replication for
assignments: This table now replicates using Full Table Replication. Previously, Stitch would encounter errors from Harvest’s API when attempting to replicate data incrementally. We’ve determined this was caused by a change in Harvest’s API, so we changed this table’s Replication Method to accommodate that change. -
Full Table Replication: Stitch will now correctly refresh tables using Full Table Replication.
MySQL integration: New version (v2) now in beta
A new version (v2) of our MySQL integration is now in beta!
This version (v2) of Stitch’s MySQL integration optimizes replication by utilizing Avro schemas to write and validate data, thereby reducing the amount of time spent on data extraction and preparation. Compared to previous versions of the MySQL integration, this version boasts increased performance and overall reduced replication time.
Notable improvements and changes in this version also include:
- New column (field) naming rules. Avro has specific rules that dictate how columns can be named. As a result, column names will be canonicalized to adhere to Avro rules and persisted to your destination using the Avro-friendly name. Refer to the Column name transformations section in the MySQL docs for more info.
- Expanded data type support. This version supports additional MySQL data types. Refer to the MySQL data types documentation for more info.
Note: The following features aren’t currently supported, but will be before the integration leaves beta:
- Custom SSL certificates and certificate authorities
To get a look at how this version compares to the previous version of MySQL, refer to the MySQL version comparison documentation.
Xero (v1) update: Replicating archived contacts
Archived contacts can now be included in replication for Xero integrations.
To replicate records for both archived and active contacts:
- In the Stitch app: Check the Include archived contacts setting in the Integration Settings page
- In the Connect API: Set the
include_archived_contactsproperty forplatform.xerototrue
If this setting isn’t enabled, Stitch will replicate data only for active contacts.
Pendo (v1) bug fix: Fixed replication issue for track_events table
This bug fix resolves the following 400 error for Pendo integrations where the track_events table is selected:
bad pipeline: bad source: bad parameters for source type trackEvents: unexpected parameters`.
We corrected the source parameter for the trackEvents source from trackId to trackTypeId, allowing this table to now replicate successfully.
Improved security documentation
We’ve been working hard to improve our security documentation - here’s a high-level look at the changes:
-
Added a dedicated category page, ensuring you can easily view and navigate all things Stitch security
-
Reformatted the Security FAQ (now the Security Overview), allowing you to view all content at once. You can also now use
Ctrl+Fto perform an on-page search. -
Expanded the Security Overview to include detailed info about:
GitHub (v1) update: New base branch data available for pull_requests
Several fields have been added to the pull_requests table in our GitHub (v1) integration!
The base object contains details about the base branch used in a given pull request, including the repository it originated from.
Learn more in our documentation.
Xero (v1) update: New quotes table
A new table (quotes) has been added to our Xero (v1) integration!
Learn more in our documentation.
New feature: Support for SSO with PingFederate
We’ve expanded our list of supported Identity Providers to include PingFederate!
Using a SAML SP connection, you can now configure Stitch to use SSO with your PingFederate instance. Check out the new step-by-step guide for help getting set up.
MailChimp (v1) improvement: Improved timeout message for campaigns
We’ve updated the export timeout error message for the campaigns table to indicate that the export will continue to be extracted in the next replication:
Mailchimp campaigns export is still in progress after [number] seconds. Will continue with this export on the next sync.
Previously, this message (campaigns - export deadline exceeded ([number] secs)) didn’t clearly set expectations for the table during the next replication job.
JIRA (v2) update: New components table
A new table (components) has been added to our JIRA (v2) integration!
Learn more in our documentation.
Zuora (v1) improvement: AQuA API CSV handling improvement
We’ve improved how Zuora (v1)integrations handle truncated CSVs received from the Zuora API.
For more info about this new feature, check out the pull request in the tap-zuora repository.
New feature: Support for SSO with Azure Active Directory (Azure AD)
We’ve expanded our list of supported Identity Providers to include Microsoft Azure Active Directory (Azure AD)!
Using a generic SAML 2.0 app, you can now configure Stitch to use SSO with your Azure AD instance. Check out the new step-by-step guide for help getting set up.
New feature: Integration changelogs
Introducing: Integration changelogs!
Check out the history of our integrations and stay in the loop on updates with dedicated changelogs for these integrations:
We’ll add changelogs for other popular integrations and destinations in the weeks to come. If there’s a specific integration you’d like to see us work on, let us know by creating an issue in the Stitch Docs GitHub repo.
Salesforce (v1) update: Removed FieldHistoryArchive object
We’ve determined that the FieldHistoryArchive object is incompatible with the Salesforce integration’s current method of querying, and as a result have removed it from the integration.
Refer to the tap repository for more info.
Google Analytics (v1) update: Lifetime Value and Cohorts documentation
Stitch Support has determined that Lifetime Value and Cohorts aren’t currently supported for Google Analytics integrations, despite being available fields in Stitch. We’ve updated our documentation to reflect this and will address this issue in the app shortly.
Eloqua (v1) update: Email groups and additional contact data
We’ve added some additional data to our Eloqua (v1) integration!
- New table:
email_groups - New
contactfields:IsBounceBackIsSubscribedEmailFormatAccountName
Learn more in our documentation.
Mambu (v1) bug fix: Resolved decimal precision failures
Previously, if Stitch extracted decimal data larger than the constraint defined in the Mambu integration (1e-10), data validation would fail and result in Extraction errors.
The integration has been updated to expand the constraint, ensuring that big decimal values will no longer result in validation failures.
Salesforce (v1) improvement: Improved OPERATION_TOO_LARGE error messaging
We’ve updated the Salesforce integration to log OPERATION_TOO_LARGE errors more clearly. The following error will now display in the Extraction Logs when this issue is encountered:
OPERATION_TOO_LARGE: exceeded 100000 distinct who/what's. Consider asking your Salesforce System Administrator to provide you with the `View All Data` profile permission. (Stream: [STREAM_NAME])
Zoom (v1) update: Updated data for report_meetings and report_webinars tables
We’ve made a few updates to the Zoom report_meetings and report_webinars tables
- The
deptattribute in both tables now correctly returns anintegerinstead of astring - We’ve added the
host_idanduser_idfields to thereport_webinarstable
Pendo (v1) improvement: Improve performance for visitors and events tables
We’ve implemented ijson, which is used in other Singer taps, to streamline replication for Pendo’s visitors and events tables. This improvement reduces the amount of memory needed to replicate large amounts of data, potentially leading to improved Extraction times.
Zuora (v1) improvement: Updated discovery process for new enforced limit on AQuA jobs
The new discovery process helps avoid Zuora integration failures due to the new enforcement of limits on AQuA jobs. For more information on Zuora’s AQuA API, click here.
New feature: Single Sign-on (SSO) with Okta and OneLogin
Stitch accounts can now be configured to use Single Sign-on (SSO) with Okta or OneLogin. Once enabled, team members would be required to authenticate with your Identity Provider (IdP) to access Stitch.
SSO is available for all Stitch plans.
Learn more in the documentation.
Pendo (v1) bug fix: Custom field issues for visitors and accounts tables
We’ve fixed a few issues with the Pendo visitors and accounts tables:
- Custom fields without a defined data type will no longer return a
nullvalue. - If a table had multiple custom fields, the last field on the table was being overwritten. We’ve updated the integration to address this.
PostgreSQL integration: New version (v2) now in beta
A new version (v2) of our PostgreSQL integration is now in beta!
This version (v2) of Stitch’s PostgreSQL integration optimizes replication by utilizing Avro schemas to write and validate data, thereby reducing the amount of time spent on data extraction and preparation. Compared to previous versions of the PostgreSQL integration, this version boasts increased performance and overall reduced replication time.
Notable improvements and changes in this version also include:
- New column (field) naming rules. Avro has specific rules that dictate how columns can be named. As a result, column names will be canonicalized to adhere to Avro rules and persisted to your destination using the Avro-friendly name. Refer to the Column name transformations section in the PostgreSQL docs for more info.
- Expanded data type support. This version supports additional PostgreSQL data types. Refer to the PostgreSQL data types documentation for more info.
- Improved handling of
JSON,JSONB, andHSTOREdata types. In previous versions, these data types were treated as strings. This version will send them to your destination as JSON objects, which may result in de-nesting.
Note: The following features aren’t currently supported, but will be before the integration leaves beta:
- Key-based Incremental Replication
ARRAYdata type
To get a look at how this version compares to the previous version of PostgreSQL, refer to the PostgreSQL version comparison documentation.
Stripe (v1) update: New fields!
New fields have been added to our Stripe (v1) integration!
The following tables now have additional fields available for replication:
chargescustomersinvoice_itemsinvoice_line_itemsinvoicespayoutssubscription_itemssubscriptions
Learn more in our documentation.
Mambu (v1) update: New tables and updated API endpoints
We’ve added some new tables to the Mambu integration:
We’ve also updated the endpoints the integration uses to extract data for the following tables:
clients- Previously usedGet all clients, now usesSearch clientsgroups- Previously usedGet all groups, now usesSearch groupsgl_journal_entries- Previously usedGet all GL journal entries, now usesSearch for GL journal entries
Learn more in our Mambu integration documentation.
QuickBooks integration: New version (v1)
A new version (v1) of our QuickBooks integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from QuickBooks to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Removal of
quickbooks_prefixes on table names - User-facing Extraction Logs
- Table and field selection
- Enhanced scheduling options
- Run and stop Extraction on demand functionality
- Availability via the Stitch Connect API
- Enhanced schema validation
Get started today by creating a new QuickBooks integration or learn more in the updated documentation.
Availability of European Data Center
We’re proud to announce the availability of an AWS European Data Center for Stitch. Enjoy the benefits of Stitch while ensuring your extracted data never leaves the European Union. Signup to get started or see our documentation for more details.
Google Analytics (v1) integration leaving open beta
Our Google Analytics integration has left open beta and is now generally available! Check out the docs for more info.
Trello integration: New version (v1)
A new version (v1) of our Trello integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from Trello to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Removal of
trello_prefixes on table names - Native OAuth support
- Support for custom fields for the
boardsandcardstables - User-facing Extraction Logs
- Updated API secret authentication
- The
exporttable now uses Append-only loading behavior - Configurable attribution windows for the
export,funnels, andrevenuetables - Table and field selection
- Enhanced scheduling options
- Run and stop Extraction on demand functionality
- Availability via the Stitch Connect API
- Enhanced schema validation
Get started today by creating a new Trello integration or learn more in the updated documentation.
Square integration: New version (v1)
A new version (v1) of our Square integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from Square to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Removal of
square_prefixes on table names - Addition of the customers table
- Several renamed tables:
square_inventoryis nowinventoriessquare_locationis nowlocations
- Several record types are now replicated through top-level tables:
feedata is now replicated through thetaxestabletimecarddata is now replicated through theshiftstable
- Removal of the
square_pagestable due to its deprecation in the Square API - User-facing Extraction Logs
- Table and field selection
- Enhanced scheduling options
- Run and stop Extraction on demand functionality
- Availability via the Stitch Connect API
- Enhanced schema validation
Get started today by creating a new Square integration or learn more in the updated documentation.
Mixpanel integration: New version (v1)
A new version (v1) of our Mixpanel integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from Mixpanel to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Removal of
mixpanel_prefixes on table names - New tables, including:
- User-facing Extraction Logs
- Updated API secret authentication
- The
exporttable now uses Append-only loading behavior - Configurable attribution windows for the
export,funnels, andrevenuetables - Table and field selection
- Enhanced scheduling options
- Run and stop Extraction on demand functionality
- Availability via the Stitch Connect API
- Enhanced schema validation
Get started today by creating a new Mixpanel integration or learn more in the updated documentation.
AdRoll integration: New version (v1)
A new version (v1) of our AdRoll integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from AdRoll to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Removal of
adroll_prefixes on table names - User-facing Extraction Logs
- Table and field selection
- Enhanced scheduling options
- Run and stop Extraction on demand functionality
- Availability via the Stitch Connect API
- Enhanced schema validation
Get started today by creating a new AdRoll integration or learn more in the updated documentation.
Intercom integration: New version (v1)
A new version (v1) of our Intercom integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from Intercom to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Use of Intercom API version 2.0
- Updated OAuth flow for easier authentication
- New tables, including:
- contacts (formerly (
users) - contact_attributes
- company_attributes
- teams
- contacts (formerly (
- Additional field support for the conversations table, including:
conversation_ratingssla_appliedstatistics
- Enhanced extraction approaches for the
contactsandcompaniestables - User-facing Extraction Logs
- Table and field selection
- Enhanced scheduling options
- Run and stop Extraction on demand functionality
- Availability via the Stitch Connect API
- Enhanced schema validation
Get started today by creating a new Intercom integration or learn more in the updated documentation.
Google Analytics (v1) integrations: Use accountSummaries: list to fetch profiles
Google Analytics integrations will now use accountSummaries to fetch Google Analytics profiles available for the user authorizing the integration. We’ve made this change to reduce the number of queries Stitch makes to Google Analytics and overall API quota usage.
Salesforce (v1) integrations: Remove NetworkUserHistoryRecent object
We’ve determined that the NetworkUserHistoryRecent object is incompatible with the Salesforce integration’s current method of querying, and as a result have removed it from the integration.
Refer to the tap repository for more info.
Facebook Ads (v1) API upgrade to v8.0
The Facebook Ads integration now replicates data using version 8.0 of the Facebook Marketing API. For more details, view the Facebook API changelog.
New integrations in open beta
Stitch is pleased to announce the release of several new integrations into open beta:
In addition to providing more tables, these integrations now include table and column selection, Extraction Logs, Loading Reports and full Connect API compatibility!
Salesforce (v1) integrations: Remove DataType object
We’ve determined that the DataType object is incompatible with the Salesforce integration’s current method of querying, and as a result have removed it from the integration.
Refer to the tap repository for more info.
Google Analytics (v1) integrations: Non-retryable error messages now in Extraction Logs
Error messages from HTTP 4xx codes that aren’t retryable will now include details from Google Analytics detailing what the issue is. Previously, these messages weren’t included in Extraction Logs, leading to confusion about the issue causing the error.
Google Analytics (v1) update: Remove searchKeyword as default Behavior Overview field
As searchKeyword isn’t data that Google Analytics collects by default, we’ve removed it from the default fields selected for replication for the Behavior Overview report. This field will still be available in Stitch, just not selected by default.
Pardot integration: New version (v1)
A new version (v1) of our Pardot integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from Pardot to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Removal of `` prefixes from table names
- New tables, including:
- User-facing Extraction Logs
- Table and field selection
- Enhanced scheduling options
- Run and stop Extraction on demand functionality
- Availability via the Stitch Connect API
- Enhanced schema validation
Get started today by creating a new Pardot integration or learn more in the updated documentation.
Google Analytics (v1) update: Pre-made reports now available
We’ve added a handful of pre-made reports to our our Google Analytics (v1) integration:
- Audience Overview: Audience metrics including page views, users, bounce rate and more
- Audience Geo Location: A breakdown of your audience by geographical location
- Audience Technology: The browsers, operating systems, and devices your users employ
- Acquisitions Overview: The performance of your users across traffic sources and mediums
- Behavior Overview: Pages visited and actions performed on your website
- Ecommerce Overview: A breakdown of your transactions by traffic source
These reports will display as tables available for selection in the Tables to Replicate tab of all Google Analytics (v1) integrations. Check out this easy way to get started with Google Analytics data!
GitHub (v1) update: Team memberships and new fields now available!
We’ve made some updates to our GitHub (v1) integration, including some a new table and additional fields!
Here’s a look at the changes:
team_memberships: New table! Includes membership data for team members in repositories specified for the integration.project_cards: New fields:_sdc_repository,cards_url,nameissue_milestones,project_columns,team_members: Added the_sdc_repositoryfieldprojects,pull_request_reviews,teams: Minor data formatting changes
Salesforce (v1) integrations: Improved PK chunking error messages
Error messages resulting from PK (Primary Key) chunking in Salesforce integrations have been extended. Previously, only timeout issues were covered by the integration. This improvement adds logic that covers additional situations, such as failure to write query results.
Salesforce (v1) integrations: Location data types unsupported for Bulk API
We’ve determined that the locations fields aren’t supported by the Salesforce Bulk API. If selected, the following erorr will surface during Extraction:
[FIELD_NAME] cannot query compound address fields or geolocations with bulk API
Refer to the tap repository for more info.
New version (v1) of Google Analytics integration in open beta!
A new version (v1) of our Google Analytics integration is now in open beta!
We’ve worked hard to ensure this new integration is the best way to extract data from Google Analytics to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Support for creating multiple custom reports
- Custom metric and dimension support
- User-facing Extraction Logs
- Enhanced scheduling options
- Run and stop Extraction on demand functionality
- Availability via the Stitch Connect API
Get started today by creating a new Google Analytics integration or learn more in the updated documentation.
Databricks Delta Lake destination in open beta
A new destination is now in open beta, available to all customers: Databricks Delta Lake (AWS).
Developed by Databricks, Delta Lake is an open-source storage layer that leverages the “lakehouse” paradigm. This allows you to implement similar data structures and data management features to those of a data warehouse, directly on the kind of low cost storage used for data lakes.
Check out the docs for more information.
Facebook Ads (v1) API upgrade to v6.0
The Facebook Ads integration now replicates data using version 6.0 of the Facebook Marketing API. For more details, view the Facebook API changelog.
PostgreSQL (v1) integrations: Correctly display BYTEA data as unsupported
Previously, Stitch would display columns typed as BYTEA as available for selection, despite this data type currently being unsupported for PostgreSQL (v1) integrations. With this fix, these columns will now correctly display as UNSUPPORTED in Stitch.
PostgreSQL (v15-10-2015) sunset
The v15-10-2015 version of our PostgreSQL integration has been sunset. As of today, this version of the PostgreSQL integration has been removed from Stitch and will no longer function.
Migrate to the latest version of PostgreSQL (v1) today to continue replicating data.
Facebook Ads (v1) integrations: Use Batch API for adcreative table
We’ve updated the adcreative table in the Facebook Ads (v1) integration to use Facebook’s Batch API. This change was made to prevent errors resulting from requesting too much data.
Google BigQuery destination in open beta
We’ve built a new Google BigQuery destination from the ground up to address feedback from our customers and take advantage of new features on the platform, including the ability to upsert data.
Some notable improvements include:
-
The ability to choose between append only and upsert loading behavior
-
Authentication using your own Google Service Account
It’s available now - check it out!
MongoDB integration: New version (v1)
A new version (v1) of our MongoDB integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from MongoDB to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- User-facing Extraction Logs
- Field selection/exclusion using Projection Queries
- Support for logical replication via OpLog and Full Table Replication
- Enhanced scheduling options
- Run and stop Extraction on demand functionality
- Availability via the Stitch Connect API
Get started today by creating a new MongoDB integration or learn more in the updated documentation.
Facebook Ads (v1) API upgrade to v4.0
The Facebook Ads integration now replicates data using version 4.0 of the Facebook Marketing API. For more details, view the Facebook API changelog.
New integration: Deputy
Deputy is a cloud-based workforce management and scheduling platform designed to help companies organize, track, and manage their teams. Our new Deputy integration enables you to extract all of your Deputy resources from a Deputy account.
Get started by creating a new Deputy integration or learning more in our documentation.
JIRA (v1) improvement: Added support for inactive users
The JIRA integration can now replicate inactive users into the users table.
To determine the status of a user, use the active field. For example: The following query will only return active users:
SELECT *
FROM jira.users
WHERE active = TRUE
MySQL (v1) integrations: Fix composite Primary Key sorting for Full Table Replication
Previously, the method used to bookmark Stitch’s place while replicating tables with composite Primary Keys resulted in some records being skipped. We’ve updated the query the integration uses to properly account for composite keys, ensuring replication will resume in the correct place.
Opt out of error notification emails
You can now opt out of system notification emails, freeing up inbox space and keeping your team on track. We’ll still let you know in-app if we run into any issues replicating data and via email for any billing information.
Check out the docs for more info.
PostgreSQL (v15-10-2015) deprecation
The v15-10-2015 version of our PostgreSQL integration has been deprecated. As of today, this version of the PostgreSQL integration is no longer formally supported.
While connections using v15-10-2015 will continue to run, this version will be sunset in the future. Migrate to the latest version of PostgreSQL (v1) today to prevent possible disruptions.
Salesforce (v1) integrations: Remove SiteDetail object
We’ve determined that the SiteDetail object is incompatible with the Salesforce integration’s current method of querying, and as a result have removed it from the integration.
Refer to the tap repository for more info.
Salesforce (v1) integrations: Convert integer zero values to prevent schema violations
Salesforce’s API occasionally returns integer fields with a value of 0.0, resulting in schema violation errors during Extraction. To prevent this error, the integration now converts 0.0 to 0 if the field can be an integer.
Recurly integration: New version (v1)
A new version (v1) of our Recurly integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from Recurly to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Removal of
_prefixes from table names - New tables, including:
- User-facing Extraction Logs
- Table and field selection
- Enhanced scheduling options
- Run and stop Extraction on demand functionality
- Availability via the Stitch Connect API
- Enhanced schema validation
Get started today by creating a new Recurly integration or learn more in the updated documentation.
Facebook Ads (v1) integrations: New ads_insights data
We’ve added a new table to our Facebook Ads (v1) integration: ads_insights_dma
This table contains entries for each campaign/set/ad combination for each day, along with detailed statistics, segmented by DMA (Designated Market Area).
Learn more in our documentation.
API access and management features for Enterprise
Take programmatic control over your Stitch account using the [Connect API](https://www.stitchdata.com/docs/developers/stitch-connect/api Now, you can manage your API keys right in your Stitch account.
This feature is available for our Enterprise customers or you can try it out during a 14-day free trial. Check out the docs.
New integration: Help Scout
Help Scout offers a help desk invisible to customers, that helps companies deliver outstanding customer support. Our new Stitch Help Scout integration enables you to extract conversations, threads, customers, mailboxes, users, and more from a Help Scout account.
Get started by creating a new Help Scout integration or learning more in our documentation.
New integration: MailChimp
MailChimp is a marketing automation platform and an email marketing service. Our new MailChimp integration enables you to extract automations, campaigns, lists, members, email activities, and more from a MailChimp account.
Get started by creating a new MailChimp integration or learning more in our documentation.
Post-load web hooks released for Enterprise customers
Want to be notified when data is loaded into your Stitch destination? With our new notification feature, you can!
Post-load webhooks send a webhook to a configurable address each time data is loaded into your destination. This new feature enables you to prompt other systems and processes to act on the data loaded by Stitch.
It’s available for our Enterprise customers, and you can try it out during a 14-day free trial. Learn more in our docs.
Salesforce (v1) integrations: Remove Announcement object
We’ve determined that the Announcement object is incompatible with the Salesforce integration’s current method of querying, and as a result have removed it from the integration.
Refer to the tap repository for more info.
Microsoft SQL Server integration: New version (v1)
A new version (v1) of our Microsoft SQL Server integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from Microsoft SQL Server databases to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Logical Replication support via SQL Server Change Tracking
- User-facing Extraction Logs
- Enhanced scheduling options
- Run and stop Extraction on demand functionality
- Availability via the Stitch Connect API
Get started today by creating a new Microsoft SQL Server integration or learn more in the updated documentation.
New integration: LivePerson
LivePerson provides tools for online messaging, marketing, and analytics. The new Stitch LivePerson integration enables you to extract agent activity, groups, statuses, enagements, messages, users, and more from a LivePerson account.
Get started by creating a new LivePerson integration or learning more in our documentation.
New integration: Asana
Asana is a web and mobile application designed to help teams organize, track, and manage their work. The Stitch Asana integration will ETL Asana data to your destination, giving you access to raw project data, without the headache of writing and maintaining ETL scripts. Our new Stitch Asana integration enables you to extract projects, tags, tasks, users, workspaces from an Asana account.
Get started by creating a new Asana integration or learning more in our documentation.
New integration: Intacct
Intacct is an accounting and financial management software for the digital era. Our new Intacct integration enables you to extract core objects via the Intacct Data Delivery Service.
Get started by creating a new Intacct integration or learning more in our documentation.
Notification extensions for Enterprise
Enterprise clients can now save time by integrating Stitch monitoring and notification with the system they use to monitor the rest of their infrastructure. For example:
- Integrate with external monitoring systems like PagerDuty or Datadog
- Post updates to Slack
- Trigger other apps using Zapier
Learn more about notification extensibility here.
Advanced (cron) scheduling for Enterprise
Enterprise users can now specify granular start times for extraction jobs via cron scheduling. You can use this new feature to manage destination usage and Stitch row volumes.
This feature is available for our Enterprise customers and you can try it out during a 14-day free trial. Learn more about cron scheduling by reading the documentation.
Facebook Ads (v1) API upgrade to v3.3
The Facebook Ads integration now replicates data using version 3.3 of the Facebook Marketing API.
NetSuite integration: New version (v1)
A new version (v1) of our NetSuite integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from NetSuite to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Removal of
netsuite_prefixes from table names - token based authentication
- Optimizations to API concurrency during discovery of tables/fields
- Utilization of an updated WSDL for a more complete set of tables/fields
- Field selection
Get started today by creating a new NetSuite integration or learn more in the updated documentation.
Start and Stop Extractions on demand
We’ve renamed the Extraction Logs page to simply Extractions.
We’ve also added new buttons to Run Extraction Now and Stop Extraction for those times when you need a little more control over when Stitch extracts data from your data sources.
Facebook Ads (v1) integrations: Workaround relevance_score deprecation
Due to Facebook prematurely deprecating relevance_score in their API, we’ve added logging to notify you should this field cause an error during replication:
Due to a bug with Facebook prematurely deprecating 'relevance_score' that is not affecting all tap-facebook users in the same way, you need to deselect `relevance_score` from your Insights export. For further information, please see this Facebook bug report thread: https://developers.facebook.com/support/bugs/2489592517771422
Should you encounter this error in Stitch, de-select the relevance_score field from any ads_insights_* tables you have set to replicate.
JIRA integration: New version (v1)
A new version (v1) of our JIRA integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from JIRA to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Removal of
jira_prefixes from table names - New tables, including:
- issues, changelog, and transitions are now top-level tables
- roles (formerly
jira_project_roles) - worklogs
- JIRA Cloud accounts now use an API token instead of user/password authentication
- User-facing Extraction Logs
- Table and field selection
- Run and stop Extraction on demand functionality
- Enhanced schema validation
Get started today by creating a new JIRA integration or learn more in the updated documentation.
MySQL (v1) integrations: Allow non-auto-incrementing Primary Keys for Full Table
Interruptible Full Table Replication now supports non-auto-incrementing Primary Keys!
Previously, this integration would only resume Full Table Replication if a table’s Primary Keys were auto-incrementing.
We’ve updated this feature to allow tables with non-auto-incrementing Primary Keys to be resumable if interrupted. Tables must have Primary Keys with one of the following data types to be interruptible if Full Table Replication is used:
BIGINTDATEDATETIMECHARINTMEDIUMINTSMALLINTTIMETIMESTAMPTINYINTVARCHAR
Salesforce (v1) integrations: Remove *ChangeEvent tables
We’ve determined that *ChangeEvent tables aren’t queryable via the Salesforce REST or Bulk APIs, and have removed them from the integration. Refer to the tap repository for more info.
Amazon Redshift (v2) destination transaction optimization
We have split DDL statements like ALTER table commands into their own transaction in Amazon Redshift destinations to minimize the length of time that tables are locked.
Microsoft Azure SQL Data Warehouse destination leaving open beta
Our Microsoft Azure Synapse Analytics destination has left open beta and is now generally available! Check out the press release or the docs for more info.
New integration: Responsys
Responsys enables marketing teams to manage and orchestrate all interactions with their customers across email, mobile, social, display, and the web. Stitch’s new Responsys integration extracts event data feeds, lists, audiences, and more from your configured Responsys Connect exports.
Get started by creating a new Responsys integration or learning more in our documentation.
New integration: Typeform
Typeform can help you build conversational forms, surveys, quizzes, landing pages, and more. The new Stitch Typeform integration extracts questions, landings and answers for the forms you care about the most. Choose the granularity you need by selecting between an hourly or daily breakdown of your data.
Get started by creating a new Typeform integration or learning more in our documentation.
New integration: Front
Front lets you manage all of your communication channels — email, social media, chat, SMS — in one place, and helps your team collaborate around every message. With the new Stitch integration, you can extract team member statistics related to conversations, messages, reaction times and more. Choose the granularity you need by selecting between an hourly or daily breakdown of your data.
Get started by creating a new Front integration or learning more in our documentation.
Stripe integration: New version (v1)
A new version (v) of our Stripe integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from Stripe to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Removal of
stripe_prefixes from table names - New and improved tables, including:
- invoice_line_items
- subscription_items
- subscription_line_items
- The
transfer_transactionstable has been replaced by payouts
- User-facing Extraction Logs
- Table and field selection
- Availability via the Stitch Connect API
Get started today by creating a new Stripe integration or learn more in the updated documentation.
Shopify integration: New version (v1)
A new version (v1) of our Shopify integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from Shopify to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- A few table changes and improvements:
- The collects and order_refunds tables now use Key-based Incremental Replication
- We’ve renamed
checkoutsto abandoned_checkouts to clarify the table’s available data - Product and customer metadata is now available! Track the products, customers, and metafields tables to replicate this data
- Optimized methods for retrieving Shopify data
- Optimized use of Shopify API quota for extraction
- User-facing Extraction Logs
- Table and field selection
- Availability via the Stitch Connect API
Get started today by creating a new Shopify integration or learn more in the updated documentation.
Google BigQuery (v1) destinations: Additional region support
Google BigQuery has begun adding additional region support (beyond the US and EU) for their users, and we’ve just made these new regions available in Stitch for Google BigQuery (1) destinations. Stitch customers can now use Stitch with Google BigQuery instances in Tokyo, London, Singapore and Sydney.
Salesforce (v1) integrations: Correct date chunking for Bulk API replication
For Salesforce integrations using the Bulk API, when a query to the API times out, Stitch would cut the requested date range in half and re-try the request. However, after replicating the records, the integration wouldn’t attempt to replicate the second half of the original window, resulting in missed records.
Because the integration only updates Replication Keys when records are extracted, Replication Keys wouldn’t advance if records weren’t received in the first half of the date range. This meant that the integration wouldn’t ever try to replicate records in the second half of the date range.
This fix adds a check to see if the date range was chunked, and if so, queries the second half of the chunked range and extracts records, if any exist.
Google BigQuery (v1) destinations: Partitioned table support
Stitch now supports loading to Google BigQuery partitioned tables and ingestion-time partitioned tables with and without clustering. We’ve added instructions to our docs for converting existing tables into partitioned and clustered tables.
Microsoft Azure SQL Data Warehouse (v1) destination now in open beta!
If you’ve been waiting to get Stitch hooked up to Microsoft Azure Synapse Analytics, good news! As of today, this destination is available for any customer to use. Learn more in the new docs.
Google BigQuery (v1) destinations: NUMERIC data type support
We’ve added support for the NUMERIC data type in Google BigQuery destinations. Numeric data will be loaded into NUMERIC columns going forward, rather than columns with the floating point data type.
Facebook Ads (v1) integrations: API upgrade to v3.2
We have updated the Facebook Ads integration to use the latest version of the Facebook Marketing API - version 3.2.
As part of this update, Facebook has deprecated many values for cost_per_action_type to simplify reporting and support reporting based on their new eight standard events. Additionally, the total_action_value field has been deprecated and removed from all ads_insights tables.
Pipedrive (v1) integration: Removed goals table
As per an update to the Pipedrive API, the goals table has been removed from the Stitch integration. See more about the available Pipedrive data in our documentation.
Salesforce (v1) integrations: BackgroundOperationResult is now Full Table
We’ve determined that the BackgroundOperationResult object doesn’t support ordering by CreatedDate, meaning that Stitch can’t reliably replicate this data incrementally. This table now has a forced Replication Method of Full Table.
MySQL (v1) integrations: Interruptible Full Table replication
Fullly replicating a table is now “interruptible,” meaning that, if the table uses auto-incrementing Primary Keys, replication for the table can span multiple replication jobs.
Previously, a table using Full Table had to be fully replicated in a single job. If the job was interrupted for any reason, Stitch would replicate the table from the beginning during the next job.
Now, if a replication job is interrupted for a MySQL (v1) integration, tables using Full Table Replication that have auto-incrementing Primary Keys will resume replication from the last replicated record instead of re-replicating the entire table.
Bing Ads integration: New version (v2)
A new version (v2) of our Bing Ads integration is now available! This version takes advantage of the latest Bing Ads API, version 12.
Here’s a high-level look at the updates to our integration:
-
Support for multi-user credentials: The new integration allow for extracting data where you use one Microsoft account and manage accounts across different customers.
-
Column restrictions: Bing now prevents the extraction of reports with invalid field combinations. Stitch will automatically show these exclusions within the field selection interface when setting up your reports. Refer to Bing’s documentation for a full list of column restrictions.
-
Schema updates: The following changes have been made to table schemas:
New integration: Campaign Monitor
Stitch’s new Campaign Monitor integration will extract your lists, campaigns, and campaign activity to power all of your email marketing analyses. Create a Campaign Monitor integration today and load your historical data for free.
Get started by creating a new Campaign Monitor integration or learning more in our documentation.
New integration: Harvest Forecast
Harvest Forecast is a fast and simple way to schedule your team across projects. With Stitch’s new integration, you can extract core object such as assignments, clients, milestones, projects and people to your Stitch destination. Combine your project data with your other sources by adding a new integration today. Learn more in our documentation.
New integration: Close.io
A new Close.io integration is now available! This integration replicates your activities, leads, tasks, users and the raw event log from your Close.io account. Create a Close.io integration today and empower your sales team to make better data driven decisions. Learn more in our documentation.
Harvest integration: New version (v2)
A new version (v2) of our Harvest integration is now available!
Changes in this version include:
- Upgrading to V2 of the Harvest API
- Many new tables
- Schema modifications to align with the Harvest API
- The
peopletable was renamed tousers, as per new Harvest API endpoints
Full details can be found on the pull request against the open sourced integration here. Stitch docs for the version 2 of the Harvest integration can be found here.
Salesforce (v1) integrations: Fix for OpportunityFieldHistory parent
Previously, OpportunityFieldHistory exports failed due to a function in the Salesforce integration incorrectly returning OpportunityField as the parent. This fix adds a check for the FieldHistory suffix, ensuring that the parent is correctly returned as Opportunity.
New integration: Amplitude
A new Amplitude integration is now available! This integration extracts event and user data from your Amplitude projects. Amplitude is an analytics service for modern product teams to understand user behavior, ship the right features fast, and drive business outcomes. Our integration enables you to extract raw data from the Amplitude Query product and combine it with all the data in your Stitch destination.
Get started by creating a new Amplitude integration or learning more in our documentation.
PostgreSQL (v1) integrations: Include schema name in destination table names
We’ve added a new setting to PostgreSQL (v1) integrations:
When checked, Stitch will include schema names from the source database in the destination table name when the table is created. For example: <source_schema_name>__<table_name>
Stitch loads all selected replicated tables to a single schema, preserving only the table name. If two tables canonicalize to the same name - even if they’re in different source databases or schemas - name collision errors can arise. Checking this setting can prevent these issues.
Note: This setting can not be changed after the integration is saved. Additionally, this setting may create table names that exceed your destination’s limits.
New integration: Xero
A new Xero integration is now available! With the new integration, Stitch will replicate your core Xero objects including bank transactions, contacts, invoices, journal entries, payments, and more to your Stitch destination.
Get started by creating a new Xero integration or learning more in our documentation.
PostgreSQL (v1) integrations: Expanded replication slot support
Stitch now supports Log-based Incremental Replication across multiple databases in a single PostgreSQL cluster. Previously, Stitch supported one replication slot per integration and required it to be named stitch. Now, Stitch will look for the replication slot you define before falling back to stitch.
New integration: Google (DoubleClick) Campaign Manager
Stitch has a new integration with Google Campaign Manager (formerly DoubleClick Campaign Manager). After you select Campaign Manager reports, Stitch will run them and replicate the results to your Stitch destination.
Get started by creating a new Campaign Manager integration or learning more in our documentation.
New integration: Yotpo
A new Yotpo integration is now available! Yotpo generates social reviews, ratings, and other user-generated content for eCommerce websites.
Get started by creating a new Yotpo integration or learning more in our documentation.
Google AdWords (v1) integrations: API upgrade to v201806
The Google AdWords integration has been updated to use v201806 of the AdWords API, from v201802.
Notable changes include:
-
Ad Groups: The
AdGroupTypeenum valueSHOPPING_UNIVERSAL_ADSwas renamed toSHOPPING_GOAL_OPTIMIZED_ADS. -
Ad Group Performance Report: The
AdGroupTypefield will now return a value of“Shopping - Goal-optimized”where it previously returned“Shopping - Universal”, and the corresponding enum value changed fromSHOPPING_UNIVERSAL_ADStoSHOPPING_GOAL_OPTIMIZED_ADS.
New integration: Amazon S3 CSV
A new Amazon S3 CSV integration is now available!
This integration can connect to your S3 bucket and replicate CSV files to your Stitch destination. Some highlights of this new integration include:
- Replication of data from CSV files stored in your S3 buckets
- Support for incremental updates based on new or modified CSV files
- Column selection for choosing which columns you want to extract from your CSV files
- Automatic inference of data types and the ability to explicitly specify datetime fields
Get started by creating a new Amazon S3 CSV integration or learning more in our documentation.
Zendesk integration: New version (v1)
A new version (v1) of our Zendesk Support integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from Zendesk Support to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- User-facing Extraction Logs
- Table and field selection
- Run and stop Extraction on demand functionality
- Availability via the Stitch Connect API
- Enhanced schema validation
Get started today by creating a new Zendesk Support integration or learn more in the updated documentation.
PostgreSQL integration: New version (v1)
A new version (v1) of our PostgreSQL integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from PostgreSQL to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Logical replication support, which allows you to replicate data from database binary logs, including hard deletes, without the use of a Replication Key
- User-facing Extraction Logs
- Table and field selection
- Enhanced scheduling options
- Run and stop Extraction on demand functionality
- Availability via the Stitch Connect API
- Enhanced schema validation
Get started today by creating a new PostgreSQL integration or learn more in the updated documentation.
Facebook Ads (v1) integrations: Field deprecation
Facebook has deprecated the following fields, meaning they are no longer available for selection or retrieval via Facebook’s API:
call_to_action_clickscost_per_total_actionsocial_reachsocial_impressionssocial_clicksunique_social_clickstoday_spendtotal_actionstotal_unique_actions
In addition, several types of metrics have been deprecated. Note: The fields are still available, but the types listed below are not:
actionsfield:mention,tab_viewaction_valuesfield:app_custom_eventcost_per_action_typefield:mention,tab_viewcanvas_avg_view_percentage_per_componentfield:canvas_view
Salesforce (v1) integrations: Add suffix to parent tables ending in __
Previously, Salesforce integrations attempted to perform PK (Primary Key) chunking for custom tables using an incorrect parent table name. This fix now appends c to parent tables ending in __, ensuring chunking is performed correctly.
New community integrations available
Thanks to the contributions of the Singer community, Stitch has five new integrations available for all customers to use:
-
Bronto (v1): An email marketing platform for ecommerce
-
FullStory (v1): A tool that offers high-fidelity session playback
-
Listrak (v1): A marketing platform for engaging shoppers across all channels
-
Quick Base (v1): A platform for developers to build, customize and connect scalable, secure cloud applications
-
SendGrid Core (v1): A platform for delivering transactional and marketing emails
All of these integrations are built on the Singer open source project and take advantage of Stitch’s secure and scalable infrastructure.
Get started by adding a new integration today or learning more in our documentation.
Marketo integration: New version (v2)
A new version (v2) of our Marketo integration is now available! Major changes include:
- Activity selection – Each Marketo activity type is now its own table, allowing you to replicate just the ones you care about the most.
- Replication of campaigns and programs – These objects are now available for replication to your destination.
- Column selection – Just as with tables, we’ll only replicate the columns that you want.
- Improved efficiency – The integration now uses Marketo Bulk API, which allows us to more efficiently replicate large amounts of data. Review our documentation for more details.
Learn more about the integration and these features in our Marketo integration documentation.
Amazon S3 (v1) destination leaving open beta
Our Amazon S3 destination has left open beta and is now generally available! Check it out today to get your source data delivered to your S3 bucket in either JSON or CSV. Check out the docs for more info.
New integration: GitHub
A new GitHub integration is now available!
This integration lets you extract data from any GitHub repository. You can choose from the following tables to replicate to your destination:
assigneescollaboratorscommitsissuespull_requestsreviewsstargazers
Create a new integration today with seven days of free historical data. Learn more in our documentation.
Zuora integration: New version (v1)
A new version (v1) of our Zuora integration is now available!
We’ve worked hard to ensure this new integration is the best way to extract data from Zuora to your Stitch destination. The new integration, based on the Singer standard, includes many new features such as:
- Removal of
zuora_prefixes from table names - Expanded table and field availability
- Choice of Zuora API, allowing you to choose the API that best fits your needs
- Replication of deleted records when using the AQuA API
- Table and field selection
- Enhanced schema validation
Get started today by creating a new Zuora integration or learn more in the updated documentation.
HubSpot integration: New version (v2)
A new version (v2) of our HubSpot integration is now available! Major changes include:
- Column-level selection
- More comprehensive data typing on custom properties
- Inclusion of all form submissions for
contacts– Older versions only replicated the newest form submissions. Now you can extract a complete picture of your contact form submissions. - Improved updates of the
list_membershipstable - Several schema changes:
hubspot_contacts_by_companyhas been renamed tocontacts_by_company- The
isDeletedfields have been removed from thedealsandcompaniestables. The HubSpot API does not provide accurate values for this data, so we’ve removed it to prevent confusion and potential discrepancies. - The
keywordstable has been removed. HubSpot has deprecated the keywords feature of their product and API. Note: HubSpot has deprecated their Keywords tool as of June 1. - New counters added to
campaigns, including:deferred,unsubscribed,statuschange,bounce,mta_dropped,suppressed
Learn more about the integration and these features in our HubSpot integration documentation.
MySQL (v1) integrations: Binlog replication support
MySQL integrations can now use binlog replication to perform incremental replication in Stitch!
If you have binary logging enabled for your MySQL database, Stitch can now use it to help replicate your data. Log-based Incremental Replication allows for incremental replication of a table without a Replication Key and will capture and persist hard deletes.
This feature is now available as a Replication Method on the Table Settings of MySQL integrations. Check out the docs for more info.
Free historical data loads for all new integrations
All new integrations will replicate seven days of unlimited data without impacting your monthly quota. Get started by creating a new integration or learn more on our blog.
Time-based replication scheduling is now available!
Stitch customers now have some control over when extractions begin. This new feature allows users to “anchor” extraction start times to a specific time, ensuring Stitch is predictably replicating data when it’s most needed.
For example: Setting a six (6) hour replication with an anchor time of 12:00 PM would create this schedule:
- 12:00PM
- 06:00PM
- 12:00AM
- 06:00AM
Check out the docs for full details.
Amazon S3 (v1) destination now in open beta
Amazon S3 is now available in open beta as a Stitch destination. Highlights include support for both JSON and CSV formats and the ability to customize the S3 Object Keys to control how your data is stored.
Check out the docs for more info.
New integration: Bing Ads
A new Bing Ads integration is now available!
Stitch’s Bing Ads integration lets you replicate data from Microsoft’s search advertising platform to the Stitch destination of your choice.
A few highlights from the integration include:
- Replication from eight of the most popular Bing Ads reports
- Configurable fields in each of your selected reports
- Connection to multiple ads accounts in each Stitch integration
- [Append-Only loading behavior](https://www.stitchdata.com/docs/replication/loading/understanding-loading-behavior, enabling you to see report changes over time
- A new
_sdc_report_datefield, allowing you to see when data was retrieved from Bing Ads
Get started by creating a new Bing Ads integration or learning more in our documentation.
Facebook Ads (v1) integrations: API upgrade to v2.11
We’ve updated our Facebook Ads integration to use the newest version of the Facebook Marketing API - version 2.11.
In addition, we’ve made the following improvements:
-
Configurable attribution window when creating or editing a Facebook Ads integration. Choose between
1,7or28days so that Stitch replicates historical data in alignment with the attribution window of your Facebook Ads account. -
A new table named
ads_insights_region. View your data by the region (such as state or province) where people live or were located when they saw your ads, depending on how you set your location targeting. -
Removed the
video_15_sec_watched_actionsattribute from relevant tables. Facebook deprecated this attribute in the 2.11 version of their API.
New destination: data.world
A new data.world destination is now available!
data.world helps you host and share your data, collaborate with your team, and capture context and conclusions as you work. We’ve partnered with them to allow you to replicate all your sources into your data.world account.
Check out the docs for more info.
Introducing Stitch Connect
We’ve just released Stitch Connect, a toolkit that enables developers to integrate a data pipeline with their own platforms behind the scenes as a seamless part of their infrastructure.
Stitch Connect comprises a JavaScript user interface and an API that lets developers programmatically create and access Stitch client accounts and configure source and destination connections.
Interested in seeing how it could work with your application? Check out the docs or get in touch.
Google AdWords (v1) integrations: API upgrade to v2.11
We’ve updated our Google AdWords integration to use the newest Adwords API - version v201802.
Additionally, we’ve made the following chanegs:
-
In the
adstable, thepolicyTopicEvidencesobject in thepolicySummary.policyTopicEntriesfield contains anevidenceTextfield. This field (evidenceText) has been renamed toevidenceTextListand is now a list. -
In the
ad_performance_reporttable, theImageAdUrlfield now returns the entire URL string -
In various reports:
- The
BidTypefield has been removed - The
EnhancedCpvEnabledfield has been removed from all reports. This field was used for experiments that are no longer active.
- The
See the AdWords API release notes for additional details.
Loading Reports are now available!
Loading Reports are now available!
A few months ago, we launched access to Extraction Logs for select integrations. Today, we’re releasing additional transparency for replication, this time on the loading end of things.
All Stitch users can now see:
- A breakdown of row counts by tables (and subtables) for each integration
- A timeline of loads for each table
- Select integrations (MySQL, Facebook, Salesforce and HubSpot to name a few) have latest data point and extraction time info per table
Check out the docs for more info.
Facebook Ads (v1) integrations: Include deleted ads, adsets, and campaigns
We’ve added a new setting for Facebook Ads (v1) integrations that enables you to replicate records for deleted ads, adsets, and campaigns:
When checked, Stitch will query for and extract data for deleted ads, adsets, and campaigns from your Facebook Ads account. Relevant records will be included in the ads, adcreatives, adsets, and campaigns tables, if selected for replication.
Learn more in our Facebook Ads integration documentation.
MySQL (v15-10-2015) deprecation
The v version of our MySQL integration has been deprecated. As of today, this version of the MySQL integration is no longer formally supported.
While connections using v will continue to run, this version will be sunset in the future. Migrate to the latest version of MySQL (v1) today to prevent possible disruptions.
Facebook Ads (v1) integrations: use_page_actor_override field deprecation
Due to issues with querying and a bug in Facebook’s API, we’re removing support for the adcreative.use_page_actor_override column. As a result, this column will no longer display in Stitch as available for replication.
Facebook Ads (v15-10-2015) integration: API upgrade to v2.9
We’ve updated the integration to use a new version of the Facebook API. This update also provides access to a new table (facebook_ads_insights_platform_and_device), which contains fields allowing you to compare insights between platforms such as Facebok, Instagram, and Messenger, and positions such as feeds, instant articles, and stories.
Introducing Stitch Community integrations
Introducing: Stitch Community integrations!
Just like other Singer taps, these integrations are able to be run in Stitch. Thanks to the success of the inger open source project and the contributions from the Singer community, we’re able to run these integrations on the Stitch infrastructure while being supported by the community rather than the Stitch team.
Like Stitch Certified integrations (built and maintained by the Stitch team), Stitch Community integrations offer a number of benefits:
- Running at scale on a reliable infrastructure
- Secure credential management
- Setup and configuration via the Stitch interface
- Configurable scheduling
- Automated notifications when something goes wrong
- Log exploration interface
- Access to all of the Stitch-supported destinations
The key difference is that Stitch provides commercial support for Certified integrations, but not for Community integrations. Commercial support is a guarantee that the Stitch team will fix bugs and adapt to new versions of third-party APIs.
For a full list of Stitch integrations - including both Certified and Community - refer to the docs.
Salesforce (v1): Primary Key (PK) chunking
We’ve implemented Salesforce’s Primary Key (PK) chunking feature into our integration.
If the integration is using the Bulk API and encounters a timeout error, Stitch will now re-try using the Sforce-Enable-PKChunking header in the API request. This approach ‘chunks’ data into small batches, allowing the integration to more efficiently extract large volumes of data.
Google AdWords integration: New version (v1)
A new version (v1) of our Google AdWords integration is now available!
A few highlights include:
- Utilizing the AdWords API to replicate the most popular Google AdWords reports to Stitch
- Configurable fields in each of your selected Google AdWords reports
- Connect multiple individual or MCC AdWords accounts in each Stitch integration
- Using a 30-day conversion/lookback window to update data over the past 30 days
- Loading report data using Append-Only loading with an
_sdc_report_datefield so that users know when data was retrieved from the AdWords API
Learn more about the new version in our documentation.
Salesforce integration: New version (v1)
A new version (v1) of our Salesforce integration is now available! Major changes include:
- Choose between Salesforce Bulk or REST API
- Configure how much of your Salesforce API quota Stitch can use
- Connect to Salesforce Sandbox accounts
- Choose whether Stitch automatically replicates new fields
- Reset the Replication Key for individual Salesforce tables in Stitch
- Toggle between Incremental or ull Table Replication for tables
- Access the latest objects and fields from the newest version of the Salesforce API
- Removed
sf_prefix for tables for all newly created integrations
Learn more about the integration and these features in our Salesforce integration documentation.
Extraction logs now available!
Detailed Extraction Logs are now available for select integrations in Stitch. This new feature presents detailed information about the extraction process in these integrations, and lets you:
- Inspect, copy, and download extraction log files up to 50MB in size
- View historical logs over the past seven days
- Visualize how often extraction runs, how long it takes, and when it errors
- View logs for extraction jobs currently in progress
This feature is available for the following integrations:
-
Salesforce (v1): (v1 only)
We’ll be working over the coming weeks to bring these logs to the rest of our integrations. Check out the docs for more info on this new feature.
Facebook Ads (v1) integrations: Ads, AdSets, and Campaigns now replicate incrementally!
Big news: The following Facebook Ads integration tables, which previously replicated in full, now use Key-based Incremental Replication:
adsadsetscampaigns
These tables use updated_time as Replication Keys, ensuring you’re only replicating records that have been updated. You can learn more about these tables in our Facebook Ads integration documentation.
Facebook Ads (v1) integrations: AdLabel data is now available!
We’ve added the adlabels fields to the adsets and campaigns tables for our Facebook Ads (v1) integration.
Learn more in our documentation.
New version (v1) of MySQL integration
A new version (v1) of our MySQL integration is now available!
Learn more about the integration and these features in our MySQL integration documentation.
Google BigQuery (v1) destination leaving open beta
Our Google BigQuery destination has left open beta and is now generally available! Check out the the docs for more info.
Facebook Ads integration: New version (v1)
A new (open-sourced!) version (v1) of our Facebook Ads integration is now available! This version, built from the ground up, supports field selection for increased control over what data you replicate through Stitch.
Learn more about the integration in our Facebook Ads integration documentation.
New integration: Autopilot
A new Autopilot integration is now available! Make your customer journeys take flight with data from Autopilot - now generally available as a Stitch source.
Get started by creating a new Autopilot integration or learning more in our documentation.
HubSpot integration: New version (v1)
A new (open-sourced!) version (v1) of our HubSpot integration is now available!
Major improvements include:
- Table selection
- Improved data typing
- Improved Primary Keys
- New tables:
hubspot_contacts_by_companyengagements
Open sourcing our integrations means more transparency into and flexibility around integration features. If you’d like to contribute to the HubSpot integration, you can check out the code here.
Learn more about the integration and these features in our HubSpot integration documentation.
Snowflake (v1) destination leaving open beta
Our Snowflake destination has left open beta and is now generally available! Snowflake is a SQL data warehouse built from the ground up for the cloud, designed with a patented new architecture to handle today’s and tomorrow’s data and analytics.
Check out the the docs for more info.
Replication scheduling change for non-database integrations
Non-database integrations now schedule replication by waiting the configured interval from the last time they were scheduled. This means that integrations with a daily schedule will run at the same time every day, and those with an hourly schedule will run at the same number of minutes past every hour. With the change, all integrations now use this scheduling logic.
Refer to the docs for more info and examples.
Change your destination!
Not happy with where your data is headed? Now you can do something about it!
Customers can now change destination types right in their account. Check out the docs for more info.
Snowflake (v1) destination now in closed beta!
Been waiting for Stitch to support Snowflake? Good news - Snowflake as a destination has just entered closed beta and testing has already begun! If you’re interested in getting on the list, add your email address here and we’ll let you know as we add more testers.
PostgreSQL (v1) destination leaving open beta
Our Amazon Aurora PostgreSQL destination has left open beta and is now generally available! Check out the the docs for more info.
New and improved Stitch Docs
Stitch is excited to relaunch a redesigned version of our extensive documentation, including a brand new Getting Started guide and a guide on picking the right destination for you.
Google Cloud SQL PostgreSQL Support
We’re excited to report that Stitch supports the recently announced PostgreSQL flavor of the the Google CloudSQL service. It’s available as both an input integration AND a destination - a dual threat!
Support for Singer Taps - 10 new integrations!
Stitch now has built-in support for Singer Taps, the data extraction component of the the just launched simple, composable, open source ETL Singer project. This exciting new standard will make getting data out of any source and into Stitch (or elsewhere) simpler and more straightforward.
To learn more about Singer, check out the launch blog post.
By supporting this standard, Stitch now supports these integrations:
Google Analytics (v14-09-2016) integrations: New default Replication Frequency
The default Replication Frequency for Google Analytics integrations is now 6 hours. Want to replicate your data at a faster rate? Learn more in our docs.
New integration: Branch
Are you using Branch for deep linking in your mobile app? Now you can replicate event data from your Branch account to your destination and analyze app installs and engagement.
Get started by creating a new Branch integration or learning more in our documentation.
Stitch Webhooks and 14 new integrations
Introducing: Stitch Webhooks!
Stitch Webhooks is a configurable incoming webhook integration that replicates data from hundreds of webhook APIs directly to Stitch.
Additionally, we’ve added 14 new integrations to Stitch, powered by webhooks, as great examples of what you can replicate across different types of applications:
Enhanced integration replication stats
Ever wondered where your data was after Stitch pulled it from the source but hadn’t arrived in your destination yet?
When the next replication job will start?
How many rows you’ve loaded today?
This information (and more) is now available in Stitch: Just click on any individual integration to experience this… experience. Check out the docs for more info.
Support for replicating database views
With the new year fast approaching, the Stitch engineers wanted to slip in a last update or two to the product before the ball drops. Customers can now see and replicate views for database integrations in Stitch - just pick a Primary Key and Replication Method. Enjoy!
Logging for rejected records
Occasionally, Stitch encounters data that it can’t load into a destination for a variety of reasons: Dates that fall out of range, table names that are too long, etc.
Stitch now logs these records into a special table (_sdc_rejected) for each integration. Each rejected record includes the reason for the rejection and as much data from the original record as can fit.
Learn more in the docs.
In-app notifications now available
When things go wrong, as they occasionally do, Stitch sends an email notification about this issue. Now, those notifications are available inside the Stitch interface as well. Just click on the Notifications tab at the top of the page to see your active notifications.
Google BigQuery (v1) and PostgreSQL (v1) destinations now in open beta!
If Amazon Redshift isn’t the right destination for you, then we’ve got you covered. Our Google BigQuery and PostgreSQL destinations are now in open beta - and you can set them up in Stitch today! Both are available during destination selection in the onboarding process.
To learn more about how Stitch loads data into these destinations, check out the docs for Google BigQuery and PostgreSQL destinations.
Re-using schema names from deleted integrations
Delete an integration, and still attached to the schema name that went with it? Now you can re-use schema names from deleted integrations when you set up new ones.
Reset Replication Keys for individual tables in database integrations
Hot off the heels of support for resetting the Replication Keys for an entire database integration, Stitch now offers the ability to do it on a per table basis. Head down to the Table Settings in a database integration for an individual table and you’ll see the new button.
PostgreSQL destination (v1) in closed beta
Longing to get your data into Amazon Aurora PostgreSQL instead of Amazon Redshift?
Good news, everyone!
Amazon Aurora PostgreSQL as a Stitch destination is now in closed beta! Sign up today if you are interested in the beta and we’ll add you to the waiting list. In the mean time, learn more about this destination in the docs.
LONGNVARCHAR data type support
Up until now, Stitch supported VARCHAR, NVARCHAR, and LONGVARCHAR. Today we’ve added support for the crazy uncle of the VARCHAR family, LONGNVARCHAR!
Just a note: If you have existing database integrations that have this data type, you’ll need to go in and specifically track it. Any new integrations will automatically track this data type.
New destination: Panoply.io
A new Panoply destination is now available!
Interested in Amazon Redshift but don’t want the hassle of maintaining an Amazon Web Services account? Exciting news - Stitch has partnered with Panoply to bring their managed data warehouse solution to our users - including a free tier with up to 10 million rows per month!
Get started by creating a new Panoply destination or learning more in our documentation.
Salesforce (v15-10-2015) integrations: Field selection support
Do objects in your Salesforce have a lot of fields? Do you only care about a few of them? Don’t you wish you could only track what you want?
Well, now you can! Starting today, you can select which fields to replicate from your Salesforce objects, giving you more control to keep your destination clean and simple. Learn more in the docs.
Close.io integration now in open beta
A new Close.io is now available!
The new integration will replicate all of your leads and activities to your warehouse, allowing you to analyze your sales cycle and always be closing.
Get started by creating a new Close.io integration or learning more in our documentation.
Google BigQuery (v1) destination in closed beta
Excited about Google BigQuery? We’ve got some big news for you!
Our Google BigQuery destination is now in closed beta. Sign up if you’re interested in joining the beta to start sending your data to Google BigQuery. In the mean time, learn more about this destination in the docs.
New integration bonanza!
Lots of integration related news today. Ready? Here we go:
-
Google Analytics (v14-09-2016): We’ve opened up the beta for our new Google Analytics integration. This new integration allows you to create custom datasets using Google Analytics’s metrics and dimensions.
-
Intercom (v02-02-2016): Intercom is leaving beta
-
Pardot (v15-10-2015): Pardot is leaving beta
-
Recurly (v14-09-2016): Recurly is leaving beta
-
Segment (v1): Segment is leaving beta
-
Trello (v15-12-2015): Trello is leaving beta
Get out there and start moving some data.
MongoDB (v11-01-2016) integrations: Replication Keys modification support
Ever select the wrong Replication Key for a MongoDB integration when setting up Incremental Replication? If so, you’ll know that it’s a headache to change it.
Now, you can easily change it to the correct field within the Stitch app. Note that doing so will force a full re-replication of the table, to ensure all data is replicated using the correct Replication Key.
Zendesk (v15-10-2015) integrations: New group membership table
The Zendesk Support integration now includes a zendesk_group_memberships table, which contains information about the groups your Zendesk Support agents are members of. Fields in this table include:
- Group membership ID (
id) - URL
- Name
- Deletion flag
created_atupdated_at
NetSuite (v10-15-2015) integrations: Deleted record support
The NetSuite integration now includes a table called netsuite_deleted which contains a row for every deleted record that supports deletes.
Accounting for deleted records is especially important if you’re performing any sort of aggregate function, such as totaling invoices or balancing your books.
Learn more about utilizing the NetSuite deletion log in our [docs](https://www.stitchdata.com/docs/integrations/saas/netsuite-suitetalk/v10-15-2015#using-netsuite-deleted.
Reset Replication Keys for database integrations
Need to completely re-replicate all incrementally replicated tables in a database integration? Now you can(!) via the Integration Settings page on any MySQL, PostgreSQL, Microsoft SQL Server, or MongoDB integration. Take care though - the re-replicated rows count towards your monthly caps.
Change an integration's display name
Don’t like what you named your integration? Now you can change it!
Integration names can be edited on the Settings page for each respective integration. Note: Changing an integration’s name won’t change the name of the schema in your destination.
Learn more in the docs.
Amazon Redshift destination: New version (v2)
Now 50% Redshiftier, along with these improvements:
- Faster loading for high volume data streams
- Transactional upserts
- NO MORE VIEWS! Data is materialized into tables directly in the target schema, and these tables are never dropped
Learn more in the docs.