Netlify Docs
Ask Netlify

Contact

Manage data /Connect /Manage data layers /

Manage data sources in Netlify Connect

This feature is available on Connect Enterprise plans.

Once you create and configure a data layer, you can review and modify the data layer on the settings page in the Netlify UI. This document outlines how to add, edit, and delete data sources for an existing data layer.

A data source is an external system or service that contains your data, such as a content management system (CMS). Connect includes built-in support for a number of popular data source types such as Contentful and Sanity, but you can also build support for your custom data source using the Netlify SDK.

Team Owners and Developers can add, edit, or delete data sources on a data layer. They can also specify cross-references between data sources to retrieve related data with a single query.

When you modify data source configurations on your data layer, Netlify re-syncs all data sources and updates the data layer’s GraphQL schema to reflect the change. Netlify also records the data source changes in the team audit log.

New to Connect? Set up a data layer first

If you haven’t already created a data layer, navigate to the

Connect
page for your team and select Add new data layer. Follow the prompts to configure the data layer and to add data sources, connected sites, and custom webhooks. For more information, refer to our get started with Netlify Connect guide.

# Add new data sources

To add a new data source to your data layer, first navigate to the data source section for your data layer:

  1. Navigate to the
    Connect
    page for your team in the Netlify UI.
  2. Select the data layer from the Data layers list, and then select Data layer settings.
  3. On the data layer settings page, select Data sources.

Each supported data source type has different credentials, options, and setup instructions:

After you save a data source configuration, Netlify connects to the data source and starts syncing data to your data layer. If the initial sync fails, review our troubleshooting tips for support.

# Contentful

Already using the Contentful Integration on Netlify?

Connect is separate from the Contentful Integration, and we currently do not leverage that integration to sync data. To use your Contentful instance with Connect, you need to add it here as a data source.

To use Contentful with Netlify Connect, complete the following steps:

  1. Prepare your Contentful instance.
  2. Add your Contentful instance to your data layer.
# Prepare your Contentful instance

Take the following steps on your Contentful space before you add it to your data layer:

  1. In the Contentful web app, navigate to
    Settings API keys
    , and select Add API key to create an API key and generate access tokens for the space you want to sync. Netlify will need one of these tokens to access your data.
  2. In the Contentful web app, navigate to
    Settings CMA tokens
    , and select Create personal access token to generate a Content Management API access token. Copy this token and store it in a safe place. Netlify will need this token to automatically set up a webhook in your Contentful space that will notify Connect whenever data changes in your CMS.

You’ll need to enter these tokens when you set up your Contentful data source in the Netlify UI.

# Add your Contentful instance

Once you have prepared your Contentful instance, take the following steps in the Netlify UI to add it to your data layer:

  1. Select Add a data source.

  2. Enter a Name for this data source.

  3. Select Contentful as the Data source type.

  4. (Optional) Enter a Type prefix for this data source. The prefix must start with an uppercase letter, and can only consist of alphanumeric characters and underscores.

    The prefix will be added to all data types synced from this data source in the GraphQL schema and you will use it when you query the GraphQL API. For example, ContentfulPost with the prefix Marketing becomes MarketingContentfulPost in the schema.

    Note that Type prefix becomes a required field when you add more than one Contentful instance to the same data layer.

  5. Enter the Access token for your Contentful instance. To sync published content, enter the Content Delivery API access token. To sync preview content instead, enter the Content Preview API access token.

  6. Enter the Space ID for your Contentful instance.

  7. Enter the Content Management API access token for your Contentful instance. Netlify will use this token to automatically set up a webhook in your Contentful space that will notify Connect whenever data changes in your CMS.

  8. (Optional) Select the Host URL for your Contentful instance. The default is cdn.contentful.com. To use the Contentful Preview API, select preview.contentful.com.

  9. (Optional) Enter the Contentful Environment to sync data from. The default is master.

  10. (Optional) Enter a Page limit to specify the number of entries to fetch per page when syncing data from Contentful. The default is 1000.

  11. (Optional) Select Enable Contentful Tags if your Contentful instance uses the Contentful Tags feature. Note that if you enable this option, you cannot use the content type name tags at this time.

  12. Select Save to add this data source.

When you add a new data source, Netlify automatically connects to it and starts syncing data to your data layer.

# Contentstack

To use Contentstack with Connect, complete the following steps:

  1. Enable the Contentstack data integration.
  2. Prepare your Contentstack instance.
  3. Add your Contentstack instance to your data layer.
# Enable the Contentstack data integration

To begin, enable the Contentstack data integration. This will make it available to all data layers on your team.

  1. In the Netlify UI, navigate to the
    Integrations
    tab for your team.
  2. Search for Contentstack.
  3. Select Enable.
# Prepare your Contentstack instance

Take the following steps on your Contentstack instance before you add it to your data layer:

  1. In your Contentstack account, navigate to
    Settings API Tokens
    for your stack, and generate a delivery token for the environment you want to sync. You’ll need to enter this token when you set up your Contentstack data source in the Netlify UI, and Netlify will use this token to access your data.
  2. To enable automatic syncing to Netlify, add your data layer webhook to your Contentstack instance:

    1. In your Contentstack account, navigate to

      Settings Webhooks
      for your stack, and select New Webhook.

    2. Add the following webhook to the URL To Notify field. Make sure to replace the placeholder with your data layer ID.

      https://webhook.netlify-connect.com/hooks/data_layer/data_source/publish/YOUR-DATA-LAYER-ID

    3. Under When, add a Condition for each content type and event that you wish to sync. At minimum, you should configure the webhook to trigger when the Entry type is Created, Updated, and Deleted. For more information on how to configure webhook conditions, refer to the Contentstack docs.

    4. Select Save to finish.

# Add your Contentstack instance

Once you have enabled the data integration and prepared your Contentstack instance, take the following steps in the Netlify UI to add it to your data layer:

  1. Select Add a data source.

  2. Enter a Name for this data source.

  3. Select Contentstack as the Data source type.

  4. (Optional) Enter a Type prefix for this data source. The prefix must start with an uppercase letter, and can only consist of alphanumeric characters and underscores.

    The prefix will be added to all data types synced from this data source in the GraphQL schema and you will use it when you query the GraphQL API. For example, ContentstackPost with the prefix Marketing becomes MarketingContentstackPost in the schema.

    Note that Type prefix becomes a required field when you add more than one Contentstack instance to the same data layer.

  5. Enter the API key for your stack.

  6. Enter the read-only Delivery token for your stack environment.

  7. Enter the stack Environment to sync data from. For example, the production environment.

  8. (Optional) Enter the Region to sync data from. Valid options are na-aws, eu-aws, na-azure, and eu-azure. The default is na-aws.

  9. (Optional) Specify the Locales to sync entries from. For example, en-us, fr-ch.

  10. (Optional) When entries aren't available for the specified locale, you can sync them in the fallback language instead. Select Include Fallback Locale to enable this. The default is false.

  11. (Optional) Enter a Limit to specify the number of entries or assets to sync per page. The default is 50.

  12. (Optional) Enter the Content Types to sync from Contentstack. For example, author, book.

  13. (Optional) Enter the Content Types to exclude from Contentstack syncs.

  14. Select Save to add this data source.

When you add a new data source, Netlify automatically connects to it and starts syncing data to your data layer.

# DatoCMS

To use DatoCMS with Connect, complete the following steps:

  1. Enable the DatoCMS data integration.
  2. Prepare your DatoCMS project.
  3. Add your DatoCMS project to your data layer.
# Enable the DatoCMS data integration

To begin, enable the DatoCMS data integration. This will make it available to all data layers on your team.

  1. In the Netlify UI, navigate to the
    Integrations
    tab for your team.
  2. Search for DatoCMS.
  3. Select Enable.
# Prepare your DatoCMS project

Take the following steps on your DatoCMS project before you add it to your data layer:

  1. In your DatoCMS account, navigate to
    Project settings API tokens
    for your project. Follow the prompts to generate a token with the Admin role and with access to the Content Management API. You’ll need to enter this token when you set up your DatoCMS data source in the Netlify UI, and Netlify will use this token to access your data.
  2. To enable automatic syncing to Netlify, add your data layer webhook to your DatoCMS project:

    1. In your DatoCMS account, navigate to

      Project settings Webhooks
      for your project, and select Add a new webhook.

    2. Add the following webhook to the URL field. Make sure to replace the placeholder with your data layer ID.

      https://webhook.netlify-connect.com/hooks/data_layer/data_source/publish/YOUR-DATA-LAYER-ID

    3. Under Triggers, add a trigger for each entity and event that you wish to sync. At minimum, you should configure the webhook to trigger when the events are Create, Update, and Delete. For more information on how to configure webhook conditions, refer to the DatoCMS docs.

    4. Select Save to finish.

# Add your DatoCMS project

Once you have enabled the data integration and prepared your DatoCMS project, take the following steps in the Netlify UI to add it to your data layer:

  1. Select Add a data source.

  2. Enter a Name for this data source.

  3. Select DatoCMS as the Data source type.

  4. (Optional) Enter a Type prefix for this data source. The prefix must start with an uppercase letter, and can only consist of alphanumeric characters and underscores.

    The prefix will be added to all data types synced from this data source in the GraphQL schema and you will use it when you query the GraphQL API. For example, DatoArticle with the prefix Marketing becomes MarketingDatoArticle in the schema.

    Note that Type prefix becomes a required field when you add more than one DatoCMS project to the same data layer.

  5. Enter the DatoCMS API Token for your project. This token requires the Admin role within your DatoCMS project and must have access to the Content Management API.

  6. Enter the DatoCMS Environment to sync. For example, main.

  7. Select Save to add this data source.

When you add a new data source, Netlify automatically connects to it and starts syncing data to your data layer.

# Drupal

Connect supports Drupal versions 9 and 10.

To use Drupal with Connect, complete the following steps:

  1. Enable the Drupal data integration.
  2. Prepare your Drupal instance.
  3. Add your Drupal instance to your data layer.
# Enable the Drupal data integration

To begin, enable the Drupal data integration. This will make it available to all data layers on your team.

  1. In the Netlify UI, navigate to the
    Integrations
    tab for your team.
  2. Search for Drupal.
  3. Select Enable.
# Prepare your Drupal instance

Take the following steps on your Drupal instance before you add it to your data layer:

  1. Install Gatsby Integration module version 2. During the installation flow, follow the prompts to enable the JSON:API Extras module.

  2. In the JSON:API Extras module, enable Include count in collection queries. This setting helps improve performance during data syncs.

  3. Navigate to

    Manage Extend
    and enable:

    • Gatsby
    • Gatsby JSON:API Extras

  4. Install JSON:API Schema module.

  5. To enable automatic syncing to Netlify, add your data layer webhook to the Gatsby Integration module.

    1. Navigate to

      Manage Configuration Web Services Gatsby Integration Gatsby Settings
      .

    2. Add the following webhook to the Build Webhook URLs field. Make sure to replace the placeholder with your data layer ID.

      https://webhook.netlify-connect.com/hooks/data_layer/data_source/publish/YOUR-DATA-LAYER-ID

    3. Under Entity types to send to Gatsby Preview and Build Server, select the types you wish to sync. At minimum, you should select the Content type.

    4. Select Save configuration to finish.

  6. Navigate to

    Manage People Permissions
    to add the following permissions for data syncing:

    1. Add Sync Gatsby Fastbuild log entities permissions. If your Drupal instance does not use authentication, then select Anonymous user. Otherwise, select the appropriate Drupal role.
    2. Add View Gatsby log entity entities permissions. If your Drupal instance does not use authentication, then select Anonymous user. Otherwise, select the appropriate Drupal role.
# Add your Drupal instance

Once you have enabled the data integration and prepared your Drupal instance, take the following steps in the Netlify UI to add it to your data layer:

  1. Select Add a data source.

  2. Enter a Name for this data source.

  3. Select Drupal as the Data source type.

  4. (Optional) Add a Type prefix for this data source. The prefix must start with an uppercase letter, and can only consist of alphanumeric characters and underscores.

    The prefix will be added to all data types synced from this data source in the GraphQL schema and you will use it when you query the GraphQL API. For example, DrupalPost with the prefix Marketing becomes MarketingDrupalPost in the schema.

    Note that Type prefix becomes a required field when you add more than one Drupal instance to the same data layer.

  5. Enter the Drupal URL for your Drupal site, including the trailing slash.

  6. (Optional) If your Drupal instance has basic authentication enabled, enter the HTTP Basic Auth username and HTTP Basic Auth password.

  7. (Optional) Enter the Gatsby Image CDN placeholder style name. The default is placeholder.

  8. (Optional) Enter the JSON:API base to use as the relative path to the JSON:API root. The default is /jsonapi.

  9. (Optional) Enter the Headers used for Drupal API to apply specific headers for the API.

  10. (Optional) Enter a Timeout value. This is the time in milliseconds before requests to Drupal will time out. The default is 30000.

  11. (Optional) Enter the number of Concurrent API requests a user can make to the Drupal API. The default is 20.

  12. (Optional) Enter the Filters used for Drupal API to specify what content to sync. This will allow you to control the data you receive from Drupal. For example, {"recipe": "filter[tags.name][value]=British"}.

  13. (Optional) Enter the Default language of your Drupal site. This will determine what language content to sync from Drupal. The default is to sync the English language content.

  14. (Optional) Enter the Enabled languages for your Drupal site. This will allow you to sync different translations from Drupal, depending on what languages your site has enabled.

  15. (Optional) Select Filter by language to filter the data you sync from Drupal based on the current language.

  16. (Optional) Enter the Translatable entities to specify what entities to sync translations for. For example, node--page, node--article.

  17. (Optional) Enter the Non-translatable entities from your Drupal site. These entities will use the default language of your site. For example, taxonomy_term--tags, taxonomy_term--categories.

  18. Select Save to add this data source.

When you add a new data source, Netlify automatically connects to it and starts syncing data to your data layer.

# Sanity

To use Sanity with Netlify Connect, complete the following steps:

  1. Prepare your Sanity project.
  2. Add your Sanity project to your data layer.
# Prepare your Sanity project

Take the following steps on your Sanity project before you add it to your data layer:

  1. Deploy a Sanity GraphQL API for the project. To deploy a GraphQL API on Sanity, use the Sanity CLI to run sanity graphql deploy in the Sanity Studio project folder. Learn more about deploying GraphQL APIs on Sanity.

    Note: You should redeploy the Sanity GraphQL API every time you make changes to the schema that you want to use in Netlify Connect

  2. To enable automatic syncing to Netlify Connect, add your data layer webhook to the Sanity project.

    1. In Sanity, navigate to

      API Webhooks
      in your Sanity settings. Under GROQ-powered Webhooks, select Create webhook.

    2. Enter a name for the webhook and then add the following webhook URL to the URL field. Make sure to replace the placeholder with your data layer ID.

      https://webhook.netlify-connect.com/hooks/data_layer/data_source/publish/YOUR-DATA-LAYER-ID

    3. Under Trigger on, select Create, Update, and Delete.

    4. Select Save to finish.

# Add your Sanity project

Once you have prepared your Sanity project, take the following steps in the Netlify UI to add it to your data layer:

  1. Select Add a data source.

  2. Enter a Name for this data source.

  3. Select Sanity as the Data source type.

  4. (Optional) Enter a Type prefix for this data source. The prefix must start with an uppercase letter, and can only consist of alphanumeric characters and underscores.

    The prefix will be added to all data types synced from this data source in the GraphQL schema and you will use it when you query the GraphQL API. For example, SanityPost with the prefix Marketing becomes MarketingSanityPost in the schema.

    Note that Type prefix becomes a required field when you add more than one Sanity project to the same data layer.

  5. Enter the Project ID for your Sanity project.

  6. Enter the name of the Dataset to sync.

  7. (Optional) If you deployed the Sanity GraphQL API with a tag, enter the GraphQL tag name. For example, if you used --tag experiment for the deploy, enter experiment. The default is default.

  8. (Optional) If your dataset is private, enter the API authentication token to use for syncing data. The token must have Viewer permissions.

  9. Select Save to add this data source.

When you add a new data source, Netlify automatically connects to it and starts syncing data to your data layer.

# Shopify

To use Shopify with Connect, complete the following steps:

  1. Enable the Shopify data integration.
  2. Prepare your Shopify store.
  3. Add your Shopify store to your data layer.
# Enable the Shopify data integration

To begin, enable the Shopify data integration. This will make it available to all data layers on your team.

  1. In the Netlify UI, navigate to the
    Integrations
    tab for your team.
  2. Search for Shopify.
  3. Select Enable.
# Prepare your Shopify store

To add a Shopify store to your data layer in Netlify Connect, first you need to set up a custom Shopify app that we can use to access Shopify’s Admin API and sync data. You will need the Admin API access token to set up your Shopify data source in Netlify Connect.

  1. Log in to your Shopify store as the store owner and search for Apps and sales channels.

  2. Enable custom app development. To do this, select Develop apps, then Allow custom app development. After reading the warning and information provided, select Allow custom app development.

  3. Create a custom app. From the App development section, select Create an app. Enter an app name and developer, then select Create app.

  4. Set admin API scopes for the app. On the custom app page, select Configure Admin API scopes. Enable the read_products, read_product_listings, and read_files scopes, and then select Save.

    You can use this data integration to proxy directly to the Shopify GraphQL API as well. To allow additional CRUD operations through the proxy, enable the admin API scopes for these operations, such as write_products.

  5. Install the app and get the API access token. Select the API credentials tab and select Install app under Access tokens. Follow the prompts to install the app on your Shopify store.

    Next, under the Admin API access token section, select Reveal token once to access the token. Store the token in a safe place as you will need it to set up the data source connection.

# Add your Shopify store

Once you have enabled the data integration and created a custom Shopify app, take the following steps in the Netlify UI to add your Shopify store to your data layer:

  1. Select Add a data source.

  2. Enter a Name for this data source.

  3. Select Shopify as the Data source type.

  4. (Optional) Add a Type prefix for this data source. The prefix must start with an uppercase letter, and can only consist of alphanumeric characters and underscores.

    The prefix will be added to all data types synced from this data source in the GraphQL schema and you will use it when you query the GraphQL API. For example, ShopifyProduct with the prefix Marketing becomes MarketingShopifyProduct in the schema.

    Note that Type prefix becomes a required field when you add more than one Shopify store to the same data layer.

  5. Enter the Store URL for your Shopify store. This is the myshopify.com URL, excluding https:// and the trailing slash.

  6. Enter the Admin API access token. This is the access token for the custom Shopify app you created in the prepare your store step. The token starts with shpat_.

  7. Select Save to add this data source.

When you add a new data source, Netlify automatically connects to it and starts syncing data to your data layer.

# WordPress

To use WordPress with Netlify Connect, complete the following steps:

  1. Enable the WordPress data integration.
  2. Prepare your WordPress instance.
  3. Add your WordPress instance to your data layer.
# Enable the WordPress data integration

To begin, enable the WordPress data integration. This will make it available to all data layers on your team.

  1. In the Netlify UI, navigate to the
    Integrations
    tab for your team.
  2. Search for WordPress.
  3. Select Enable.
# Prepare your WordPress instance

Take the following steps on your WordPress instance before you add it to your data layer:

  1. Install and activate the Netlify Connect WordPress plugin:

    1. Download the Netlify Connect WordPress plugin.
    2. In your WordPress admin dashboard, navigate to Plugins and then select Add New Plugin.
    3. Select Upload Plugin and follow the prompts to upload the netlify-connect-wp-plugin.zip file that you downloaded in step 1.
    4. Select Install now.

  2. In your WordPress admin dashboard, navigate to

    Edit Profile Application Passwords
    and create an application password. You’ll need to enter this as your token when you set up your WordPress data source in the Netlify UI, and Netlify will use this token to access your data.

  3. To enable automatic syncing to Netlify, add your data layer Webhook URL in your WordPress plugin settings for Connect:

    1. In your WordPress admin dashboard, navigate to

      Settings Netlify Connect
      .

    2. Add the following webhook to the Data layer Webhook URL field. Make sure to replace the placeholder YOUR-DATA-LAYER-ID with your data layer ID.

      https://webhook.netlify-connect.com/hooks/data_layer/data_source/publish/YOUR-DATA-LAYER-ID

    3. Select “Save Changes” to finish.

# Add your WordPress instance

Once you have enabled the data integration and prepared your WordPress instance, take the following steps in the Netlify UI to add it to your data layer:

  1. Select Add a data source.
  2. Enter a Name for this data source.
  3. Select WordPress as the Data source type.
  4. Enter the full API Host URL for your WordPress instance (for example, https://example.com without a trailing slash).
  5. Enter the Token (the application password you created in WordPress).
  6. Enter the User (the username for which you created the application password).
  7. Select Save to add this data source.

When you add a new data source, Netlify automatically connects to it and starts syncing data to your data layer.

# Optional configuration

If you need to customize your setup further, you can configure the following optional settings during the setup process:

  • Type prefix: add a prefix for this data source. The prefix must start with an uppercase letter and can only consist of alphanumeric characters and underscores.

    Connect will add the prefix to all data types synced from this data source in the GraphQL schema, which you will use when you query the GraphQL API. For example, Post with the prefix Marketing becomes MarketingPost in the schema.

  • Instance ID: add an instance ID for this data source to uniquely identify it.

  • Per page: specify the number of nodes to fetch per page when syncing data from WordPress. The default is 100.

  • Request concurrency: set the number of concurrent requests to make during node sourcing. You can lower this if your WordPress server experiences issues during data sourcing. The default is 15.

  • Types to exclude globally: specify the slugs of post types, taxonomies, or other content types to exclude from sourcing, listed as comma-separated values.

# Other

To use a custom data source, an integration must already exist for it

If a data integration doesn’t already exist for your custom data source type, create one with the Netlify SDK. Data integrations use the Connectors component to specify the data model and logic for syncing data from a custom data source. Once you publish your data integration, you can start using it in Netlify Connect.

To use a custom data source with Netlify Connect, complete the following steps:

  1. Enable the data integration.
  2. Prepare your data source instance.
  3. Add your custom data source to your data layer.
# Enable the data integration

Before you can add a custom data source to your data layer, you must ensure that the data integration for that type of source is enabled on your team.

  1. In the Netlify UI, navigate to the
    Integrations
    tab for your team.
  2. Find the data integration for the custom data source type that you wish to use.
  3. If it’s not already enabled, select Enable.

If you can’t find the data integration, speak with the integration developer to ensure they have followed all the steps to publish a data integration.

# Prepare your data source instance

To enable automatic syncing to Netlify, you need to manually add a webhook to your custom data source instance. The exact instructions vary for each system but you need to do the following:

  1. Log in to your data source and navigate to the webhook settings.

  2. Follow the prompts to create a new webhook and add the following to the URL field. Make sure to replace the placeholder with your data layer ID.

    https://webhook.netlify-connect.com/hooks/data_layer/data_source/publish/YOUR-DATA-LAYER-ID

  3. If the options are available, select the data types and events that should trigger the webhook. We suggest including any create, edit, and delete events for all content types that you wish to store in your data layer.

  4. Save and enable the webhook.

# Add your custom data source

Once you have enabled the data integration for your team and prepared your data source instance, take the following steps in the Netlify UI to add the custom data source to your data layer:

  1. Select Add a data source.

  2. Enter a Name for this data source.

  3. Under Data source type, select the data integration that you enabled.

  4. Fill in the configuration fields with the values for your data source instance. For example, you may need to provide the API key for your CMS instance.

  5. Select Save to add this data source.

When you add a new data source, Netlify automatically connects to it and starts syncing data to your data layer.

# Edit data sources

Want to create links between data sources?

Use cross-references to create links between fields across data sources so you can retrieve combined data through a single query. To set up cross-references, navigate to the Cross-references section of your Data layer settings. Learn more about cross-references.

  1. Navigate to the
    Connect
    page for your team in the Netlify UI.
  2. Select the data layer from the Data layers list, and then select Data layer settings.
  3. On the data layer settings page, select Data sources.
  4. Select the data source you want to edit.
  5. Select Edit and update the fields as needed.
  6. Select Save.

# Delete data sources

When you delete a data source, Netlify will delete all data related to that source from the data layer and then update the data layer’s schema to reflect the change.

To delete a data source from your data layer:

  1. Navigate to the
    Connect
    page for your team in the Netlify UI.
  2. Select the data layer from the Data layers list, and then select Data layer settings.
  3. On the data layer settings page, select Data sources.
  4. Select the data source you want to delete.
  5. Select Delete.
  6. A confirmation prompt will appear. Enter the name of the data source to confirm.
  7. Select Delete.

After the sync events are complete, make sure you review the new schema and update any sites that make queries to the GraphQL API to reflect this change.

← Manage cross-references →