Steps to work with Amazon Datazone in a running environment organized by producer-central-consumer style accounts

For this scenario, let's have an Amazon DataZone domain, i.e., Marketing. For this domain, we have the following three different AWS accounts.

• Account 1 - 111111111111 (Producer account where data sits and can be harvested into the catalog. Note: Make sure there are some existing AWS Glue data tables and Redshift cluster data tables for which you will need to catalog data. )
• Account2: 222222222222. (Central account for governance)
• Account3: 333333333333. (Consumer account where subscribed data can be consumed i.e., build an analysis)

You can follow the steps as mentioned below:

Central account for governance

Step 1. Create an Amazon DataZone domain (named Marketing) in the central account i.e.; 222222222222. [In Amazon DataZone Console Portal]

• This is the account where you will have your permissions required to use Amazon DataZone management console and for Data Portal and KMS keys for encryption. You will also set up AWS IAM Identity Center and enable it for Amazon DataZone at the root domain configuration.
• Documentation: https://docs.aws.amazon.com/datazone/latest/userguide/create-root-domain.html

Producer account where data sits and can be harvested into the catalog

Step 2. Associating the producer account i.e.; 111111111111 with the domain [In Amazon DataZone Console Portal]

• Required to publish data from the accounts and create Amazon DataZone projects resources for publishing.
• Documentation: https://docs.aws.amazon.com/datazone/latest/userguide/working-with-associated-accounts.html

Step 3. Create Project Profile using the associated producer account [In Amazon DataZone Data Portal]

• While creating the project profile, you can specify the associated AWS account & region where you want to create a producer project.
• Documentation: https://docs.aws.amazon.com/datazone/latest/userguide/create-project-profile.html

Step 4. Create Project using the producer account project profile [In Amazon DataZone Data Portal]

• Product resources will be created in the producer account.
• Documentation: https://docs.aws.amazon.com/datazone/latest/userguide/create-new-project.html

Step 5. Create Data Source for your data assets in the producer account [In Amazon DataZone Console Portal]

• You can create multiple data sources based on distinct data and sources (Glue, Redshift). You can allow the specific project to have access to the data source.
• Documentation: https://docs.aws.amazon.com/datazone/latest/userguide/data-source-admin-tasks.html

Step 6. Publish a data asset to the catalog through a project [In Amazon DataZone Data Portal]

• When creating a publishing job, you select your publishing agreement and the data source (created in step 3) that is connected to your Amazon DataZone domain.
• Documentation: https://docs.aws.amazon.com/datazone/latest/userguide/publish-data-asset.html

Consumer account where subscribed data can be consumed i.e., build an analysis

Step 7. Associating the consumer account i.e.; 333333333333 with the domain [In Amazon DataZone Console Portal]

• Required to create Amazon DataZone projects resources for data consumption.
• Documentation: https://docs.aws.amazon.com/datazone/latest/userguide/working-with-associated-accounts.html

Step 8. Create Project Profile using the associated consumer account [In Amazon DataZone Data Portal]

• While creating the project profile, you can specify the associated AWS account & region where you want to create a consumer project.
• Documentation: https://docs.aws.amazon.com/datazone/latest/userguide/create-project-profile.html

Step 9. Create Project using the producer account project profile [In Amazon DataZone Data Portal]

• Product resources will be created in the producer account.
• Documentation: https://docs.aws.amazon.com/datazone/latest/userguide/create-new-project.html

Step 10. Discovering, subscribing to, and consuming data [In Amazon DataZone Data Portal]

• Documentation: https://docs.aws.amazon.com/datazone/latest/userguide/discover-subscribe-consume-data.html