Skip to main content

How to set up Google Datastream

Updated this week

Setup takes about 10 minutes.

Introduction

Connecting Google Datastream to Foundational allows Foundational to scan Datastream pipelines, determine lineage, and assess downstream impact.

To make the connection, you need to:

  • Create a Google Cloud service account for Foundational

  • Assign the Datastream Viewer role to the account


Prerequisites

Ensure you have:

  • Permissions to create a service account (iam.serviceAccounts.create)

  • Project Admin permissions to assign a service account to a project

  • Added Foundational IP addresses to the allowlist, see the article Allowing IP access to Foundational.


Access permissions

The permissions you assign to Foundational enable it to:

  • Read Datastream metadata

  • List Datastream streams and their configurations

  • Map Datastream lineage and downstream impact


Create a service account for Foundational

  1. In Google Cloud, open the IAM & Admin page and select Service Accounts.

  2. Select the relevant Google Cloud project and click Create service account.

  3. The Create service account screen opens.

    Enter the Service account name: foundational-reader.

  4. On the same screen, click Create and continue.

  5. In Grant this service account access to project, select Datastream Viewer as the role.

  6. To save the account, click Done.


Create a key for the service account

  1. Go to IAM & Admin > Services accounts and select your account.

  2. At the next screen, select the Keys tab (#1) and then open the ADD KEY dropdown (#2).

  3. Click Create new key.

  4. Select JSON as the key type, then click Create.

  5. Download the JSON key file and save it. You’ll need it to set up the connection.


Connect Foundational to Google Datastream

  1. In Foundational, open the Connectors & Integrations page.

  2. In ETL, select the Datastream card and click Connect.

  3. Click Add Project.

  4. The initial setup screen opens. Click Start Setup.

  5. The Set Up New Connection screen opens.

  6. Click Upload File and upload the JSON key file.

  7. Click Next.

  8. The final setup screen opens. To complete the connection, click Save.

That’s it. Foundational is now connected to Google Datastream.


Did this answer your question?