Create an Amazon Managed Streaming for Apache Kafka import topic

An Amazon Managed Streaming for Apache Kafka (Amazon MSK) import topic lets you continuously ingest data from Amazon MSK as an external source and into Pub/Sub. Then you can stream the data into any of the destinations that Pub/Sub supports.

This document shows you how to create and manage Amazon MSK import topics. To create a standard topic, see Create a standard topic.

For more information about import topics, see About import topics.

Before you begin

• Know more about the Pub/Sub publish process.

• Configure the required roles and permissions to manage Amazon MSK import topics including the following:

  • Add the Pub/Sub publisher role to the Pub/Sub service account

  • Add the Pub/Sub service agent role to the Pub/Sub service account, if not already granted.

  • Add the service account user role to the service account

• Set up workload identity federation so that Google Cloud can access the external streaming service.

Required roles and permissions

To get the permissions that you need to create and manage Amazon MSK import topics, ask your administrator to grant you the Pub/Sub Editor (roles/pubsub.editor) IAM role on your topic or project. For more information about granting roles, see Manage access to projects, folders, and organizations.

This predefined role contains the permissions required to create and manage Amazon MSK import topics. To see the exact permissions that are required, expand the Required permissions section:

Required permissions