Send event message to AWS MSK in Streamsets

Question

I have a Streamsets pipeline that sends events to AWS SNS currently (Using HTTP client). I now have a requirement to send these events to AWS MSK instead of AWS SNS.

I am not finding a relevant documentation to start with this. Don't know where and how to start.

Can someone help in pointing to a relevant documentation which will be much helpful in starting this change?

Any help will be much appreciated. Thanks much in advance.

Answer 1

MSK is just a managed service around Apache Kafka. In StreamSets there is a Kafka connector.

MSK can use certificates (mTLS) for authentication, and this is the method that might work for StreamSets.