I am trying to create an MSK connector using kafka-connect-aws-s3-kafka-2-8-4.0.0.zip, but it is stuck in ** Creating...** status and it fails with an unknown error. So a bit about my connector config: I am trying to deploy this Connector in order to sink data from MSK to s3 ( kafka-connect-aws )
here are the connector properties:
connector.class=io.lenses.streamreactor.connect.aws.s3.sink.S3SinkConnector
behavior.on.null.values=ignore
s3.region=eu-central-1
flush.size=5
tasks.max=8
topics=MyTopic
s3.part.size=5242880
connect.s3.vhost.bucket=true
schema.enable=false
format.bytearray.separator=\n--==SEPARATOR==--\n
key.converter.schemas.enable=false
connect.s3.kcql=INSERT INTO kafka-connect-aws2:evelin-msk SELECT * FROM MyTopic WITH_FLUSH_INTERVAL = 300
format.class=io.confluent.connect.s3.format.bytearray.ByteArrayFormat
partitioner.class=io.confluent.connect.storage.partitioner.DefaultPartitioner
value.converter.schemas.enable=false
connect.s3.aws.region=eu-central-1
value.converter=org.apache.kafka.connect.converters.ByteArrayConverter
storage.class=io.confluent.connect.s3.storage.S3Storage
errors.log.enable=true
s3.bucket.name=kafka-connect-aws
Any idea what could be the reason? Please let me know if I need to provide more information
When you create the Kafka connector, you have choice to write the log.
For example, you can write to S3. This should help further locate your issues.