Goal:
We want to support multiple environments in the same Openshift. We use the service mesh control plan and namespaces defined in the member rolls, as the boundaries for each environment. Each environment also has its own Kafka cluster, installed using the Openshift AMQP operator.
We’ve also also installed the Openshift serverless operator and deployed a Knative Eventing control plane (along with a Knative Serving control plane). We’ve found that only one knative eventing control plane can be installed in each cluster, as it is restricted to a certain namespace name, and you can only have one control plane in a namespace For each environment there is a handful of Knative channels (we use the channel/subscription model, but we can use brokers and trigger as wells, if that solves the problem) which are backed by the kafka cluster of that environment.
We use the subscriptions to push events to Knative services.
Issue:
It seems that the kafka bootstrap server domains are configured in the control plane (KnativeKafka resource specifically), for which we can only have one of per openshift cluster. This means that we can ensure that data/events in one environments ends up in the kafka cluster in that same environment.
How would one go about creating two Knative channels in the same cluster, but configured in such a way, so that the events of each are guaranteed to end up in different kafka clusters, all within the same openshift cluster?
The details:
Openshift v4.14.12_1552
Red Hat AMQP Streams v2.6.0-1
Which uses:
- Kafka v3.6.0
- Strimzi v0.38
Openshift Serverless v1.31.1
Which uses:
- Knative Serving v1.10
- Knative Eventing v1.10