Monitor and manage spring cloud data flow (SCDF) Server using Prometheus

Question

Is it possible to monitor and manage spring cloud data flow(SCDF) server itself using Prometheus?

I am aware that, I can monitor and collect metrics for the jars deployed in SCDF Server (i.e source, processors, sink).

But my question is, if I hit URL http://localhost:9393/actuator/prometheus will I get metrics related to SCDF server alone. I tried it, I did not get result.

I ran the SCDF jar.

java -jar spring-cloud-dataflow-server-2.11.1.jar

Answer 1

I you look at the docker-compose file for using prometheus for local testing you will see the properties added to dataflow and skipper as well as the deployment of prometheus-proxy. You can also look at the Kubernetes deployment, in the same folder tree, for guidance. You will most probably not spend time monitoring dataflow or skipper server themselves since they don't consume much resources and are only active when you interact with them directly. The Task and Stream monitoring guides will provide more useful information regarding monitoring a solution.

Answer 2

The solution is, for spring cloud data flow server metrics are exposed in /management/prometheus endPoint and not in /actuator/prometheus endPoint.