Executor pod is assigned with 9g Memory , Even after data processing is done executor still holds 3GB of JVM OnHeapMemory.
How to check which process is holding the memory after load is stopped ?
kubectl top <pod_name> gives whole node memory processes instead of pod memory .
config("spark.cleaner.periodicGC.interval","5min") GC is configured to run for every 5 min , but doesn't seem to be clearing the memory