In dataproc serverless, the underlying vm is hidden. How to change log level in dataproc serverless spark?
--properties ^@^spark.executor.extraJavaOptions=-Dlog4j.configuration=spark-log4j2.properties \
--files spark-log4j2.properties \
In dataproc serverless, the underlying vm is hidden. How to change log level in dataproc serverless spark?
--properties ^@^spark.executor.extraJavaOptions=-Dlog4j.configuration=spark-log4j2.properties \
--files spark-log4j2.properties \
Copyright © 2021 Jogjafile Inc.
Adding
file:
prefix worked.