Question

How to pass or allow spark-operator pod in eks to access AWS resources like S3

score 25 · Answer 1 · 2024-03-24T12:46:46.680000

25

Views

How to pass or allow spark-operator pod in eks to access AWS resources like S3

Published on 24 March 2024 at 12:46

score 20 · Answer 2 · 2024-02-27T18:00:55.163000

20

Views

Multiple sparkOperators on same EKS cluster?

Published on 27 February 2024 at 18:00

score 90 · Answer 3 · 2024-02-04T16:08:25.347000

90

Views

Spark-operator: infinite spark-pi-driver running with no executors

Published on 04 February 2024 at 16:08

score 32 · Answer 4 · 2024-02-01T14:12:30.087000

32

Views

Executor instance is not getting created while running Spark app on Kubernetes ( Minikube)

Published on 01 February 2024 at 14:12

score 111 · Answer 5 · 2023-09-19T17:34:30.383000

111

Views

Sync AWS CodeCommit with gitsync on SparkApplication+k8s

Published on 19 September 2023 at 17:34

score 155 · Answer 6 · 2023-09-14T17:55:13.173000

155

Views

java.lang.NoSuchMethodError: 'scala.collection.immutable.ArraySeq scala.runtime.ScalaRunTime$.wrapRefArray(java.lang.Object[])'

Published on 14 September 2023 at 17:55

score 137 · Answer 7 · 2023-08-30T12:26:07.540000

137

Views

PVC-oriented executor pod allocation with spark-on-k8s-operator

Published on 30 August 2023 at 12:26

score 152 · Answer 8 · 2023-08-11T17:39:56.913000

152

Views

Efficiente way to use spark dependency on spark operator

Published on 11 August 2023 at 17:39

score 195 · Answer 9 · 2023-07-10T13:17:51.783000

195

Views

Executor self-exiting due to : Unable to create executor due to URI has an authority component

Published on 10 July 2023 at 13:17

score 214 · Answer 10 · 2023-07-09T14:54:41.923000

214

Views

placementrules in yunikorn don't work as expected when trying to launch a spark job using the spark-operator

Published on 09 July 2023 at 14:54

score 410 · Answer 11 · 2023-06-21T15:34:11.803000

410

Views

Scraping custom metrics into Prometheus from a Pyspark cluster running on K8s using the Python Client

Published on 21 June 2023 at 15:34

score 889 · Answer 12 · 2023-06-21T15:14:36.253000

889

Views

Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

Published on 21 June 2023 at 15:14

score 128 · Answer 13 · 2023-06-16T03:41:54.237000

128

Views

Retrieving Password from Secrets in Kubernetes Spark Application through Spark Operator

Published on 16 June 2023 at 03:41

score 30 · Answer 14 · 2023-05-31T14:58:48.210000

30

Views

Spark application going out of spark operator's reach

Published on 31 May 2023 at 14:58

score 257 · Answer 15 · 2023-02-09T15:19:56.327000

257

Views

spark streaming from kafka on spark operator(Kubernetes)

Published on 09 February 2023 at 15:19

score 246 · Answer 16 · 2023-01-17T14:37:33.317000

246

Views

JMX exporter & spark-on-k8s-operator

Published on 17 January 2023 at 14:37

score 407 · Answer 17 · 2023-01-15T16:18:25.240000

407

Views

Kubernetes spark operator driver pod is failing due to NoSuchMethodError: org.apache.hadoop.conf.Configuration.getPassword

Published on 15 January 2023 at 16:18

score 427 · Answer 18 · 2023-01-14T03:47:32.197000

427

Views

How can i set RestartPolicy to Spark driver pod on kubernetes using spark-submit not with spark-operator?

Published on 14 January 2023 at 03:47

score 293 · Answer 19 · 2022-10-06T11:19:16.190000

293

Views

How to deploy a Beam Application on already deployed Spark application on Kubernetes?

Published on 06 October 2022 at 11:19

score 522 · Answer 20 · 2022-09-24T14:16:17.073000

522

Views

Failed to connect to spark-master:7077

Published on 24 September 2022 at 14:16

List Question

How to pass or allow spark-operator pod in eks to access AWS resources like S3

Multiple sparkOperators on same EKS cluster?

Spark-operator: infinite spark-pi-driver running with no executors

Executor instance is not getting created while running Spark app on Kubernetes ( Minikube)

Sync AWS CodeCommit with gitsync on SparkApplication+k8s

java.lang.NoSuchMethodError: 'scala.collection.immutable.ArraySeq scala.runtime.ScalaRunTime$.wrapRefArray(java.lang.Object[])'

PVC-oriented executor pod allocation with spark-on-k8s-operator

Efficiente way to use spark dependency on spark operator

Executor self-exiting due to : Unable to create executor due to URI has an authority component

placementrules in yunikorn don't work as expected when trying to launch a spark job using the spark-operator

Scraping custom metrics into Prometheus from a Pyspark cluster running on K8s using the Python Client

Upgrade to spark 3.4.0 from 3.3.2 gives Exception in thread "main" java.nio.file.NoSuchFileException: , although jar is present in the location

Retrieving Password from Secrets in Kubernetes Spark Application through Spark Operator

Spark application going out of spark operator's reach

spark streaming from kafka on spark operator(Kubernetes)

JMX exporter & spark-on-k8s-operator

Kubernetes spark operator driver pod is failing due to NoSuchMethodError: org.apache.hadoop.conf.Configuration.getPassword

How can i set RestartPolicy to Spark driver pod on kubernetes using spark-submit not with spark-operator?

How to deploy a Beam Application on already deployed Spark application on Kubernetes?

Failed to connect to spark-master:7077

Trending Questions

Popular # Hahtags

Popular Questions