Question

How can I know if spark application/job is idle/waiting for resources?

score 33 · Answer 1 · 2024-03-25T13:10:08.717000

33

Views

How can I know if spark application/job is idle/waiting for resources?

Published on 25 March 2024 at 13:10

score 134 · Answer 2 · 2023-12-10T09:27:22.803000

134

Views

Spark, Connect, could not cache persist jdbc_relation

Published on 10 December 2023 at 09:27

score 352 · Answer 3 · 2023-10-18T09:36:33.577000

352

Views

Is any solution related to SparkConnectGrpcException?

Published on 18 October 2023 at 09:36

score 33 · Answer 4 · 2023-10-09T10:52:21.317000

33

Views

Is there any way to set spark applicationId format

Published on 09 October 2023 at 10:52

score 147 · Answer 5 · 2023-09-30T11:45:45.320000

147

Views

Java 8 compatible no error given spark version needed

Published on 30 September 2023 at 11:45

score 22 · Answer 6 · 2023-08-08T18:18:01.857000

22

Views

Is it Possible to Choose Spark Executor Location

Published on 08 August 2023 at 18:18

score 314 · Answer 7 · 2023-08-07T12:03:22.970000

314

Views

Spark executors exiting frequently and Initial job has not accepted any resources

Published on 07 August 2023 at 12:03

score 220 · Answer 8 · 2023-07-24T13:04:22.783000

220

Views

Connecting to Spark Standalone cluster from Airflow

Published on 24 July 2023 at 13:04

score 100 · Answer 9 · 2023-05-19T13:10:55.677000

100

Views

Define specific spark executors per worker on a Spark cluster of 3 worker nodes

Published on 19 May 2023 at 13:10

score 1k · Answer 10 · 2022-12-13T09:52:03.073000

1k

Views

Is writing to database done by driver or executor in spark cluster

Published on 13 December 2022 at 09:52

score 1.4k · Answer 11 · 2022-11-25T06:31:02.717000

1.4k

Views

Hadoop 3 gcs-connector doesn't work properly with latest version of spark 3 standalone mode

Published on 25 November 2022 at 06:31

score 114 · Answer 12 · 2022-09-10T12:33:45.983000

114

Views

Spark driver / executors in docker containers with port translation

Published on 10 September 2022 at 12:33

score 1.2k · Answer 13 · 2022-07-25T07:40:27.320000

1.2k

Views

spark scala: Performance degrade with simple UDF over large number of columns

Published on 25 July 2022 at 07:40

score 1k · Answer 14 · 2022-07-24T06:02:56.423000

1k

Views

Spark not giving equal tasks to all executors

Published on 24 July 2022 at 06:02

score 169 · Answer 15 · 2022-07-14T07:16:56.480000

169

Views

how to change spark worker URL change in master UI?

Published on 14 July 2022 at 07:16

score 556 · Answer 16 · 2022-05-30T11:59:02.890000

556

Views

spark Local mode vs standalone cluster in term of cores and threads usage

Published on 30 May 2022 at 11:59

score 256 · Answer 17 · 2022-05-25T09:07:40.730000

256

Views

how to fix error in lunching pyspark standalone mode

Published on 25 May 2022 at 09:07

score 430 · Answer 18 · 2022-03-20T06:04:55.223000

430

Views

ERROR StandaloneSchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up. - Spark standalone cluster

Published on 20 March 2022 at 06:04

score 551 · Answer 19 · 2022-02-25T16:14:19.413000

551

Views

What is Spark default username and password for a standalong installation?

Published on 25 February 2022 at 16:14

score 155 · Answer 20 · 2021-12-26T07:41:42.167000

155

Views

How to get result from Spark after submitting a job via REST API?

Published on 26 December 2021 at 07:41

List Question

How can I know if spark application/job is idle/waiting for resources?

Spark, Connect, could not cache persist jdbc_relation

Is any solution related to SparkConnectGrpcException?

Is there any way to set spark applicationId format

Java 8 compatible no error given spark version needed

Is it Possible to Choose Spark Executor Location

Spark executors exiting frequently and Initial job has not accepted any resources

Connecting to Spark Standalone cluster from Airflow

Define specific spark executors per worker on a Spark cluster of 3 worker nodes

Is writing to database done by driver or executor in spark cluster

Hadoop 3 gcs-connector doesn't work properly with latest version of spark 3 standalone mode

Spark driver / executors in docker containers with port translation

spark scala: Performance degrade with simple UDF over large number of columns

Spark not giving equal tasks to all executors

how to change spark worker URL change in master UI?

spark Local mode vs standalone cluster in term of cores and threads usage

how to fix error in lunching pyspark standalone mode

ERROR StandaloneSchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up. - Spark standalone cluster

What is Spark default username and password for a standalong installation?

How to get result from Spark after submitting a job via REST API?

Trending Questions

Popular # Hahtags

Popular Questions