Question

Compute and Data transfer not happening concurrently in cuda Streams on Iteration 2

score 48 · Answer 1 · 2024-03-08T18:38:59.323000

48

Views

Compute and Data transfer not happening concurrently in cuda Streams on Iteration 2

Published on 08 March 2024 at 18:38

score 148 · Answer 2 · 2024-02-07T11:13:59.257000

148

Views

Can multiple cuda kernels execute in parallel on the same SM?

Published on 07 February 2024 at 11:13

score 55 · Answer 3 · 2024-01-28T22:55:26.380000

55

Views

What are the semantics of CUDA kernel launch priorities?

Published on 28 January 2024 at 22:55

score 68 · Answer 4 · 2024-01-28T22:19:59.363000

68

Views

What does the "synchronization policy" mean when launching a kernel?

Published on 28 January 2024 at 22:19

score 134 · Answer 5 · 2023-06-14T03:15:26.323000

134

Views

Why am I unable to establish a pipeline when using multiple concurrent streams in CUDA programming?

Published on 14 June 2023 at 03:15

score 81 · Answer 6 · 2023-06-04T12:17:17.997000

81

Views

What are the possible mistakes leading to 'fatal error: cudacheck.h: No such file or directory' in CUDA C++?

Published on 04 June 2023 at 12:17

score 162 · Answer 7 · 2023-05-17T18:18:59.477000

162

Views

Does a CUDA stream "become active" after execution of a scheduled host function concludes?

Published on 17 May 2023 at 18:18

score 759 · Answer 8 · 2023-04-26T05:21:23.900000

759

Views

Can we overlap compute operation with memory operation without pinned memory on CPU?

Published on 26 April 2023 at 05:21

score 72 · Answer 9 · 2023-03-19T22:36:11.663000

72

Views

What does CU_MEMPOOL_ATTR_REUSE_ALLOW_OPPORTUNISTIC actually allow?

Published on 19 March 2023 at 22:36

score 339 · Answer 10 · 2023-03-15T02:17:22.660000

339

Views

Is it possible to execute more than one CUDA graph's host execution node in different streams concurrently?

Published on 15 March 2023 at 02:17

score 436 · Answer 11 · 2023-03-13T20:14:15.880000

436

Views

Is there a way to block and unblock a CUDA stream arbitrarily?

Published on 13 March 2023 at 20:14

score 334 · Answer 12 · 2022-12-26T09:15:16.237000

334

Views

What are the new unique-id's for CUDA streams and contexts useful for?

Published on 26 December 2022 at 09:15

score 881 · Answer 13 · 2022-06-24T19:29:34.923000

881

Views

What's the capacity of a CUDA stream (=queue)?

Published on 24 June 2022 at 19:29

score 568 · Answer 14 · 2022-06-12T18:35:58.283000

568

Views

Getting total execution time of all kernels on a CUDA stream

Published on 12 June 2022 at 18:35

score 1.2k · Answer 15 · 2022-05-17T03:27:16.550000

1.2k

Views

Using multi streams in cuda graph, the execution order is uncontrolled

Published on 17 May 2022 at 03:27

score 160 · Answer 16 · 2022-04-13T16:42:19.627000

160

Views

What is cuEventRecord guaranteed to do if it gets the default-stream's handle?

Published on 13 April 2022 at 16:42

score 693 · Answer 17 · 2022-01-29T22:05:39.673000

693

Views

How can I pause a CUDA stream and then resume it?

Published on 29 January 2022 at 22:05

score 696 · Answer 18 · 2021-12-01T13:43:03.570000

696

Views

How can I make sure two kernels in two streams are sent to the GPU at the same time to run?

Published on 01 December 2021 at 13:43

score 525 · Answer 19 · 2021-03-05T20:27:33.367000

525

Views

Reusing cudaEvent to serialize multiple streams

Published on 05 March 2021 at 20:27

score 151 · Answer 20 · 2021-02-16T22:56:29.507000

151

Views

Using constant memory with MPI and streams

Published on 16 February 2021 at 22:56

List Question

Compute and Data transfer not happening concurrently in cuda Streams on Iteration 2

Can multiple cuda kernels execute in parallel on the same SM?

What are the semantics of CUDA kernel launch priorities?

What does the "synchronization policy" mean when launching a kernel?

Why am I unable to establish a pipeline when using multiple concurrent streams in CUDA programming?

What are the possible mistakes leading to 'fatal error: cudacheck.h: No such file or directory' in CUDA C++?

Does a CUDA stream "become active" after execution of a scheduled host function concludes?

Can we overlap compute operation with memory operation without pinned memory on CPU?

What does CU_MEMPOOL_ATTR_REUSE_ALLOW_OPPORTUNISTIC actually allow?

Is it possible to execute more than one CUDA graph's host execution node in different streams concurrently?

Is there a way to block and unblock a CUDA stream arbitrarily?

What are the new unique-id's for CUDA streams and contexts useful for?

What's the capacity of a CUDA stream (=queue)?

Getting total execution time of all kernels on a CUDA stream

Using multi streams in cuda graph, the execution order is uncontrolled

What is cuEventRecord guaranteed to do if it gets the default-stream's handle?

How can I pause a CUDA stream and then resume it?

How can I make sure two kernels in two streams are sent to the GPU at the same time to run?

Reusing cudaEvent to serialize multiple streams

Using constant memory with MPI and streams

Trending Questions

Popular # Hahtags

Popular Questions