I'm running pytest on a server with 64 cores, and I'm currently using 16 threads with pytest. I could probably use a lot more without need for the cores to context switch, but I'm wondering if there's a downside to using more threads?
Is there a downside to using too many threads with pytest-xdist?
103 Views Asked by roulette01 At
0
There are 0 best solutions below
Related Questions in MULTITHREADING
- How can I outsource worker processes within a for loop?
- OpenMP & oneTbb difference
- Receiving Notifications for Individual Task Completion OmniThreadLibrary Parallel.ForEach
- C++ error: no matching member function for call to 'enqueue' futures.emplace_back(TP.enqueue(sum_plus_one, x, &M));
- How can I create a thread in Haskell that will restart if it gets killed due to any reason?
- Qt: running callback in the main thread from the worker thread
- Using `static` on a AVX2 counter function increases performance ~10x in MT environment without any change in Compiler optimizations
- Heap sort with multithreading
- windows multithreading CreateMutex
- The problem of "fine-grained locks and two-phase locking algorithm"
- OpenMP multi-threading not working if OpenMPI set to use one or two MPI processor
- WPF Windows Initializing is locking the separated thread in .Net 8
- TCP Client Losing Connection When Writing Data
- vc++ thread constructor throwing compiler error c2672
- ASP.NET Core 6 Web API : best way to pause before resending email
Related Questions in PARALLEL-PROCESSING
- How to calculate Matrix exponential with Tailor series PARALLEL using MPI c++
- Efficiently processing many small elements of a collection concurrently in Java
- Parallelize filling of Eigen Matrix in C++
- Memory efficient parallel repeated rarefaction with subsequent matrix addition of large data set
- How to publish messages to RabbitMQ by using Multi threading?
- Running a C++ Program with CMake, MPI and OpenCV
- Alternative approach to io.ReadAll to store memory consumption and send a PUT Request with valid data
- Parallelize nested loop with running sum in Fortran
- Can I use parfor within a parfeval in Matlab R2019b and if yes how?
- Parallel testing with cucumber, selenium and junit 5
- Parallel.ForEach vs ActionBlock
- Passing variable to foreach-object -parallel which is with in start-job
- dbatools SQL Functions Not Running In Parallel While SQL Server queries do in Powershell
- How do I run multiple instances of my Powershell function in parallel?
- Joblib.parallel vs concurrent.futures
Related Questions in PYTEST
- What's the best way to breakup a large test in pytest
- Alternatives to pytest-watch on python unit test with pytest
- Flask Application Testing with pytest Returns 404 for Routes
- pytest mock failing when mocking function from imported package
- Difficult to run pytest with a fastAPI and ODM beanie, I get the error: beanie.exceptions.CollectionWasNotInitialized
- How to create an improperly closed gzip file using python?
- how to mock default_factory in pydantic model
- How to write pytest tests for a FastAPI route involving dependency injection with Pydantic models using Annotated and Depends?
- Issue with pytest-bdd execution after python and pytest-bdd version upgrade
- Pytest: When writing many assert statements in the same test function, some of it fails, but how to know which assert statement/s is causing failure?
- How can I tell pytest that for a function it is the correct behaviour (and only the correct behaviour) to have a failed assertion?
- Pytest mocking SQLalchmey
- Pytest PropertyMock not returning different attribute values
- Sporadic Windows fatal error on Github Python CI (may be joblib related)
- Pytest: in memory data doesn't persist through fixture
Related Questions in CONTEXT-SWITCH
- How is cpu's state saved by os without altering it?
- Why doesn't this pop instruction restore the register values?
- what's the exact performance cost of context switch within the same thread? (memory access -> page fault -> memory access again)
- Change Shipping method will throw out exception in Shopware6, although id exists in database
- Can a context switch between threads of the same process occure during signal handling?
- Difference in overhead of a mode switch vs intra-process context switch on Linux
- Linux vhost kvm exit upon guest sending a packet
- Too much context switches - how to be sure that it is actual problem?
- Is there a downside to using too many threads with pytest-xdist?
- Measure the performance impact of context switching within a executable binary
- How do real schedulers involved processes and threads work?
- From an fxsave dump, how to determine whether in x87 or MMX mode?
- RTOS on ARM microcontroller: why do we save the state of registers R4-R11 upon context switching
- ARM64 SVE registers not preserved when issuing a syscall, why does Linux discard SVE registers with sve_user_discard()?
- switch loses its state while scrolling even after getting saved
Related Questions in PYTEST-XDIST
- pytest, xdist, and sharing generated file dependencies
- pytest-xdist ssh: Pseudo-terminal will not be allocated because stdin is not a terminal
- pytest-xdistis failing when two tests read same file
- pytest-xdist fails to collect tests after identifying workers
- Pytest-allure filter by hosts
- Pytest parallel can I run test after all parallel finished?
- Pytest-xdist 3.40 and higher not honoring --exitfirst
- Set tests order while running tests in parallel
- Is there a downside to using too many threads with pytest-xdist?
- examples are not appearing in the feature object and scenario object of pytest-bdd
- Pytest-xdist cannot run after being packaged with pyinstaller
- A test fixture lock for downloading and writing data with pytest-xdist
- When using pytest-html with pytest-xdist plugin ,the report generated does not show screenshot for failed test case
- pytest xdist: different number of tests fail depending on number of workers
- Running a test using pytest-xdist is opening several tabs
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular # Hahtags
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?