For example I have 5 control tasks and 100 tasks and have mixing settings 4 task and 1 control. What happens when the worker (aka toloker) just seen the last one, while there are still more potential task suites to work on?
What if I have less control tasks than I need to mix all suites for workers in toloka
48 Views Asked by katoquro At
1
There are 1 best solutions below
Related Questions in CROWDSOURCING
- Crowdsourcing data collection through online tables or spreadsheets
- Collecting crowd-sourced data in tabular or spreadsheet format
- What if I have less control tasks than I need to mix all suites for workers in toloka
- "Recent values to use" in Toloka quality control
- Setup sandbox environment in Toloka
- Where to create External Question on Mechanical Turk
- MTurk external Survey Link. Add Worker-ID to URL
- How to edit manifest when specifying multiple sources for one task with AWS Sagemaker ground truth
- Multiple issues trying to install PyBOSSA
- CrowdFlower Markup Language: selecting one of the two images by clicking
- Calculate the dependency standard deviation in R
- Exporting Pybossa results to Scifabric Enki in real time
- How do I see the contract log events in Ethereum?
- How to secure Pybossa completely?
- Architecture of crowdsourcing app for real time process
Related Questions in TOLOKA
- How are Toloka task pages created
- How to archive a pool?
- Missing pools in Toloka
- Tasks for mobile devices on Toloka
- The right way to assign tasks
- Difference between overlap for the pool and for the tasks
- Task availability to certain groups of performers
- How can I use training in a project for selecting objects in images?
- Array of strings as an input
- Option with text for a drop-down text box in Toloka
- What if I have less control tasks than I need to mix all suites for workers in toloka
- Submitting data in the review mode
- How do I set up how often control tasks are shown to a toloker?
- Adding buttons to the interface
- Defining own skip and submit button
Trending Questions
- UIImageView Frame Doesn't Reflect Constraints
- Is it possible to use adb commands to click on a view by finding its ID?
- How to create a new web character symbol recognizable by html/javascript?
- Why isn't my CSS3 animation smooth in Google Chrome (but very smooth on other browsers)?
- Heap Gives Page Fault
- Connect ffmpeg to Visual Studio 2008
- Both Object- and ValueAnimator jumps when Duration is set above API LvL 24
- How to avoid default initialization of objects in std::vector?
- second argument of the command line arguments in a format other than char** argv or char* argv[]
- How to improve efficiency of algorithm which generates next lexicographic permutation?
- Navigating to the another actvity app getting crash in android
- How to read the particular message format in android and store in sqlite database?
- Resetting inventory status after order is cancelled
- Efficiently compute powers of X in SSE/AVX
- Insert into an external database using ajax and php : POST 500 (Internal Server Error)
Popular # Hahtags
Popular Questions
- How do I undo the most recent local commits in Git?
- How can I remove a specific item from an array in JavaScript?
- How do I delete a Git branch locally and remotely?
- Find all files containing a specific text (string) on Linux?
- How do I revert a Git repository to a previous commit?
- How do I create an HTML button that acts like a link?
- How do I check out a remote Git branch?
- How do I force "git pull" to overwrite local files?
- How do I list all files of a directory?
- How to check whether a string contains a substring in JavaScript?
- How do I redirect to another webpage?
- How can I iterate over rows in a Pandas DataFrame?
- How do I convert a String to an int in Java?
- Does Python have a string 'contains' substring method?
- How do I check if a string contains a specific word?
The worker be kicked out of the "pool" !So only 5 task for every worker!
If the worker has seen all of the control tasks in the pool, he will not be able to complete any more of the task suits and will be notified that the tasks are finished. However, if you create a separate pool with the exact same control tasks, the system will consider those as new control tasks and can show them to the same tolokers (But it could affect quality) I suggest create more control tasks from verified answers from prev runs