How do I mark my Jenkins build status based on cucumber scenarios pass percentage?

28 Views Asked by At

I'm trying to mark Jenkins build status as failed if more than 10% of the cucumber scenarios have failed. if 90% has passed the build should be success.

I have referred to the cucumber reports documentations https://www.jenkins.io/doc/pipeline/steps/cucumber-reports/ https://plugins.jenkins.io/cucumber-reports/ and have set

failedScenariosPercentage : 10

but the build is marked as failed even if 1 scenario has failed.

weirdly in console I see it is logged that

Found 0.496278 failed steps, while expected not more than 0.000000 present. Build status left unchanged.

I haven't set any checks on test steps. The pipeline steps are as follows

 post {
        always {
            cucumber failedFeaturesNumber: -1,
            failedScenariosNumber: -1,
            skippedStepsNumber: -1,
            failedStepsNumber: -1,
            pendingStepsNumber:-1,
            undefinedStepsNumber: -1,
            fileIncludePattern: '**/*cucumber-report.json',
            sortingMethod: 'ALPHABETICAL',
            failedScenariosPercentage:10
        }
    }

Can someone tell me if I'm doing something wrong here?

0

There are 0 best solutions below