Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Visibility: Public
  • Change Control: Stable
  • Synopsis: A new option added to pbs_benchpress command to override default value of testcase failure threshold count while running testsuite
  • Details: While running testsuite, if PTL will run testsuite till testcase failure reaches <count>, once testcase failure count for the testsuite exceeds <count> then PTL will immediately stops execution of any remaining testcases from that testsuite with error message "Testcases failure for this testsuite count exceeded testcase failure threshold(<count>)" and PTL will move to next given testsuite. Default testcase failure threshold will be 10. <count> should integer while overriding default value for testcase failure threshold using this option, if <count> is not integer then PTL will bail out with error message "Invalid value provided for testcase failure threshold, please provide integer". <count>==0 will disable this threshold.

Interface: New option (--cumulative-tc-failure-threshold=<count>) in pbs_benchpress command

  • Visibility: Public
  • Change Control: Stable
  • Synopsis: A new option added to pbs_benchpress command to override default value of cumulative testcase failure threshold count while running tests
  • Details: While running tests, PTL will run tests , if till total testcase failure reaches <count>, once total testcase failure count exceeds <count> then PTL will immediately stops execution of any remaining tests with error message "Total testcases failure count exceeded cumulative testcase failure threshold (<count>)". Default cumulative testcase failure threshold will be 100. <count> should integer while overriding default value for cumulative testcase failure threshold using this option, if <count> is not integer then PTL will bail out with error message "Invalid value provided for cumulative-tc-failure-threshold, please provide integer". <count> should be greater or equal to 'tc-failure-threshold', if <count> is less than 'tc-failure-threshold' then PTL will bail out with error message "Value for cumulative-tc-failure-threshould should be greater or equal to 'tc-failure-threshold'". <count>==0 will disable this threshold.

Interface: New option (--max-postdata-threshold=<count>) in pbs_benchpress command

  • Visibility: Public
  • Change Control: Stable
  • Synopsis: A new option added to pbs_benchpress command to override default value of max post analysis data threshold count while running testsuite
  • Details: While running testsuite, if saving post analysis data is enabled and then PTL will save post analysis data for failure case till saved data count reaches <count> for the testsuite, once number of saved data count for the testsuite exceeds <count> then PTL will stops saving data for any further failure for that testsuite with error message "Total number of saved post analysis data for this testsuite is exceeded max postdata threshold (<count>)". Default max postdata threshold will be 10. <count> should integer while overriding default value for max postdata threshold using this option, if <count> is not integer then PTL will bail out with error message "Invalid value for max-postdata-threshold, please provide integer". <count> should be less or equal to 'tc-failure-threshold', if <count> is greater than 'tc-failure-threshold' then PTL will bail out with error message "Value for max-postdata-threshold should be less or equal to 'tc-failure-threshold'". <count> == 0 will disable this threshold.