Megatest

Ticket Change Details
Login
Overview

Artifact ID: a8098329b6b5830c21926285014be19329301d54
Ticket: 4b072de97c2b80e392d5e7e182fdf6d2f1d8a1dc
provide means to specify desire to rerun a test/step N times on fail
User & Date: bjbarcla on 2015-10-05 17:19:39
Changes

  1. foundin changed to: "1.6024"
  2. icomment:
    Motivation: there exist tests which, due to brittleness, environment instability or cosmic rays, fail 1 in N times and pass (N-1) in N times.  It is not economical to make the test 100% reliable.
    
    Desired is a means to specify a test step may be rerun some specified # of times upon fail before reaching a final FAIL state.  This should be in the testconfig file
    
    Possible extension of testconfig [ezsteps] format  :
    
    [ezsteps]
    getoalibs getoalibs.sh
    oabuild[retry 3]   oabuild.csh
    cleanup   cleanup.sh
    
    In this example, the suffix on step "oabuild" is "retry 3" meaning an unsuccessful completion of any given iteration of this test will be retried 3 times until either success criteria are met or we have 3 unsuccessful runs in a row.
    
    The sample syntax above is not a hard requirement, it is just there to illustrate the desired level of control.
    
  3. login: "bjbarcla"
  4. mimetype: "text/x-fossil-plain"
  5. private_contact changed to: "463e166cbd557fda643f629dd4886619ce461689"
  6. severity changed to: "Important"
  7. status changed to: "Open"
  8. title changed to:
    provide means to specify desire to rerun a test/step N times on fail
    
  9. type changed to: "Feature_Request"