When reviewing the results of a playback (either when it has finished or during its execution) it is important to understand the various possible statuses of the individual scripts (and script steps) being played back.
These statuses can be most easily seen once a playback has finished under Results —> Playback Overview —> Script View tab. The columns “Status” and “Result” show the success or otherwise of the scripts in the playback.
Before diving into the detail of the different statuses and execution results in the following sections, it is worth explaining the difference between a Status and a Result, as this often causes some confusion.
The status of a script is the final technical status after playback. It tells you information on whether, and how far, the script was able to be executed (or was chosen to be executed) during the playback. The following statuses are possible.
- Complete: All steps of the script were executed
- Partially complete: One or more (but not all) steps of the script were executed
- Error: A technical error occurred which prevented one of the script steps from being executed
- Cancelled: Testimony decided not to run this script
- Suppressed: One of the steps in the script failed, but the error was suppressed through configuration
- Not processed: The script was not executed, nor was it attempted to be executed
There are only three possible results for a script:
- Passed: All steps of the script were executed, and the outputs from the playback matched the outputs from the recording
- Failed: One of the steps in the script had a different output in the playback than it did in the recording
- No result: The status of the script meant that no result could be determined
Mapping statuses to results
Some statuses can have only one possible result, whilst others can have more than one. The following table maps the possible status & result combinations.
The different statuses and execution results are discussed in the following sections.