|
Summary
The table below oulines the criteria for estimating eValid effectiveness
on a range of different web applications.
The idea behind the level estimate is to estimate how easily eValid can
be used to create and run tests of an application that are
effective and reliable.
Operational | Level | Summary | What This Means... | Notes |
100% automatic record and play. | A+ | Records and plays accurately using "out of the box" settings. | eValid runs normally. | 1 |
A | Records and plays accurately with some "out of the box" settings changed. | eValid runs normally, after minor adjustments. | 2 | |
100% GUI-based record and play. | B+ | Records and plays reliably using non-standard settings and/or special recording protocol. | Scripts need to be recorded using special combinations of commands, e.g. F11 or Alt+F11 or Ctrl+F11. | 3, 4, 5, 7 |
B | Records and plays reliably using non-standard settings and/or special recording protocol, but with no substantive manual edits to the script. | Scripts may need special commands to work reliably, e.g. AJAX synchronization. | 4, 5, 6, 7 | |
Manual intervention needed to achieve reliable playback. | C+ | Records and plays reliably using non-standard settings and/or with manual adjustments/edits to the script. May need application mode. | May require careful study of the underlying web application to determine correct extra commands. | 8, 9 |
C | Records and plays reliably with manual adjustments/edits to the script (e.g. delete NAV or add NAV/NO_NAV or comment out a command), but 100% reliable playback can always be accomplished. May need application mode or desktop window mode. | Recording is the basis for success, but is not reliable without manual assistance/modification. | 8, 9, 10 |
Hierarchy of Settings/Modes
There is a logical hierarchy in this table,
based on the increasing complexity of the eValid switches and options
that are needed for the particular kind of application.
Higher-scoring applications can be recorded reliably
and effectively with GUI-accessible functions.
In some cases it is necessary to manipulate the eValid script
manually based on properties of the application to achieve
100% reliable