Tool setup and configuration | No setup or configuration | Requires knowledge of required development environments and programming concepts | Several Days |
Test framework | Automatically generated. Users begin creating tests right away | Must be custom-built and then tested. Frameworks can take weeks or months to complete. | Several Weeks |
Browser support | Edge, Firefox, Chrome. Handles all web application components including dynamic tables | IE, Firefox , Chrome, Opera. Does not handle all web components, e.g. popup windows, dynamic tables | Varies based on complexity |
Non-browser based application support | Yes, including windows, dotNet, PowerBuilder, Terminals, Java and many others | No | Days to build (or search for and implement a third-party solution) |
Coding experience | None required | Yes. Requires experienced staff with skills to integrate the framework and code tests | Skillset is costly |
Software cost | License and annual | Free maintenance fee | |
Script generation time | Drag and drop accelerates | Scripting is time-consuming test development | Ongoing costs are high, easily take 4 or 5 times longer to develop tests |
Test maintenance | Abstraction and encapsulation results in high reuse and low maintenance | High, tests are difficult and costly to maintain | Ongoing costs are high, Easily take 4 or 5 times longer to maintain tests |
Test Execution Time | 30 to 40% faster than Selenium | Execution time is slow | Tests run 5x faster on AscentialTest |
Object recognition /repository | Powerful object recognition with a multitude of attributes used to identify objects. Built-in Repository. Dynamic objects recognized | Uses xPath, id, name and others, but not very effective. Repository not available. Dynamic objects are difficult to recognize reliably | Twice as long to define objects |
Image-based object recognition | Yes | Requires third-party tools and coding to implement | Days to build or search for and implement a third-party solution |
Test Data tables | Provides built-in data tables that automatically handles data types of any level of complexity | Requires use of external data tables | Days to search for and implement a third-party solution |
Startup and recovery | Built-in and customizable. | No. Must be called for each test. | No solution in Selenium, each test starts a new browser |
Drag & Drop UI | Yes, making test development quick and easy | No, uses a code editor | Scripting takes 2 or 3 times longer than drag & drop |
Distributed testing | Yes, single or multiple remote targets can be controlled | Possible, but requires skill-set and coding to configure | Days to build (or search for and implement a third-party solution) |
Scheduling tests | Built-in | A lot of code must be written to implement scheduling | Days to build (or search for and implement a third-party solution) |
Batch execution | Yes from Plan, Suite or Test Set | Yes, but knowledge required to run through Pom.xml | Days to build (or search for and implement a third-party solution) |
Image capture/compare | Yes, includes masking and tolerance | Requires third-party tools and a lot of code to implement | Days to build (or search for and implement a third-party solution) |
Integration with SVN | Built-in, including external non-AscentialTest files | A lot of custom code must be written for integration and management of files | Days to build (or search for and implement a third-party solution) |
Integration with JIRA | Built-in | A lot of custom code must be written for integration | Days to build (or search for and implement a third-party solution) |
Integration with Jenkins | Yes | Yes | |
Test reports | Standard and custom reports available for test results and metrics | No | Days to build (or search for and implement a third-party solution) |
Test management | Built-in | No | Days to build (or search for and implement a third-party solution) |
Dependence on access to target application | Tests can be developed using snapshots when target application is unavailable | Application must be available to develop tests | |
Software upgrades | Zeenyx provided installer | User must manually track upgrades for their IDE, webdrivers and any plug-ins being used | |