Automated Testing Software Information

Epic Systems Corporation

 

 

Product Specifications

 

  1. What operating systems can the program support?
    1. Can it run on multiple operating systems across a network?
  2. Describe the recommended system for running the program (Processor speed, RAM, etc).

 

 

Purchasing Information

 

  1. What licenses are available?
    1. Can floating licenses be purchased?
  2. What is the cost of each license?
    1. Is there a volume discount?
  3. What options are available for evaluating the program?
    1. Is a demo available for download?
    2. Is an online demo available?
    3. Is a trial license available?  If so, what are the terms?
    4. Is the vendor willing to do on-site demos?
  4. Are there companies that can be contacted as references?

 

 

Developing Scripts

 

  1. Describe the program’s record and playback features.
    1. Can recorded scripts be edited?
  2. Describe the language(s) used to record or to write testing scripts.
    1. If not in VB or C++, can it use scripts written in these languages?
    2. What level of programming experience is recommended for users?
  3. Describe what the program does to facilitate script construction by testers not trained as programmers.

 

Managing Scripts

 

  1. Describe how the program handles changes in the GUI interface from version to version.
    1. Does the program allow object mapping to an abstract layer?
  2. Describe how the script library is managed at an enterprise level.

 

Program Architecture

 

  1. Describe how the program identifies GUI objects.
  2. Describe how custom controls are handled.
    1. Is there a way to map custom controls?
    2. Can custom functions be developed by the vendor to recognize custom controls?  If so, what is the average cost for this development?
  3. Can an abstract layer be created between the test script and the program under test to allow for mapping of GUI objects?
  4. Can the program create or use DLLs?
  5. Can the program use APIs?

 

 

Functionality

 

  1. Describe how the program tests client-server applications.
  2. Does the program allow for information to be read from text files, databases or spreadsheets?  If so, which formats are recommended (such as MS Access)?
  3. Does the program allow for information/test results to be written to text files, databases or spreadsheets?  If so, which formats are recommended?
  4. Can the program identify memory leaks?
  5. Describe how reporting is handled.
    1. Is there a report-writer for handling test results?
    2. Can it provide summary reports of the test cases run?
    3. What format are the reports provided in (graphical, text)?
  6. Describe how test documentation is handled.
    1. What method (if any) do you use to document the relationship between a specific test script, the test case it addresses, and the requirements it satisfies?

 

Load/Benchmark Testing

 

  1. Is performance testing integrated with the program?
  2. Describe how it simulates multiple users.
    1. To simulate multiple users, does it require the use of multiple physical workstations?
  3. Does the program support resource monitoring?
  4. Does the program measure client-server response times?

 

Interfacing/Other Programs

  1. Does the program allow for testing in Citrix?
  2. Describe how it interacts with Oracle, SQL and other DB programs.
  3. Has the program ever been used with VMWare (virtual machines)? – www.vmware.com
    1. If so, please describe.

 

Integration

 

  1. Describe how the test scripts can integrate with code written in Visual Basic, both from testing and programming aspects.
  2. Does this program require other programs to make use of all of it’s functionality, or is it a stand-alone program?
  3. Does this program allow integration with other testing programs?

 

Support

 

  1. Describe the support that is offered once the product is purchased.
    1. Is there technical support available?
    2. If there is maintenance, what technical support is included?
  2. Describe the training that is available.
    1. Is the training conducted on-site or at the vendor?
    2. Is training available on-line?
  3. Is there a User Group meeting or forums for current users?  If so, please describe.

 

Other Information

 

  1. What is the current version of the product?
    1. What enhancements are planned for future versions?
  2. Please describe how other companies have implemented the program.
  3. Describe how the program itself is tested.