Slide1: Management for Manual Software Testing www.aptest.com/atm2 Applied Testing and Technology


Overview: Overview Manages and tracks testing status and results Provides consistent, repeatable QA process WWW based Persistent information repository Integrated requirements management Extensive reporting Role-based security Highly flexible and customizable


QA Testing Challenges: QA Testing Challenges Process inconsistent and is not repeatable Personnel turnover loses knowledge Time consuming and difficult to monitor progress measure productivity assess quality share information


The ApTest Manager Solution: The ApTest Manager Solution Consistent, repeatable process Permanent information store Real time access to tests, results, status Geographically distributed users QA, customers, development, . . . Test method and tool neutral


ApTest Manager Benefits: ApTest Manager Benefits Higher product quality Better tests, better coverage, better process Find and fix bugs sooner in the development cycle Shorter projects at a lower cost Improved, measurable productivity


Manage Manual/Automated testing: Manage Manual/Automated testing Requirements Test Cases Manual Testing Reporting Test Results Automated Testing


Requirements Repository: Requirements Repository User defined tree of Folders As deep and wide as you want Folders contain Requirements and Files Requirements fields totally configurable. As many fields as you want: menu fields, text fields, date fields, tables, etc. Requirement names can be strings or automatically assigned numbers


Test Repository: Test Repository User defined tree of Folders As deep and wide as you want Folders contain Test Cases and Files Test Case fields totally configurable. As many fields as you want: menu fields, text fields, date fields, tables, etc. Test Case names can be strings or automatically assigned numbers


Link Requirements and Tests : Link Requirements and Tests Tests can be linked to Requirements in any relationship One-to-one, many-to-one, and one-to-many Tests can be automatically created and linked to Requirements


Execution: Execution Unlimited number of different groups of tests (Test Sets) Created by querying test characteristics: e.g. the tests for a particular version or feature. Each Test Set can be run as many times as you want, results stored separately for different test environments (Test Sessions)


Typical Project: Typical Project Reqs Tests Sets Sessions test subsets execution results . . . . . .


Customization: Customization Easily customized What fields make up a Test Case Name, Format, Default Value How a Test Case is displayed Editing, Executing, Reporting Session Variables Characterize test environment H/W-S/W Design your own ‘gold standard’ configuration


Reports: Reports On part or all of a project composed of different Sets and Sessions Status: %done, results, vs. schedule Coverage of test cases Productivity of users Compare Sessions On specific sessions Custom queries can be defined and saved


Integrates with Existing Tools: Integrates with Existing Tools


Test Repository: Test Repository Tree of folders of tests Create Edit Copy Rename Delete View


Test Editing: Test Editing Field Types Menus Text Areas Tables Field Styles WYSIWYG HTML Editor Text


Requirements Repository: Requirements Repository Tree of Reqs Create Edit Copy Rename Delete View


Repository Reports: Repository Reports Test Requirements Reports Test Specification Reports


Test Execution: Test Execution Run specific groups of Tests (Test Sets) Run them in specific Test Environments (Test Sessions)


Test Execution: Test Execution Any number of Test Sets (subset of Test Cases for different test cycles, product versions, etc.) Any number of Test Sessions, each recording the execution of a Test Set (in a different H/W-S/W environment). Test Cases only need be defined once, so easily maintained and evolved


Test Set: Test Set Group of Test Cases based on an ad hoc query of Test Case field values


Test Sets: Test Sets Queries select different groups of tests


Test Session: Test Session Results of running Test Cases for a Test Set Session Variables specify test environment


Test Sessions: Test Sessions Session Variables tag the session with info on where and how it was run. e.g. O.S., browser, hardware, product version, tester, . . . You can search for and report on Sessions based on a variety of criteria, including session variables, e.g. compare the results of all the Sessions run on Windows XP with Oracle.


Test Execution: Test Execution Tester is given Requirements Procedure Tester enters Test result Time spent (optional) Notes


Reports: Reports Are generated for one or more sessions Sessions can be selected with ad hoc queries


Status Report: Status Report Multiple sessions % Complete Time remaining Trends Result Details Links to per session reports


Users Report: Users Report Results Productivity Schedule analysis


Results Report: Results Report Test Case details and results


Regression Report: Regression Report Multiple Sessions Compares Results


Coverage Report: Coverage Report Coverage of Test Cases by Sessions Can create Test Sets of uncovered Test Cases


Configuration: Configuration Specify Test Case Fields and their formats


Configuration: Configuration Specify Test Results


Configuration: Configuration Specify how a Test Case is displayed for editing, execution, reports


Configuration: Configuration Specify Session Variables


Security: Security Password protected accounts Access controls per user by Test Suite


Security: Security Admin functions controlled by admin users


Email Notifications: Email Notifications Per User, Per Suite Multiple event triggers


Other Features: Other Features Integrates with third-party tools Bug tracking Source control Import and Export Test Cases and Requirements via CSV files (e.g. from Excel spreadsheets) Import of automated test results from test harnesses


Support & Maintenance: Support & Maintenance Multiple releases annually Bug fixes Enhancements Updated OS, browser and server compatibility


What’s Coming Up: What’s Coming Up ApTest Manager Automation Edition Adds Test Automation support Scripts can be associated with tests and executed over your network Results stored and reported with manual tests Separately priced add-on


System Requirements: System Requirements Windows, Linux, or MacOS Perl Web Server, e.g. Apache, IIS Server of moderate size (e.g. 2.8GHz P4) Server does not have to be dedicated


Licensing/Pricing: Licensing/Pricing Purchase and run on your server Per Seat floating licenses. Number of Seats limits number of logged in users.     #seats       $/seat       discount     1-5           $500        n/a     6-10         $475        5%     11-15       $450        10%     16-20       $425        15%     21-30       $400        20%     31-40       $375        25%     41-50       $350        30%     51+          call factory Can add more licenses at any time Support: $100/seat/year


Licensing/Pricing: Licensing/Pricing As a service, hosted on our servers For short term projects High up time, fast connections $45/user/month, $200 set up fee Support included


Performance: Performance ApTest QAs the product With Test Suites containing 30,000 tests With 100 concurrent users


What customers say: What customers say We love the use of your software, it's doing a lot to streamline our software development cycle. This is a great product. The support you offered has been magnificent, far better than I have seen from your competitors. I have been thoroughly impressed. AP Test Manager is a good product and I base this opinion on my 20 plus years in R&D, test management and testing. I've gotten good responses from the users - they really like the tool.