Automation Methodology
The phases of the automation testing lifecycle are:
Requirement Analysis
The test team will analyze the test automation requirements in detail in this phase. The detailed base lined scenarios are an input to this phase. The activities in this phase include:
- Identifying common functionality across scenarios (potential of reuse)
- Understanding baseline test data (do we need to have a baseline database that remains unchanged between multiple runs? How dependant is the scenarios on the baseline database?)
- Analyzing test data used by the scenarios (what needs to be parameterized in the scenarios, what values are used as constants, computed values, etc.)
- Identifying the right type of automation framework based on the client's requirements and the scenario analysis
Strategy Planning
The main objective of this phase is to organize, manage, and schedule the test automation effort. The plan is based on the test automation strategy. The plan identifies the tasks, the transactions/business scenarios to be automated and the contingency plans for the identified risks, the schedule, roles and responsibilities and the deliverables from the MindTree Testing Team. The infrastructure required to carry out the tests is identified.
Framework Design and Development
The identified automation framework is designed in detail in this phase. The scripting standards are defined and the framework is developed. If the client has an existing automation framework, MindTree will utilize the framework and understand the design and usage details of the framework.
Scenario Design and Scripting
The identified base lined scenarios are designed and scripted in this phase. Test data is also created for the scenarios and incorporated in the test data pool. The scenarios will be tested and compared against the results of the appropriate manual test scenario. The automated scenarios will also undergo peer review before they are presented to the client for final approval and base lining.
User Documentation
User documentation for the frameworks and scripts is created in this phase. The user documentation will target different kinds of users of the automation framework.
Reporting
Progress reporting will be done at intervals & mechanisms agreed upon by the client and MindTree. The reports will contain details on the progress of test automation activities, project metrics, defect statistics and issues faced if any. Status reports will be shared with all the stakeholders of the project.
Release and Sign-off
On MindTree delivering each set of automated scenarios successfully, the client will sign off all the deliverables of test automation (test automation plan, test scripts, test data pool, etc.).