Continuous & Automated Testing
Continuous testing is the process of executing automated tests as part of the software delivery pipeline to obtain immediate feedback on the business risks associated with a software release. Given below are some typical real-world scenarios where Continuous Testing could have saved the day.
Alice owns a bookstore downtown. To manage a busy lifestyle, Alice embraces ecommerce. On a typical day, she uses an online service to book a cab ride to work. Enroute, she orders groceries online and pays for it through a digital wallet. She plans her holidays by researching airfares and hotels. If she experiences an unreliable, slow or hard-to-use site, she quickly abandons it and takes her business elsewhere. She also uses social networking to tell her story to others!
With year-over-year double-digit growth in ecommerce, no company can afford alienating millions of Alice-style shoppers. Yet, this is a frequent phenomenon during busy shopping seasons when a retailer has the most to lose. For example, on Black Friday 2014, a traffic surge took down the website of the world’s largest consumer electronics company. The crash caused bad publicity on social media sites, lost sales and a drop in share value.
Setbacks like these can be avoided with continuous testing, functional testing and automated testing methods. In fact, winning the loyalty of people like Alice requires new and efficient testing approaches that evaluate:
- User experience: Does the interface offer a fast and faultless experience across multiple browsers and platforms? Do customers receive useful and timely reminders?
- Security: Is the payment process convenient, secure and compliant?
- Function: Do all the functions work, such as hotel suggestions for the traveler prior to signoff?
- Automation: Is automation working to ease the purchase decision, such as simple price comparisons or deals lists?
- Analytics: Are pop-ups driven by a user’s search behavior?
Continuous Testing - The value of outside-in testing
Developing an outside-in approach to QA testing improves quality, cost and agile development. The QA organization not only engages in testing but helps define an enterprise portfolio strategy. This new testing approach can help you achieve:
- Validation for all your business objectives.
- Live performance metrics for online channels.
- Up to 95% automation in test portfolios.
- The agility of in-sprint regression testing.
- Up to 20% reduction in cycle time using risk-based and catalog-based testing models.
- Pay-per-defect pricing that achieves more than 97% defect removal efficiency (DRE).
Automation and upgrade of a multi country rollout testing, accelerated by Mindtree
The customer, one of the largest ICT service providers needed a SAP test automation solution. With worldwide revenues of 2.2 billion...