Continuous testing in DevOps paradigm, people, process & tools
DevOps –It’s All About Continuous Testing and monitoring the feedback loop from dev to testing to production. Is has become aparent that the benefits of having a Continuous Testing cycle helps improvise the quality & TAT while your business solutions are in production.
Following are few points to consider to achieve seamless & stable continuous testing process.
- DevOps QA Is About Preventing Defects, Not Finding Them
- QA owns continuous improvement and quality tracking
- Tests are code
- Automation rules
- Testers are the quality advocates
- Mature automation testing framework
- Changed Role of QA in DevOps
- Traditional build which is deployed on their designated environment and QA would then commence their functional & regression testing.
- QA align their efforts in the DevOps cycle
- All their test cases are automated and achieve near 100% code coverage
- QA Environments are standardized and deployment on their QA boxes is automated
- All their pre-testing tasks, cleanups, post-testing tasks, etc. are automated and aligned with the Continuous Integration cycle.
- QA Engineers can configure their automation test cases into the DevOps chain
- Beyond Functional Testing: Automation for Load Testing, Stress Testing, and Performance Testing
Continuous testing and Job Automation
- Continuous Integration and Continuous Delivery facilitate Continuous Testing
- Customized Test Suites and Test Pipeline with Promotion Gates
- Multiple Stacks, Multiple Suites, Test Data, Test Results Aggregation
- Integrated Diagnostics and simple auto-remediation
- All test data aggregated and reporting + trending enabled
- All the environments required for testing need to be standardized and deployments have to be automated
- Using various automation techniques, QA should be able to fire automation testing runs across various cross-platform (and cross-browser in case of web applications) environments.
- Setting up specialized counters like response times, memory & CPU utilization, etc. can provide a lot of insight into the end-user experience.
- End User Experience Monitoring
- Performance Testing and Diagnostics Framework