2015 Blogs, Blog

Continuous testing in DevOps paradigm, people, process & tools

DevOps –It’s All About Continuous Testing and monitoring the feedback loop from dev to testing to production. Is has become aparent that the benefits of having a Continuous Testing cycle helps improvise the quality & TAT while your business solutions are in production.


Following are few points to consider to achieve seamless & stable continuous testing process.



 



  • DevOps QA Is About Preventing Defects, Not Finding Them

  • QA owns continuous improvement and quality tracking

  • Tests are code

  • Automation rules

  • Testers are the quality advocates

  • Mature automation testing framework

  • Changed Role of QA in DevOps

  • Traditional build which is deployed on their designated environment and QA would then commence their functional & regression testing.

  • QA align their efforts in the DevOps cycle

  • All their test cases are automated and achieve near 100% code coverage

  • QA Environments are standardized and deployment on their QA boxes is automated

  • All their pre-testing tasks, cleanups, post-testing tasks, etc. are automated and aligned with the Continuous Integration cycle.

  • QA Engineers can configure their automation test cases into the DevOps chain

  • Beyond Functional Testing: Automation for Load Testing, Stress Testing, and Performance Testing


Continuous testing and Job Automation



  • Continuous Integration and Continuous Delivery facilitate Continuous Testing

  • Customized Test Suites and Test Pipeline with Promotion Gates

  • Multiple Stacks, Multiple Suites, Test Data, Test Results Aggregation

  • Integrated Diagnostics and simple auto-remediation

  • All test data aggregated and reporting + trending enabled

  • All the environments required for testing need to be standardized and deployments have to be automated

  • Using various automation techniques, QA should be able to fire automation testing runs across various cross-platform (and cross-browser in case of web applications) environments.


Application Monitoring



  • Setting up specialized counters like response times, memory & CPU utilization, etc. can provide a lot of insight into the end-user experience.

  • End User Experience Monitoring

  • Performance Testing and Diagnostics Framework

Author


Avatar