The Limits of Regression Test Automation

Page 1

Title: The Limits of Regression Test Automation Summary: Regression testing has now become an essential part of the software testing life cycle as it helps in checking that the existing functionality of the software works as expected whenever the change is made to the software. Also with the advent of automation testing tools, it has become more easy and convenient for testers to run regression tests. But like every testing method or approach regression test automation also have some limitations which one needs to look upon before automating the regression test. Body: What is regression testing? Regression testing is a type of software testing that validates that any new code change is the software that does not affect the existing functionality of the software. In Regression testing already existing test cases are fully or partially executed to ensure that existing functionalities of the software are not affected and they work as expected even after frequent changes. Regression testing sometimes becomes tedious as testing the whole system again and again consumes time and fixing the defects requires efforts. Therefore testers use automation regression testing tools where pre-written test scripts are executed on code change with no human intervention to ensure that existing functionalities are working fine. Why should regression testing be automated? Regression tests are repeatable and need to be executed as soon as a change in code is made. With the help of automation tools, there is no need for QA teams to run these tests manually every time, thus helping testers by saving their time which they can use to focus more on the high-priority test. In manual regression tests, the outcome of the test depends heavily on the ability and expertise of the tester who is performing the test. But with help of automation tools tests become more reliable and less prone to errors as compared to manual regression testing. Automation regression testing provides increased test coverage as compared to manual regression testing. Increased number of sessions that run for an extended period, uninterrupted provides better test coverage as compared to manual regression tests. What are the limits of regression test automation? As every testing method has its own pros and cons and similarly automated regression test also has some cons or we can say limits which makes it difficult for some organizations to automated their regression tests. A false sense of quality – Automation regression test provides a false sense of quality as the automated test scripts will only look for those bugs for which it is programmed and hence some defects may be overlooked or remain unseen. Lack of accuracy – Automation regression test can sometimes fail due to various factors such as bugs or error while running long test scripts which can give a false sense of accuracy. Low chances of finding new defects – Automation regression test follows the same pre-defined path, sometimes with the same set of test data. Hence the chances of finding new defects are low as no new path is followed while testing. Test cases require maintenance – The more test cases we automate the more test cases we require to maintain which further consumes more time and effort. Also if test cases are written too loosely they get passed in an automation test


Turn static files into dynamic content formats.

Create a flipbook
Issuu converts static files into: digital portfolios, online yearbooks, online catalogs, digital photo albums and more. Sign up and create your flipbook.