Not every software testing project can or should be automated. Before your department accepts a new test automation project, you should establish a process by which projects are reviewed and either accepted or rejected. This can be done with a simple Test Automation Acceptance Checklist.
Repeatable Test Cases with Static Data
The true cost benefit of test automation is achieved only when the same scripts are executed multiple times. The first execution is very expensive because it includes the one-time cost of the automation tools and 100% of the Test Automation engineer's time. When the scripts are executed again, the cost of test automation declines sharply. The tool has already been purchased and the scripts have already been coded. If there have been changes in the application, the scripts may require maintenance before being executed. Maintenance on minor software updates should be minimal.
Because test automation is only successful when the scripts can be executed multiple times, only application which require the same test cases to be executed with the same data are good candidates for automation. For example, a mortgage application that needs to be regression tested on a weekly basis could be a good candidate for test automation. Script maintenance is minimal and the scripts can enter a mortgage application using the same group of test data in a fraction of the time it would take a manual tester to test the same functionality.
On the other hand, a mortgage origination system, which cannot use the same test data for each iteration would not be a good automation candidate. Due to the nature of mortgage systems, data could be staged in various states of approval or rejection, based on the current data and the departments who have already processed their part of the mortgage application. If the script cannot easily figure out what data to enter in the software, it is not a good automation candidate.
Another problem with automating this type of complex system is that the test environment often contains a sampling of production data that is refreshed on a periodic basis. Sometimes this can be overcome by rebuilding the test data when the test environment is refreshed. The feasibility of rebuilding test data on a regular basis depends on the complexity of the application. You will have to make that decision on a case-by-case basis.
Application or Environmental Stability
Environmental stability is crucial to a successfully automating a software testing project. Scripts cannot be coded in a timely manner if the application environment is unavailable, experiences frequent down-times, or excessive defects and errors.
Little or No Application or Environment Downtime
It takes longer to write scripts than it does to manually test the same functionality. Most automation tools are watered down version of C or Visual Basic, which means that writing automated scripts is essentially programming and takes adequate time and specialized skills. Unlike manual test cases, which can sometimes be written based off requirements and mock-ups, automated tools require the actual application. When a test environment is unavailable, automation engineers cannot create scripts, which prolongs the project and ends up costing more.
Excessive downtime can consist of any of the following:
Unstable Environment
Lack of Infrastructure Support
Frequent Application Updates
Buggy Code
Effects of Environment Instability on Script Development and Execution
When an application or environment is unstable, scripting progress is dramatically slowed or stopped altogether. In some cases, it's possible to continue scripting, but this may causes more work at a later date. For example, if you are scripting in buggy code, you may have to script around error messages and the scripts will have to be revised at a later date. Or, you may only be able to create scripts to a certain point and finish them at a later date. To help avoid and decrease environment instability, read the chapter on Service Level Agreements.
Timely Defect Fixes
Application defects do not have to be detrimental to an automated software testing project. When defects are fixed in a timely manner, scripting can continue without significant downtime. When estimating an automated testing project, it's always best to add some buffer time that will accommodate for defect reporting and revisions.
When defect fixes take an excessive amount of time to resolve and are causing the automated software testing project to be delayed, it's time to pull together a meeting. Invite all the major players and discuss the root of the problem and what everyone can to improve the situation. Maybe development is spending too much time trying to reproduce the problem and having your automation team enter better description would help them turn the defect fixes around faster. Maybe you can work together to classify defects and establish reasonable fix times for each classification. For example, a Critical defect needs to be fixed that day while a High defect needs to be fixed with in 24 hours.
Responsive Contact Person
When your team takes on a new automated testing project, you will need a contact person. This person is responsible for making sure you have the business requirements and answering questions about how the application works. This will not be his or her main job, so you will need to make sure he or she is responsive. If you cannot get adequate business requirements, test data, or questions answered, your automation project will not be successful.
Copyright 2004. Danna Henderson. All Rights Reserved.
Danna Henderson has helped many organizations automate their software testing with WinRunner. For information on creating robust, data driven scripts, and successful automated testing, visit WinRunner Experts.
Beginning with Domino version R4 it has integration with the... Read More
Microsoft Business Solutions Great Plains and MS CRM (client relation... Read More
Microsoft Business Solutions Great Plains, former Great Plains Software Dynamics/eEnterprise... Read More
What is RAID RECOVERY?RAID stands for Redundant Array of Inexpensive... Read More
Microsoft CRM is now on the scene and it is... Read More
As Mozilla Firefox nears 10% market share, with well over... Read More
Spyware and malware are large problems for Internet users today... Read More
As you probably know, when Microsoft purchased Great Plains Software... Read More
When you need a phone number, you do a quick... Read More
Microsoft Business Solutions ? Great Plains has captured the US... Read More
Are you ready? SQL Server 2005, the next-generation data management... Read More
Microsoft Business Solutions CRM is present several years on the... Read More
Microsoft Business Solutions Great Plains, Solomon, Navision, Axapta, Microsoft CRM... Read More
Almost all new and major brand of PCs come with... Read More
Great Plains Software Dynamics, Dynamics C/S+, eEnterprise were written on... Read More
I have yet to see a business that, sometimes in... Read More
When my daughter was getting into AOL instant messaging (AIM)... Read More
C/SIDE (Client/Server Integrated Development Environment) - The core of... Read More
Homeland security, airport security, Internet security â?" these days weâ??re... Read More
If you would like to pick something from Microsoft, or... Read More
Microsoft Business Solutions Great Plains has Project Accounting module where... Read More
Bar charts, bar graphs, and any other chart or graph... Read More
Microsoft Business Solutions Great Plains, former Great Plains Software Dynamics... Read More
Microsoft Business Solutions Great Plains, former Great Plains Software eEnterprise,... Read More
Follow the steps below to quickly design, generate, and deploy... Read More
Microsoft CRM is CRM answer from Microsoft Business Solutions. If... Read More
Every organization which creates collaborative documents, whether they are budgets,... Read More
I completed an experiment recently. I wanted to find out... Read More
Is your PC is slow and wimpy? Then you need... Read More
Usually, the easiest way to tell you have spyware is... Read More
Pirated software is on the increase and now accounts for... Read More
Ad-Aware and Spybot are probably the two most well known... Read More
As seeing large number of implementations ? in our case... Read More
Microsoft Great Plains as ERP and Microsoft CRM as... Read More
Several software companies design programs for preventive maintenance. Most of... Read More
ERP is the acronym of Enterprise Resource Planning. Multi-module ERP... Read More
Customer Relationship Management (CRM) is a strategy and processes used... Read More
In linux, one of great commands for finding out information... Read More
Domino server is a buffer between the operation system and... Read More
Collaboration SoftwareCollaboration Software, also known as group collaboration software or... Read More
The vast majority of us will have, at some point,... Read More
How do you run a program on a remote server... Read More
Document Management or Enterprise Information Management is perhaps one of... Read More
Microsoft Business Solutions CRM is present several years on the... Read More
Just imagine: you are walking, say, towards your car, and... Read More
Now is the time to look at an alternative to... Read More
If you are in the market for new staffing software,... Read More
Microsoft Business Solutions Great Plains fits to majority of horizontal... Read More
This article will not attempt to advocate the use of... Read More
Microsoft Business Solutions Navision is main ERP application for European,... Read More
Microsoft Business Solutions Great Plains is very popular ERP platform... Read More
I like my software simple. If it's too complex or... Read More
Microsoft Great Plains ? ERM from Microsoft Business Solutions and... Read More
Looking at all the ads which promise to get rid... Read More
We would like first emphasize the change in the paradigm.... Read More
Enabling Chinese input is quick and easy, there are only... Read More
Not every software testing project can or should be automated.... Read More
Disclaimer: All the thoughts expressed are my views only! Your... Read More
Google Inc. has launched a new software package that allows... Read More
I love new technology. I am still ready to wait... Read More
MicroWorld Technologies, Inc. the leading solutions provider in the area... Read More
It won't matter how effective your WinRunner Team is if... Read More
Microsoft Business Solutions Great Plains has I'd say end user... Read More
As seeing large number of implementations ? in our case... Read More
With so many Microsoft Windows related viruses, errors, and other... Read More
The most important things you can do for your computer... Read More
Software |