Automated Testing Interview Preparation Guide

Download PDF

Table-Driven testing, also known as keyword or action driven testing uses a specified methodology for testing. The methodology divides the testing in two stages,

Planning stage: In this stage, the requirements of the application are analyzed. Thereafter the operations that need to be performed on the objects are planned. Here, the testers write the test cases based on keywords.

E.g. identifying all text fileds in the application accepting Mobile numbers. Here the keyword can be Entering Mobile number.

Implementing stage: Here the test cases are executed based on keywords mentioned above.

Load testing is done to know how well can a system handle and respond when subjected to load. It can be done by either moderately loading the system for a long time or heavily loading the system for a short time. In either approaches intention is to check the limitations of the system.

E.g. exceeding the number of users on the web, Memory management testing: i.e. uploading many pictures

I would consider the following points to help me decide if a test should be automated:

How often does the test need to be executed? i.e. is that going to be a regression test? Sometimes the test will need to be executed once, but with a large set of data
How much time does automating this test will save me so that I can use my time in exploratory testing
How important is the test to the business; i.e. is the test scenario a typical user journey through the application
How complex is it to automate the test and how likely is it that the complexity doesn’t cause many false positives which increases results analysis time?
How likely is it that this test catches a defect?
How likely is it that a feature or functionality will break and what is the impact of it to the business? If it is high impact, then it should be automated to ensure it passes from release to release

This interview question is similar to previous question but focuses on which tests Not to be automated and left for manual testing. Possible answers can be:

Usability Testing – at times this can be an impossible task to perform by automation as the computer cannot efficiently judge if the system is of any use to its users
Tests that only need to be executed once – unless the same test needs to be executed for a large dataset then it makes sense to automate
Tests without predictable results – test automation should give us confidence in the results of the tests. If there are intermittent failures then the tests cannot be reliable and cannot be dependent on
Tests that need to be verified visually
Tests that need to be executed quickly. At first, writing an automated test takes longer. If we want a quick check, we should test manually, however, if that test is a good one which should be run regularly, then it should be automated in time

Pros

UI automated tests execute in a way that simulates user interacting with the system. So it is very good for validating user journeys and flows
Can cover end-to-end flows that communicate with 3rd party systems
Because tests are run against the system, they can be demoed to the customer who can understand what tests are run
Can catch high severity or show stopper bugs
Can check UI functionality where it is not possible to test otherwise

Cons

UI automated tests can be very brittle (i.e. fail due to UI changes even though functionality hasn’t changed)
Slow feedback to the team. Execution is slow as you have to wait for the system to launch and connections with 3rd party system can take a long time
Limitation on what can be checked from the UI. There are some information that are not present from the UI
Because tests are slow from UI, we can’t have a lot of tests running against the UI
Can be time consuming to construct automated test scripts for the UI
Usually have to depend on a 3rd party tool or vendor for UI testing

“WinRunner handles automation test scripts
TestDirector manages test scripts, defects and test plan”

“Test Script Language, TSL C++”

Oracle, Access, Sybase, MsSQL

Web_****

Data is written multiple times, while WinRunner has a repeated loop to process the data.