CS-4349 – Software Testing and
Implementation
Chapter 6: Tools Support for Testing
Tool Support for Testing
1- Tools that support the management of
testing
- Test management tool
- Requirement management tool
- Incident management tool
2- Tools that support static testing
3- Tools that support test
specification
- Test design tool
4- Tools that support test execution and
logging
- Test execution tool
- Test comparator
5- Tools that support performance and
monitoring
- Dynamic analysis tool
- Performance testing, load testing, stress
testing
Test Tool Classification
1. Tool support is very useful for repetition and complex tasks.
-
Computer doesn’t get bored and tired to
repeat.
-
Tool will be fast, accurate, efficient and
reliable.
2. Tools are grouped by the testing activities e.g. tools to support
static testing, tools to support dynamic testing, tools to support
code coverage.
3. Tools perform a very limited and specific functions are called
point solution.
Test Tool Classification
Probe Effect
Test Tool Classification
In the description of the tools below we will discuss:
1.Tools which are most likely to be used in component testing and
integration testing.
10
Tool Support for Management of Testing
Tools of Management of Testing
Test Management Tool
Requirements Management Tool
Incident
Management Tool
11
Tool Support for Management of Testing
Test Management
The planning, estimating, monitoring and control of test activities, typically carried out be the test manager.
Test Management Tool
12
Tool Support for Management of Testing
Characteristics of Test Management Tools
Management of tests
1.Keeping track of the data associated for a given set of tests. 2.Knowing which test need to run.
3.Number of test planned
4.Number of test written, run, passed, failed.
Scheduling of tests to be executed
1.Manually or by test execution tools
Management of testing activities
1.Time spent in test design, test execution 2.Whether we are on schedule or on budget
Traceability of tests, test results and defects to requirements Preparing progress report
1.Tests run and passed
13
Tool Support for Management of Testing
Tools of Management of Testing
Test Management Tool
Requirements Management Tool
Incident
Management Tool
14
Tool Support for Management of Testing
Test Management
The planning, estimating, monitoring and control of test activities, typically carried out be the test manager.
Test Management Tool
15
Tool Support for Management of Testing
Characteristics of Test Management Tools
Management of tests
1.Keeping track of the data associated for a given set of tests. 2.Knowing which test need to run.
3.Number of test planned
4.Number of test written, run, passed, failed.
Scheduling of tests to be executed
1.Manually or by test execution tools
Management of testing activities
1.Time spent in test design, test execution 2.Whether we are on schedule or on budget
Traceability of tests, test results and defects to requirements Preparing progress report
1.Tests run and passed
16
Tool Support for Management of Testing
Requirement Management Tools
A tool that supports the recording of requirements.
Characteristics
1.Storing requirement statements
2.Storing information about requirement attributes
3.Checking consistency of requirements
4.Identifying undefined, missing or to be defined later
requirements.
17
Tool Support for Management of Testing
Incident Management OR Defect Management Tool
OR Bug Tracking Tool OR Defect Tracking Tool
A tool that supports the recording and status of defects
Characteristics
1.Storing information about the attributes of defects 2.Prioritizing defects
3.Assigning actions to people e.g. fix, confirmation test 4.Status e.g. open close, reject, fix, duplicate
18
Tool Support for Management of Testing
Configuration Management Tools
A tool that provides support for the identification of configuration items e.g. their status over change and version.
Characteristics
1.Storing information about the versions
2.Traceability between software and different versions
19
Tool Support for Management of Testing
Static Testing Tool
20
Tool Support for Static Testing
Review Process Support Tool
1.Informal review is one, where one person looks at another’s documents and gives a few comments about it.
2.Formal review is one, when many people are involved or when the people involved are in different geographical location, then tool support becomes more beneficial.
3.It is possible to keep track of all the information for a review process using spreadsheet and text document, but a review tool will more likely to do a better job.
21
Tool Support for Static Testing
Characteristics
1. Storing review comments
2. Sorting review comments
3. Communicating comments to relevant people
4. Keeping track of comments e.g. defects found and providing
statistical information about those defects.
22
Tool Support for Static Testing
Static Analysis
Analysis of software artifacts e.g. requirements or code carried out
without execution of those software artifacts.
Static Analysis Tool
A tool that carries out static analysis.
23
Tool Support for Test Specification
Test Specification Tool
24
Tool Support for Test Specification
Test Design Tool
1.Test design tools help to construct list of test cases or test inputs.
2.Most test generation tools do not include an oracle i.e. they generate the test input but do not generate the expected results.
3.If requirements are kept in requirement management, then it is possible to identify input fields, including the range of valid values.
4.Range of valid values can be used to identify boundary values and EP.
25
Tool Support for Test Specification
6.If the expected result of the input of a valid value is known, then that expected result can also be included in the test case generated by test design tool.
7.Test design tool may have only a partial oracle i.e. it may know which input value are to be accepted and rejected.
8.Another type of test design tool is called screen scraper. It identifies all of the buttons and input fields i.e. every button will be clicked and every list box will be selected.
26
Tool Support for Test Specification
Characteristics of Test Design Tool
Generating input values from
1- Requirements
2- Code
3- Test condition etc.
27
Tool Support for Test Specification