• Test and acceptance plan is completely documented in accordance with applicable policies
• Test plan is relevant to application and test requirements are in compliance with legal and customer requirements
• Test system accurately reflects real world • Testing scenario is automated where
feasible
• Realistic test cases are developed and results compared with expected performance
• Testing resources are identified and scheduled appropriately
• Customer acceptance occurs upon successful completion of test plan
• Knowledge of user application
• Knowledge of testing impact on timeline and budget
• Knowledge of test domain and ability to distinguish edges and critical points • Knowledge of operating systems, interfaces
and testing tools
• Knowledge of legal and customer requirements
• Ability to develop and execute test acceptance plans
• Ability to understand system organization/hierarchy
• Ability to follow processes/procedures • Ability to respond to system demand • Ability to write technical documents and
detailed supporting documents • Ability to consider risk implications and
compile multiple viewpoints • Ability to use word processing tools
and techniques
G2. Develop test procedures
• Test procedures explicitly verify specifications
• Test procedures define test conditions • Test procedures are documented in detail • Appropriate tests are developed for
individual components and end-to- end operations
• Test results are reviewed to confirm test validity
• Knowledge of test domain and ability to distinguish edges and critical points • Ability to construct automated test
sequences and recognize errors in test procedure and system
• Knowledge of test discipline, tools, languages and testing methodology • Ability to develop and apply testing
specifications
• Ability to understand system organization/hierarchy
• Ability to follow processes/procedures • Ability to respond to system demand • Ability to consider risk implications • Ability to analyze technology output and
examine task/technology relationship • Ability to interpret, clarify and influence
KEY ACTIVITY
PERFORMANCE INDICATORS
TECHNICAL KNOWLEDGE
EMPLOYABILITY SKILLS
How do we know when the key activity is performed well? Skills, Abilities, Tools SCANS Skills and Foundation Abilities
G3. Develop and perform usability and integration testing
• User reactions to test product are accurately observed and documented • Test data is conveyed to development team
in a timely manner
• Test results are analyzed and applied to problem resolution
• Test data and documentation is accurately maintained over time and accessible to development team
• Test routines and procedures are periodically reviewed for effectiveness
• Knowledge of test procedures for usability and integration
• Knowledge of application environment and user requirements
• Ability to translate usability issues into application/site modifications • Knowledge of error analysis and
resolution processes
• Ability to understand system organization/hierarchy
• Ability to follow processes/procedures • Ability to analyze technology output • Ability to examine task/technology
relationship
• Ability to appropriately refer complaint/discrepancy • Ability to identify and evaluate
system performance
G4. Perform tests • Test process includes appropriate team members
• System is tested according to plan and schedule
• Test results are documented completely and communicated as appropriate • System integration testing and volume/
performance testing are performed when appropriate
• Ability to develop and perform test procedures
• Knowledge of system and ability to recognize and resolve problems identified through testing
• Knowledge of testing methodology and protocols
• Ability to interpret test results and resolve discrepancies appropriately
• Ability to follow processes/procedures • Ability to appropriately refer
complaint/discrepancy • Ability to understand system
organization/hierarchy • Ability to identify and evaluate
system performance
• Ability to analyze technology output and examine task/technology relationship G5. Document test
results and take corrective actions
• Errors and preexisting conditions are clearly documented
• Recommendations for corrective action are included in documentation
• Problems are identified and resolved • Test results are accurately recorded,
analyzed and communicated effectively • Test results are reviewed to confirm
test validity
• Knowledge of documentation procedures • Knowledge of testing tools and
methodologies
• Ability to troubleshoot and correct technical problems
• Ability to discern trends, patterns and anomalies
• Ability to understand system organization/hierarchy
• Ability to respond to system demand • Knowledge of word processing software,
networks and operating environments • Ability to evaluate system performance
and devise plan to monitor and/or correct system
• Ability to modify process/procedure
KEY ACTIVITY
PERFORMANCE INDICATORS
TECHNICAL KNOWLEDGE
EMPLOYABILITY SKILLS
How do we know when the key activity is performed well? Skills, Abilities, Tools SCANS Skills and Foundation Abilities
G6. Recommend and implement performance improvements
• Performance metrics are codified, analyzed and presented for effective decision support
• Test log information and development team input are regularly integrated into
performance reviews
• Customer feedback is actively solicited, accurately maintained and applied to performance improvement reviews • Performance improvement reviews result in
site improvement plans based on business goals and ROI considerations
• Knowledge of performance tuning and site improvement strategies
• Ability to gather, analyze and present performance data
• Ability to collect, organize and maintain customer feedback
• Knowledge of business goals and ROI processes
• Ability to evaluate/adjust plan of action • Ability to analyze and respond to client/
user needs
• Ability to write detailed documents • Ability to approach problems in a logical
and systematic way
KEY ACTIVITY
PERFORMANCE INDICATORS
TECHNICAL KNOWLEDGE
EMPLOYABILITY SKILLS
How do we know when the key activity is performed well? Skills, Abilities, Tools SCANS Skills and Foundation Abilities