Course Blueprint Template 1 Rev.0
Load Testing an Internet Site
Course Overview
Course Title
Load Testing and Performance Tuning Methods for Optimizing Web Site Performance
Description
Maximizing Web site performance is essential for those companies that do business online. While performance monitoring gathers metrics to measure operational performance, load testing emulates an active Web site so that you can assess performance independent of actual users. Load testing controls and structures environmental variables in a way to reveal sources of potential problems. Knowing how and what to monitor, what tools and vantage points to choose for different situations, and how to correlate and analyze reams of performance data to quickly pinpoint and solve performance problems is a complex task for event-driven, highly-distributed Web environments. This course describes load testing for a Web site and explains how to effectively use load testing to identify typical problem areas. It differentiates
alternative solutions for each problem area and describes when to use them. The course introduces multiple load-testing tools and discusses how to choose the tool that offers the best price to performance return to satisfy your business needs. Using a demonstration example, the course walks you through a simple load-testing process that demonstrates how to define scenarios, run load tests, and analyze test results.
Course Type
Internet-based/OLC Desktop Companion
Course Length
Estimated time of completion is two hours, depending on your reading speed and the level of detail you desire.
• Module 1: approximately 15 minutes • Module 2: approximately 15 minutes • Module 3: approximately 15 minutes • Module 4: approximately 15 minutes • Module 5: approximately 15 minutes • Module 6: approximately 15 minutes
Target Audience
This course is designed for eBusiness Solution Providers (eBSPs), Business Development Managers (BDMs), and Strategic Relations Managers (SRMs).
Prerequisite(s)
• noneCourse Goal
This course is designed to introduce load testing as an essential step in Web site development and to provide a guide to the process of load testing, as well as to educate eBSPs, BDMs, SRMs, and other course viewers on the needs, intentions, and technology capabilities of Web site load testing and performance tuning.
Course Blueprint Template 2 Rev.0
Course Objectives
After completing this course, you will be able to: • Explain the process of performance tuning.
• Describe the need for load testing as part of performance tuning. • Explain the process of load testing.
• Identify Web site performance problems and determine effective solutions. • Identify available load-testing tools.
Instructional Strategy
A pre-course assessment and post-course assessment will be administered to determine the participant’s pre- and post-course knowledge. Each instructional module will include objectives, presentation of information (text and multimedia), and a review exercise. Animation demonstrating and multimedia exercises reinforcing the dynamic concepts presented in this course is also included wherever applicable.
Course Outline
1. Course Introduction
Course Overview
• Course Description • Course Type • Course Length • Target Audience • Prerequisite(s) • Course Goal • Course ObjectivesPre- Course Assessment
Assess your knowledge of load testing a Web site! This pre-course assessment allows you to gauge your current knowledge and preview the course content.
This assessment has [X] questions. After answering all of the questions, click on the "Evaluate Exercise" button below to see how you did.
[Assessment explanations will include references to specific lessons within the modules.]
2. Module 1: Performance Tuning Overview
Module Description
Once you have developed your Web site, how do you know that it can perform reliably when accessed by thousands of users over the Internet? How can you keep up with increasing traffic on the site, while ensuring that users can still load pages quickly and consistently? Regular performance tuning enables you to optimize performance under evolving business conditions, and ensures that your Web site remains scalable, available, and reliable. Lesson 1 provides an overview of different methods to fine-tune your Web site. Lesson 2 reveals some of the hazards of insufficient performance tuning. Lesson 3 discusses the iterative, top-down nature of the performance-tuning process, and the steps of performance tuning.
Duration
Course Blueprint Template 3 Rev.0
Module Objectives:
After completing this module, you will be able to: • Identify three components of tuning a Web site. • Explain the benefits of performance tuning. • Explain the process of performance tuning.
Lesson 1: Overview to Tuning a Web Site
Lesson 1 Objective:
After completing this lesson, you will be able to: • Identify the components of tuning a Web site.
Lesson 1 Outline:
1.
Methods of Tuning a Web Site’s Performance1.1.
Functional Tuning1.2.
Usability Tuning1.3.
Performance TuningLesson 2: Why Tune a Web Site?
Lesson 2 Objectives:
After completing this lesson, you will be able to:
• Explain why performance tuning is a necessary function for any Web site. • Describe the potential losses that can occur when a Web site is unavailable.
Lesson 2 Outline:
1.
Unrealistic Optimism Rules the Business World2.
Consequences of Unavailability2.1.
Potential Lost Revenue When Site is Down or Not Performing2.2.
Solution: Performance Tuning to Meet Performance GoalsLesson 3: Performance Tuning Process
Lesson 3 Objective:
After completing this lesson, you will be able to: • Explain the major steps of performance tuning.
Lesson 3 Outline:
1.
Performance Tuning: An Iterative Process2.
Performance Tuning: A Top-down Process3.
Example of Performance Tuning: Initial System Configuration3.1.
Step One: Set Performance Goals3.2.
More Info: Sizing Tools and Sizing Guide3.3.
Step Two: Configure System Hardware and Software3.4.
More Info: Benchmarks3.5.
Step Three: Load Test to Gather Data3.6.
Step Four: Analyze Data to Determine If Performance Goals Are Met3.7.
Step Five: Identify the Source of the Performance Bottleneck3.8.
Step Six: Select a Viable Solution4.
A Valuable Resource: Intel® Solution Center and Services4.1.
Intel® Solution Center and Services Can Assist With Performance Tuning5.
Performance Tuning GameModule 1 Summary
This module introduced three tuning techniques that you can use to validate your Web site’s functional, usability, and performance capabilities. You learned that most businesses are overly optimistic about their
Course Blueprint Template 4 Rev.0
Web site’s capabilities, and that performance tuning can make their expectations a reality. Finally, you learned the steps involved in iterative, top-down performance tuning.
The following outline reviews the information presented in this module. Use the syllabus to the left to navigate to the appropriate lesson for more detailed information.
Lesson 1.1: Overview to Tuning a Web Site
Methods of Tuning a Web Site’s Performance (1 of 2) • Functional Tuning (1 of 2)
• Usability Tuning (1 of 2) • Performance Tuning (2 of 2)
Lesson 1.2: Why Tune a Web Site?
Unrealistic Optimism Rules the Business World (1 of 4) Consequences of Unavailability (2 of 4)
• Potential Lost Revenue When Site Is Down or Not Performing (3 of 4) • Solution: Performance Tuning to Meet Performance Goals (4 of 4)
Lesson 1.3: Performance Tuning Process
Performance Tuning: An Iterative Process (1 of 6) Performance Tuning: A Top-down Process (2 of 6)
Example of Performance Tuning: Initial System Configuration (3 of 6) • Step 1: Set Performance Goals (3 of 6)
• Step 2: Configure Hardware and Software (3 of 6) • Step 3: Load Test to Gather Data (3 of 6)
• Step 4: Analyze Data to Determine If Performance Goals Are Met (4 of 6) • Step 5: Identify the Source of the Performance Bottleneck (4 of 6) • Step 6: Select a Viable Solution (4 of 6)
A Valuable Resource: Intel Solution Center and Services (5 of 6)
• Intel Solution Center and Services Can Assist With Performance Tuning (5 of 6) Performance Tuning Game (6 of 6)
Module 1 Review Exercise
See how much you have learned! This review exercise has [X] questions. After answering all of the questions, click on the "Evaluate Exercise" button below to see how you did. If you choose to do so, you can retake this exercise.
[Exercise explanations to include references to specific lessons within the modules.]
Break Page
+Congratulations! You have completed Module [#]. If you would like to take a break, this would be a good stopping point. If you would like to continue on to the next module, just click on the “next” arrow.
+
Hidden page
3. Module 2: What is Load Testing?
Module Description
Load testing emulates an active Web site so that you can assess your Web site’s performance independent of actual users, enabling you to give your site a trial run before its release on the Internet. You can test potential workloads over time, minimize response time, identify performance limitations, and further optimize your Web site. Lesson 1 discusses the importance of load testing in the performance-tuning process, and demonstrates the capabilities of load testing as a measuring tool. It explains how automated
Course Blueprint Template 5 Rev.0
tools simplify the load testing process and enable you to define tests that yield reproducable outcomes. Lesson 2 identifies when in your Web site’s life cycle that you should perform load tests.
Duration
Approximately 15 minutes
Module Objectives:
After completing this module, you will be able to: • Define load testing.
• List the variables measured by load testing.
• Describe how load-testing tools are used to measure a Web site’s performance. • Identify when you should load test your Web site.
Lesson 1: Load Testing Overview
Lesson 1 Objective:
After completing this lesson, you will be able to:
• Explain how load testing helps to enhance Web site performance.
Lesson 1 Outline:
1.
Load Testing: An Integral Part of Performance Tuning2.
A Way to Measure3.
Automated Tools to the Rescue3.1.
Benefits of Automated Load TestingLesson 2: When to Load Test
Lesson 2 Objective:
After completing this lesson, you will be able to: • Identify when to perform load tests.
Lesson 4 Outline:
1.
When to Load Test2.
Pre-deployment Load Testing3.
Post-deployment Load TestingModule 2 Summary
Load testing is an integral part of performance tuning and involves applying measurement tools to your Web site. These automated tools can accurately simulate a user load on your Web site and provide information that will help you improve your site’s performance. Load testing should be repeated often, both before and after deployment.
The following outline reviews the information presented in this module. Use the syllabus to the left to navigate to the appropriate lesson for more detailed information.
Lesson 2.1: Load Testing Overview
What is Load Testing? (1 of 4) A Measurement Tool (2 of 4)
Automated Tools to the Rescue (3 of 4)
• Benefits of Automated Load-testing Tools (4 of 4)
Lesson 2.2: When to Load Test
When to Load Test (1 of 3)
Pre-deployment Load Testing (2 of 3) Post-deployment Load Testing (3 of 3)
Course Blueprint Template 6 Rev.0
Module 2 Review Exercise
See how much you have learned! This review exercise has [X] questions. After answering all of the questions, click on the "Evaluate Exercise" button below to see how you did. If you choose to do so, you can retake this exercise.
[Exercise explanations to include references to specific lessons within the modules.]
Break Page
+Congratulations! You have completed Module [#]. If you would like to take a break, this would be a good stopping point. If you would like to continue on to the next module, just click on the “next” arrow.
+
Hidden page
4. Module 3: Load-testing Process
Module Description
Module 3 expands some of the basic concepts introduced earlier in Modules 1 and 2 with a systematic explanation of the load-testing process. Load testing can help you match your Web site’s performance with your goals. Understanding your users and their needs, intentions, and technology capabilities is essential to the load-testing process, as you simulate their interaction with your Web site. Load testing helps you analyze your systems, identify areas that can be improved, implement changes, and test these changes. Lesson 1 provides an overview of the four phases of the load-testing process: definition, planning, preparation, and testing. Lesson 2 helps you define and set your performance, business, and technical goals. Lesson 3 helps you plan your test by specifying your testing objectives, testing scenarios, load-testing strategies, test environments, and load-load-testing tools appropriate for the job. In Lesson 4, you prepare your testing environment and create the scripts, metrics, and workload models for the workload generation. Lesson 5 outlines the execution of the test. Lesson 6 reviews tasks that follow in the overall performance-tuning life cycle.
Duration
Approximately 15 minutes
Module Objectives:
After completing this module, you will be able to: • Describe each step in the load-testing process. • Set performance goals.
• Define the user workload. • Prepare and execute load tests.
Lesson 1: Overview of the Load-testing Process
Lesson 1 Objective:
After completing this lesson, you will be able to:
• Identify the four phases in the load-testing process.
Lesson 1 Outline:
1.
Load-testing ProcessLesson 2: Load-testing Process: Definition Phase
Lesson 2 Objectives:
After completing this lesson, you will be able to:
• Describe the definition phase in the load-testing process.
• Identify factors that should be considered when setting performance goals. • Describe the types of users, activities, and connections that can affect workload.
Course Blueprint Template 7 Rev.0
Lesson 2 Outline:
1.
Definition Phase2.
Setting Performance Goals3.
Setting Business Goals: Logical User Model4.
Workload5.
Response Time6.
Navigation Methods7.
Web Site Categories7.1.
Publishing/Subscriber’s Sites7.2.
Online Shopping Sites7.3.
Customer Self-service Sites7.4.
Trade/Auction Sites8.
Setting Technical Goals: Hardware and Software ConfigurationLesson 3: Load-testing Process: Planning Phase
Lesson 3 Objective:
After completing this lesson, you will be able to: • Describe how to set up the testing environment
Lesson 3 Outline:
1.
Planning Phase2.
Setting Load-testing Objectives3.
Load-testing Scenario4.
Defining the Load-testing Scenario: Virtual Users5.
Business-to-consumer Sites’ Virtual Users6.
Business-to-business Sites’ Virtual Users7.
Defining the Load-testing Scenario: Activities8.
Business-to-consumer Setes’ Virtual Users: Activities9.
Business-to-business Sites’ Virtual Users: Activities10.
Defining the Load-testing Scenario: Connection Speed11.
Load-testing Strategy12.
Test Environment12.1.
Virtual User Model12.2.
Testing Equipment12.3.
Web Site Configurations13.
Load-testing Tools for the JobLesson 4: Load-testing Process: Preparation Phase
Lesson 4 Objectives:
After completing this lesson, you will be able to:
• Describe the preparation phase in the load-testing process. • Identify the steps in creating realistic test scripts.
Lesson 4 Outline:
1.
Preparation Phase2.
Setting Up the Test Environment3.
Creating Virtual-user Test Scripts4.
Customizing Virtual-user Test Scripts4.1.
WebTrends5.
Modeling User Behavior in Test ScriptsCourse Blueprint Template 8 Rev.0
5.2.
System Response Times5.3.
Error Handling6.
Configuring Metrics7.
Defining Statistics8.
Modeling Total WorkloadLesson 5: Execute Test and Monitor Run-Time Information
Lesson 5 Objective:
After completing this lesson, you will be able to:
• Describe the testing phase in the load-testing process. • Describe how to execute and monitor a load test.
Lesson 5 Outline:
1. Testing Phase
2.
Executing the Load Test3.
Monitoring Run-time InformationLesson 6: Analyze Results and Modify the System
Lesson 6 Objective:
After completing this lesson, you will be able to:
• Explain the importance of analyzing the load test results.
• Explain the importance of retesting the system after making changes.
Lesson 6 Outline:
1.
Analyzing Results and Modifying the System2.
Repeating the Load Test to Validate ChangesModule 3 Summary
Load testing is a four-phase process: definition, planning, preparation, and testing. In the definition phase, you set performance goals, designate your hardware and software configuration, and build a logical model of potential users. In the planning phase, you use products of the definition phase to set your load-testing objectives, create a load-testing scenario that will meet those objectives, choose a load-testing strategy, design your test environment, and choose load-testing tools for the job. In the preparation phase, you build a model of the workload using the load-testing scenario and load-testing objectives, and the virtual user scripts and performance metrics you configure. In the testing phase, your isolated test environment executes the test to gather performance and capacity statistics about your Web site. After load testing, you analyze the results of the load test and modify your Web site accordingly. The final step is to retest the system to validate the changes you made.
The following outline reviews the information presented in this module. Use the syllabus to the left to navigate to the appropriate lesson for more detailed information.
Lesson 3.1: Overview of Load-testing Process
Load-testing Process (1 of 1)
Lesson 3.2: Load-testing Process: Definition Phase
Definition Phase (1 of 5)
Setting Performance Goals (1 of 5)
Setting Business Goals: Logical User Model (2 of 5) Workload (2 of 5)
Response Time (3 of 5) Navigation Methods (3 of 5) Web Site Categories (4 of 5)
Course Blueprint Template 9 Rev.0 • Online Shopping Sites (4 of 5)
• Customer Self-service Sites (4 of 5) • Trade/Auction Sites (5 of 5)
Setting Technical Goals: Hardware and Software Configuration (5 of 5)
Lesson 3.3: Load-testing Process: Planning Phase
Planning Phase (1 of 8)
Setting Load-testing Objectives (1 of 8) Load-testing Scenario (2 of 8)
Defining Load-testing Scenario: Virtual Users (3 of 8) • Business-to-consumer Sites’ Virtual Users (3 of 8) • Business-to-business Sites’ Virtual Users (3 of 8) Defining Load-testing Scenario: Activities (4 of 8)
Business-to-consumer Sites’ Virtual Users: Activities (4 of 8) Business-to-business Sites' Virtual Users: Activities (4 of 8) Defining Load-testing Scenario: Connection Speed (5 of 8) Load-testing Strategy (6 of 8)
Test Environment (7 of 8)
• Virtual User Models (7 of 8) • Testing Equipment (7 of 8) • Web Site Configurations (7 of 8) Load-testing Tools for the Job (8 of 8)
Lesson 3.4: Load-testing Process: Preparation Phase
Preparation Phase (1 of 6)
Setting Up the Test Environment (1 of 6) Creating Testing Scripts (2 of 6)
Customizing Virtual-user Testing Scripts (3 of 6) • WebTrends (3 of 6)
Modeling User Behavior in Testing Scripts (4 of 6) • “Think Times” (4 of 6)
• System Response Times (4 of 6) • Error Handling (4 of 6)
Configuring Metrics (5 of 6) Defining Statistics (5 of 6) Modeling Total Workload (6 of 6)
Lesson 3.5: Load-testing Process: Testing Phase
Testing Phase (1 of 1)
Executing the Load Test (1 of 2)
Monitoring Run-time Information (2 of 2)
Lesson 3.6: After Load Testing
Analyzing Results and Modifying the System Repeating the Load Test to Validate Changes
Module 3 Review Exercise
See how much you have learned! This review exercise has [X] questions. After answering all of the questions, click on the "Evaluate Exercise" button below to see how you did. If you choose to do so, you can retake this exercise.
Course Blueprint Template 10 Rev.0
Break Page
+Congratulations! You have completed Module [#]. If you would like to take a break, this would be a good stopping point. If you would like to continue on to the next module, just click on the “next” arrow.
+
Hidden page
5. Module 4: Performance Problems and Solutions
Module Description
Before you tune a Web site, you should be familiar with the categories of performance problems and the types of symptoms that those problems manifest. This can help you isolate the problem area to identify bottlenecks and pinpoint viable solutions. This module discusses alternative solutions for each problem area and describes when to use them. Lesson 1 introduces you to symptoms of a Web site with
performance problems and to the six different categories of performance issues. Lessons 2, 3, and 4 discuss system-level performance issues and their alternative solutions for servers, network bandwidth, and security. Lessons 5, 6, and 7 discuss system, application, and microarchitecture performance issues and their solutions for the key components of your Web site: Web servers, applications, and databases
Duration
Approximately 15 minutes
Module Objectives:
After completing this module, you will be able to:
• Identify the symptoms of a Web site with performance problems. • Explain the types of general performance problems and solutions. • Explain how to eliminate bandwidth utilization problems. • Explain how to improve Web server performance. • Identify Web-site security problems and solutions. • Explain how to improve database performance. • Explain how to improve application performance.
Lesson 1: Performance Problems and Symptoms
Lesson 1 Objectives:
After completing this lesson, you will be able to:
• Identify the symptoms of a Web site with performance problems. • Explain the six categories into which performance problems are placed.
Lesson 1 Outline:
1.
Categorizing Performance Problems1.1.
Distribution of Problems by Category2.
Identifying Performance ProblemsLesson 2: General Performance Problems
Lesson 2 Objectives:
After completing this lesson, you will be able to: • Describe general performance problems.
• Explain how to resolve general performance problems.
Lesson 2 Outline:
1.
Identifying General Performance ProblemsCourse Blueprint Template 11 Rev.0
Lesson 3: Network Bandwidth Problems
Lesson 3 Objectives:
After completing this lesson, you will be able to:
• Identify acceptable bandwidth utilization statistics. • Explain how to resolve bandwidth utilization problems.
Lesson 3 Outline:
1.
Recognizing Bandwidth Problems2.
Monitoring Bandwidth Utilization3.
Resolving Network Bandwidth ProblemsLesson 4: Security Problems
Lesson 4 Objectives:
After completing this lesson, you will be able to: • Identify different security problems. • Explain effective security implementations.
Lesson 4 Outline:
1.
Using Security Technologies2.
Resolving Security and System Resource ProblemsLesson 5: Web Server Problems
Lesson 5 Objectives:
After completing this lesson, you will be able to:
• List the problems that commonly affect Web servers. • Explain how to resolve each of these problems.
Lesson 5 Outline:
1.
Identifying the Web Server as the Problem2.
Resolving Memory Problems3.
Resolving Memory Leaks4.
Addressing CPU Utilization Problems5.
Addressing Caching Problems6.
Balancing the Use of Static and Dynamic Content7.
Providing Resources for Web and Application ServicesLesson 6: Application Problems
Lesson 6 Objectives:
After completing this lesson, you will be able to:
• Describe the problems of poor application server performance. • Describe the problems associated with poor application performance. • Explain how to resolve application performance problems.
Lesson 6 Outline:
1.
Identifying Poor Application Performance2.
Addressing Memory Problems3.
Optimizing Applications3.1.
Intel VTune Performance AnalyzerLesson 7: Database Problems
Lesson 7 Objectives:
After completing this lesson, you will be able to:
• Identify common problems associated with database software and database servers. • Describe solutions to improve database performance.
Course Blueprint Template 12 Rev.0
Lesson 6 Outline:
1.
Identifying Database Problems2.
Examining Database Problems3.
Identifying Database SolutionsLesson 8: Identifying Performance Solutions
Lesson 8 Objectives:
After completing this lesson, you will be able to:
• Complete the game by providing the appropriate solution to specific performance problems.
Lesson 6 Outline:
1.
Identifying Performance SolutionsModule 4 Summary
Web site performance problems manifest themselves in the following categories of problems: general performance, network bandwidth, security levels and protocols, Web server, application, and database. Module 4 discussed specific issues and solutions within these categories to help you to identify and remedy performance problems and meet your load-testing goals.
The following outline reviews the information presented in this module. Use the syllabus to the left to navigate to the appropriate lesson for more detailed information.
Lesson 4.1: Performance Issues and Symptoms
Categorizing Performance Problems (1 of 3)
• Distribution of Performance Problems by Category (2 of 3) Identifying Performance Problems (3 of 3)
Lesson 4.2: General Performance Issues
Identifying General Performance Problems (1 of 2) Resolving General Performance Problems (1 of 2)
Lesson 4.3: Network Bandwidth Problems
Recognizing Bandwidth Problems (1 of 3) Monitoring Bandwidth Utilization (2 of 3) Resolving Network Bandwidth Problems (3 of 3)
Lesson 4.4: Security Problems
Using Security Technologies (1 of 2)
Resolving Security and System Resource Problems (2 of 2)
Lesson 4.5: Web Server Problems
Identifying the Web Server as the Problem (1 of 6) Resolving Memory Problems (2 of 6)
Resolving Memory Leaks (3 of 6)
Addressing CPU Utilization Problems (4 of 6) Addressing Caching Problems (5 of 6)
Balancing the Use of Static and Dynamic Content (5 of 6) Providing Resources for Web and Application Services (6 of 6)
Lesson 4.6: Application Problems
Identifying Poor Application Performance (1 of 3) Addressing Memory Problems (2 of 3)
Optimizing Applications (3 of 3)
Course Blueprint Template 13 Rev.0
Lesson 4.7: Database Problems
Identifying Database Problems (1 of 3) Examining Database Problems (2 of 3) Identifying Database Solutions (3 of 3)
Lesson 8: Identifying Performance Solutions
Identifying Performance Solutions (1 of 1)
Module 4 Review Exercise
See how much you have learned! This review exercise has [X] questions. After answering all of the questions, click on the "Evaluate Exercise" button below to see how you did. If you choose to do so, you can retake this exercise.
[Exercise explanations to include references to specific lessons within the modules.]
Break Page
+Congratulations! You have completed Module [#]. If you would like to take a break, this would be a good stopping point. If you would like to continue on to the next module, just click on the “next” arrow.
+
Hidden page
6. Module 5: Evaluating Load-testing and Run-time Monitoring Tools
Module Description
Now that you understand the methodology behind load testing a Web site, how do you go about selecting a load-testing tool? What are some commonly used tools? Are load-testing tools and run-time monitoring tools packaged together, or are they separate applications? Module 5 answers these questions and also provides a basic set of criteria for evaluating different load-testing and run-time monitoring tools. The criteria will direct you to the product or products that are most appropriate for your load-testing needs. Lesson 1 discusses the criteria for evaluating load-testing tools. Lesson 2 introduces several commonly used load-testing tools and provides usability and cost information for each of them. Finally, Lesson 3 presents criteria for evaluating run-time monitoring tools and provides some basic information about several commonly used run-time monitoring tools.
Duration
Approximately 15 minutes
Module Objectives:
After completing this module, you will be able to:
• Explain the criteria for selecting a load-testing tool.
• Describe the strengths and weaknesses of the load-testing tools presented in this module. • Explain the criteria for selecting a run-time monitoring tool.
• Describe the level of analysis provided by the run-time monitoring tools presented in this module.
Lesson 1: Evaluating Load-testing Tools
Lesson 1 Objective:
Course Blueprint Template 14 Rev.0 • Explain the criteria for choosing a load-testing tool.
Lesson 1 Outline:
1. Load-testing Tools
2.
Criteria for Evaluating Load-testing Tools2.1.
Central Control over Testing2.2.
Ability to Create Automated Users2.3.
Utilities for Further Analysis2.4.
Test Your Entire System2.5.
Support a Wide Variety of Protocols and Technologies2.6.
Openness to New Protocols and TechnologiesLesson 2: Common Load-testing Tools
Lesson 2 Objective:
After completing this lesson, you will be able to:
• Describe the strengths and weaknesses of common load-testing tools.
Lesson 2 Outline:
1.
Common Load-testing Tools1.1.
Empirix e-Test 4.21.2.
Segue SilkPerformer 4.01.3.
Mercury Interactive Astra LoadTest 4.01.4.
Compuware QALoad 4.71.5.
Quest Software Benchmark Factory 2.51.6.
RadView WebLoad 4.02.
Evaluation of Common Load-testing Tools2.1.
More Info: Pricing InformationLesson 3: Evaluating Run-time Monitoring Tools
Lesson 3 Objectives:
After completing this lesson, you will be able to:
• Describe the different types of run-time monitoring tools.
• Describe when you would use the different types of run-time monitoring tools.
Lesson 3 Outline:
1.
Choosing a Run-time Monitoring Tool2.
Types of Run-time Monitoring Tools2.1.
More Info: Server Counters2.2.
More Info: System Counters2.3.
More Info: Web Server Performance Counters2.4.
More Info: Web Service Counters3.
Common Run-time Monitoring Tools4.
Evaluating the Level of AnalysisModule 5 Summary
When evaluating load-testing tools, make sure that the tools you purchase enable control over testing, automate virtual-user creation, and provide utilities for further analysis. They should allow you the ability to test your entire system, support a wide variety of protocols and technologies, and be designed to provide support new protocols and technologies. This module introduced some of the basic features, advantages, and disadvantages of six commonly used load-testing tools.
Course Blueprint Template 15 Rev.0 When evaluating run-time monitoring tools, carefully research the monitoring capabilities, data collection methods, and the level of analysis provided by each tool. This module examined several commonly used run-time monitoring tools and briefly discussed the type of analysis each of these tools offers.
Remember, when you are determining the purchase of a load-testing or run-time monitoring tool, be sure to select the tool that meets your needs. If you are spending extra money for features that you do not need, you could be spending money that would be better used in testing other parts of your site.
The following outline reviews the information presented in this module. Use the syllabus to the left to navigate to the appropriate lesson for more detailed information.
Lesson 5.1: Evaluating Load-testing Tools
Load-testing Tools (1 of 3)
Criteria for Evaluating Load-testing Tools (2 of 3) • Central Control Over Testing (2 of 3) • Ability to Create Automated Users (2 of 3)
Criteria for Evaluating Load-testing Tools (Continued) (3 of 3) • Utilities for Further Analysis (3 of 3)
• Test Your Entire System (3 of 3)
• Support a Wide Variety of Technologies and Protocols (3 of 3) • Openness to New Technologies and Protocols (3 of 3)
Lesson 5.2 – Common Load-testing Tools
Common Load-testing Tools (1 of 3) • Empirix e-Test 4.2 (1 of 3) • Segue SilkPerformer 4.0 (1 of 3)
• Mercury Interactive Astra LoadTest 4.0 (2 of 3) • Compuware QALoad 4.7 (2 of 3)
• Quest Software Benchmark Factory 2.5 (2 of 3) • RadView WebLoad 4.0 (2 of 3)
Evaluation of Common Load-testing Tools (3 of 3)
Lesson 5.3: Evaluating Run-time Monitoring Tools
Choosing a Run-time Monitoring Tools (1 of 5) Types of Run-time Monitoring Tools (2 of 5) Common Run-time Monitoring Tools (4 of 5) Evaluating the Level of Analysis (5 of 5)
Module 5 Review Exercise
See how much you have learned! This review exercise has [X] questions. After answering all of the questions, click on the "Evaluate Exercise" button below to see how you did. If you choose to do so, you can retake this exercise.
[Exercise explanations to include references to specific lessons within the modules.]
Break Page
+Congratulations! You have completed Module [#]. If you would like to take a break, this would be a good stopping point. If you would like to continue on to the next module, just click on the “next” arrow.
+
Hidden page
Course Blueprint Template 16 Rev.0
Module Description
This module walks you through a simple example that demonstrates the practical applications of the performance-tuning and load-testing processes. First, you will step through the planning stages of a load test, from setting performance goals to choosing a load-testing tool. Next, you will load test three different system configurations and perform an analysis on a specific set of data retrieved from those tests,
identifying performance issues and bottlenecks that occur in each configuration. Finally, you will determine which of these three configurations best meet your performance goals. Lesson 1 discusses how to define, plan, and prepare a load test for the demonstration. Lessons 2, 3, and 4 walk you through three iterations of load testing to familiarize you with points that might arise as you tune your system
configuration. Lesson 5 covers issues involved with load testing that you should consider when testing in a more complex Web site configuration.
Duration
Approximately 15 minutes
Module Objectives:
After completing this module, you will be able to:
• Relate the performance-tuning and load-testing processes to a practical example of load testing. • Explain how to set up a load test.
• Analyze practical data from a load test and compare it to performance goals. • Choose the most effective solution presented in this demonstration.
Lesson 1: Load-test Exercise Introduction
Lesson 1 Objectives:
After completing this lesson, you will be able to:
• Relate the performance-tuning and load-testing processes to a load-testing demonstration exercise. • Identify techniques for completing the definition, planning, and preparation phases of the
load-testing process.
Lesson 1 Outline:
1.
Performance Tuning2.
Load Testing3.
Load Testing: Definition Phase3.1.
Performance Goals3.2.
Hardware and Software Configuration3.3.
Logical User Model4.
Load Testing: Planning Phase4.1.
Load-testing Objectives4.2.
Load-testing Scenario4.3.
Load-testing Strategy4.4.
Test Environment4.5.
Load-testing tools for the Job5.
Load Testing: Preparation Phase5.1.
Create Virtual User Scripts5.2.
Configure Metrics5.3.
Model User Behavior5.4.
Model Total WorkloadLesson 2: Initial Configuration
Lesson 2 Objective:
Course Blueprint Template 17 Rev.0 • Analyze load testing data and make conclusions from this data.
Lesson 2 Outline:
1.
Run Test2.
Analyze Data3.
ConclusionsLesson 3: Scaled-out Configuration
Lesson 3 Objective:
After completing this lesson, you will be able to:
• Analyze load-testing data and make conclusions from this data.
Lesson 3 Outline:
1.
Run Test2.
Analyze Data3.
ConclusionsLesson 4: Scaled-up Configuration
Lesson 4 Objective:
After completing this lesson, you will be able to:
• Analyze load-testing data and make conclusions from this data.
Lesson 4 Outline:
1.
Run Test2.
Analyze Data3.
Make ConclusionsLesson 5: Load-test Exercise Conclusion
Lesson 5 Objectives:
After completing this lesson, you will be able to:
• Identify the most effective of the three system configurations presented in this module. • Explain the importance of maintaining a isolated and consistent test environment. • Discuss the term ripple effect as it applies to load testing.
Lesson 5 Outline:
1.
ConclusionsModule 6 Summary
In Module 6, you walked through the performance-tuning process and load-testing process, testing several configurations of a simple web site. First you went through the definition, planning, and preparation phases of the load-testing process, identifying objectives, creating user profiles, configuring your test
environment, and setting up your load-testing tools. Then you ran load test and analyzed data for an initial two-processor, single-server configuration; a second, scaled-out configuration; and a third, scaled-up configuration. You determined that the scaled-up configuration offered the best performance solution, although it did not completely meet performance goals. In a more extensive test, further tuning would be necessary to fully meet performance goals. A closed, repeatable testing environment is essential to an effective load test.
Lesson 6.1: Load-test Exercise Introduction
Performance Tuning (1 of 7) Load Testing (2 of 7)
Load Testing: Definition Phase (3 of 7) • Performance Goals (3 of 7)
• Hardware and Software Configuration (3 of 7) • Logical User Model (3 of 7)
Course Blueprint Template 18 Rev.0 Load Testing: Planning Phase (4 of 7)
• Load-testing Objectives (4 of 7) • Load-testing Scenario (4 of 7)
• Load-testing Strategy (Load, Stress, or Capacity) (5 of 7) • Test Environment (5 of 7)
• Load-testing Tools for the Job (5 of 7) Load Testing: Preparation Phase (6 of 7)
• Create Virtual-user Scripts (6 of 7) • Configure Metrics (6of 7)
• Model User Behavior (7 of 7) • Model Total Workload (7 of 7)
Lesson 6.2: Initial Configuration
Run Load Test (1 of 3) Analyze Data (2 of 3) Make Conclusions (3 of 3)
Lesson 6.3: Scaled-out Configuration
Run Load Test (1 of 3) Analyze Data (2 of 3) Make Conclusions (3 of 3)
Lesson 6.4: Scaled-up Configuration
Run Load Test (1 of 3) Analyze Data (2 of 3) Make Conclusions (3 of 3)
Lesson 6.5 – Load-test Exercise Conclusion
Conclusions (1 of 1)
Module 6 Review Exercise
This review exercise has [#] questions. After answering each of the questions, click on the "Evaluate Exercise" button below. If you choose to, you can retake this exercise multiple times.
Exercise explanations to include references to specific lessons within the modules.
Break Page
+Congratulations! You have completed Module [#]. If you would like to take a break, this would be a good stopping point. If you would like to continue on to the next module, just click on the “next” arrow.
+
Hidden page
8. Course Summary
Course Summary
This six-module course has introduced you to the concepts of load testing and performance tuning, as well as the reasons why these functions are important. You have learned the best times to conduct a load test and the specific steps of the process. The course has discussed common performance problems that can be revealed through load testing and suggestions for correcting those problems. Last, the course provided you with some information on several common load-testing tools.
Course Blueprint Template 19 Rev.0
Post Course Assessment
This exercise has [#] questions. After answering all of the questions, click on the "Evaluate Exercise" button below. If you choose to do so, you can retake this exercise.
[Assessment explanations to include references to specific lessons within the modules.]
Course Evaluation
Thank You Page+
+