HIGHLIGHTS:
• Fully managed service
• Dedicated engineer
• Detailed reporting and recommendations
• Validation from neutral experts
EVERY SECOND COUNTS
0.25 Seconds
delay
All it takes to lose a customer
0.50 Seconds delay
Equals a 20% drop in traffic
1.0 Seconds delay
Can cause a 7% drop in
conversions
Neustar
®Full-Service Load Testing
When DIY Won’t Work.
The Value of a Dedicated Engineer
If you need to test your website but have limited internal resources, Neustar full-service load testing is a smart choice. A Neustar Professional Services engineer handles it all, from planning, scripting and implementation to execution and analysis. When your testing needs are complex, this level of expertise and hands-on engagement makes a crucial difference.
Neustar’s engineers have performed thousands of load tests. They use proven methodologies to test beyond the firewall, providing the clearest simulation of real-world performance. With our managed solution, there’s no costly software or hardware to install – a plus for your development, QA and operational teams, especially towards the end of the software development cycle.
Let Neustar do the heavy lifting, so you can focus on site improvements. We’ll provide the data and analytics that lead to better decisions.
PROJECT MILESTONES:
• Statement of work – Your team and Neustar agree on the scope, deliverables and timing of the project.
• Script definition and development of application scripts – Once you deliver script definitions, Neustar builds and validates the test application scenarios.
• Test scheduling and execution – We do this in collaboration with
your development and operational teams.
• Analysis, discussion and final deliverables – After evaluating the results, Neustar provides a summary document with key findings and recommendations.
The Testing Process
Your Neustar engineer helps to define your testing needs and create a workable schedule. Working with you closely, he or she gathers your requirements, builds the test scenarios, then schedules and runs a series of load tests and analyzes the results. Your engineer works alongside your team to ensure your tests go smoothly, plus answer questions about the results. Your test plans are based on the number of concurrent users outlined in each
scenario. Utilizing Neustar’s global testing network, we simulate as many logins, registrations and other transactions as needed. Thanks to our cloud-based platform, we can generate loads of virtually any size. You’ll discover how many concurrent users your applications can handle at acceptable page load times and error rates.
At the conclusion of each test, you get a quick view of the overall results and shortly afterwards, a customized analysis with key takeaways and areas for improvement.
CUSTOMER WEBSITE/APPLICATION PROFESSIONAL
SERVICES ENGINEER
INTERNET GLOBAL WEBSITE ANALYSIS
AND TESTING PLATFORM
App Server Web Server Database Server PROFESSIONAL PERFORMANCE SUMMARY (EXPERT ANALYSIS)
TYPICAL TEST METRICS
Summary Results
• Total page load attempts• Total page load failures
• Total transaction attempts (sequence of pages)
• Total transaction failures
• Total data transferred (Mbytes)
• Average throughput
• Throughput and total data transferred by interval
• User load level and ramp schedule
You can run as many or as few tests as you need, but we generally
recommend a series of three. The first test establishes baselines and areas for improvement. The second and third tests measure and validate your progress. We capture detailed performance statistics and provide easy-to-understand graphs, so you can quickly pinpoint bottlenecks and problems within applications.
See your summary results at a glance.
Clear, Detailed Reporting
View the number of concurrent users applied over time against your website/application.
BI-INTERVAL RESULTS
Each test is divided into distinct intervals, so you can see the impact load is having on your application over time. We provide the following metrics:
• Page load times compared to no-load benchmark
• Transaction success rate
• Page successes and errors
• Transaction load times
• Page load time ranges
Get a quick view of results by interval.
Discover the number of successes/failures for each step.
Find successful transactions by interval.
Learn page load and transaction times by interval.
Learn page load and transaction times by interval.
Do statistical analysis to develop confidence.
See a breakdown of errors by page.
See a breakdown of errors by type.
Errors
• Errors by page • Errors by type
Track percentage of errors by type (content, timeout, connectivity). Note: Content/application errors are captured and saved for later analysis.
Analysis and Recommendations
After each test iteration, your engineer provides a written summary and analysis. Besides noting key findings, he/she pinpoints problems to the component level (network, router, application or server) and recommends corrective steps.
With this information you’ll be able to tackle common performance problems like:
• Bandwidth limitations
• Error rates exceeding thresholds
• Server CPU limitations
• Misconfigured web servers, application servers or database servers
• Errant load balancing configurations
• Router/firewall failure or misconfiguration
Executive Summary
After all tests are completed, your engineer will prepare your executive summary with overall findings and statistics from each test iteration. This document helps you answer important questions like “How many transactions can the website support?” or “How long does the checkout process take when under peak load?”
Armed with this information, you’ll find serious problems before your
customers do, plus know exactly how your site performs when it matters most. Instead of leaving things to chance, you’ll proactively protect your customer experience.
21575 Ridgetop Circle, Sterling, VA 20166 / +1 571 434 5400 / www.neustar.biz ©2012 Neustar, Inc. All rights reserved.
V1-11/08/2012
Neustar, Inc., (NYSE: NSR) is a trusted, neutral provider of real-time information and analysis to the Internet, telecommunications, information services, financial services, retail, media and advertising sectors. Neustar applies its advanced, secure technologies in location, identification, and evaluation to help its customers promote and protect their businesses. More information is available at www.neustar.biz.