Professional Services

(1)

Professional Services

Performance Testing

Center of Excellence

Application Performance Management Solution

Information Technology Services

_{Click to Advance Presentation}

(2)

Today’s Challenges

Business lines rarely share information on tool research, usage,

testing practices, and cost containment.

Software Development Life Cycle models frequently compromise testing

initiatives to meet deliverable deadlines.

Performance Testing Practices vary in most projects.

Knowledge Transfer – performance testing information leaves with consultants.

Performance Tools are expensive, and very complex to integrate.

No global approach to Performance Testing tools, techniques, or costs.

Expensive consultants are frequently hired for Performance Testing

Many projects cannot afford to make long term commitments to

Performance testing.

Decentralized approach to building and testing software.

(3)

Industry Trends

Application owners often ask the following:

Does my application scale to meet business goals?

75% of ERP systems fail to do so

(Gartner)

Does my application scale to meet business goals?

70% of performance problems can be resolved by configuration changes

(survey of 3,000 HP/Mercury engagements)

Can I resolve application bottlenecks?

40% of app bottlenecks are first noticed by a customer or executive

(Mercury Survey)

$2B + spent in app server overcapacity from 2001 to 2003

(Gartner)

(4)

One Platform Solution

T3 works to empower Business, Quality Assurance, and Development

teams to deliver better software by centralizing all aspects of testing and

performance management.

Become Performance center of excellence

Centralize performance testing and monitoring tools

Global Performance testing execution capability

Focus on quick “cost savings” wins!

Reduce dependency on expensive consultancy

QUICK START‐ Bring automation in quickly that addresses an immediate need.

Reduce infrastructure support for testing

Take a ‘value’ approach and network it

Forge alliances & partnerships

Leverage vendor Purchasing Power

“Bringing the pieces together”

(5)

Performance Approach

Phase-driven approach to Performance Optimization

Phase 1:

Plan

Fully Plan the project

Organize the Team

Determine the business goals Define the business process Inventory HW, SW and network

Identify key participants Mobilize test team Create test plan

Agree execution schedule

Phase 2:

Baseline

Quantify the System

Performance

Create test cases

Deploy monitoring agents Run initial test plan

Document the baseline profile Compare baseline with target

Phase 3:

Optimize

Iteratively Isolate and

Reduce Bottlenecks

Emulate production load Monitor system performance Identify problem areas Analyze root cause Determine resolution Apply modification

Assess the Performance

Improvements and Report

Phase 4:

Report

Document

9 improved throughput 9 Increased capacity 9 reduced error rate 9 greater stability

9 better user response time Compare with baseline and target Produce findings/recommendations Retain data for future comparison

(6)

Why HP/Mercury

1. Proven Leadership

2. Market Visionaries

3. Strategic Alliance

Worldwide Performance Testing Market Share

Source Newport Group, Inc © 2004

Empirix

4%

Compuware

_4%

Other

9%

Segue

2%

Rational

9%

RadView

1%

HP/Mercury

71%

6

(7)

Automated Performance Testing

Web Server

App. Server

Database

Internet/

WAN

Controller

User

Simulation

PERFORMANCE MONITORS

Replaces real users with thousands of virtual users

Generates consistent, measurable, and repeatable

load, managed from a single point of control

Efficiently isolates performance bottlenecks across all

tiers/layers with automated reporting and analyses

(8)

Types of Performance Testing

1. Stress Testing

2. Capacity Planning

3. Throughput Improvement

4. Server Consolidation

5. Baseline Assessment

6. New Version Impact Analysis

7. Ensure Business Performance

(9)

Application Monitoring

Application Server Web Servers Database Server Router Router Load Balancer Firewall

ISP

¾

98% of sites experience critical performance problems

–

Typical applications encounter problems at 15% of design

capacity

¾

Problems occur both inside & outside firewall

–

25% - network and bandwidth related

–

23% - application server related

–

20% - load balancers, web server or proxy server issues

Source: Mercury Interactive hosted services

Application Management monitors the entire infrastructure

from the users perspective!

(10)

A Day In the Life… Daily Challenges

07:17AM

Ticket opened

07:05AM

Problem detected

- data center serving

e-Bank customers is down

07:31AM

Bridge-line opened

- 8 people

11:48AM

4 more people paged

, DBA joins line

04:05PM

Root cause identified

: mis-configured connection

pooling caused DB crash at peak traffic. At least 800

customers affected,

business impact unknown

04:20PM

IT representative sent to client impact

assessment meeting

08:03AM

Check UNIX issue,

escalate to hardware vendor

08:06AM

Business urgency discussed

, not well understood

10:51AM

Hardware is ok, Informix

DB appears down

10:20AM

Security clearance delays hardware vendor from

entering data center

(11)

Diagnose Root Cause

Define SLAs Business_Console Customer_Impact SLM Event Viewer

Tier 2 Top View

BUSINESS AVAILABILITY CENTER

Tier 1 Tier 3

(12)

Application Management Dashboard

Define SLAs Business_Console Customer_Impact SLM Event Viewer

Tier 1 Tier 2 Tier 3 Top View

BUSINESS AVAILABILITY CENTER RESOLUTION CENTER

(13)

Appendix

(14)

Introducing LoadRunner

Our Center of Excellence approach uses Mercury Interactive LoadRunner

product to deliver an integrated solution

for business technology optimization.

Network bandwidth Routers Switches Hosting equipment Load balancers Application servers Databases Middleware Back office Firewalls IDS systems DDoS systems Gateways Web servers Cache servers LAN / WAN Client Systems Legacy system .NET services Sun ONE services

Security Infrastructure Application Load Runner Sys tem Monitor Automated Scripts Data Repository

It provides an end-to-end tool set for performance

tuning

a user simulation module to create business transaction load

a system monitoring module to display infrastructure behavior and application

errors

a set of automated scripts that identifies modifications

a data repository for future comparisons

(15)

Powering the CoE

Application Delivery Foundation

Application Monitoring

Business Availability Center • Resolution Center

Application Delivery Console

Virtual

Users

Protocols

Monitors

PERFORMANCE CoE

Global Management

Multi-project Management

Resource Management

Diagnostics

Tuning

LoadRunner

Capacity

Planning

(16)

LoadRunner Coverage

Recommendation Resolution

Problem

Identification

Monitoring

User Simulation

Infrastructure

(e.g. Linux, Solaris, Windows)

Vendor Product

(e.g. Oracle, Websphere)

Performance Tuning Steps

T

unable Components

LoadRunner Capabilities in Optimization Exercise

In-house Apps

•_•method level for J2EE apps_{program level for other types}

* J2EE source code line-level identification available using OptiBench add-on.

(17)

LoadRunner Overview

Web Server App. Server Database Internet/ Intranet

USER SIMULATION PROTOCOLS

Clients

PERFORMANCE MONITORS

• SAP

• Oracle

• Siebel

• PeopleSoft

ERP/CRM

• HTTP(S)

• XML

• Citrix ICA

• SOAP

• WAP

Web

• EJBs

• CORBA

• COM

• RMI

• MQSeries

• 3270

• 5250

• VT100

• Oracle

• MS

SQLServer

• DB2

• ODBC

Middleware

Databases

Legacy

Operating

Systems

Network

Web

Servers

App

Servers

Java

Databases

• Windows

• Unix

• Linux

• SNMP

• WAN

Emulation

• MS IIS

• iPlanet

• Apache

• EJB • JDBC • JSP • Sitraka JMonitor

• Oracle

• MSSQL

Server

• DB2

• BEA WebLogic • IBM WebSphere • ATG Dynamo

(18)

LoadRunner Deployment

Application Tier Applications Application Servers Infrastructure Tier Fire wall Web Servers Load Balancer Fire wall Database Tier Database Servers Storage

Distributed System

App & System

Monitoring

Measure Performance → Identify Constraints → Apply Modification

~~~ ~~~

Stress Simulation

Telecomm Fabric Infrastructure Consumption CPU 28 CPUs Memor y 2,560MB Disk I/O 70% Networ k 80% System Capacity User count 100

Tranx rate 100/mi

n User Experienc e Response time 10 sec Error rate 10 %

Automated & Manual

Tuning

Step 1

1.Define business process

2.Capture user behavior

3.Create simulation profile

4.Apply controlled load

Step 2

Step 4

Sample Recommendations

WebLogic - misconfigured Java VM heap size

Database - missing indexes, full table scan ...

Step 3

Environment

under

User Load

Typical Statistics

18

(19)

Metrics

Databases

Oracle

• Total file opens • Enqueue deadlocks • Enqueue waits

• Opened cursors current

• SQL*Net roundtrips to/from client

• Plus 164 other counters

Sybase • Disk Reads • Memory • Disk Writes • Disk Waits • Locks count • % Hits

• % Processor Time (process) %

Microsoft SQL Server

• SQL Re-Compilations/Sec • I/O - Outstanding Reads • Lock Wait Time (ms) • Total Latch Wait Time (ms) • SQL Re-Compilations/Sec

DB2

• Local_con_exec • Total_sorts

App. Servers

IBM WebSphere • ThreadCreates • ActiveThreads • ConnectionPoolSize • SessionsActive

BEA WebLogic

• HeapSizeCurrent

• ActiveConnectionsCurrentCount • WaitingForConnectionCurrentCount

Iplanet Application Server • nasKesEngAutoStart

• nasEngSYBPreparedQueryTotal • nasEngThreadWait

Microsoft Active Server Pages • Requests Executing • Requests Queued • Request Bytes Out Total • Requests/Sec

• Transactions Aborted • Transactions Pending Oracle 9iAS HTTP Server Allaire ColdFusion SilverStream Ariba

ATG Dynamo

Microsoft COM+ Monitor BroadVision

Web Servers

Apache • #Busy Servers • #Idle Servers • CPU Usage • Hits/Sec • KBytes Sent/Sec MS IIS • Connection Attempts/Sec • Files Received/Sec • Logon Attempts/Sec • Total Files Transferred

Iplanet (Netscape) • Bad requests/Sec • Bytes Sent/Sec • Hits/Sec

Other Software

and Hardware

Streaming Media Monitors Checkpoint Firewall Server ERP Performance Monitors Middleware Monitors Java Performance Monitors Citrix MetaFrame Monitors Network Delay