BSM 9.22 Overview Introducing Big Data Analytics for IT July 18, 2013

(1)

© Copyright 2013 Vivit Worldwide

BSM 9.22 Overview – Introducing Big Data

Analytics for IT

_{July 18, 2013}

(2)

Brought to you by

Vivit Business Service Management

Special Interest Group (SIG)

Leaders: Jim Copio, Mark Laird,

Denver Meeks and Sandy Schubert

(3)

Hosted by

Mark Laird

PreSales Technical Consultant

Steria Ltd.

(4)

Today’s Presenter

Ian Bromehead

Sr Product Marketing Manager

HP Software

(5)

Housekeeping

This “LIVE” session is being recorded

Recordings are available to all Vivit

members

Session Q&A:

(6)

Webinar Control Panel

Toggle View Window between

Full screen/window mode.

(7)

Agenda

• Key business challenges

• Improving operational efficiency

• Managing the big data landscape

• “Read all about it”

• Connecting to your world

• New style of IT management

• Don’t use your users to manage

• Customer examples

• Key takeaways

• Questions

(8)

(9)

Agile Development creates rapidly

changing applications

Built in diverse languages and running on

diverse language runtimes

Running on next generation

deployment platforms

Deployed on multiple

virtualization platforms

Running on scaled out

commodity hardware

Located in multiple clouds with multiple

owners

The customer’s new world

(10)

The reality of today

Challenges for IT this creates

$426

billion in downtime per year

5.75 million servers

are installed every year.

10% are unused

The average data center has

30,000 resources

25%

of a company’s IT budget is spent on operating data center

300% increase

in the number of “events” over last 5 years

Public cloud

Private cloud

Managed cloud

Traditional

(11)

Comprehensive intelligence and analytics to deliver operational excellence

HP Business Service Management (BSM) 9.2

Intelligence on comprehensive data to ensure optimum IT performance

• Consolidate data from multiple disparate sources

• Provide intelligence to IT Operations help reduce MTTR

• Provide automation to reduce manual operator assistance and reduce cost

• Support heterogeneous environments, applications and technologies

Public cloud

Private cloud

Managed cloud

(12)

Featuring the Run Time Service Model

Ensure optimal IT performance and availability…in a dynamic world

Business Service Management

Forrester &

Gartner Leader

Ops Analytics the

next big thing!

Unique RTSM

engine

Patented

Analytics: IT’s

crystal ball

Huge Installed

Base

Operations

Intelligence

Actionable insight from

advanced analytics

Comprehensive visibility

and monitoring of hybrid

IT

Infrastructure Management

●●

Consolidated management,

accelerated root cause

analysis

Operations Bridge

End to end composite

application performance

management

Application

Management

(13)

Turning IT Data into actionable insights

IT Management infused with Analytics

Better,

Right Time

Decisions

Metrics

Events

Machine

data

RTSM

IT Financial

Analytics

Operations

Analytics

Service

Forecast/Trending

User Analytics

Predictive Analytics

IT Dashboard

Foresight

–

What will happen?

Hindsight

–

What happened?

Insight

–

What is happening now?

Oversight

–

Do I have the right

controls?

(14)

Improving operational

efficiency:

(15)

OMi 9.2x new features

Stream-based event

correlation:

• Repetition

Check of frequent repetitions of an

event

• Combination

Detect a combination of multiple

events

• Missing Recurrence

A repeatedly occurring event is

suddenly missing

Automatic event storm

detection & suppression

Show potential causes within

topology based event

correlation scenarios

Fast time-to-value

• Works purely on events

• No need to map events to health

indicators

Simple operations

• Integrated into BSM mesh-up

• Drill-down to Event Console

• Simple status aggregation via filters

and views

• Also available for mobile devices

Modern user interface

• Optimized usage of available real

estate

• Custom pictures for quick

identification

• Flexible layout capabilities

• iSO and Android Mobile MiniApp

• Windows 8 Quick Access

(16)

Engage OpsBridge users with OMi gamification

Take advantage of

proven

psychological

theories

to

engage users

Motivate

OMi

users

by

providing

direct feedback

when they achieved

something

Notifications, timeline,

achievements

for OMi operators and

administrators

(17)

Monitoring automation at a glance

Monitoring automation simplifies

monitoring configuration for

dynamic, hybrid environments, by:

• Automatic, model driven monitoring

configuration and deployment using RTSM

• Hiding monitoring implementation complexity

- e.g. agent less/based monitoring

• Easy-to-tune monitoring parameters by SMEs

• Dedicated workflows for monitoring design

• Monitoring configuration easy auditing and

reporting

• Drive compliance to IT Management internal

best practices as well as Industry standards e.g.

Six Sigma

(18)

Fully automated monitoring configuration

For composite applications and…

• Application discovered within RTSM

• Result is matched against modeled application blueprint

• Monitoring Automation activates monitoring configuration

according to pre-defined “best practices”

(e.g. Windows vs. Linux servers)

• Works identically for infrastructure components

…to changes in modern dynamic IT

landscape

• Constant “re-discovery” of IT landscape

• In case of changes, correct monitoring is deployed or

undeployed automatically

• Monitoring configurations exports possible e.g for virtual

machine images

New composite application

provisioned within minutes

Nodes & apps added, or

suppressed on demand

(19)

Fully automated monitoring configuration

Works across many tools

• Separate what should be monitored from how

–

aspects vs. policy templates

• Automatically configure corresponding monitoring tools

as needed

Self-service configuration for

non-Ops staff

• Specific, tailored workflows for monitoring design and

operations

• Parameters for easy tuning by SMEs (no policy skills

needed))

• Parameters abstracted from underlying monitoring

tools

 use same parameters independent of

which tool is used

OM

Agents

SiS

Server

s

Open to connect other tools

OMi +

Monitoring Automation

Monitoring

Designer

Subject Matter

Expert

(20)

Built-in configuration reports

What is monitored and how?

Built-in report pages that show hat

is monitored and how:

‚Configuration Item‘-centric or

‚Node‘-centric

Also shows what is currently monitored by

which tool (e.g. agent based vs. SiteScope

agentless monitoring)

(21)

Out-of-the-box / available today / more to come …

OMi Management Packs

Hadoop

Distributed storage &

application processing

Vertica

Interactive real-time

analytics

Discovery

Data

Collection

Availability

monitoring

Performance

monitoring

Event

Correlation

Real time

graphs

Trend

Reporting

Oracle

Database

Relational Database for

enterprise applications

Infrastructure

System, OS, Virtual OS,

Cluster

(22)

Hadoop Management Pack overview

Value proposition

Automatic monitoring of your Hadoop environment

Monitoring of availability and performance of core

Hadoop components

• HDFS

• Map/Reduce

System Infrastructure monitoring of Hadoop nodes

Support matrix

Hadoop on Linux (RHEL 5/6, Ubuntu 12x,

SLES 10/11)

Distributions:

• Apache 1.0.x

• Cloudera CDH 4.1.x

Value prop and support matrix

Critical monitoring includes

• Monitoring Hadoop Services

• Node Infrastructure and Cluster monitoring

• Correlation with cross domain/components JVM, RPC,

Network, Database like Vertica, MongoDB and other

databases.

(23)

Vertica Management Pack overview

Value proposition

Automatic monitoring of your Vertica

environment

Monitoring of availability and performance of

core Vertica components

System Infrastructure monitoring of Vertica

nodes

Support matrix

Vertica 6.0, 6.1 on

SLES 10 + 11

RHEL 5 + 6

Value prop and high level features

Key required events generated by Vertica cluster with severity, Timestamp and

Vertica node name include

• Low Disk Space

• Read Only File System

• Loss Of K Safety

• Current Fault Tolerance at Critical Level

• Too Many ROS Containers

• WOS Over Flow

• Node State Change

• Recovery Failure

• Recovery Error

• Recovery Lock Error

• Recovery Projection Retrieval Error

• Refresh Error

• Refresh Lock Error

• Tuple Mover Error

• Timer Service Task Error

• Stale Checkpoint

(24)

Other OMi Management Pack Software

Value proposition

Automatic monitoring of your Oracle

Database environment

Monitoring of availability and performance of

core Oracle components

System Infrastructure

monitoring of Oracle DB nodes

Value proposition

Automatic monitoring of your system

infrastructure

Monitoring of availability and performance

of servers

Oracle Management Pack overview Infrastructure Management Pack

overview

(25)

HP OMi Management Pack Licensing

How to count number of OMi Management Pack licenses required:

• Identify the number of OS Instances (physical or virtual)

• The number of application domains on each OS instance (physical or virtual) gives the total license requirement

Server 1

Physical OS

Oracle Application Instance 1 (Ora1)

Server 1

Physical OS

Ora1 Ora2

Server 1

Physical OS

Ora1 Had1

Server 1

Physical OS

Or a1 Ha d1 Or a2

# OS Instances

# App Domains on

each OS Instance

# License Req

1

2 2 (1Std, 1Adv)

1

2 2 (1Std, 1Adv)

(26)

Read all about IT:

Cross-Domain Reporting

with SHR 9.30

(27)

Cross-Domain Reporting with Service Health

Reporter

• Remote collector support

• SHR Support for Red Hat Linux

• CAC certification

• Collection from Sitescope

now uses Profile DB

• Platform refresh: BO XI 3.1 SP5

(28)

OVPI Migration Program: Key Dates

Date

Program Activity

May 1, 2013

Internal announcement

June 1, 2013

Product discontinuance announced

August 1, 2013

End of sale

May 31, 2015

End of Committed Support for 5.4x version

(29)

OVPI to SHR Migration

• EOL June 1st 2013, last orders 31st August

• All customers with active support contracts for

OVPI will receive full entitlement to SHR core

product

• Entitlement includes 1:1 node count

• PI Cores and all Report Packs Migrate to SHR

using Migration SKU

• Support costs economically attractive to the

majority of migrated customers

• Customers using OVPI network report packs are

entitled to special discount with a special OVPI

to NNNi + iSPIs Promotion

Summary

PI Core

System RP

SHR

Migration

SKU

NNMi +

iSPI(s)

250 Nodes

1000 Nodes

5000 Nodes

Unlimited Nodes

250 Node

Migration SKU

1000 Node

Migration SKU

5000 Node

Migration SKU

Unlimited Node

Migration SKU

Promo

Network RP

(30)

OVPI to NNM iSPI(s) Promotion

• PI Cores and any Network report packs

• Customers may purchase NNMi + iSPI(s)

via promo with 87% discount..

• Scalability Migration SKUs for each tier..

PI Core

System RP

Network RP

SHR Migration

SKU

NNMi + iSPI(s)

PI Nodes Counts

• Infrastructure

• LAN Edge

• WAN

Advanced Services

• IPT

• MPLS

• Traffic

• QA

Equivalent

NNMi + Metrics

Nodes Count

Required Points

and / or Traffic

collectors

Promo

(31)

Connecting to your world:

the BSM Connectors

(32)

What’s available today

BSM Connectors

• These connectors are available at

https://hpln.hp.com/group/business-service-management

• Check regularly, more new connectors coming very soon!

• A few examples:

Topology

Events

Metrics

BSM Connector for Nagios

Yes

No

BSM Connector for Microsoft SCOM

Yes

BSM Connector for Tivoli/Netcool

Yes (from

events)

Yes

No

BSM Connector for Oracle Enterprise Manager 1.0

Yes

No

BSM Connector for NNMi

Yes

No

BSM Connector for ArcSight

N/A

Yes

No

(33)

New style of IT management:

Operations Intelligence

(34)

Fundamental transformation in IT

IT management : a seminal shift

1990s

2000s

Now

Static

Vertically Scaled

Client Server

100s (Elements, MB

)

Clustered

Load balanced

N-Tier Web App

1000s (Elements, GB)

Virtualized and Cloud

Horizontally Scaled

Hybrid Composite App

1,000,000s (Elements, ZB)

IT

c

om

plex

it

y

Manage what

matters

Advanced

correlation

IT Analytics

100s

1000s

1,000,000s

(35)

A unified approach to solving IT Management

problems

Event triage

Log management

Advanced analytics

Advanced correlation

Unknown problems

Known problems

R

eac

tiv

e

m

onit

oring

Proac

tiv

e

m

onit

oring

Operations Intelligence

(36)

HP

Only HP provides end-to-end Operational

Intelligence

Event Triage

Log Management

Advanced Analytics

Advanced Correlation

Unknown Problems

Known Problems

R

eact

iv

e

M

oni

torin

g

P

roact

iv

e

M

oni

torin

g

Operations Analytics

OM

Logger

SHA

OMi + TBEC

Event Triage HP Run-Time Service Model and

OMi

Adv. Correlation HP OMi Topology Based Event

Correlation

Log Management HP Arcsight + Integrations

Advanced Analytics HP Operations Analytics +

SHA

Service model RtSM + BSM Apps



Topology Operational Events Performance Metrics Logs

NNMi++

(37)

Free information to securely flow anywhere

Digital signage

Data

Event

s

Cloud

Topolog

y

Metrics

Network

Apps

Texts

Storage

Logs

(38)

HP Operations Analytics

Enable a single view of IT health –

risk-free.

• An economical solution licensing based on # of

IT components, not volume of data being

collected.

Collect everything.

• Collect data from log-generating source and IT

events.

Store everything.

• Using efficient compression store all data in one

location for any number of years. enable easy

search, reporting, and analytics and reduces the

cost of storage.

Analyze everything.

• Analyze data using simplified search functions

and enhanced auto-completion of search key

Advanced Logfile Management for the new style of IT Operations

Operations Analytics

IT Search

Events

OMi/OM/NNMi

Logs

ArcSight Logger

(39)

Log Intelligence – collect, store and analyze everything including server, app,

infra logs

Understand your IT data

• Collect

logs and events from any log

generating source and enrich

metadata through normalization and

categorization

• Store

years’ worth IT data through a

high compression ratios for archival

and search

• Analyze

raw machine logs and events

in real time to deliver IT security, IT

operations, IT GRC, and Log analytics

(40)

Digital signage

Data

Event

s

Cloud

Topolog

y

Metrics

Network

Apps

Texts

Storage

Logs

Advanced analytics based on COMPLETE Operations data

(41)

Comprehensive, actionable insight for the new style of IT Operations

HP Operations Analytics

Application

Mobile app

Storage

Network

System

Cloud

Scalable Operations Analytics solution

Operational

events

Performance

metrics

Topology

Logs

Visual Analytics

Guided troubleshooting

IT Search

NE

W

(42)

HP Operations Analytics

Features

• Robust platform to aggregate operational Big Data for

IT

• Advanced Analytics with powerful IT search, guided

troubleshooting and breakthrough visual analytics

Problems it solves

• Actionable insight from increasing data volumes &

complexity

• Speeds troubleshooting with minimum domain

expertise

• Analysis of structured & unstructured IT data in a

single place

Customer benefits

• Comprehensive visibility and analysis of IT data

• Prevent costly service downtime and reduces outages

• Protects investment in existing solutions (HP BSM,

Splunk

Comprehensive, actionable insight into all aspects of operations in the New Style of

IT

(43)

HP BSM: Service Health Analyzer

• Predictive alerting based on learned

pattern detection

• Unique topology-based performance analytics

• Automated root-cause and similarity analysis

• HP patented algorithms / IP

Foresight

of potential issues with behavioural learning and predictive analytics

“SHA Detected an issue 36 minutes before

regular monitoring detected it”

Healthcare Provider

“SHA detected an issue 1 hour before it was

reported by end user”

(44)

How SHA works

• Adaptive Baseline

– detect metrics seasonality,

trend and create dynamic baselines

• Topology Analysis

– correlate metrics of related

CIs across domains

• Temporal Analysis

– differentiate between

spikes and real anomalies

• Historical Analysis

– compare with similar

anomalies from the past

• Statistical Learning

– learn normal system

behavior and suppress noise

Dynamic model driven behavioural learning and predictive analytics

Collects

data

Creates

baselines

Detects

anomalies

Sends

event

Investigate

remediate

SHA

Runtime

Core

Baseline

Topology

Analysis

Temporal

Analysis

Historical

Analysis

Statistical

Self

Learning

(45)

Why should you care about ‘HP Operational Analytics’

Why HP for HP OpsAnalytics solution?

• HP has a more mature product than Splunk

• Enterprise ready / scaleable

• >300 connectors /normalization capabilities, Splunk < 100

• HP ArcSight Logger is an universal log

management solution that can help you “beat

Splunk” in IT ops, ops intelligence, and analytics

• Yes, Logger is integrated with BSM=HP

OpsAnalytics today

• Yes, Logger is now your metric-1

• Logger is leader in Gartner MQ Quadrant

• HP OpsAnalytics voted Strong Value by EMA

(46)

Don’t use your users to

manage:

Application Performance

Management

(47)

Pinpointing root cause of poor performing mobile apps isn’t easy

New adventures in mobile performance

Carrier?

App?

[Hybrid]

(48)

End-to-end mobile performance monitoring

Carrier

Service

App

[Hybrid]

Proactive (synthetic)

Real user

 Performance views by

time, place, carrier &

transaction;

 Lower mean time to

isolation, insight in

minutes.

 Baseline real user

performance;

 Assure and protect the

brand equity

 Understand transaction

popularity and response

times;

 Dev/Ops script reuse

User analytics: performance by time, location, transaction

(49)

Analytics – RUM ‘User Flow Analytics ’

• RUM User Flows Analytics

report identifies application

flows which are frequently

accessed by real users and

allows you to view real

sessions including the flow,

configure RUM transaction

and even create a VuGen

script based on the session

• The report is based on

advanced HP Labs analytics

algorithm

(50)

HP SaaS global infrastructure footprint

Over-the-air mobile

locations via

different carriers

coming soon…

AMS -

31 EMEA -

₂₃

APJ - 12

(51)

Persona: Operations Manager

With HP Performance Anywhere,

Operations can predictively monitor

mobile application performance

(52)

Persona: Operations Manager

With HP Performance Anywhere,

Operations can determine the

reason for poor mobile

(53)

Persona: Operations Manager

With HP Virtualization

Performance Viewer, operations

managers can drill down to VM’s

performance to

(54)

Persona: Operations Manager

With HP Network Flow Analytics, a

free tool, operations managers can

easily find network performance

problems.

(55)

Persona: Operations Manager

With HP SiteScope (agentless monitoring)

operations managers can drill down to servers,

storage, CPU, performance to identify problems.

(56)

(57)

“We needed to go with the most powerful software solution on the market.

After evaluating vendors, we decided to implement HP’s BSM software.”

Aslan Demir, Chief Information Officer, Kuveyt Türk Participation Bank

Issue

Before

After

Spending too much time on root-cause

analysis, not knowing where is the

problem

• Spending ~3 hrs on the root

cause of a problem, with annual

cost of approx $140K

• Reduced to 1 hour for root

cause analysis – 50%

improvement

Reactive application monitoring -

availability & performance issues,

increased

service desk costs

• ~ 3000 calls on apps/yr

• ~45K service desk cost annually

• # of calls down to about 2000

• Reduced service desk costs by

a third

Using HP BSM to reduce costs, improve customer satisfaction

(58)

(59)

Call to action

Download Operational Intelligence solution today

Explore 1

st

_{Generation operations}

analytics

-

Download the freemium integration

components

-

(Optional) Download freemium Arcsight logger

and/or OMi

-

Integrate your OMi or OM or NNMi

-

Exploit Award winning search to find issues

fast

Adopt the New Style of IT

Management

-

Ask to enter the Early Release Program for HP

Operations Analytics

-

Install the Virtual appliance

-

Get all the advantages of BigData Analytics for

IT Operations

(60)

Call to action

Please consult

www.hp.com/go/bsm

www.hp.com/go/oi

www.hp.com/go/omi

• Free downloadable software

• White Papers

• Videos

• Recorded webinars

• Customer use cases

• Industry experts’ opinions

Download BSM and Operations Intelligence solutions today

Intelligent IT Operations: making IT smarter

with advanced event correlation and

management

Plus!

(61)

Thank you

(62)

Opt-In

Opt-In to hear and receive more information

from HP and be entered into a draw to win one

USD50 Amazon Gift Card.

www.hp.com