Big Data Volume, Velocity, Variability

(1)

Dr. Jürgen Krämer

VP Product Strategy IBO &

Product Management Apama

20.02.2014

Big Fast Data

Anwendungen und Lösungen

der Software AG

2 |

the time window to

analyze

&

act

to cause a smart

response

Big

Data

Volume

,

Velocity

,

Variability

3 |

… requires:

Continuous analysis

&

intelligent in-time action

Big

Fast

_Data

Volume

,

Velocity

,

Variability

4 |

Many industries face shrinking time windows to make

smart responses to critical business patterns

Typical Business SLAs

Algorithmic trading

100 ms

< 1 ms

Call center inquiries

8 hr

10 sec

Supply chain updates

1 day

15 min

Phone activation

1 min

0.5 hour

Refresh data warehouse

Track financial position

5 min

1 day

Airline operations

20 min

30 sec

Trade settlement

2 hrs.

Build-to-order PC

4 weeks

1 day

weeks

days

hours

minutes

seconds

3 days

1 week

5 days

Batch Analytics/

Data Warehouse

Rapid and

proactive

response is the

key to surviving

the pace of

competition

Intra-day Batch

Analytics

Continuous

in-memory Analytics

Low Latency

Analytics

Real-time “Continuous

Intelligence” Needed

Traditional Business Intelligence

(2)

5 |

Improve response time

to problems & opportunities

Link real-time insights with the right actions

V

a

lu

e

Business event

Data captured

Action taken

Information delivered

Time

SOURCE: Richard Hackathorn – The BI Watch: Real Time to Real Value

Action time

6 | 6 |

What is IBO?

“Intelligent Business Operations are a style of work in

which real-time analytic and decision management

technologies are integrated into the transaction-executing

and book-keeping operational activities that run the

business”

Gartner. March 2011

W. Roy Schulte, Janelle B. Hill, Nigel Rayner

Gartner’s definition focuses on operational effectiveness

7 |

Traditional BI and

off-line analytics

Intelligent

Business

Operations

BI and other Historical Analysis complement IBO

Running business operations

Observe

Situational

Awareness

Decide

Faster & Better

Decisions

Dynamic

Act

Actions

Strategic and

tactical decisions

Traditional BI,

statistical analytics,

data mining, etc. for

historical analysis

Reporting

Ad-hoc BI

analytics

Improve

Store

data

Data in motion

Source: W. Roy Schulte, Gartner Inc.

Data

Warehouse

8 |

Fast (In-Memory) Data Connectivity and Access

• Streaming analytics

• Historical analytics

• Process KPIs and SLAs

Process

Activity

Big Data

Live

Transactions &

Events

• Intelligent Actions

• Visualizations

• Alerts

Decisions

Analytics

Hadoop & Data Warehouse

Mobile events Financial & News Events Social Media Events

System alerts, sensors & machines

$ £ €

_¥

Business Processes

IBO Platform: Capabilities

(3)

9 |

Software AG Context

IBO becomes more compelling when aligned to the full SAG suite

In-Memory Data

Management

Connectivity & messaging

VISUALIZATION | ANALYSIS | DECISIONS | ACTIONS

Real-time process

analytics &

operational

monitoring

Process discovery

& historic process

analytics

SOLUTION BLUEPRINT…

SOLUTION BLUEPRINT

Customer Experience Mgmt

SOLUTION BLUEPRINT

Capital Markets

IBO Platform: Functions

Database

Real-time

continuous analytics

& event processing

$ £ €

_¥

11 |

Database

CEP

Optimize

PPM

IBO Platform: Primary products

SOLUTION BLUEPRINT…

SOLUTION BLUEPRINT

Customer Experience Mgmt

SOLUTION BLUEPRINT

Capital Markets

$ £ €

¥

12 |

Facts & Figures

• Leading provider of in-memory data

management and CEP (real-time

analytics) solutions

• 500K+ Enterprise Deployments

• 70% of Global 1000 use our software

• Behind some of the most widely

deployed software for scalability

and performance

5+ PB of data in memory

2.1M Developers in 190 Countries

• Powers 2 of the top 3

market-leading Foreign Exchange platforms

(4)

13 |

BigMemory: In-Memory Data Management

Server Array

BigMemory

App Server Ehcache App Server Ehcache

Speed Up

Scale Up

Scale Out

Elastic Scale

_{In the Cloud}

App Server Ehcache App Server Ehcache Database Database Database Database App Server

Ehcache

App Server

Ehcache

BigMemory

Server Array

BigMemory

Increase Data in Memory

Reduce Database Reliance

14 |

Unified

Productivity

Tooling

The

Correlator:

Apama

Run-Time Engine

Integration

with Live

and Static

Data Systems

Real-time output streams

feed Apama’s real-time,

interactive, dashboards or

any external system

Integration with

any data source/

sink or library

Cache integration

Rich, intuitive

development environment

for developers and business

analysts

Analytics, Patterns and

Applications are deployed

into the Correlator

Scalable,

high-performance

“Correlator”

Complex Event Processing

15 |

Real-time Data Visualization & Analytics

16 |

Use cases

Real-time visibility

(5)

17 |

Global E-commerce Avoiding “Black Friday” Blackouts

Challenges:

• Huge spikes in customer traffic at

peak times

• Proactive customer care

Legacy Approach:

• Product catalogue & shopping cart

pulled from multiple disk-bound

databases

FORTUNE 150

ATHLETIC

BRAND

Violated SLA

Order

bungled

Delivery late

18 |

Global E-commerce Avoiding “Black Friday” Blackouts

Solution:

Move data access to in-memory

Results:

• 90% of product requests served

instantly

• Backend services load slashed by 40%

• Average page load time reduced by

16%

• Search time reduced by 30%

FORTUNE 150

ATHLETIC

BRAND

19 |

Dell’s Global Command Centers

fix problems before they hit the customer

SLA Events

Inventory

Equipment Locations

Social Media

Weather Patterns

Visualize status &

proactively address

impending problem

Identify that an onsite

support SLA could be violated

20 |

Use cases

Continuous

optimization

Do more with less

Real-time visibility

(6)

21 |

Smart shipping logistics

Ship Movements (Sat)

Ship reporting

Port Messages

Detect a ship passing a certain area,

determine the relevance

Start appropriate

process

Pilot Project: Lines

on Sea

Detect when ships cross

a certain line, and give a

meaning to it.

Real-time and

historic/enriched

information on ships

Space based AIS

generates large

number of ship

movements

Real-time tracking of all

entities, highlighting

efficiencies and

predicted problems

Convey data reliably

from the remote ships

& dock side machines

Real-time access to

ships’ inventories

and planning

schedules

22 |

Sabre: Largest Airline Reservation System

Challenges

–

Scalability to meet business growth requirements

–

Keep operational & development cost to a minimum

–

750K reservations a day

–

Maximum of 10,000 transactions per second

–

Retain high reliability of mainframe

Solution

–

Terracotta BigMemory

–

Storing 500GBs of travel reservation sessions

and itineraries per day

Business Value

–

Delivered SLA’s of 99.99% uptime

–

Offload Mainframe MIPs by 80%

23 |

Use cases

Multi-payments Data

Interoperability

Continuous

optimization

Do more with less

Real-time visibility

Better, faster decisions

Fix problems early

Seize real-time

revenue opportunities

Outperform your

competitors

24 |

Intelligent Offers: Right Place, Right Time, Relevant

Thank You for Using Our Credit Card. We are offering 2% APR finance over 60 months on this TV to loyal bank customers. Click here to accept.

Real-time,

One-to-One

Marketing

Purchase flat

screen TV at

partner store using

bank credit card

Purchase flat

screen TV at

partner store using

bank credit card

Low current account balance

History of responding to attractive

credit offers

(7)

25 |

Location & context-aware promotions increase

revenue & loyalty

Enjoy 15% discount off any main meal at Sports Bar Diner in Wellington Mall this lunchtime

Real-time,

One-to-One

Marketing

Customer

location

detected

entering mall

Customer

location

detected

entering mall

Call Records

Program Triggers

Profile Changes

Location Changes

Customer who subscribes to the

“Live Sports Results” package

enters a Mall

Partner “Sports Bar Diner” has

capacity

Push offer of 15% off any main

meal this lunchtime

• Marketing the right offer at the

right time has yielded

$15m

revenue increase and 10x offer

uptake

• 35 million

subscriber profiles

analyzed each day

• Event streams with

40,000 events/second

Visualize campaign

deployed in

24 hours

Visualize campaign

effectiveness in real-time;

New campaigns can be

deployed in

24 hours

• 200 business criteria

checked in real-time

26 |

Use cases

Multi-payments Data

Interoperability

Continuous

optimization

Do more with less

Continuously manage

risk

Reduce losses by spotting

problems early

Real-time visibility

Better, faster decisions

Fix problems early

Seize real-time

revenue opportunities

Outperform your

competitors

27 |

Unusual trading activity just before

news release suggests insider

trading

Notify relevant

Compliance Officer

Trades

Quotes

News

Trader Behavior

Social Media

Compliance staff

visualize trade abuse

alerts; drill in to

investigate

Large numbers of complex risk and

surveillance rules that can detect

market abuse or problems before the

situation becomes critical

Real-time and historic

market data feeds

Mitigate potential regulatory violations before

they make the headlines

28 |

Fraud detection

in milliseconds drives

profit up by

10s of millions

Transforming Security

• Drive profit up by tens of millions

of Euros

• Meet 650 millisecond end-to-end

SLA 99% of the time

• Achieve better accuracy

• Fraud detection

–

Reduce fraud loss

–

Improve speed and accuracy

of fraud detection system

–

Increase rules in fraud detection

algorithm from 50 to over 1,000

Globally leading online payments

company with more than 100 million

customers in close to 200 countries

and an annual payment volume of

above $10B.

PayPal

(8)

29 | 29 |

Summary

Best of breed technologies – Apama, Terracotta, webMethods

Store, analyze and respond to patterns in process data, big data,

fast data and transaction data in the same platform

Streamlined for in-memory and real-time operations (Big Fast Data)

Operates on commodity hardware – no specialized hardware

appliances required

Market-leading time-to-value from solution blueprints + integrated

platform components

Intelligent Business Operations (IBO)

Thank you!

Dr. Jürgen Krämer