• No results found

<Insert Picture Here> Real-Time Data Integration for BI and Data Warehousing

N/A
N/A
Protected

Academic year: 2021

Share "<Insert Picture Here> Real-Time Data Integration for BI and Data Warehousing"

Copied!
33
0
0

Loading.... (view fulltext now)

Full text

(1)

<Insert Picture Here>

(2)

<Insert Picture Here>

Agenda

Why Real-Time Data for BI?

Architectures for Real-Time BI

Oracle GoldenGate for Real-Time Data

Integration

Customer Examples

(3)

Evolution of Business Intelligence

A Paradigm Shift

Business focus Primary users Timeframe Use model

Operational BI

Manage and optimize daily business operations

LOB managers, front-line employees, operational systems

Intra-day

Event-driven, Event processing

Strategic BI

Long-term organizational goals

Executives, analysts

Months to years

(4)
(5)

Real-Time, Operational BI in Action

Fraud detection

Online promotion

optimization

Contact

(6)
(7)

<Insert Picture Here>

Agenda

Why Real-Time Data for BI?

• Architectures for Real-Time BI

Oracle GoldenGate for Real-Time Data

Integration

Case Studies

(8)

Architectures for Real-Time BI

Single source, operational reporting

Restricted to a single application

Easily combines BI into transaction processing

OLTP

OLTP OLTP ODS ODS EDW Reporting instance

Multiple source integration for reporting

BI apps run on ODS using operational data

Multiple source with operational and historical data

BI apps run on both ODS and the DW to combine

(9)

Common Methods for Data Loading to ODS/DW

(10)

<Insert Picture Here>

Agenda

Why Real-Time Data for BI?

Architectures for Real-Time BI

• Oracle GoldenGate for Real-Time Data

Integration

Customer Examples

(11)

Oracle GoldenGate provides

low-impact

capture, routing, transformation,

and delivery of transactional data across

heterogeneous

environments in

real time

Key Differentiators:

Non-intrusive, low-impact, sub-second latency

Open, modular architecture - Supports heterogeneous sources and targets

Maintains transactional integrity - Resilient against interruptions and failures

What is Oracle GoldenGate?

Performance

Flexible and Extensible

(12)

Oracle GoldenGate Use Cases

Enterprise-wide Solution for Real Time Data Needs

Log Based, Real-Time Change Data

Capture Heterogeneous Source Systems EDW ODS EDW Active-Active High Availability Zero Downtime Migration and Upgrades Real-time BI Fully Active Distributed Database Reporting Database ETL ETL Query Offloading Data Distribution New DB/ OS/HW/App

Global Data Centers

(13)

How Oracle GoldenGate Works

LAN/WAN Internet Capture

(14)

How Oracle GoldenGate Works

LAN/WAN Internet Capture Trail

Source

Oracle & Non-Oracle Database(s)

Target

Oracle & Non-Oracle Database(s)

Capture: committed transactions are captured (and can be

filtered) as they occur by reading the transaction logs.

(15)

How Oracle GoldenGate Works

LAN/WAN Internet Capture Trail Pump

Capture: committed transactions are captured (and can be

filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

(16)

How Oracle GoldenGate Works

LAN/WAN Internet

TCP/IP

Capture Trail Pump Trail

Capture: committed transactions are captured (and can be

filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

Pump: distributes data for routing to target(s).

Route: data is compressed,

encrypted for routing to target(s).

Source

Oracle & Non-Oracle Database(s)

Target

(17)

How Oracle GoldenGate Works

LAN/WAN Internet

TCP/IP

Capture Trail Pump Trail Delivery

Capture: committed transactions are captured (and can be

filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

Pump: distributes data for routing to target(s).

Route: data is compressed,

encrypted for routing to target(s).

(18)

How Oracle GoldenGate Works

LAN/WAN Internet

TCP/IP

Bi-directional

Capture Trail Pump Trail Delivery

Capture: committed transactions are captured (and can be

filtered) as they occur by reading the transaction logs.

Trail: stages and queues data for routing.

Pump: distributes data for routing to target(s).

Route: data is compressed,

encrypted for routing to target(s).

Delivery: applies data with transaction

integrity, transforming the data as required.

Source

Oracle & Non-Oracle Database(s)

Target

(19)

Databases

O/S and Platforms

Oracle GoldenGate Capture:

 Oracle  DB2  Microsoft SQL Server  Sybase ASE  Teradata  Enscribe  SQL/MP  SQL/MX JMS message queues

Oracle GoldenGate Delivery:

 All listed above, plus:

 MySQL, TimesTen, Netezza, Greenplum,

HP Neoview and any ODBC compatible databases Windows 2000, 2003, XP Linux Sun Solaris HP NonStop HP-UX HP TRU64 HP OpenVMS IBM AIX IBM z/OS z/linux

(20)

Oracle GoldenGate Topologies

Unidirectional

Query Offloading

Zero-Downtime Migration

Bi-Directional

Hot Standby or

Active-Active for HA

Peer-to-Peer

Load Balancing,

Multi-Master

Broadcast

Data Distribution

Integration/Consolidation

Data Warehouse

Data Distribution

via Messaging

(21)

Real-Time Data Integration for BI with ODS

Low-impact, change data capture, transformation, and delivery

BI Application

Production

OLTP Databases

ODS

trans5 trans4 trans2 trans

1 trans3

Real-time streaming of transactions

Sub-second latency

No impact on source systems

Oracle GoldenGate

LAN / WAN / Internet

Capture Source Trail

Target Trail

(22)

Real-Time Data Integration for BI with DW

Fastest Real-Time Data Integration, Fastest Bulk Data Transformation

BI Application

Production

OLTP Databases

DW

tx6 tx5 tx4 tx3 tx2 tx1

Real-time streaming of transactions

Low-latency

data for end users

No source impact and reduced batch windows on target

Thin middle-tier for high-performance, in-database transformations

Complete data recoverability with persisted queuing

Oracle GoldenGate ODI EE & DQ OBI EE LAN / WAN / Internet

Capture Source Trail

Target Trail

(23)

ODI EE & GoldenGate: Complete & Integrated

Non-invasive Capture + E-LT Processing

Application

Real Time BI

(using OLTP Schema)

Analytic BI

(Facts & Dims)

(24)

24

Oracle Real-Time BI/DW

Complete, Flexible, Integrated

EMP DEPT DIM FACT DIM DIM DIM ODS Schema DW Schema OBI EE Suite Plus

Log-based, Real-time Data Feeds

(25)

<Insert Picture Here>

Agenda

Why Real-Time Data for BI?

Architectures for Real-Time BI

Oracle GoldenGate for Real-Time Data

Integration

• Customer Examples

(26)

Solution

• Real-time data integration from Siebel CRM on Oracle Database to central Enterprise Warehouse

• 1,500 service agents log

600,000 customer calls per day

• Oracle GoldenGate moves 150-200 million records per day with 1.5 second latency.

Return on Investment

Reduced customer churn by 25%

Increased responsiveness of field technicians by optimizing call routes

More targeted/personalized offers by call center agents

Ranked top in its industry in the American Customer

Satisfaction Index

Business Challenges

• Focus on differentiating with customer service and reducing churn in a competitive market

• Centralize customer information to achieve single view to support sales, marketing, support & field service

• Executive direction to limit data latency to 15 minutes

Reduced Churn and Optimized Field Operations

(27)

Solution

 Enabled active data warehouse roll-out in 90 days with real-time data feeds from shopping and auction systems

 Complements Oracle

GoldenGate with Oracle Data Integrator for data transforms within the EDW

Return on Investment

• Customer analysis now done in minutes, rather than days

• Reduced marketing spend with ‘smart’ campaign decisions

• Reduced inventory costs

• Eliminated batch windows

Business Challenges

 Better understand customer purchasing behavior

 Provide timely information to support marketing, merchandising & operational decisions

 Improve shopping database reliability & uptime

Improved Customer Service and Reduced Costs

(28)

Solution

• Feed real-time data from Cage & Marker management,

Property Management and the Players Club loyalty applications to EDW

• Disaster Protection for Cage & Marker Management application

• Zero downtime database and hardware upgrades for Players Club application

Return on Investment

• Achieved complete view of customers and gain better insight on customers’

experience

• Provides timely data to marketing teams for high quality service and targeted offers for loyal customers

• Maintains system uptime

during planned and unplanned outages

Business Challenges

 Launched a Players Club for frequent, loyal

customers, which requires complete view of members

 Built an Enterprise Data Warehouse, to track

demographic and hotel folio data as well as casino activity, for marketing and financial analysis

Enhance Customer Experience with Unified View

(29)

<Insert Picture Here>

Agenda

Why Real-Time Data for BI?

Architectures for Real-Time BI

Oracle GoldenGate for Real-Time Data

Integration

Customer Examples

(30)
(31)
(32)

Quote Attribution

Title, Company

• Visit the Oracle Fusion Middleware 11g

web site at

oracle.com/goto/fmw11g/index.html

• Oracle Data Integration on oracle.com

oracle.com/goto/odi

• Oracle GoldenGate on oracle.com

oracle.com/goto/goldengate

• Oracle BI/EPM on oracle.com

oracle.com/solutions/business_intelligenc e/index.html

Get Started

• Oracle GoldenGate Resource Kit:

oracle.com/goto/goldengate

• Blog:

http://blogs.oracle.com/dataintegration

• Technical information available at:

oracle.com/technology/products/oracle-data-integrator/goldengate/index.html

• Data Integration Events

http://www.oracle.com/events

(33)

References

Related documents

Paracelsus introduced in his treatise the Doctrine of Signatures, the concept that the Creator has placed his seal on plants to indicate their medicinal uses.. Paracelsus

Informatica provides products and services to cost effectively access and deliver timely and trusted data in support of both analytical and operational business processes, enabling

Whether grown as freestanding trees or wall- trained fans, established figs should be lightly pruned twice a year: once in spring to thin out old or damaged wood and to maintain

If emergency access to the system by (company) or North Somerset staff, full details of passwords, procedures and contracts can be found in a sealed envelope in the school

Data Cleaning &amp; Integration Databases Data Mining Data Warehouse Task-relevant Data Selection &amp; transformation. }   Data mining plays

Data Cleaning &amp; Integration Databases Data Mining Data Warehouse Task-relevant Data Selection &amp; transformation. ` Data mining plays

•  LTFS stands for: Linear Tape File System 1,2 •  Allows for a single tape cartridge to appear like disk •  Files stored in hierarchical directory structure. • 

The proportion of news users in Northern Ireland who said they used BBC One, UTV, the BBC website or app, or other local commercial radio stations to access news.. about their