Implementing efficient system i data
integration within your SOA
Are your production systems maxed out?
Are your information systems in sync?
What happens in case of a disaster?
How do you integrate new applications?
Do you react to your business fast enough?
Do your operations run 24 hours a day?
What happens when you can’t access production systems? How do you ensure consistent data?
Is your data out of date?
Are you under pressure to protect your business applications?
Can you handle the growing volumes of data?
Do you know how your business is doing right now?
Are you confident about the accuracy of your data?
Data Challenges
Data is
everywhere
Data access is
complex
• Numerous data
sources
• Decentralized
silos of info
• Fragmented or
inconsistent data
• Stored in different
types of data sources
Data is difficult
to integrate
• No aggregated,
real-time view of information
• Costly to build,
maintain, and troubleshoot
• Demanding
Business and IT Drivers Demand Agility
Respond rapidly to new opportunities and customer demands
Increase real-time information sharing in the enterprise
Leverage existing
relevant information to better understand the business
Ensure regulatory compliance with information
Requirements for real-time, access to data from numerous data sources
Integrate data that resides both inside and outside the company
Increase data consistency and quality
Reduce increasing data access complexity and costs
Be agile to the data needs of the business
Meet regulatory
compliance and data privacy laws
Current Situation
Data contained in multiple database and applications
No aggregated, real-time view of data
Point-to-point connection between the consumer and the data source
Portals Web Applications
BI
Applications ESB, EAI, BPM
DB HR Sales Web
Business Benefits
• Enables rapid development and deployment of data services – minimize coding
• Transforms data into reusable, actionable information as a service
Faster Time to Value
• Decouple consumers from data implementation – provide change isolation
• Provides data governance – security, auditing
Reduced TCO
• Manages enterprise data complexity and consistency
• Easily adapts to business demands and application requirements
• Increases information sharing
Greater Business Agility
DataMirror’s unique technology provides continuous data
integration, protection and event detection without
impacting the performance of operational systems.
Business Problems
……Without Slowing the Performance of Production Systems
Data Protection for High Availability and Disaster Recovery
Mitigate risk and offload production systems
Real-time Integration for Business Intelligence and Reporting
Yesterday’s data inadequate for
inventory and purchasing decisions
Real-time Event Detection
Pro-actively monitor and respond to business changes
Integration of Production Data for e-Business
Applications
Up to date information flowing to and from web applications
The DataMirror Advantage
Databases
Database Log Databases
DB2, Oracle, SQL Server, etc
Message Queues
DataMirror Transformation Server
High performance, peer-to-peer data integration solution
Detects, translates, and communicates information changes
(real-time)
Eliminates batch windows
High Volumes with Minimal System Impact
Information always fresh & synchronized
Native database interfaces - fast/efficient
Push vs. Pull technology
Replication options for data warehousing environments
Role-based user security
GUI improves ease of use
Transformation Server Overview
High performance, peer-to-peer, multi-platform data integration
solution
Captures, transforms and flows data in real time across
heterogeneous platforms and databases
Creates real-time data flows that facilitate a range of critical
business applications:
Active Data Warehousing - EAI
Business Activity Monitoring - e-Business
Business Intelligence - Mainframe Integration
CRM - Regulatory Compliance
Data Distribution - Supply Chain Management
Transformation Server
Transformation Server (TS) is a software solution that:
Connects two or more databases together employing replication
Works on a variety of systems (Windows NT, Mainframe, iSeries, Sun, HP, etc.)
Works with a variety of databases (Oracle, DB2, etc.)
Employs Changed Data Capture technology
Captures, transforms and flows the data in real-time
Capture: Grab/copy changes to data as the change occurs
Transform: Modify the data using filters, calculations or functions
Flow: Send the data to another database
Real-time: Without any delay, changes are immediately sent
Real-time Data Integration
1010
Transformation Server: What can it do?
Data replication
Real-time
Multi-platform
Multi-mode
Bi-directional
Joins
Custom extensions
Column level filtering
Row filtering
Data transformation
Single point of admin
Fault tolerance
Business Benefits of
Transformation Server
Ease to Deploy: TS easy-to-use GUI makes it simple to select
source and target databases and configure transformations
Low Impact – Using log-based CDC, TS captures changed data
without impacting the performance of mission-critical applications
Real-time – Data changes are detected real-time and flows
immediately to target systems
Flexible – Customers use Transformation Server to solve many
different problems across a wide range of platforms
Data in Motion
Database technologies store data.
Message Oriented Middleware technologies move data.
Until now, there has not been an easy way to allow the database
to integrate with message oriented middleware
data at rest VS data in motion – Gartner
What does TS/ES do?
Detects events as they occur in mission-critical production
applications
Creates useful business information to feed into the message
queues of leading enterprise application integration (EAI),
business process management (BPM), and service-oriented
architecture (SOA) environments.
TS TS
Message Queue TCP/IP
Logs Publisher Subscriber TCP/IP
DB Update
Event Detection
What is an event?
Could be anything?Financial – suspicious transaction
Retail – stock shortage, loyalty rewards, late delivery
Telco – new customer, number of support calls
Manu – low inventory, large order
Healthcare – potential drug interaction
To improve customer service, increase revenue or lower costs
companies can proactively react to these business events
How?
The DataMirror Fit
We bridge the gap between where the data is and where it will
make a competitive difference
CDC – Real-time, Low-Impact, Data Auditing
XML RFID EDI X12 … Event Data flow
Transformation Server/ES: MOM Support
Transformation Server/ES uses JMS (Java Message Service) to
write to JMS Compliant Message Oriented Middleware.
Configure the MOM as a JMS provider,
Define JMS connection factories, queues, and topics in the Java
Naming and Directory Interface (JNDI) namespace for use by
Transformation Server /ES.
Content Enrichment
Combines content associated with the event from other systems
ERP Event
Server
CRM
Purchase Order
Customer Information
XML Document
Content Based Routing
ERP Event
Server
Content based routing
Routes the data to different message queues based on content
of a message
Purchase Order
Message Queue
Message Queue
Graphical XML Mapping Tool
Automatically adjusts the structure of an
XML document using drag and drop GUI
Automatic XML Mapping
<CustomerOrder> <Customer>
<CustomerName>ABCDelivery</CustomerName> <CustomerCode>CUS112</CustomerCode>
<CustomerAddress1>1234 Avenue Street</CustomerAddress1> <CustomerAddress2>Waterloo</CustomerAddress2> </Customer> <Order> <OrderNumber>S906</OrderNumber> <OrderDate>02/14/05</OrderDate> <ProductCode>X5PR</ProductCoder> <CustomerCode>CUS112</CustomerCode> </ Order> </CustomerOrder> CUS112 X5PR 02/14/05 S906 Customer Code Product Code Order Date Order Number Customer Customer Customer Customer
CUSTOMER ORDER TABLE
TS/ES Example
National Retailer of Home Electronic, Furniture and Appliances
Business challenge
Need to centrally manage inventory allocation to stores
Technical challenge
Need to flow sales data in real-time between the POS systems and the Stock Allocation Application
TS/ES Example
POS
TS/ES
Uses CDC to detect new sales orders
TS/ES detects new sales order, transforms the data, and sends it in
a message format for immediate delivery to a message queue
Sale
s Order
Message Queue Sales/Inventory
Information
POS
POS
Sales Order
Sales O rder
28
Telecom company - Environment
Integrate billing system and other applications using
Transformation Server/ES and TIBCO message queues (which
they already own)
Data captured from source is converted into XML format and applied to the TIBCO message queue
TIBCO then transports the message to other applications
Example: Prepaid customers
TS detects customers who are running low on minutes and sends XML to TIBCO
TIBCO routes XML to CRM application to notify the customer via a text message Billing System TS/ES Customer Transactions Corporate Systems TIBCO Customer Transactions
Business Benefits of TS/ES
Ease to Deploy – Quick set up of event detection and message
delivery
Low Impact – Captures events without impacting the performance
of mission-critical applications
Real-time – Events are detected in real-time and flow immediately
to messaging middleware
Flexible – Native connection of source databases across multiple
computing platforms for message delivery to any JMS compliant
message queue
Multi-Platform Support
IBM iSeries IBM zSeries IBM pSeries HP-9000 INTEL HP ALPHA SUN MS SQL ServerSYBASE DB2 / UDB
ORACLE TCP/IP TERADATA OS/400 OS/390 AIX HP-UX SOLARIS MS Windows LINUX(INTEL) PointBase DATABASES Source & Target
DATABASES Target Only OPERATING SYSTEMS HARDWARE PLATFORMS NETWORK PROTOCOLS MESSAGE QUEUE Target Support JMS MQ Series WebMethods BEA Tibco NETEZZA
Business Benefits Of Data Resiliency
High Availability
Perform backups without interruption
Provide a service during periods of scheduled maintenance
Business Continuity
Rapidly resume service in the event of a failure
Allow batch jobs to re-start from a known good copy of the data
Disaster Recovery
Rapidly resume service at a remote data centre in the event of a disaster
Other
Offload query and reporting workload
Single Integrated Product
Data
Mirroring
Object
Mirroring
Monitoring
Switching
Strengths
• Single install (more reliable)
• Unified administration (easier to use)
• Less complex switching (faster and more reliable)
• Avoids duplicate processing jobs (uses less CPU)
About DataMirror
Founded in 1993
Stock Symbols (TSX: DMC)
Fiscal 2007 Revenue: $46.5 million US
International Offices in North America, South America,
Asia, UK, Belgium, Germany, France, Spain
300+ employees worldwide
2,100+ customers worldwide; 10,000+ licenses deployed
Leading provider of real-time information integration solutions and
services
Thank You
How to reach us:
