Let Big Data connect
the dots in your business
Big Data Conven-on -‐ September 25, 2014 – Golden Tulip Brussels Airport
Falke Van Onacker
Segment Leader for Big Data Analy4cs
IBM SoIware Group – Belgium & Luxembourg
3
4
Pop up slides
CuNng-‐Edge « Freemium » soIware for YOU
Go to
hVps://www.ibm.com/analy-cs/watson-‐analy-cs/sign-‐up/
index.html?SOURCE=default&S_CMP=az-‐neo
6
Many Industries are in the middle of all kinds of Hurricanes
Fiat Chrysler’s boss, Sergio Marchionne, is worried that
it will cost his company money to
“provide a venue to host other people’s par=es”
Source: The Economist – “The Connected Car” September 6, 2014
Digital disrup-on is now in full bloom at European, Australian
newspapers
If newspaper companies cannot produce sufficient revenues from digital, if they cannot
produce exci4ng, engaging offerings for both readers and adver4sers, they are des4ned to
offer mediocre products with
nothing to differen=ate
them from the mass of faux news.
Source: « Poynter » -‐ online ar4cle June 9, 2014
7
Automotive & Transport Industries are in the middle of all kinds of Hurricanes
Copyright by Boston Consul4ng Group
8
12
!
Operations Analysis
"
!
Only vendor combining at-rest
vehicle data with real time
data-in-use from vehicles for single,
integrated view and analysis
within and outside of Hadoop
environment
•
Predict demand for replacement
parts and service
•
Monetize telematics data
•
Provide drivers assistance
Advanced Condition
Monitoring
13
14
Introduction – IBM Big data architectural overview
Paradigm shifts enabled by big data
Leverage all data being captured
Reduce effort to leverage data
15
Big Data is Changing the Value Equation
Analyzing MORE Data will provide MORE Value
Cost outweighs value of
analyzing more data
Jump in value curve from
new data sources and types
Reduction in incremental costs from
new Big Data technologies
16
of every big data & analytics project is spent
Finding
Data
Understanding
Data
Cleansing
Data
Integrating
Data
17
Actionable insight
Data Marts
Data types
Transaction and application data Predictive analytics and modeling Reporting and analysisOperational
systems
ArchiveEnterprise
Warehouse
Staging area
Better information through transformation
18
Actionable insight
Reporting &
interactive
analysis
Data types
Transaction and application data Predictive analytics and modeling Reporting and analysisOperational
systems
ArchiveEnterprise
Warehouse
Staging area
Better information through transformation
Leverage column-store and in-memory capabilities to improve performance and enable reporting &
analysis directly against operational data
19
Actionable insight
Reporting &
interactive
analysis
Deep
analytics &
modeling
Data types
Transaction and application data Predictive analytics and modeling Reporting and analysisOperational
systems
ArchiveEnterprise
Warehouse
Staging area
Better information through transformation
Provide dedicated analytics processing for faster, deeper analysis
and modeling
20
Actionable insight
Exploration and
landing
Trusted data
Reporting &
interactive
analysis
Deep
analytics &
modeling
Data types
Transaction and application data Enterprise content Social data Image and videoThird-party data Predictive analytics and modeling Reporting, analysis, content analytics Discovery and exploration
Operational
systems
ArchiveBetter information through transformation
Leverage Hadoop to capture operational data, leverage additional data types and enable exploration
of data prior to normalization
21
Actionable insight
Exploration,
landing and
archive
Trusted data
Reporting &
interactive
analysis
Deep
analytics &
modeling
Data types
Transaction and application data Enterprise content Social data Image and videoThird-party data Predictive analytics and modeling Reporting, analysis, content analytics Discovery and exploration
Operational
systems
ArchiveBetter information through transformation
22
Actionable insight
Exploration,
landing and
archive
Trusted data
Reporting &
interactive
analysis
Deep
analytics &
modeling
Data types
Real-time processing & analytics
Transaction and application data Machine and sensor data Enterprise content Social data Image and video
Third-party data Decision management Predictive analytics and modeling Reporting, analysis, content analytics Discovery and exploration
Operational
systems
Better information through transformation
23
Information Integration & Governance
Actionable insight
Exploration,
landing and
archive
Trusted data
Reporting &
interactive
analysis
Deep
analytics &
modeling
Data types
Real-time processing & analytics
Transaction and application data Machine and sensor data Enterprise content Social data Image and video
Third-party data Decision management Predictive analytics and modeling Reporting, analysis, content analytics Discovery and exploration
Operational
systems
Information
Integration
Data Matching
& MDM
Security &
Privacy
Lifecycle
Management
Metadata &
Lineage
Better information through transformation
24
Information Integration & Governance
Exploration,
landing and
archive
Trusted data
Reporting &
interactive
analysis
Deep
analytics &
modeling
Data types
Real-time processing & analytics
Transaction and application data Machine and sensor data Enterprise content Social data Image and video
Third-party data
Operational
systems
Actionable insight
Decision management Predictive analytics and modeling Reporting, analysis, content analytics Discovery and exploration25
Information Integration & Governance
Logical Data Warehouse
Exploration,
landing and
archive
Trusted data
Reporting &
interactive
analysis
Deep
analytics &
modeling
Data types
Real-time processing & analytics
Transaction and application data Machine and sensor data Enterprise content Social data Image and video
Third-party data
Operational
systems
Actionable insight
Decision management Predictive analytics and modeling Reporting, analysis, content analytics Discovery and explorationThe Logical Data Warehouse
26
Information Integration & Governance
INFORMATION SERVER, MDM, G2, GUARDIUM, OPTIM
Exploration,
landing and
archive
Trusted data
Reporting &
interactive
analysis
Deep
analytics &
modeling
Data types
Real-time processing & analytics
INFOSPHERE STREAMSTransaction and application data Machine and sensor data Enterprise content Social data Image and video
Third-party data
Operational
systems
INFOSPHERE BIG INSIGHTS DB2, INFORMIX PUREDATA TRANSACTIONS PUREDATA ANALYTICS PUREDATA ANALYTICSActionable insight
Decision management Predictive analytics and modeling Reporting, analysis, content analytics Discovery and exploration SPSS MODELER COGNOS BI COGNOS TM1 SPSS MODELER GOLDIBM Big Data & Analytics offerings
PUREDATA ANALYTICS
27
1
2
4
3
3
3
3
3
5
1
2
3
4
5
More than Hadoop
Greater resiliency and recoverability
Advanced workload management & multi-tenancy
Enhanced, flexible storage management (GPFS)
Enhanced data access (BigSQL, Search)
Analytics accelerators & visualization
Enterprise-ready security framework
Data in Motion
Enterprise class stream processing & analytics
Analytics Everywhere
Richest set of analytics capabilities
Ability to analyze data in place
Governance Everywhere
Complete integration & governance capabilities
Ability to govern all data where ever it is
Complete Portfolio
End-to-end capabilities to address all needs
Ability to grow and address future needs
Remains open to work with existing investments
3
3
28
IBM Client Value Engagement
29
CVE for Big Data Analytics: Methodology
Identify Technical &
Business Initiatives
Determine
Current
State
Process &
Costs (As-Is)
Determine
Future State,
Process &
Costs
(To-Be)
Technical
Solution
Blueprint
CVE
Final Results
+ Definition
of Scope for
PoC
Define & Identify
technical & business
Problems / Challenges
Identify Future Process
& Costs with the
Recommended
Solution (
To-Be
)
CVE
Engagement
Summary &
Final Analysis
Identify Current State,
Process & Related
Costs (
As-Is
)
Measure the
Difference Between
As-Is & To-Be
30
CVE Roles: Client Participation
Required Client Roles
Role Description
Client Executive Sponsor
Details top client organizational priorities
Provides high-level view of top organizational challenges
Supplies key decision-making criteria (In scope solution)
Client CVE Coordinator
Responsible for scheduling interviews,
Resolves and/or elevating any client process issues
Helps to facilitate any challenges during the CVE process
Communicates the Executive Sponsor’s top priorities
Client Interview Roles:
CVE Offering:
Time to Value
CVE Offering:
Reduced Infra. Costs
CVE Offering:
Value of New Data Sources
Business Level Discussions
Business Analysts
Depending on Analysis Business Area (Representatives from)
– Marketing – Finance – Sales – Security – AccountingIT Level Discussions
– CIO, Enterprise Architects, Application Managers: – Database Administrator & System Administrator – Analytic Modelers, BI Developers, Report Writers – ETL and DW Developers