Endeca Introduction to
Big Data Analytics
Overview
May 8, 2013
Agenda Introduction
Overview – Analytics for Big Data
Overview – Endeca Information Discovery
Q & A
Introduction
Business vs. IT
Big Data Initiatives
– What Technologies are being used? Projects underway?
– Familiarity with Big Data - What is Big Data? What technologies
support it?
– Terms like Hadoop, HDFS
Familiarity with Endeca
Your Goals for this Session
4 “V”s of Big Data
Sample Big Data flow
C ollec t R eal T im e W eb Log Ent ries
Acquire Organize Analyze Decide
Source
Customer
Records
from Various
Silos
For Identified
customers, track
bank web pages
visited
Explore current
Customer
Information
Bat c h Arc hiv ing of W eb Log Ent ries
Products of Interest
Sum m ariz e C us tom er relat ed Inf orm at ion for Analy tic s
Historical metrics
Monitor and track
Identified metrics
of interest
Customer
Monitoring
Recommend Action
Data
Transformation
Track Life Events
Identify
Statistical
Outliers
Alert Anomalies
Big Data Software Components
N oSQL D at abase
Acquire Organize Analyze Decide
Source
Customer
Records
from Various
Silos
For Identified
customers, track
bank web pages
visited
H adoop D at a W arehous e
Business
Intelligence
Advanced
Analytics
Decisioning
Oracle
Endeca
Information
Discovery
Connectivity
Social Media
Monitoring
Big Data Software Components
N oSQL D at abase
Acquire Organize Analyze Decide
Source
Customer
Records
from Various
Silos
For Identified
customers, track
bank web pages
visited
H adoop D at a W arehous e
Business
Intelligence
Advanced
Analytics
Connectivity
Big Data
Appliance Exadata
Endeca Information
Discovery
Data Volume, Variety Growth Presents New
Challenges
More and
Different Data
Rapid growth in
structured and unstructured,
internal and external data
More
Unanticipated
Questions
Self-service ability to explore
data, add new data, and construct
analysis as required
More Change and
Uncertainty
Unanticipated business needs
can’t be addressed by predefined
models, dashboards, and reports
Customers Workforce
Dialogues Contain Critical, Untapped Insights
3 rd Parties The Public
“Competitive pricing is
15% lower than yours
and they offer
discounted shipping.”
“RT @finwiz. Checkout
video http://bit.ly/wLe6Y2
Sweet!”
“Why should I pay a
checking fee if other
banks don’t charge
one?”
“She saved the project
with strong leadership
& building trust with the
customer..”
New Insights Drive New Opportunities
Revenue & margin
Operational efficiency.
Better partnerships
Product positioning.
• Improved Targeting
• Increased Customer
Satisfaction
• Brand Awareness &
Perception
Impact
• Employee
Satisfaction
• Improved
Performance
• Hiring & Retention
of Top Talent
• Improved Operational
Efficiency
• Better Partnerships
• Product Awareness
• Improved Brand
Perception
• Insight into Topics
and Trends
• Public Awareness
Customers Workforce
The Public
3 rd Parties
“ ”
Challenge – Difficult to Harness Unstructured Data
Diverse sources, spread out everywhere
Unpredictable structure, impossible to model
Growing exponentially, constantly changing
Full of noise, poor data quality
Existing solutions are not enough
Social Media
Websites
Big Data
Content Systems,
Files, Email
Text in Enterprise
Applications
80% of the world’s information is unstructured
Unstructured Data
80%
2005 2010 2015
V ol um e of Data G en erated
Structured Data
20%
Unlocking the Value of Unstructured Data
Who, What, When,
Where?
Business
Intelligence
Why, How?
Information
Discovery
Structured & Unstructured Analysis
Answer All the Questions Using All the Relevant Data
Extend Business Analytics with Unstructured Data
Introducing Oracle Endeca Information Discovery
Oracle Business Intelligence
Best platform for integrated ROLAP and MOLAP
BI Server + Essbase
Common Enterprise
Information Model
OLTP & ODS
Systems
Enterprise Applications
(Oracle, SAP, Others)
Data Warehouse
& Data Marts
Structured Data
Social Media
Content Systems,
Files, Email
Websites
Unstructured Data
Big Data
Oracle Endeca Information Discovery
Best platform for Unstructured Analytics
Endeca Server
Hybrid Search/Analytical Database
Flexible Data Model
Oracle Endeca Information Discovery
Understand the complete picture with context from any source.
Transactions TxnID ProductI
D Category Amoun t 12324 506 Mountain
Bike 499
12325 507 Road Bike 1399
