Big Data & Analytics
Heute & Morgen
Dipl.Ing.Wolfgang Nimführ
Business Development Executive Big Data Analytics
Watson Ambassador
20 May 2015 Con.ect Informunity © IBM Corporation
1
Untapped Resource
Empower Everyone
Increased Value
Velocity is the game changer
What is your connected car?.
It’s not just how fast data is produced or changed, but the speed at which it must
be received, understood, and processed
20 May 2015 Con.ect Informunity © IBM Corporation
3
Today’s customers live out loud and expect
Personalization
Paradigm shifts enabled by Big Data & Analytics
TRADITIONAL APPROACH
Analyze small subsets of information Analyzed information All available information
BIG DATA & ANALYTICS APPROACH
Analyze allinformation All available information analyzed
Leverage more of the data being captured
Data leads the way—and sometimes
Reduce effort required to leverage data
Leverage data as it is captured
TRADITIONAL APPROACH
Carefully cleanse information beforeany analysis
Small amount of c ar efully or ganized infor mation
BIG DATA & ANALYTICS APPROACH
Analyze information as is, cleanse as needed Lar ge amount of messy infor mation Hypothesis Question Data Answer TRADITIONAL APPROACH
Start w ith hypothesis and test against selected data
BIG DATA & ANALYTICS APPROACH
Explore alldata and identify correlations
Data Exploration
Correlation Insight
Repository Analysis Insight
Data
TRADITIONAL APPROACH
Analyze data afterit’s been processed and landed in a w arehouse or mart
Data
Insight Analysis
BIG DATA & ANALYTICS APPROACH
Analyze data in motionas it’s generated, in real-time
© 2015 IBM Corporation
5
IBM Analytics enables Decisions at Point of Impact
How can
you
generate more
Business
Value
Emerging
Focus on
Business
v
alue
Descriptive
Reporting
Prescriptive
Personalized
Predictive
Forecasting
Cognitive
Watson
What has happened?
What could happen?
How can I achieve the best outcome?
Tell me the best course of action?
Big Data
&
Analytics
Big Data
&
Analytics
Integrate and analyze ALL DATA of ANY FORMAT
Data Media Content Machine Social
Internal & External Data
New Dev Styles More People
The Need for Big Data & Analytics is everywhere
Attract, grow, retain customers Create new business models Transform financial processes Manage risk Optimize operations and reduce fraud Improve IT economics • Data-driven Products and Services • Non-traditional Partnerships • Mass Experimentation•Harness and Analyze all Data
•Govern All Data
•Optimize Analytic Workloads •Spectrum of Analytics •Global Operations •Infrastructure & Asset Efficiency •Fraud •Security •Financial Performance •Forecasting & Planning •Operational Performance •Financial Risk •Operational Risk and Compliance •Enterprise Risk Management • Acquisition • Personalization • Profitability • Retention
© 2015 IBM Corporation 7 New / Enhanced Applications All Data Machine/Sensor Policy Broker Claims Social Media Location Litigation & Other 3rdparty Better and Indiv idual Pricing Enhanced 360 Degree View
Claims Analy tics & Real Time Fraud Detection
Batch or Real Time Next Best
Action
Inf ormation Sharing & Transparency
Big Data & Analytics Platform
Big Data & Analytics Strategy, Integration & Managed Services
Big Data & Analytics Infrastructure & Cloud
What is happening? Discovery and exploration What could happen? Predictive analytics and modeling Why did it happen? Reporting and analysis What did I learn, what’s best? Cognitive What action should I take? Decision management
Information Integration & Governance Landing, Exploration and Archive data zone EDW and data mart zone Operational data zone
Real-time Data Processing & Analytics
Deep Analytics data zone Machine/Sensor Machine/Sensor Machine/Sensor Policy Machine/Sensor Policy Machine/Sensor Machine/Sensor Machine/Sensor Policy Machine/Sensor Policy Machine/Sensor Broker Policy Machine/Sensor Broker Policy Machine/Sensor Claims Broker Policy Machine/Sensor Claims Broker Policy Machine/Sensor Social Media Claims Broker Policy Machine/Sensor Social Media Claims Broker Policy Machine/Sensor Location Social Media Claims Broker Policy Machine/Sensor Location Social Media Claims Broker Policy Machine/Sensor Litigation & Other 3rdparty Location Social Media Claims Broker Policy Machine/Sensor
Landing, Exploration and Archive Data
IBM Hadoop
O
p
e
n
D
a
ta
P
la
tf
o
rm
w
it
h
A
p
a
ch
e
H
a
d
o
o
p
20 May 2015 Con.ect Informunity © IBM Corporation
9
Realtime Processing & Analyics Zone
IBM Streams
Mining in
Microseconds &
Statistics
Predictive
Advanced
Mathematical
Models
Natural
Language
Processing
Geospatial
Acoustic
Entities & Relationships
Image & Video
Data Warehouse, Data Mart and Deep Analytics Zone
IBM PureData System for Analytics
What makes it different?
Speed
- 10-100x faster than traditional custom systems
1Simplicity
- minimal administration and tuning
Scalability
- petabyte+ scale user data capacity
Smart
- high performance, advanced analytics
Purpose-built analytics appliance
Integrated database, server and storage
Standard interfaces
20 May 2015 Con.ect Informunity © IBM Corporation
11
ASTRON Netherlands
Challenge
• Develop a resource- and energy-efficient way for astronomers to analyze unprecedented amounts of unstructured data and gain insight into major
astronomical questions, like to explore the origin of the Universe
Solution
• A streaming analytics platform running on energy-efficient exascale supercomputing technology.
Benefits
• Accelerates identification of relevant images and data by approximately 99 percent making info. available to astronomers in minutes vs. days • Streaming analytics platform facilitates daily
analysis of over one exabyte of data; twice the amount generated by daily Internet traffic
20 May 2015 Con.ect Informunity © IBM Corporation
13
Dublin City Council
Challenge
• Improve public transport services by providing dynamic, near-real-time views to better gauge if its 1,000 buses is operating on time.
Solution
• Data from GPS-equipped buses displays the near-real-time position of them allowing controllers to locate delays and identify root causes. Predictive analytics take into account speed, traffic flow and other factors to generate up-to-date bus arrival and transit times estimates.
Benefits
• Dynamic, near-real-time view of bus activity ensures they run on time and riders receive excellent service.
• Controllers can more quickly identify early stage congestion and mitigate impact
• Can effectively manage resources and optimize bus routes which saves energy and reduces pollution
13
NYPD
Challenge
• Integrated crime data in real time in order to dramatically reduce crime rates
Solution
• A real-time Crime Information Warehouse that makes NYPD more proactive and effective in fighting crime.
Benefits
• Support for proactive policing tactics since crime trends can be seen as they are happening
• Faster and higher rate of case-closing through efficient crime-related data analysis • Improved data integrity and speed of data
access to optimize decision making
• Improved officer safety through better risk-assessment capabilities
20 May 2015 Con.ect Informunity © IBM Corporation
15
City of Toulouse
Challenge
• Find new ways to capture its citizens concerns and use analytics to identify and prioritize urgent issues as well as understand how messages are resonating
Solution
• A social data analytics solution to analyze citizens’ needs posted on public social media, taking into account factors including context, content and sentiment.
Benefits
• Collected and analyzed more than 1.6 million comments enabling the city to identify issues with precision.
• Accelerated its average response time to road-maintenance issues by 93 percent, from 15 days to 1 day.
• Able to identify and address residents’
misconceptions and concerns and gain support of a revitalization project.
15
Honda
Challenge
• Improve product quality while minimizing money and time by conducting real-time predictive maintenance
Solution
• Using SPSS software, Honda is able to employ an IBM predictive maintenance and quality solution that leverages powerful analytics and data integration
Benefits
• Provides real-time predictive maintenance so that data streamed directly from the vehicle can be analyzed for performance
• Able to analyze and predict warranty issues which will help prevent future related
problems
• Improved asset productivity and process quality
20 May 2015 Con.ect Informunity © IBM Corporation
17
Wissenschaftliches Institut der
AOK
Challenge
• Collect and analyze clinical data from millions of patients, 2,000 hospitals, 140,000 mobile medics and 20,000 pharmacies to understand healthcare trends
Solution
• An advanced business analytics platform to
understand healthcare trends, including when and why people get sick, which treatment pathways work best, which medications are prescribed, how illness affects productivity and more.
Benefits
• Shortened analysis times from over two hours to a few seconds; over a 99 percent improvement • Enabled the processing of more complex
analytical tasks, from formally defined analysis applications to ad hoc queries
• Expanded the institute’s reach in multidisciplinary, geographically broad studies, allowing it to
analyze much larger data volumes
17
TerraEchos uses Big Data
with Covert Intelligence and
Surveillance Sensor Systems
Capabilities
• InfoSphere Streams
Need
• Deployed security surveillance system to detect, classify, locate, and track potential threats at highly sensitive national lab
Benefits
• Reduces time to capture and analyze 275MB of acoustic data from hours to one-fourteenth of a second
• Enables analysis of real-time data from different types of sensors and 1,024 individual channels to support extended perimeter security
• Enables a faster and more intelligent response to any threat
20 May 2015 Con.ect Informunity © IBM Corporation
19
Vestas optimizes capital
investments based on
2.5
Petabytes
of information
Need
• Model the weather to optimize placement of turbines, maximizing power generation and longevity
Benefits
• Reduce time required to identify placement of turbine from weeks to hours
• Reduces IT footprint and costs, and
decreases energy consumption by 40 % --while increasing computational power • Incorporate 2.5 PB of structured and
semi-structured information flows. Data volume expected to grow to 6 PB
19
Memorial Sloan-Kettering
Cancer Center
Challenge
• Transform the quality and speed of care delivered to patients through individualized, evidence based medicine using cognitive computing
Solution
• IBM Watson applies big data and analytics and cognitive computing by processing, analyzing and interpreting complex clinical information to improve health care quality and efficiency
Benefits
• Provides individualized treatment options through insights gleaned from cognitive systems
• A first of-its-kind Watson cloud based advisor identifies individualized treatment options for cancer patients
• Oncologists located anywhere can remotely access detailed treatment options
20 May 2015 Con.ect Informunity © IBM Corporation
21
University of Ontario
Institute of Technology
(UOIT) uses big data to
improve quality of care for
neonatal babies
Need
• Performing real-time analytics using physiological data from neonatal babies • Continuously correlates data from medical
monitors to detect subtle changes and alert hospital staff sooner
• Early warning gives caregivers the ability to proactively deal with complications
Benefits
• Detecting life threatening conditions 24 hours sooner than symptoms exhibited • Lower morbidity and improved patient care
21
20 May 2015 Con.ect Informunity © IBM Corporation
23
Video: Watson Anayltics
25 to 29 October, Las Vegas
ibm.com
/software/de/events/get-insight/
20 May 2015 Con.ect Informunity © IBM Corporation
25
bigdatauniversity
.com
ibm.com/analytics/us/en/technology/
spark
Dipl.Ing.
Wolfgang Nimführ
Business Development Executive Big Data Analytics &
Watson Foundation IBM Analytics Group
IBM Austria
Obere Donaustraße 95 A1020 Vienna Tel +43-664-618-5389