BCS (NLB) Big Data seminar
“Big Data”
John Morton, Chief Technology Officer SAS Institute
Who is SAS: The Leader in Enterprise Analytics Software
Customer Partnerships:
• 4.5 million users worldwide • 50,000+ sites in 114 countries
• 92 of the Top 100 Fortune Global 500
• 9 of 10 Leading Media Agencies
• Over 1,000 Universities
• Over 90% of US Federal Agencies
• All 50 US State Governments
Services 11% Financial Services 42% Retail 4% Other 2% Manufacturing 6% Healthcare & Life Sciences
8%
Government Education
Communications 8%
Anticipate Opportunity, Empower Action, Drive Impact
Basic company statistics:
• Founded 1976: 11,000+ employees in 400+ offices • 600+ global alliances
• 2010 worldwide revenue $2.43 B
• 24% of revenues reinvested in R&D
• Ranked in Leader’s Quadrant for Gartner’s 3 key areas for
Analytics: Data Intelligence, Analytics and Reporting
3
What is Big Data?
In 2011 (Gartner) this now includes – Complexity!!
May 2011 McKinseys Report “Big Data : The next frontier for Innovation, Competition and Productivity” stated :
US healthcare reduction by $300 B a year 2/3rds from a 8% reduction in national healthcare
Retailers can increase operating margin by 60% by fully utilising data
Euro 100 B reduction in Government administration across Europe
Big data is a term applied to data sets whose size is beyond the ability of commonly used software tools to capture, manage, and process the data within a tolerable elapsed time. Big data sizes are a constantly moving target currently ranging from a few dozen terabytes to many petabytes of data in a single data set. (Wikipedia)
In a 2001 (Gartner), defined data growth challenges (and opportunities) as being three-dimensional,
increasing volume (amount of data),
velocity (speed of data in/out),
Big Data
Big data definition
Big data is the ability to extract value from huge data sets by employing big data analytics to make better and faster decisions based not only on what has happened, but what will happen next. By
identifying patterns, trends and insights from big data, organisations will drive greater innovation, competitiveness and productivity.
5
What Does it Mean? - People
Future
You and technology
Customers/Citizens
Pace of
Technology
10-14 jobs between
age of 21 and 38
Technology Shift
Dot com boom
£30 Terabyte disks
£2000 fault tolerant, supercomputers
Store everything file systems
Visualisation of data - Gamefication
In-Database processing
7
Data Intensive Workloads
-
Usage Driven Technologies
Video Information Search Predictive Analytics What-if Analysis Ad Hoc Queries Pre-defined Queries In fo rm a ti o n I n te g ra ti o n 2006 2008 2010 Usage Sophistication 0 % 100% 20% 13% 25% Search & Semantic Analysis TopQuadrant, Forester, Intel IT study, Gartner
High Performance Analytics
•
A weeks worth of the information
in the Times equals a lifetimes
worth of information in 1800
• Video content growing at an
astonishing pace
• 40 Exabytes of data created this
year….
What Does it Mean? - Processes
3.0
Collaboration Business Clock Managing Data Linked Data Grey computing9
Decision Making
What Does it Mean? - Systems
Role of IT?
Context Aware
The Burton Group
Today New Threats (e.g., IM, Rootkit) Perimeter Ambiguity Virtualization Client Diversity Digital Rights Management End-point Performance and Technology VM VM VM VM VM VM VM VM VM VM VM VM Tomorrow
11
13