Transforming eCommerce Big Data into
Big Fast Data
October 22nd 2013
Gagan Mehra, Chief Evangelist, Terracotta, Inc.
Do
Not
Copy
© 2013 Terracotta Inc. 2
© 2013 Terracotta Inc. | 2
WHAT IS BIG DATA?
Do
Not
Copy
What is Big Data?
Do
Not
Copy
© 2013 Terracotta Inc. 4
DATA is
Expanding Exponentially
A confluence of interconnected forces is
generating
andutilizing
VAST AMOUNTS
OF
DATA
Do
Not
Copy
Big Data Holds Big Value for Enterprises
BIG
DATA
Opportunities
Making Better Informed Decisions – Access Discovering Hidden Insights -- Manage Automating Business Processes -- Analyze Generate Revenue – Act Strategies, Recommendations Forensics, Patterns, Trends Complex Events, Translation
Know What Your Customers Want
and When
Do
Not
Copy
© 2013 Terracotta Inc. 6 © 2013 Terracotta Inc. 6
Enterprise Big Data Challenges
Do
Not
Copy
The Road Ahead…
Big Data is pervasive
1.
2.
3.
But if you can’t extract value,
Big Data is just a problem to be managed
Value relies on Big Data being fast
Do
Not
Copy
© 2013 Terracotta Inc. 8
© 2013 Terracotta Inc. | 8
BIG DATA & eCOMMERCE
Do
Not
Copy
eCommerce has been HOT for a long time
...and it is still very hot
Do
Not
Copy
© 2013 Terracotta Inc. 10
E-Commerce Challenges
Can Your Platform Keep Pace?
Big Data Use Cases
eCommerce
• Customer Experience Management
© 2013 Terracotta Inc. 12
Many enterprises use caching, NoSQL, etc. to
incrementally improve performance
An eCommerce system consisting of several applications might use caching, and a
combination of relational & NoSQL databases is unable to support all Big Data use cases
Do
Not
Copy
Evolution of the eCommerce Architecture
An architecture designed for real-time Big Data would make it possible for the enterprise to:
• Intelligently react to hundreds of thousands of events per second
• Easily handle incremental load without sacrificing performance
• Rapidly deploy new functionality and associated data sets without worrying about scalability or performance constraints
• Focus on business growth versus worrying about data
Do
Not
Copy
© 2013 Terracotta Inc. 14
A large in-memory store, however, can transform all
big data into big FAST data
After an in-memory data management solution is introduced in the environment, all
applications are able to leverage it, improving overall performance, even under load, and reducing the volume of data that needs to be maintained in databases.
Do
Not
Copy
IN-MEMORY
TRANSFORMS BIG DATA
Do
Not
Copy
© 2013 Terracotta Inc. 16
In-Memory in E-Commerce
All-Round Better Performance
E-commerce
application Speed
Slash response times with 100x faster data access Scale
Keep pace with rapid traffic and transaction growth Stability
Decouple from databases to protect performance Cost Efficiency
Cut infrastructure and operational expenses Revenue Growth
Boost sales with customer satisfaction
Do
Not
Copy
BigMemory in E-Commerce
Proven Track Record
E-Commerce Use Cases
• Website performance • Web server consolidation • Real-time personalization • Real-time fraud detection
BigMemory powers popular
global e-commerce sites with:
•
1,000s of products
•
100,000s of registered users
•
Millions of daily visitors
•
Billions in annual revenue
Do
Not
Copy
© 2013 Terracotta Inc. 18
SUCCESS STORY: Getting Global E-commerce on Pace
With BigMemory
SCALE
FORTUNE 150 ATHLETIC BRAND
What they wanted
Before BigMemory
• Continued e-commerce growth for nearly 7,500 products and $340 million in sales
• Product catalog and shopping cart data pulled from multiple disk-bound databases
• Huge spikes in customer traffic (Cyber Monday, Black Friday) jeopardized stability
Do
Not
Copy
SUCCESS STORY: Getting Global E-commerce on Pace
With BigMemory
SCALE
FORTUNE 150 ATHLETIC BRAND
After BigMemory:
90% of product requests served instantly by
BigMemory
Backend services load slashed by 40%
Average page load time reduced by 16%
Search time reduced by 30%
Improved online shopping experience without big
investment in new servers
Do
Not
Copy
© 2013 Terracotta Inc. 20
SUCCESS STORY: Radically Improving Profitability With
Better, Faster Fraud Detection
SPEED
FORTUNE 500 ONLINE
PAYMENTS PROCESSOR
What they wanted
Before BigMemory
• Dramatically boost bottom-line profit through faster, more accurate fraud detection
• Lost 30 cents on every $100 to fraud
• With Oracle Exadata, failed to meet 800 ms SLA around 10% of time
• Limited to 50 rules, even though each new rule generated $12 million in profit
Do
Not
Copy
SUCCESS STORY: Radically Improving Profitability With
Better, Faster Fraud Detection
SPEED
FORTUNE 500 ONLINE
PAYMENTS PROCESSOR
After BigMemory:
Savings of tens of millions of dollars in reduced
costs from missed SLAs and fraudulent charges
Meeting stricter 650-millisecond SLA 99% of
time
Savings of $1 million annually in reduced
database licenses
Plans to expand from 4TB to 150TB for new
applications and to achieve 250 millisecond SLA
Do
Not
Copy
© 2013 Terracotta Inc. 22
SUCCESS STORY: Building a Global Media Distribution
Platform With BigMemory
SCALE
GLOBAL ONLINE MOVIE
STREAMING SERVICE
What they wanted
Before BigMemory
• Build a digital media streaming service (Ultraviolet) to compete with the likes of Netflix
and Amazon
• Strict requirements for streaming movies to mobile devices worldwide
• Global rollout aspirations
• VMware GemFire rejected in proof-of-concept for scalability, WAN replication
Do
Not
Copy
SUCCESS STORY: Building a Global Media Distribution
Platform With BigMemory
GLOBAL ONLINE MOVIE
STREAMING SERVICE
SCALE
After BigMemory:
6.5 million customers using the service to
stream and watch movies on their TVs, tablets,
smartphones and other devices
Company rolling out service worldwide with new
countries every quarter
80GB in-memory store in BigMemory
Do
Not
Copy
© 2013 Terracotta Inc. 24
SUCCESS STORY: Delivering New Revenue by Presenting
Relevant Offers in Real Time
SCALE
FORTUNE 100
SHIPPING COMPANY
What they wanted
Before BigMemory
• Boost revenue with relevant offers and tools while customers are ordering, tracking packages
• 32 million tracking requests = • opportunities to present offers
• Performance 4x slower than required by SLA because data resided in multiple disk-bound databases
• Oracle Coherence rejected for complexity and slowness
Do
Not
Copy
SCALE
After BigMemory:
Increased revenue by presenting relevant offers
85% faster — in just 120 milliseconds
Exceeding performance SLAs
Adopted BigMemory as company-wide standard
for in-memory data management
SUCCESS STORY: Delivering New Revenue by Presenting
Relevant Offers in Real Time
FORTUNE 100
SHIPPING COMPANY
Do
Not
Copy
www.terracotta.org
