TRENDS IN DATA WAREHOUSING

TRENDS IN DATA

WAREHOUSING

Chapter #3 Imran Khan

Agenda

•

Continued Growth in DW

DW has become Mainstream

Industries using DW

•

Vendor Solution & Products

Status of DW market

•

Significant Trends

Web Enabled DW

CONTINUED GROWTH IN DATA

WAREHOUSING

y Data warehousing is no longer a purely novel idea for

study and experimentation.

y It has become mainstream.

y True, the data warehouse is not in every dentist’s office

yet, but neither is it confined only to high-end businesses.

y More than half of all U.S. companies have made a

commitment to data warehousing.

y About 90% of multinational companies have data

warehouses or are planning to implement data warehouses in the next few months.

CONTINUED GROWTH IN DATA

WAREHOUSING

y In every industry across the board, from retail chain

stores to financial institutions, from manufacturing enterprises to government departments, from airline companies to pharmaceuticals, data warehousing has revolutionized the way people perform business analysis

and make strategic decisions.

y Every company that has a data warehouse continues to

realize enormous benefits that get translated into positive results at the bottom line.

y Many of these companies, incorporating Web-based

technologies, have enhanced the potential for greater and easier delivery of vital information.

Data Warehousing has Become

Mainstream

y In the early stages, four significant factors drove many companies to move

into data warehousing:

◦ Fierce competition

◦ Government deregulation

◦ Need to revamp internal processes

◦ Imperative for customized marketing

y Telecommunications, banking, and retail were the first industries to adopt

data warehousing.

y That was largely because of government deregulation in telecommunications

and banking.

y Retail businesses moved into data warehousing because of fiercer

competition.

y Utility companies joined the group as that sector was deregulated.

y The next wave of businesses to get into data warehousing consisted of

companies in financial services, healthcare, insurance, manufacturing, pharmaceuticals, transportation, and distribution.

Data Warehousing has Become

Mainstream

y Today, telecommunications and financial services

continue to lead in data warehouse spending.

◦ As much as 15% of technology budgets in these industries is spent on data warehousing.

y At present, data warehouses exist in every conceivable

industry.

y In 2008, pharmaceuticals was at the top of the list, with

Vendor Solutions and Products

thousands of data warehousing products and solutions.

y Each company positioned its own products as the

proper set of data warehousing tools.

y Data warehousing was a new concept for many of the

businesses that adopted it.

y These businesses were at the mercy of the marketing hype of

the vendors.

y Over the past decade, the situation has improved

tremendously.

y The market is reaching maturity, to the extent of producing

Status of the data warehousing

market

SIGNIFICANT TRENDS

y

In the next few years, data warehousing is

expected make big strides in software, especially

for

◦ optimizing queries

◦ indexing very large tables

◦ enhancing SQL

◦ improving data compression

SIGNIFICANT TRENDS

y Real-Time Data Warehousing y Multiple Data Types

y Adding Unstructured Data y Searching Unstructured Data y Spatial Data

y Data Visualization

y Major Visualization Trends y Visualization Types

y Advanced Visualization Techniques

◦ Chart Manipulation.

◦ Drill Down.

SIGNIFICANT TRENDS

y Dashboards and Scorecards y Parallel Processing

◦ Parallel Processing Hardware Options

◦ Parallel Processing Software Implementation

y Data Warehouse Appliances y Query Tools

◦ Flexible presentation

◦ Aggregate awareness

◦ Crossing subject areas

◦ Multiple heterogeneous sources

◦ Integration

◦ Overcoming SQL limitations

SIGNIFICANT TRENDS

y Data Fusion

y Data Integration

◦ Data Integration

◦ Application Integration

◦ Business Process Integration

◦ User Interaction Integration

y Analytics

y Multidimensional Analysis y Predictive Analytics

y Agent Technology y Syndicated Data

SIGNIFICANT TRENDS

y Data in ERP Packages y Integration Options

SIGNIFICANT TRENDS

y

Data Warehousing and KM

Data Warehousing and CRM

Agile Development

WEB-ENABLED DATA

WAREHOUSE

y

The Warehouse to the Web

◦ Bringing the Web to the warehouse essentially

involves capturing the clickstream of all the visitors to your company’s Web site and performing all the

traditional data warehousing functions.

◦ And you must accomplish this, near real-time, in an environment that has now come to be known as the dataWebhouse.

WEB-ENABLED DATA

WAREHOUSE

y

Clickstream data enables analysis of several key

measures, including:

◦ Effectiveness of marketing promotions

◦ Effectiveness of affiliate relationship among products

◦ Demographic data collection

◦ Customer buying patterns

WEB-ENABLED DATA

WAREHOUSE

y

The Webhouse can produce the following useful

information:

◦ Visitor conversions

◦ Ad metrics

◦ Referring partner links

◦ Site navigation resulting in orders

◦ Site navigation not resulting in orders

WEB-ENABLED DATA

WAREHOUSE