Business Analytics For All
BA4All – Insight Session April 29
th
2014
Guy Van der Sande – Vincent Greslebin
Unlocking the Value within
Fifthplay : Architecture
Smart Homes Platform
Data Warehouse
Data
Vault
Data
mart
Gebruikers
Marketing &
SSC
Utility Portal
ETL
Dag - 1
-
Controle data kwaliteit
-
Toepassing business
rules
-
Aggregatie
-
Filtering
Fifthplay : Why Data Vault ?
• Pattern based design which allows agility to take place
• Easy to add
new data sources
making it future proof. This allows
Fifthplay to stay
innovative
•
Large volume
of data
• Build up
history
that is not available in the operational system
• Possibility of performing
analysis
on raw data (cfr quality checks)
• Development
speed
(Pilot : 37 working days)
Data Vault ?
The Data Vault is a detail oriented, historical tracking and
uniquely linked set of normalized tables that support one or
more functional areas of business. It is a hybrid approach
encompassing the best of breed between 3rd normal form
(3NF) and star schema.
The design is flexible, scalable, consistent and adaptable to
the needs of the enterprise.
Standard architecture
The centerpiece of the Enterprise Data Warehouse
History is build-up
Granularity as ‘detailed’ as possible
No use of business rules
Use of business keys that are horizontal in nature and
provide visibility
across
lines of business
A new layer which has the
benefits of the RAW Data
Vault
, but with the business data embedded
In the Business Data Vault the data has been altered,
cleansed and changed to meet the
business rules
Downstream of the raw data vault
Starting point for
Master Data Management
The Data Vault Model exists of 3 basic entity types
• Hubs : contains a
unique
list of
business
keys
• Links :
associations
across or between business keys
• Satellites : holds
descriptive
data (about the business key) over time
• Represents a Core Business Concept
• Is formed around the Business Key of this concept
• Is established the first time a new instance of that
business key is introduced
• Must be 1:1 with a single instance
• Consists of the business key, a sequence id, a load
date/time stamp and a record source.
• Represents a natural business relationship between business keys
• Is established the first time this new unique association is presented
• Can represent an association between several Hubs and sometimes other
Links.
• maintains a 1:1 relationship with the unique and specific business defined
association between that set of keys.
• Consists of the sequence ids from the Hubs and Links
• Contains sequence id, a load date/time stamp and a
• record source.
• The Satellite contains the descriptive information
(context) for a business key.
• A Satellite can only describe one key (Hub or a Link).
• The Satellite is the only construct that manages time
slice data (data warehouse historical tracking of
values over time).
Fact
Dimension 1
Dimension 3
Dimension 2
Dimension 4
Fact
Dimension 1
Dimension 3
Dimension 2
Dimension 4
Fact
Dimension 1
Dimension 3
Dimension 2
Dimension 4
Fact
Dimension 5
Data Vault – Why ?
DV
DV
DM
S
S
S
S
H
S
L
H
H
H
Data Vault – Why ?
DV
DM
S
S
S
S
H
S
L
H
H
H
Dimension
Fact
Data Vault – How did we do
it with Fifthplay ?
HubServicePartner HubCustomer HubHomeAreaManager HubSmartPlug HubDeviceGroup HubEnergyLogType LinkServicePartnerCustomer LinkCustomerHomeAreaManager LinkHomeAreaManagerSmartPlug LinkCustomerDeviceGroup LinkDeviceGroupSmartPlug LinkDeviceSubGroupSmartPlug LinkSmartPlugApplianceEnergyLogT ype HubCity LinkHomeAreaManagerCity HubCountry LinkCountryCity HubSatServicePartner HubSatCustomer HubSatHomeAreaManager LinkSatHomeAreaManagerCity LinkSatCountryCity HubSatCountry HubSatDeviceGroup HubSatSmartPlug HubAppliance HubSatAppliance LinkSatSmartPlugApplianceEnergyL ogType HubSatHomeAreaManagerAddress SeqServicePartner PK ServicePartnerID LoadDateTime RecordSource SeqCustomer PK CustomerID LoadDateTime RecordSource SeqHomeAreaManager PK HomeAreaManagerNumber LoadDateTime RecordSource SeqSmartPlug PK SmartPlugID LoadDateTime RecordSource SeqDeviceGroup PK DeviceGroupID LoadDateTime RecordSource SeqEnergyLogType PK EnergyLogName LoadDateTime RecordSource SeqServicePartnerCustomer PK SeqCustomer LoadDateTime RecordSource SeqServicePartner SeqCustomerHomeAreaMan ager PK SeqCustomer LoadDateTime RecordSource SeqHomeAreaManager SeqHomeAreaManagerSmar tPlug PK SeqHomeAreaManager LoadDateTime RecordSource SeqSmartPlug SeqCustomerDeviceGroup PK SeqCustomer LoadDateTime RecordSource SeqDeviceGroup LoadDateTime SeqDeviceGroupSmartPlug PK LoadDateTime RecordSource SeqDeviceGroup SeqDeviceSubGroupSmartPl ug PK LoadDateTime RecordSource SeqDeviceGroup SeqSmartPlug SeqSmartPlug SeqSmartPlugApplianceEner gyLogType PK SeqEnergyLogType LoadDateTime RecordSource SeqSmartPlug SeqCity PK CityPostalCode LoadDateTime RecordSource CityName SeqHomeAreaManagerCity PK SeqCity LoadDateTime RecordSource SeqHomeAreaManager SeqCountry PK CountryIsoCode LoadDateTime RecordSource SeqCountryCity PK SeqCity LoadDateTime RecordSource SeqCountry SeqSatServicePartner PK SeqServicePartner LoadDateTime RecordSource LoadEndDateTime ServicePartnerCode ServiucePartnerEmail ServicePartnerCustomerCon tact SeqSatCustomer PK SeqCustomer LoadDateTime RecordSource LoadEndDateTime CustomerEmail CustomerFirstName CustomerLastName CustomerLanguage SeqSatHomeAreaManager PK SeqHomeAreaManager LoadDateTime RecordSource LoadEndDateTime HomeAreaManagerMode HomeAreaManagerArchitec ture SeqSatHomeAreaManagerCi ty PK SeqHomeAreaManagerCity LoadDateTime RecordSource LoadEndDateTime HAMCityAddressLine1 HAMCityPhoneNumber HAMCityAddressLine2 SeqSatCountryCity PK SeqCountryCity LoadDateTime RecordSource LoadEndDateTime CountryCityRegion CountryCityState SeqSatCountry PK SeqCountry LoadDateTime RecordSource LoadEndDateTime CountryName SeqSatDeviceGroup PK SeqDeviceGroup LoadDateTime RecordSource LoadEndDateTime DeviceGroupName DeviceGroupDescription SeqSatSmartPlug PK SeqSmartPlug LoadDateTime RecordSource LoadEndDateTime SmartPlugDisplayName SmartPlugManufacturer SmartPlugModel SmartPlugIsGenerator SmartPlugHasChildren SmartPlugHasSchedule SeqAppliance PK ApplianceID LoadDateTime RecordSource SeqSatAppliance PK SeqAppliance LoadDateTime RecordSource LoadEndDateTime ApplianceCategory SeqSatSmartPlugApplianceE nergyLogType PK SeqSmartPlugApplianceEner gyLogType LoadDateTime RecordSource LoadEndDateTime EnergyLogDateTime EnergyLogValue SeqAppliance EnergyLogValueUnit Legend Hub Link Satellite ServicePartnerWebPage SeqSatHomeAreaManagerA ddress PK SeqHomeAreaManager LoadDateTime RecordSource LoadEndDateTime HomeAreaManagerAddress Line1 HomeAreaManagerPostalCo de HomeAreaManagerAddress Line2 HomeAreaManagerCityNam e HomeAreaManagerProvince HomeAreaManagerState HomeAreaManagerCountry