Making the Most of Your Data Quality &
Data Governance Dollar$
Karen A. Way, MHA Principal/Founder 4 November 2013
Information and Data Quality Conference November 4-7, 2013
Overview
• Introduction
• Identifying Your $$ Dilemma • Inventorying Your Toolbox
• Creating Symbiotic/Synergistic Relationships • Resource Pool
Introduction
Identifying the $$ Dilemma
• Where are your Data Quality/Data Governance needs?
– Data Profiling
– Metadata Management – Data Stewardship
– Data Cleansing – Other items?
• What will your budget cover/not cover?
Inventorying Your Toolbox
What tools does your organization already have? • MS Office – Excel – Access – InfoPath – SharePoint • Query/Dashboard Tools • Programming Language – PL/SQL – NoSQL – C# – SAS/SPSS • ERD/Design tools These are just a few examples.
Using the Tools
Data Quality Perspective
• Data Profiling
– Simple queries, Excel, Dashboard tools
• Frequency Distributions for data values • Hi/Low values
• Metrics Monitoring
– Scheduled jobs – SAS, SPSS, other query language
• Export data to Excel or other Dashboard tools
and Data Quality Completeness* Precision Currency Consistency Accuracy* Privacy* Reasonable- ness Referential Integrity Timeliness* Uniqueness Validity*
Using the Tools
Data Governance Perspectives
• Metadata Management
– Excel
– Inexpensive ERD tools
• Data Dictionary • Business Glossary • Data Stewardship – SharePoint • Policies • Procedures • Reference Materials
Using the Tools – Case Study #1
Problem: Same question posed to different groups in organization, resulting in multiple answers.
Solution: Implementation of a Query Library
Query Library
• Stakeholders engaged; workflow created
– Submission
– Review/Validation – Approvals
– Posting to Library
• InfoPath form developed
– Business definition/usage of query – Query code
– Identification of parameters that can be changed w/o impacting
Using the Tools: Case Study #2
Problem: Organization needed a way to identify all data assets. Solution: Template created in Excel; distributed to stakeholders
Building Symbiotic Relationships
Find out what other parts of the organization are doing. • Offer assistance to those projects
– Profile a new data source as a proof of concept – Showcases the benefits of DQ/DG
• What are the goals of other projects?
Relationships: Case Study
Problem: Data Quality team in need of Data Quality Toolset, but
not enough $$ in capital expense budget to cover costs.
Solution: Identified that IT was interested in purchasing an ETL
Building Symbiotic Relationships Externally
Use your social networks! • LinkedIn Groups
– See what other organizations are doing – Post questions, ask for ideas
– Share successes
• Search for Case Studies
– IAIDQ – DGI
In Short:
Create positive, mutually beneficial partnerships between stakeholders
Finding Resources
Qualified resources can be hard to come by.
• Look at skillsets present w/in the organization
– Consider what skills you need
– Negotiate for some of the time of those resources – Share successes
• Consider a matrix structure instead of dedicated resources
Finding Resources: Case Study #1
Problem: Organization needed to conduct particular Data
Quality activities, but there no resources.
Solution: Resources located w/in organization with skills.
– Temporary team created for 5 week project.
Finding Resources
Being open to alternative resourcing can lead to smoother operations.
Spending Your $$
Wisely
You have Money to Burn
Make use of available resources:
• Gartner Magic Quadrant
• Social Media – Find out what others are saying
• Product Webinars
• Conduct Proof of Concept projects
– Short term (1 – 2 weeks)
– Identify specific outcomes/functionality to be included – Involve multiple stakeholders
You are Pinching Pennies
Think about the options we’ve discussed today. Other options include:
• Purchasing less expensive tools that meet short term needs
• Hiring resources that may not meet all requirements immediately, but are willing to learn
Summary Points
• Be open to alternatives
– Consider all your options with regards to how to address your
organizations DQ/DG needs.
– Don’t depend/focus on the next “bright and shiny” new
tool/technology.
• “Making do” often has unforseen benefits
– Allows current resources to expand their skills – Creates an environment of creative thinking – Demonstrates dedication and commitment