MDS and DQS

13
April 10-12 | Chicago, IL MDS and DQS Beyond the TLAs to Data Quality Neil Hambly – Northdoor PLC SQL Server Technology Evangelist

description

MDS and DQS. Beyond the TLAs to Data Quality. Neil Hambly – Northdoor PLC SQL Server Technology Evangelist. Who Am I ?. SQL Server Technology Evangelist for Northdoor PLC [email protected] DBA – 15+ Years, SQL Server 6.5 - 2014 - PowerPoint PPT Presentation

Transcript of MDS and DQS

April 10-12 | Chicago, IL

MDS and DQSBeyond the TLAs to Data Quality

Neil Hambly – Northdoor PLCSQL Server Technology Evangelist

Who Am I ?SQL Server Technology Evangelist for Northdoor PLC• [email protected] • DBA – 15+ Years, SQL Server 6.5 - 2014Held # of DB roles @ many leading organizations Regular International PASS Presenter @ SQL Conferences, User-Groups & WebinarsSQL London PASS Chapter Leader,SQL Relay UK Events OrganizerPASS Professional Development VC LeaderTwitter: @Neil_Hambly Contributing AuthorBlog: http://dataidol.com/neilhambly/

2

Session Agenda MDS and DQS - Beyond the TLAs to

Data Quality“Data Quality”

DQS Overview• Knowledge Bases, Industry Reference Data• DQS Tools

EIM Solution {SSIS, DQS, MDS}

MDS Overview• MDS Excel Add-in

3

DQS Overview

4

MDS Overview

5

MDS Overview

6

SSIS - MDS Process

7

MDS Requirements

8

MDS Configuration Manager – Defining your MDS environment

9

SQL Server CU1 Improvements

10

Data Size

Discovery Cleansing SSIS Cleansing Matching

RTM CU1 RTM CU1 RTM CU1 RTM CU1

10K records

1 minute<1 minute

1 minute<1 minute

2-5 minutes

<1 minutes

1 minute<1 minute

100K records

5-10 minutes

2-4 minutes

2-7 minutes

1.5-5 minutes

40-75 minutes

10-20 minutes

5-10 minutes

1-2 minutes

1M records

1.5-3 hours

30-75 minutes

0.5-1.5 hours

25-75 minutes

7-12 hours

2-3.5 hours

1-4 hours15-60 minutes

Below are the comparative DQS performance numbers between the SQL Server 2012 RTM and CU1 releases: 

To upgrade a previously configured DQS server

instance

11

ReleaseKB article + Download link 

DQSInstaller -Upgrade required

DQSInstaller -UpgradeDlls required 

SQL Server 2012 RTM NA Not Applicable Not Applicable

SQL Server 2012 RTM CU1

2679368  Yes No

SQL Server 2012 RTM CU2

2703275  Yes No

SQL Server 2012 RTM CU3

2723749  Yes (when upgrading from RTM or CU1) No (when upgrading from CU2)

No (when upgrading from RTM or CU1)  Yes (when upgrading from CU2)

SQL Server 2012 RTM CU4

2758687    Pending Research Pending Research

SQL Server 2012 Service Pack 1

2674319  Yes No 

SQL Server 2012 SP1 CU1

2674319    Pending Research Pending Research 

.Net Framework Updates or Windows Updates

NA  No  Sometimes (depends on which assemblies are patched)

This chart helps to show which product updates require schema upgrades as well as Upgrade Dlls when schema upgrades are not required.         

April 10-12 | Chicago, IL

Thank you!Diamond Sponsor

13

MDS Training {links}Some new self-paced training is now available on the Microsoft Download Center. To take advantage of this training, you should have a working installation of MDS with sample data already loaded.

01 Introduction http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/01 Introduction.pdfThis lesson provides an overview of MDS.

02 MDS Environment http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/02 MDS Environment.pdfThis lesson provides an overview of MDS terminology and features of the Master Data Manager web application.

03 Managing Entities http://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/03 Managing Entities.pdfIn this lesson, MDS terminology is explored in more depth. You start working with data and learn how to use the Master Data Manager web application to do common tasks.

04 Managing Hierarchieshttp://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/04 Managing Hierarchies.pdfThis lesson provides information about all of the available hierarchy types in MDS. You practice adding, removing, and moving members in hierarchies.

05 Creating Collectionshttp://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/05 Creating Collections.pdfThis lesson shows you how to create collections, and how to add and remove items from a collection.

06 Version Managementhttp://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/06 Version Management.pdfThis lesson explains version management and shows you how to view and reverse transactions.

07 Modeling Guidelineshttp://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/07 Modeling Guidelines.pdfThis lesson gives you ideas for how to use MDS to model your organization's data. It prepares you for the next lesson, where you will use the knowledge you've gained to start creating your model.

08 Model Buildinghttp://download.microsoft.com/download/5/9/F/59F1639E-EF57-4915-8848-EF1DC2157EBB/08 Model Building.pdfIn this lesson, you will use the knowledge from Lesson 07 to begin creating a model for your data.