SQL Server Data IS profiles stored in tables

The task of SQL Server Data Profile Information Services stores the results of profiling in an XML document that can be examined with the Data Profile Viewer. In the article SQL Server 2008 Dataprofiling to explain how to use this new Task in SSIS. Although this method is very simple, sometimes may not be sufficient.

If a project addresses data quality could be interesting, for example, store a history of profile to assess how it has been improving the quality of the processed data. The best way to work with historical data is to use a database and storing the data in tables, on which may make inquiries, reports and compare it takes.

To do all you would need is to pass the metadata tables that the task of profiling has been stored in the XML file. As someone has already spent looking for an easy way to do it. Thomas Frisendal from their web solutions Information quality explains how to create an XSLT file for each type of profiling that is used to extract the XML generated by the Data Profile Task SSIS one or more XML files into a format that can be directly imported into tables .

SSIS Package to go to Profiles Data Tables

So, with just creating a process that applies an XSLT for each type of profile, then load each resulting XML file into a table and can store profile data in tables.As also in all the files include a field that reports the name of the source table, with one table for each type of profile and you can store the profiles of all tables to be discussed.

SSIS Data Flow Task ProfileToSQL

I have also added to the table a date field that stores the date on which the process is done, and now the result has been good. In the graph we can see the distribution of different track types to the Spanish street according to INE and realize, for exampleexample, that identifiers are not too well established, since we can find things like more of an identifier for the same type of street (STREET, C, C /), or many paths to a point as an identifier.

SSIS Data Table Profile of values ​​different kind of way

In Free tool for automation of SQL Server, the author discusses how this solution works and how to get the leavesstyle, and recommandations for the ProfileToSQL Usage stylesheets explained in detail how to use XSLT, and includes a disclaimer making clear that this software is a test version.