ISO TS 8000-81-2021 pdf free download – Data quality — Part 81: Data quality assessment: Profiling.
This document specifies a procedure for data profiling to generate the foundation for performing dataquality assessment. This profiling is applicable to data sets that are either originally in a structure oftables and columns or are the output from a transformation to create such a structure.
NOTE 1 Data profiling is applicable to all types of database technology.
The following are within the scope of this document:
– performing structure analysis to determine data element concepts;
– performing column analysis to identify relevant data elements,including statistics about a data set;-performing relationship analysis to identify dependencies in a data set.
The following are outside the scope of this document:
– methods for extracting and sampling data to be profiled from a data set;- deriving data rules;
– measuring the extent of nonconformities in a data set.
NOTE2 ISo 8000-8 specifies approaches to measuring data and information quality.
This document can be used in conjunction with, or independently of, quality management systemsstandards.
2Normative references
The following documents are referred to in the text in such a way that some or all of their contentconstitutes requirements of this document. For dated references,only the edition cited applies. Forundated references, the latest edition of the referenced document (including any amendments) applies.
ISo 8000-2, Data quality — Part 2: Vocabulary
3Terms and definitions
For the purposes of this document, the terms and definitions given in ISo 8000-2 apply.
ISO and IEC maintain terminological databases for use in standardization at the following addresses:- ISO online browsing platform: available at https:.//www.iso.org/obp
—IEC Electropedia: available at http://www.electropedia.org/
5.3Outputs
The output from structure analysis is a data element concept.6 Column analysis
6.1 Inputs
The inputs to column analysis are a data set and a corresponding data element concept from structureanalysis (see Clause 5).
6.2Scope of activitiesColumn analysis consists of:
– extracting data elements from the data element concept;- comparing the data elements with the values in the data set;-determining the value domain.
NOTE The methods for extracting data elements include discovery, assertion testing and visual inspection.These methods can be supported by automated tools.
6.3Outputs
The output from column analysis is a list of constraints of value domain.These constraints include thefollowing (see Annex B for more details):
-cardinalities: count of rows,range of values, nulls, count of distinct values and uniqueness;- storage: data type, length of values and decimals;
– valid values: discrete value list, permissible range, skip-over rules, pattern and domain.7 Relationship analysis
7.1 Inputs
The inputs for relationship analysis are a data set and the corresponding data elements from columnanalysis (see Clause 6).
NOTE Relationship analysis extracts relationships between columns within not only a single table but alsomultiple tables.ISO TS 8000-81 pdf download.