Data quality kite-mark guide

A data quality traffic light or kite mark appears next to key performance indicators in the dashboard to provide visual assurance on the quality of data underpinning a performance indicator. A visual indicator acknowledges the variability of data and makes an explicit assessment of the quality of evidence on which the performance measurement is based.

The kite-mark is presented as a coloured pie chart and sectors are as

rated green for sufficient
or red for insufficient assurance

as per the definition below and it focuses on the following four domains

timeliness,
completeness,
validity
process.

Domain	Definition	Sufficient for assurance	Insufficient for assurance
Timeliness Right upper quadrant	This is the time taken between the end of the data period and when the information can be produced and reviewed.	Where data is available daily for an indicator, up-to-date data can be produced, reviewed and reported upon the next day. Where data is only available monthly, up-to-date data can be produced, reviewed and reported upon within one month. Where the data is only available quarterly, up-to-date data can be produced, reviewed and reported upon within three months.	Where data is available daily for an indicator, there is a data lag of more than one day. Where data is only available monthly, there is a data lag of more than one month. Where data is only available quarterly, there is a data lag of more than one quarter.
Completeness Right Lower quadrant	The extent to which all the expected attributes of the data are populated but also the extent to which all the records for the relevant population are provided.	Fewer than 3% blank or invalid fields in expected data set. This standard applies unless a different standard is explicitly stated for a KPI within commissioner contracts or through national requirements.	More than 3% blank or invalid fields in expected data set
Validation Left lower quadrant	This is the extent to which the data has been validated to ensure it is accurate and in compliance with relevant requirements	The Trust has agreed upon procedures in place for the validation of data for the KPI. A sufficient amount of the data, proportionate to the risk, has been validated to ensure data is: -Accurate; and -In compliance with relevant rules and definitions for the KPI.	Either: -No validation has taken place; or -An insufficient amount of data has been validated as determined by the KPI owner; or -Validation has found that the KPI is not accurate or does not comply with relevant rules and definitions.
Process Left upper quadrant	This is the extent to which a process has been documented to support consistency and understanding of data capture requirements for all relevant staff	There is a documented process to detail the following core information; -The numerator and denominator of the indicator. -The process for data capture. -The process for validation and data cleansing. -Performance monitoring.	There is no documented process. The process is fragmented / inconsistent across the services