Skip to content

DQ Assesment Tool v2.0.0

Latest
Compare
Choose a tag to compare
@novoneel-iudx novoneel-iudx released this 29 Sep 13:21
· 40 commits to main since this release
038d899

This tool can be used to assess the quality of a dataset by providing a metric score between 0 and 1, where 1 is the highest possible score, indicating a 100% score. Currently, the tool is able to assign a score to seven parameters, an increase from the 5 parameters described in v1.0.0. These parameters attempt to quantify the quality of specifically sensor data, and they are:

-Regularity of Inter-Arrival Time
-Outlier Presence in Inter-Arrival Time
-Sensor Uptime
-Absence of Duplicate Values
-Adherence to Attribute Format
-Absence of Unknown Attributes
-Adherence to Mandatory Attributes

The tool takes static historical data as input for the user to be able to check and assess the quality.

The output of the tool is primarily a fully fleshed out PDF with visualisations and explanations, a change from the JSON output of v1.0.0. This change was made with readability and accessibility for the end user in mind. The previous functionality of a JSON output has been retained and improved as well, for a user that wants to view the scores in isolation.

Full Changelog: v1.0.0...v2.0.0