IBM BigQuality is a data quality product that runs natively on Apache Hadoop clusters. It provides data profiling, cleansing, monitoring, and rule-based quality checks executed on Hadoop data nodes. The product brings traditional information quality functions into a Hadoop-based data lake environment rather than requiring data extraction to another platform for quality processing.
On IBM’s official product page, BigQuality is described as providing:
- Data profiling to assess assets stored in Hadoop
- Cleansing, standardization, matching, and survivorship capabilities
- Ongoing monitoring and stewardship through data quality rules
- Sensitive-data discovery to support privacy and masking initiatives (for example, identification of PII-like patterns)
- Address cleansing/validation capabilities (for example, USAC and AVI)
(Official vendor product page)