des-persona-data-quality-engineer

Enforce data quality expectations by converting them into measurable rules, operational signals, and response paths. This approach applies dimensions, thresholds, anomaly baselines, and orchestration behavior directly within your data pipelines.

Set data quality thresholds using a layer-aware design for Bronze, Silver, and Gold layers. Baseline-aware thresholding ensures expectations reflect different baselines and specific requirements at each data layer.

Configure retry policies and alerts by specifying how data quality checks run and how failures are detected. Operational responses include alerts, backoff behavior, and runbooks to guide remediation during pipeline execution.

Production-release gating requires an owner-backed remediation path to prevent unresolved validation failures from moving downstream. This governance-ready handling ensures accountability when DQ rules involve PII or architecture changes.

Implement data observability and governance by adding handoffs when DQ rules involve PII or retention concerns. This ensures explicit ownership and remediation paths are established for validation failures impacting sensitive data.

Use baseline-aware thresholding for anomaly detection by defining completeness and validity thresholds with baseline windows. This is essential when onboarding new ingestion pipelines to establish accurate operational signals.