Identify stale data across configured tables in data warehouses and ETL pipelines.
npx skills add https://github.com/starlake-ai/starlake --skill freshness
Please help me install this Agent Skill. Skill: freshness Source: https://github.com/starlake-ai/starlake/tree/main/.agent/skills/freshness Command: npx skills add https://github.com/starlake-ai/starlake --skill freshness
Data engineers and analysts often rely on stale data that undercuts trust and decision making. This Skill provides a quick way to verify that important tables are fresh according to defined thresholds.
Run starlake freshness to identify stale tables and surface freshness metrics for your configured datasets.
High-intent search queries and answers about installing and using this skill.
You can verify data freshness by running a command that checks configured tables against defined timeliness thresholds. This identifies stale data in your data warehouse and surfaces staleness metrics for monitoring.
Yes, you can integrate data freshness checks into scheduled ETL pipelines. Running timeliness verification during pipeline execution alerts you to stale data, ensuring downstream datasets remain current for decision making.
Data timeliness verification confirms that tables are updated within expected timeframes. You need it in data warehouses and ETL pipelines to prevent reliance on stale data, maintaining trust and data quality.
Yes, freshness checks support CLI options for table filtering and result persistence. You can customize checks for specific connections and store the freshness results to integrate with existing data quality dashboards.
The best way to monitor data staleness across multiple datasets is applying a freshness verification check across environments. This surfaces stale tables and integrates metrics into existing data quality dashboards.
yu13130122297Identify uncertainties in research framing, datasets, metrics, and baselines.
prashsubDetect stale or incomplete Databricks Unity Catalog tables using ML models.
haJ1tManage data pipeline lifecycles including ETL, warehousing, orchestration, and data quality.
williamzujkowskiValidate dataset completeness, accuracy, and consistency with Great Expectations.
