Run SodaCL data quality checks against configured data sources.
npx skills add https://github.com/ivanshamaev/de-agent-skills --skill soda-core
Please help me install this Agent Skill. Skill: soda-core Source: https://github.com/ivanshamaev/de-agent-skills/tree/main/skills/soda_core Command: npx skills add https://github.com/ivanshamaev/de-agent-skills --skill soda-core
Data pipelines often silently produce bad, incomplete, stale, or schema-violating data, and teams need a reliable way to detect and stop downstream failures early.
Use the soda-core skill to scan silver/orders with SodaCL checks by running: soda scan -d postgres_prod -c soda/configuration.yml soda/checks/silver_orders.yml
High-intent search queries and answers about installing and using this skill.
You can add data quality checks to your ETL pipeline by running SodaCL definitions through a scan command, which evaluates your data sources for missing values, duplicates, and schema violations, returning pass, warn, or fail statuses.
Yes, you can use SodaCL to validate data freshness and schema expectations in dbt workflows by executing soda scan commands alongside your dbt runs, allowing you to define SLA checks and schema validations directly in YAML.
Yes, SodaCL supports running data quality gates in Airflow. You can embed the soda scan execution as a task within your Airflow DAGs to automatically halt downstream processes if checks fail.
You can run SodaCL data quality checks against multiple data sources including PostgreSQL, Spark, ClickHouse, Trino, and BigQuery by configuring a YAML data source file for your specific adapter.
To check for duplicate and invalid records in SQL tables before publishing, define SodaCL checks in a YAML file and execute a soda scan, which will evaluate your custom SQL metrics and referential integrity rules.
The best way to set up data quality gates for batch ETL partitions is to define SodaCL checks in a YAML file and run the soda scan command targeting your specific partitions to return pass, warn, or fail statuses.
BellaBeConfigure deployment targets and generate a YAML schema with presets.
microsoftValidate and enforce quality gates across CI/CD workflows with pass/fail reports.
CODE-SAURABHDesign reliable data pipelines with idempotent processing and schema validation.
Datus-aiGuide structured SQL data analysis with schema discovery and data sampling.
