des-duckdb-local-engine
CommunityProfile data locally with DuckDB evidence
Data & Analytics#data quality#schema validation#duckdb#ducklake#data profiling#parquet conversion#sql prototyping
AuthorDKSang
Version1.0.0
Installs0
System Documentation
What problem does it solve?
des-duckdb-local-engine prevents downstream DES artifacts from being built on assumptions by using DuckDB (and optionally DuckLake) to inspect real data, validate schema/grain/quality, and capture evidence early in the workflow.
Core Features & Use Cases
- Local-first source profiling: read raw files and infer/validate schema, row counts, nulls, duplicates, ranges, and categorical distributions to reduce uncertainty.
- Grain and key validation: test candidate keys and join cardinality before drafting Silver/Gold logic so aggregation grain and relationships are trustworthy.
- SQL prototyping and conversion: prototype transformation SQL locally, generate conversion/export plans (e.g., to Parquet), and produce artifact-ready evidence packages.
- DuckLake local lakehouse layer: use Parquet + SQL catalog + snapshots/time travel for a lightweight local lakehouse to support Bronze/Silver/Gold prototypes and schema evolution experiments.
Quick Start
Use des-duckdb-local-engine to profile your provided data files and write findings into the matching DES evidence outputs for the active phase.
Dependency Matrix
Required Modules
None requiredComponents
references
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: des-duckdb-local-engine Download link: https://github.com/DKSang/DES-SKILL/archive/main.zip#des-duckdb-local-engine Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.