What problem does it solve?
This Skill converts independently harmonized Lance tables into a complete, internally linked collection that is ready for ingestion, analysis, and machine learning. It resolves cross-table relationships, assigns required identifiers, preserves auditability for source-data changes, and catches schema or value inconsistencies before downstream use.
Core Features & Use Cases
- Collection-wide finalization: Processes tables in dependency-aware DAG order so registry targets receive identifiers before referencing tables are linked.
- Multimodal table integration: Joins feature-space observation tables, preserves ingestion row-order artifacts, and supports both single-modality and multimodal datasets.
- Deterministic enrichment and validation: Assigns UIDs and dataset identifiers, fills registry keys and derived fields, removes transient or audited leftovers, initializes missing schema columns, and validates every row against its target schema.
- Fail-loud safeguards: Detects duplicate or unmatched natural keys, conflicting multimodal values, malformed polymorphic relationships, missing required fields, and value-level schema violations instead of silently producing incomplete links.
- Use Case: After harmonizing datasets from multiple assays, run this Skill to connect observations, datasets, publications, feature registries, and other entities into a validated Homeobox collection ready for ingestion.
Quick Start
Use the finalize-tables skill to finalize the harmonized collection at the specified root against its target schema YAML and perform a dry run before writing changes.