haipipe-data-1-source

To standardize raw CSV, JSON, and XML files, this Skill processes them into a unified SourceSet, which is a dictionary of DataFrames. This ensures consistent data ingestion for downstream analytical and machine learning workflows.

The best way to ingest diverse raw data formats like Parquet and JSON is to use a pipeline orchestration framework that enforces schema consistency. This Skill converts them into a structured SourceSet asset ready for your pipeline.

Yes, this data pipeline Skill supports schema consistency enforcement within defined data domains. It orchestrates data transformation to ensure your raw CSV, XML, Parquet, and JSON files are consistently structured.

To process raw EHR extracts and sensor logs, you can run this Skill to transform them into a unified SourceSet. This standardized dictionary of DataFrames can then be consistently fed into your patient record-building pipeline.

Yes, you can use Parquet files as input for research data standardization. The Skill reads diverse raw data formats including CSV, XML, Parquet, and JSON, converting them into a consistent SourceSet format.

You should use a SourceSet for data wrangling when you need to feed multiple raw file formats into downstream analytical workflows. It standardizes data into a consistent dictionary of DataFrames via a pipeline framework.