Redact PHI and generate synthetic equivalents for health evaluation datasets.
npx skills add https://github.com/JustinChaney2023/orate --skill dataset-redaction
Please help me install this Agent Skill. Skill: dataset-redaction Source: https://github.com/JustinChaney2023/orate/tree/main/roles/dataset-redaction Command: npx skills add https://github.com/JustinChaney2023/orate --skill dataset-redaction
This Skill creates safe evaluation datasets by redacting PHI and optionally generating synthetic equivalents while preserving document structure necessary for OCR, STT, and LLM benchmarking.
Run the redaction pipeline on a sample dataset to generate redacted_documents.json and gold_facts.json, then validate the dataset with the provided manifests.
High-intent search queries and answers about installing and using this skill.
To redact PHI in health datasets for benchmarking, apply deterministic pseudonymization to patient identifiers across visits. This removes sensitive information while preserving the document structure necessary for accurate OCR, STT, and LLM testing.
Synthetic data generation for benchmarking produces realistic, test-ready data with controlled deltas to evaluate model performance. You need it when creating safe evaluation datasets that require realistic variations without exposing actual patient health information.
Yes, you can preserve cross-visit timing structures when redacting patient identifiers. The redaction pipeline enforces deterministic pseudonymization specifically designed to maintain these temporal relationships across visits while ensuring health datasets remain safe.
To generate redacted_documents.json and gold_facts.json for evaluation pipelines, run the redaction pipeline on your sample dataset. After generating these artifacts, validate the dataset using the provided manifests to ensure reproducible benchmarking.
Deliverables needed for reproducible dataset redaction and benchmarking include redaction policies, schemas, and tooling specifications. These ready-to-use artifacts ensure your evaluation data pipelines remain transparent and reproducible across different testing environments.
Yes, this redaction approach works for both STT and LLM test corpora. It applies deterministic pseudonymization to redact PHI and generate synthetic equivalents across health datasets, preserving the audio and text document structures required for benchmarking.
jmeier1963Scaffold an ΩmegaWiki skeleton from raw sources with YAML frontmatter templates.
PSkinnerTechDesign and run AI evaluations to measure model quality.
crazymsnOrganize neuroscience datasets into BIDS-compliant directory structures.
pacphiGenerate synthetic privacy-preserving test data with faker libraries.
