datalad-addurls

Bulk-populate a DataLad dataset from CSV, TSV, or JSON URL manifests.

1|Updated Feb 25, 2026

Search Tags:#automation #manifest #dataset #URL #datalad #annex #addurls

Ready to run

npx skills add https://github.com/bcmcpher/my-skills --skill datalad-addurls

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: datalad-addurls
Source: https://github.com/bcmcpher/my-skills/tree/main/plugins/datalad-cli/skills/datalad-addurls
Command: npx skills add https://github.com/bcmcpher/my-skills --skill datalad-addurls

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Bulk-populate a DataLad dataset by reading a URL manifest and adding each file as an annexed entry with its download URL registered as the annex remote. DataLad will fetch content on demand using the datalad get command.

Core Features & Use Cases

Bulk-import files into a DataLad dataset from a manifest (CSV, TSV, or JSON).
Register the download URLs as annex remotes so content is retrieved on demand.
Use case: ingest dozens to thousands of files listed in a manifest and track provenance in a DataLad dataset.

Quick Start

Use this skill to bulk-import files into a DataLad dataset by providing a manifest of URLs.

Frequently Asked Questions about datalad-addurls

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I bulk import files into a DataLad dataset from a URL manifest?▼

To bulk import files into a DataLad dataset, read a URL manifest and add each file as an annexed entry with its download URL registered as the annex remote. DataLad will then fetch content on demand using the datalad get command.

What manifest formats can I use to populate a DataLad dataset with URLs?▼

You can use CSV, TSV, and JSON manifests to populate a DataLad dataset. The process parses the manifest, detects URL and filename columns, and constructs the datalad addurls command for large-scale file ingestion.

How does DataLad handle on-demand content retrieval after adding URLs from a manifest?▼

After adding URLs from a manifest, DataLad registers each download URL as an annex remote. Content is not downloaded immediately; instead, DataLad fetches files on demand when you run the datalad get command.

Can I use parallel downloads when ingesting files into a DataLad dataset?▼

Yes, you can use parallel downloads when ingesting files into a DataLad dataset. The workflow supports options for parallel downloads and missing-value handling when building the datalad addurls command from your manifest.

What information is required in a manifest to add URLs to a DataLad annex?▼

To add URLs to a DataLad annex, your manifest must contain parseable URL and filename columns. The workflow also requires a meaningful commit message to properly register the annexed entries during the bulk ingestion process.