skills.rest
cas-bigdatalab
cas-bigdatalabOFFICIAL
Explore all skills by this author →
WebsiteGitHub

dataspace_file_source_stop

Downloads a file from a Dataspace source as a DAG workflow input node.

539|171|Updated May 3, 2018
Search Tags:#pipeline#data ingestion#DAG#data source#file download#dataspace#workflow input
One-click install
npx skills add https://github.com/cas-bigdatalab/piflow --skill dataspace-file-source-stop
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: dataspace_file_source_stop
Source: https://github.com/cas-bigdatalab/piflow/tree/main/workspace/skills/dataspace_file_source_stop
Command: npx skills add https://github.com/cas-bigdatalab/piflow --skill dataspace-file-source-stop

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

Workflow pipelines often need files stored in a Dataspace as their starting input, but manually downloading and staging those files before running a DAG is repetitive and error-prone. This Skill acts as the entry node of a pipeline, fetching a single file from a Dataspace data source instance and exposing it as a local output for downstream operators.

Core Features & Use Cases

  • Dataspace File Download: Retrieves a file from a Dataspace data source instance using its datasource ID and in-space file path.
  • DAG Start Node: Runs with no upstream input, making it the designated starting operator of a workflow graph.
  • Downstream Output Slot: Writes the downloaded file to a local path and exposes it as an output reference for subsequent operators.
  • Use Case: A research data pipeline needs a CSV dataset hosted in a Dataspace. Use this Skill as the first node to download the file locally, then feed it into downstream cleaning, transformation, or analysis operators.

Quick Start

Ask the agent to download a file from a Dataspace data source by providing the datasource ID, the file path inside the space, and a local output path as the first node of the workflow.

Frequently Asked Questions about dataspace_file_source_stop

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I use a Dataspace file as input to a workflow DAG?▼

Use this operator as the starting node of the DAG. Provide the Dataspace datasource instance ID, the file path inside the space, and a local output path; the downloaded file is exposed as an output slot for downstream nodes.

What parameters does the Dataspace file source operator require?▼

It requires three parameters: datasource_id (the Dataspace data source instance ID), input_file_path (the file path within the space, optionally starting with /), and output (the local path where the downloaded file is written).

Can this operator run in the middle of a DAG pipeline?▼

No. It has no upstream input and is designed to be the starting node of a DAG. It only fetches a file from Dataspace and passes it downstream, so it must be placed at the beginning of the workflow.

Why does the Dataspace file download fail with an empty path error?▼

The script strips leading slashes from input_file_path and raises an error if the result is empty. Ensure the path points to an actual file inside the Dataspace space, not just a root slash or blank string.

What happens to the downloaded file after the operator runs?▼

The file is first downloaded into a temporary directory, then copied to the specified output path. The output path is returned as a reference so downstream operators can consume the local file.

Related Skills

Explore More Data & Analytics Skills→
datamaker-krdatamaker-kr
1

synapse-upload-workflow

Automate file uploads from local or cloud storage to Synapse data collections.

Official
Advanced
thechandanbhagatthechandanbhagat
8

csv

Parse and transform CSV data with Python and pandas.

Community
Intermediate
danilomongedanilomonge
1

fetchngs

Fetch sequencing metadata and FastQ files from accession lists.

Community
Advanced
agent0aiagent0ai
1.4k

File Download

Trigger browser downloads from app filesystem paths, in-memory content, or external URLs.

Official
Basic