reana-cmd-plot-workflow

To plot large Parquet datasets from S3 using a reproducible REANA workflow, this Skill automates fetching and caching public data locally, then generates a hex-bin visualization using Dask, Matplotlib, and Seaborn.

Visualizing Parquet data and generating hex-bin plots requires a Python 3.12 environment with dask[dataframe], s3fs, matplotlib, seaborn, and pyarrow installed to handle S3 access and rendering.

Yes, you can use REANA to cache astronomical datasets locally for fast visualization; this workflow pulls a public Parquet dataset from S3 and caches approximately 200,000 rows for rapid plotting.

Dask handles S3 Parquet data access for astronomical plotting by using the s3fs and pyarrow libraries to anonymously fetch the dataset, which is then cached locally for efficient hex-bin rendering.

The best way to manage a REANA workflow for generating dataset plots is using the local REANA client to create, start, monitor, and retrieve the output cmd.png file generated by the plot_cmd.py script.

This plotting workflow currently focuses on generating a 512x512 hex-bin PNG plot with an inverted y-axis for astronomical samples, and does not explicitly support custom visualization outputs beyond this specific rendering.