hops-job
OfficialAutomate Hopsworks job orchestration and execution.
Authorlogicalclocks
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill streamlines the process of creating, configuring, scheduling, and running Hopsworks jobs or Airflow workflows, reducing manual steps and improving efficiency.
Core Features & Use Cases
- Job Orchestration: Automate the scheduling and execution of Hopsworks jobs and Airflow workflows.
- Script Deployment: Upload and execute Python/PySpark scripts from HopsFS.
- Environment Configuration: Select and utilize pre-defined Python environments for job execution.
- Use Case: If you have a series of data processing tasks in Hopsworks that need to be executed in a specific order, this Skill can automate the entire workflow.
Quick Start
Deploy a new Hopsworks job by running the following command:
hops job deploy feature-pipeline feature_pipeline.py --env python-feature-pipeline --cron @daily --run --wait --overwrite
Dependency Matrix
Required Modules
hopsworksairflow
Components
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: hops-job Download link: https://github.com/logicalclocks/hopsworks-api/archive/main.zip#hops-job Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.