hops-data-discovery

Automate data discovery across Hopsworks feature groups, data sources, and files.

15|32|Updated Nov 13, 2021
One-click install
npx skills add https://github.com/logicalclocks/hopsworks-api --skill hops-data-discovery
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: hops-data-discovery
Source: https://github.com/logicalclocks/hopsworks-api/tree/main/skills/data/hops-data-discovery
Command: npx skills add https://github.com/logicalclocks/hopsworks-api --skill hops-data-discovery

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill solves the problem of manually searching for and accessing data within Hopsworks, streamlining the process and enabling users to quickly find the data they need.

Core Features & Use Cases

  • Data Discovery: Quickly find available data in Hopsworks from feature groups, data sources, free-text search, and files.
  • Feature Reuse: Promote feature reuse by enabling models to use existing features, reducing the need for new feature pipelines.
  • Use Case: For instance, a data scientist can use this Skill to find a feature group that already contains the necessary data for their model, avoiding the need to create a new feature pipeline.

Quick Start

To list all feature groups in your project, use the hops-data-discovery skill with the command 'hops fg list'.

Frequently Asked Questions about hops-data-discovery

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I discover available feature groups in a Hopsworks project?

To discover available feature groups in a Hopsworks project, you can use the 'hops fg list' command. This automates data discovery, allowing you to quickly locate feature groups, data sources, and files for machine learning workflows.

Can I search for existing features in Hopsworks to avoid building new feature pipelines?

Yes, you can search for existing features in Hopsworks to avoid building new feature pipelines. This Skill promotes feature reuse by enabling models to leverage existing feature groups, reducing the need for new pipeline creation.

What is the best way to locate data sources and files for machine learning workflows in Hopsworks?

The best way to locate data sources and files for machine learning workflows in Hopsworks is automating data discovery. This approach quickly finds available data from feature groups, data sources, free-text search, and files.

Do I need access to the Hopsworks Feature Store to use the hops CLI for data discovery?

Yes, you need access to the Hopsworks Feature Store to use the hops CLI for data discovery. The Skill requires this access to automate locating feature groups, data sources, and files within your project.

Why does finding existing data in Hopsworks manually slow down model development?

Finding existing data in Hopsworks manually slows down model development because it requires tedious searching. Automating data discovery streamlines this process, enabling data scientists to quickly find necessary features and reduce pipeline creation.