skills.rest
logicalclocks
logicalclocksOFFICIAL
Explore all skills by this author →
Website𝕏@hopsworksGitHub

hops-data-sources

Automate external data source ingestion and mounting into Hopsworks.

15|32|Updated Nov 13, 2021
Search Tags:#data ingestion#connector#data source#hopsworks#feature group
One-click install
npx skills add https://github.com/logicalclocks/hopsworks-api --skill hops-data-sources
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: hops-data-sources
Source: https://github.com/logicalclocks/hopsworks-api/tree/main/skills/data/hops-data-sources
Command: npx skills add https://github.com/logicalclocks/hopsworks-api --skill hops-data-sources

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill unit simplifies the process of ingesting and mounting external data sources into Hopsworks, enabling users to leverage diverse data sources for their projects.

Core Features & Use Cases

  • Data Mounting: Mount external tables as feature groups without copying data.
  • Data Ingestion: Ingest data into managed feature groups using DLTHub.
  • Connector Management: Create and manage connectors for various data sources.
  • Use Case: Integrate Snowflake, BigQuery, S3, ADLS, GCS, and more with Hopsworks.

Quick Start

Use the 'hops-data-sources' skill to create a connector for Snowflake and ingest data from a table into a feature group.

Frequently Asked Questions about hops-data-sources

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I ingest data from Snowflake into Hopsworks feature groups?▼

To ingest data from Snowflake into Hopsworks feature groups, you need to configure a data source connector and use DLTHub to automate the ingestion process into managed feature groups.

Can I mount external BigQuery tables in Hopsworks without copying data?▼

Yes, you can mount external BigQuery tables as feature groups in Hopsworks without copying the underlying data, allowing direct access to external data sources.

What is the difference between data mounting and data ingestion in Hopsworks?▼

Data mounting links external tables as feature groups without copying data, whereas data ingestion uses DLTHub to actively load data into managed feature groups inside Hopsworks.

Does Hopsworks support data ingestion from S3 and ADLS?▼

Yes, Hopsworks supports data ingestion and mounting from various external data sources including S3, ADLS, GCS, Snowflake, and BigQuery through configurable connectors.

How do I create and manage connectors for external data sources in Hopsworks?▼

You can create and manage connectors for external data sources in Hopsworks by configuring the required connection parameters, enabling seamless integration with platforms like Snowflake and BigQuery.

Related Skills

Explore More Data & Analytics Skills→
databrickslabsdatabrickslabs
60

authenticate-source

Generate connector specifications, collect credentials, and validate data source authentication.

Official
Intermediate
logicalclockslogicalclocks
15

hops-data-discovery

Automate data discovery across Hopsworks feature groups, data sources, and files.

Official
Intermediate
logicalclockslogicalclocks

hops

Manage Hopsworks Feature Store resources via the hops CLI with JSON output.

Official
Advanced
logicalclockslogicalclocks
15

hops-superset

Create and manage Superset dashboards and charts within Hopsworks.

Official
Intermediate