esload

Load structured datasets into Elasticsearch with configurable indexing options.

209|30|Updated Sep 18, 2021
One-click install
npx skills add https://github.com/starlake-ai/starlake --skill esload
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: esload
Source: https://github.com/starlake-ai/starlake/tree/main/.agent/skills/esload
Command: npx skills add https://github.com/starlake-ai/starlake --skill esload

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Elasticsearch data ingestion often requires manual steps and careful configuration to index documents correctly. ESLoad provides a focused CLI to load structured data into Elasticsearch, streamlining the workflow from domain/schema selection to dataset formatting and indexing.

Core Features & Use Cases

  • Direct data loading: index datasets into Elasticsearch with domain, schema, and format options.
  • Flexible configuration: support for optional timestamp suffix, document id attribute, mapping file, and dataset path.
  • Scalable integration: integrates with esSpark configuration options to tune performance for large datasets.

Quick Start

Provide a dataset path and required parameters, then run the starlake esload command to index data into Elasticsearch.

Frequently Asked Questions about esload

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I load structured datasets into Elasticsearch?

You can load structured datasets into Elasticsearch by specifying domain, schema, and format options, then executing the command to index documents directly into your cluster without manual steps.

What is the process for indexing data into Elasticsearch using a CLI?

Indexing data into Elasticsearch via a CLI involves executing a focused command that automates the workflow from domain and schema selection to dataset formatting, replacing manual configuration with required parameters.

Can I specify a custom document ID when ingesting data into Elasticsearch?

Yes, you can specify a custom document ID attribute during data ingestion into Elasticsearch. This optional configuration ensures your indexed documents retain specific identifiers rather than auto-generated ones.

Does this Elasticsearch data loading method support large datasets?

Yes, this data loading method supports large datasets by integrating with esSpark configuration options, allowing you to tune performance and scale data ingestion across domains and schemas efficiently.

What format options are available for indexing datasets into Elasticsearch?

Available format options for indexing datasets into Elasticsearch include configurable dataset paths, optional timestamp suffixes, and mapping files, providing flexible configuration for structured data integration.

Do I need a mapping file to index structured data into Elasticsearch?

No, a mapping file is an optional configuration when you index structured data into Elasticsearch. Required parameters include domain and schema, while mappings are used only for flexible indexing needs.