berdl-query

Execute SQL queries against a remote BERDL Spark cluster via secure proxy.

14|11|Updated Jan 15, 2026

Search Tags:#data query #data export #proxy #spark sql #berdl #remote compute

Ready to run

npx skills add https://github.com/kbaseincubator/BERIL-research-observatory --skill berdl-query

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: berdl-query
Source: https://github.com/kbaseincubator/BERIL-research-observatory/tree/main/.claude/skills/berdl-query
Command: npx skills add https://github.com/kbaseincubator/BERIL-research-observatory --skill berdl-query

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill enables users to securely run SQL queries against the BERDL Spark cluster from their local machine, providing a controlled way to access and process large datasets without direct exposure of the cluster.

Core Features & Use Cases

Remote Spark Compute: Execute SQL queries on the BERDL cluster while maintaining local control over the process.
Controlled Data Retrieval: Safely retrieve small to medium-sized results directly, with a clear fallback for exporting large datasets to object storage.
Use Case: Analyze millions of microbial genomes stored in BERDL by running a SELECT COUNT(*) query to understand dataset size, then exporting specific gene sequences for further local analysis.

Quick Start

Run the SQL query 'SHOW DATABASES' against the BERDL cluster using the secure proxy.

Frequently Asked Questions about berdl-query

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I run Spark SQL queries on a remote cluster from my local machine?▼

You can run Spark SQL queries remotely by executing them against the BERDL Spark cluster using a secure proxy connection. This setup maintains local control while processing large datasets on the remote compute cluster.

What is the best way to export large SQL query outputs to object storage?▼

Exporting large SQL query outputs to object storage is the recommended fallback for massive result sets. The Skill robustly manages this data export process, ensuring reliable retrieval without overwhelming your local machine.

Does querying a remote Spark cluster securely require special network configuration?▼

Querying a remote Spark cluster securely requires establishing a secure proxy connection. This controlled access method prevents direct exposure of the cluster while allowing interactive analysis and data retrieval.

Can I retrieve large datasets directly from a remote Spark SQL query?▼

You can safely retrieve small to medium-sized datasets directly from a remote Spark SQL query. For large datasets, the system provides a clear fallback to export the query outputs to object storage.