skills.rest
kbaseincubator
kbaseincubatorOFFICIAL
Explore all skills by this author →
WebsiteGitHub

berdl-query

Execute SQL queries against a remote BERDL Spark cluster via secure proxy.

14|11|Updated Jan 15, 2026
Search Tags:#data query#data export#proxy#spark sql#berdl#remote compute
One-click install
npx skills add https://github.com/kbaseincubator/BERIL-research-observatory --skill berdl-query
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: berdl-query
Source: https://github.com/kbaseincubator/BERIL-research-observatory/tree/main/.claude/skills/berdl-query
Command: npx skills add https://github.com/kbaseincubator/BERIL-research-observatory --skill berdl-query

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill enables users to securely run SQL queries against the BERDL Spark cluster from their local machine, providing a controlled way to access and process large datasets without direct exposure of the cluster.

Core Features & Use Cases

  • Remote Spark Compute: Execute SQL queries on the BERDL cluster while maintaining local control over the process.
  • Controlled Data Retrieval: Safely retrieve small to medium-sized results directly, with a clear fallback for exporting large datasets to object storage.
  • Use Case: Analyze millions of microbial genomes stored in BERDL by running a SELECT COUNT(*) query to understand dataset size, then exporting specific gene sequences for further local analysis.

Quick Start

Run the SQL query 'SHOW DATABASES' against the BERDL cluster using the secure proxy.

Frequently Asked Questions about berdl-query

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run Spark SQL queries on a remote cluster from my local machine?▼

You can run Spark SQL queries remotely by executing them against the BERDL Spark cluster using a secure proxy connection. This setup maintains local control while processing large datasets on the remote compute cluster.

What is the best way to export large SQL query outputs to object storage?▼

Exporting large SQL query outputs to object storage is the recommended fallback for massive result sets. The Skill robustly manages this data export process, ensuring reliable retrieval without overwhelming your local machine.

Does querying a remote Spark cluster securely require special network configuration?▼

Querying a remote Spark cluster securely requires establishing a secure proxy connection. This controlled access method prevents direct exposure of the cluster while allowing interactive analysis and data retrieval.

Can I retrieve large datasets directly from a remote Spark SQL query?▼

You can safely retrieve small to medium-sized datasets directly from a remote Spark SQL query. For large datasets, the system provides a clear fallback to export the query outputs to object storage.

Related Skills

Explore More Data & Analytics Skills→
GitnappGitnapp

remote-ssh

Configure and troubleshoot SSH connections to remote machines.

Community
Advanced
DevHive1DevHive1
18

excel-generator

Generate Excel workbooks with formatting, formulas, and charts using openpyxl and xlsxwriter.

Community
Intermediate
dralkhdralkh
74

phylogenetics

Build phylogenetic trees from FASTA sequences using MAFFT, IQ-TREE 2, and ETE3.

Community
Advanced
weiflycc-cmdweiflycc-cmd

spark-consumption-cli

Run interactive PySpark and Spark SQL analytics on Microsoft Fabric lakehouse data via the Lakehouse Livy API.

Community
Intermediate