skills.rest
AzureAzureOfficial·1 Agent Skills Included

azure-kusto-spark

Spark data connector for Azure Data Explorer reads and writes

Connects Apache Spark jobs to Azure Data Explorer for fast data reads and writes. Diagnoses ingestion failures, authentication errors, and schema mismatches with step-by-step triage. Automates the full release lifecycle including version bumps, changelogs, cherry-picks, and tags. Removes manual debugging and repetitive release work for data engineering teams.
81|39
↗
npx skills add Azure/azure-kusto-spark --all -g -y

All Skills in This Repository (1)

Pure Emerald Level Indicators
📦 In Repo
AzureAzure

Azure Kusto Spark Connector — Release Process

Automate Azure Kusto Spark Connector releases with git and shell commands.

Official
Advanced

Frequently Asked Questions

FAQPage Schema
How to install azure-kusto-spark?▼

Run `npx skills add Azure/azure-kusto-spark --all -g -y` in your terminal to install all skills in this repository globally.

How to write Spark data to Azure Data Explorer?▼

Use the connector's DataSource V1 format with df.write and choose Transactional, Queued, or KustoStreaming mode. Queued mode is recommended for large production loads.

How to fix Kusto Spark connector ingestion failures?▼

The troubleshooting skill walks you through classifying the failure, matching known error patterns, and collecting diagnostics like request IDs and ingestion failure logs.

Can it automate the connector release process?▼

Yes. The release skill handles cherry-picking between branches, version bumps, changelog updates, tagging, and triggering the release pipeline.

Which Spark environments are supported?▼

The connector works with Azure Databricks, Azure Synapse Data Explorer, and Microsoft Fabric real-time analytics, on Spark 3.x and 4.x.

Related Repositories in Data & Analytics

View All in Data & Analytics→
PaddlePaddlePaddlePaddle
87.3k

PaddleOCR

Extract text, tables, and formulas from PDFs and images

Official📦 2 Skills
D4VinciD4Vinci
73.3k

Scrapling

Scrape any website and bypass anti-bot protection with AI

Community📦 1 Skills
mvanhornmvanhorn
60.8k

last30days-skill

Research any topic across Reddit, X, YouTube, and the web

Community📦 2 Skills