deploy-connector

Deploy data ingestion pipelines for source connectors using Databricks CLI.

60|116|Updated Nov 13, 2025

Search Tags:#pipeline #ingestion #deploy #connector #databricks #unity catalog

Ready to run

npx skills add https://github.com/databrickslabs/lakeflow-community-connectors --skill deploy-connector

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: deploy-connector
Source: https://github.com/databrickslabs/lakeflow-community-connectors/tree/main/.claude/skills/deploy-connector
Command: npx skills add https://github.com/databrickslabs/lakeflow-community-connectors --skill deploy-connector

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill streamlines the process of deploying data connectors to Databricks, enabling users to ingest data from various sources efficiently.

Core Features & Use Cases

Pipeline Creation/Update: Guides users through creating new or updating existing data pipelines for specified source connectors.
Interactive Configuration: Collects necessary parameters like connection names, catalog/schema details, and table selections interactively.
Use Case: A data engineer needs to set up a new pipeline to ingest data from a GitHub repository. This Skill will walk them through authenticating, configuring the pipeline, and deploying it using the Databricks CLI.

Quick Start

Use the deploy-connector skill to create a new pipeline for the github source.

Frequently Asked Questions about deploy-connector

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I deploy a data ingestion pipeline to Databricks?▼

To deploy a data ingestion pipeline to Databricks, this Skill interactively gathers connection details, schema configurations, and table selections, then executes Databricks CLI commands to create or update the pipeline.

Can I update an existing data connector pipeline in Databricks?▼

Yes, you can update existing data connector pipelines in Databricks. The Skill supports both new pipeline creation and updates to existing ones, including options for using local source files.

What is the process for configuring Unity Catalog schema details for a new Databricks connector?▼

Configuring Unity Catalog schema details for a Databricks connector involves interactively providing the connection name, catalog, schema, and table selections to the Skill before it executes the deployment.

Do I need the Databricks CLI to set up source connectors for data ingestion?▼

Yes, the Databricks CLI is required to set up source connectors for data ingestion. The Skill manages the deployment by executing Databricks CLI commands based on your interactive inputs.

How do I ingest data from a GitHub repository into Databricks?▼

To ingest data from a GitHub repository into Databricks, the Skill walks you through authenticating, configuring the pipeline parameters, and deploying it using the Databricks CLI.

What are the limitations of using local source files when deploying Databricks pipelines?▼

The Skill provides options for local source file usage during the pipeline deployment process, allowing you to specify local files when creating new or updating existing Databricks ingestion pipelines.