databricks-lakeflow-connect

Official

Streamline data ingestion with Lakeflow Connect into Databricks

Authormkgs-databricks-demos
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill solves the problem of complex and time-consuming data ingestion from SaaS applications and databases into Databricks.

Core Features & Use Cases

  • Managed Ingestion: Simplifies the process of ingesting data from various sources into Databricks using Lakeflow Connect.
  • Connector Catalog: Provides access to over 100 connectors for SaaS apps and databases.
  • Serverless Pipelines: Offers serverless ingestion pipelines for efficient data processing.
  • Use Case: For instance, if you need to import Salesforce data into Databricks, this Skill can automate the process, saving time and effort.

Quick Start

To start using Lakeflow Connect, run the following command: databricks pipelines create --json '{"name": "myIngestionPipeline", "ingestion_definition": {"connection_name": "mySalesforceConnection", "objects": [{"table": {"source_schema": "salesforce", "source_table": "Account", "destination_catalog": "main", "destination_schema": "salesforce_raw"}}]}}'

Dependency Matrix

Required Modules

databricks-clidatabricks-sdk

Components

scriptsreferencesassets

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: databricks-lakeflow-connect
Download link: https://github.com/mkgs-databricks-demos/aiSkillUpdater/archive/main.zip#databricks-lakeflow-connect

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.