databricks-lakeflow-connect

Automate SaaS and database data ingestion into Databricks via Lakeflow Connect.

Updated Jul 4, 2026
One-click install
npx skills add https://github.com/mkgs-databricks-demos/aiSkillUpdater --skill databricks-lakeflow-connect
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: databricks-lakeflow-connect
Source: https://github.com/mkgs-databricks-demos/aiSkillUpdater/tree/main/databricks-lakeflow-connect
Command: npx skills add https://github.com/mkgs-databricks-demos/aiSkillUpdater --skill databricks-lakeflow-connect

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires databricks-cli, databricks-sdk, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill solves the problem of complex and time-consuming data ingestion from SaaS applications and databases into Databricks.

Core Features & Use Cases

  • Managed Ingestion: Simplifies the process of ingesting data from various sources into Databricks using Lakeflow Connect.
  • Connector Catalog: Provides access to over 100 connectors for SaaS apps and databases.
  • Serverless Pipelines: Offers serverless ingestion pipelines for efficient data processing.
  • Use Case: For instance, if you need to import Salesforce data into Databricks, this Skill can automate the process, saving time and effort.

Quick Start

To start using Lakeflow Connect, run the following command: databricks pipelines create --json '{"name": "myIngestionPipeline", "ingestion_definition": {"connection_name": "mySalesforceConnection", "objects": [{"table": {"source_schema": "salesforce", "source_table": "Account", "destination_catalog": "main", "destination_schema": "salesforce_raw"}}]}}'

Frequently Asked Questions about databricks-lakeflow-connect

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I ingest data from SaaS applications into Databricks?

You can automate data ingestion from SaaS applications into Databricks using Lakeflow Connect. It provides a comprehensive connector catalog and serverless pipelines to streamline the process of importing data like Salesforce records.

What is the best way to automate importing Salesforce data into Databricks?

The best way to automate importing Salesforce data into Databricks is using Lakeflow Connect. You can create a serverless ingestion pipeline via the Databricks CLI, defining your connection and destination schema to streamline the data processing.

Do I need the Databricks CLI and SDK to set up Lakeflow Connect pipelines?

Yes, you need the Databricks CLI and Databricks SDK for Python to use this Skill. These dependencies are required to configure and run the serverless ingestion pipelines for your SaaS and database connectors.

Can I use serverless pipelines for database ingestion into Databricks?

Yes, you can use serverless pipelines for database ingestion into Databricks. Lakeflow Connect offers serverless ingestion pipelines alongside its connector catalog to ensure efficient data processing from your databases.

How many connectors are available for data ingestion with Lakeflow Connect?

Lakeflow Connect provides access to a comprehensive connector catalog featuring over 100 connectors. These cover various SaaS applications and databases to simplify your data ingestion workflows into Databricks.