databricks-ai-functions

Access Databricks AI functions for SQL and PySpark text analysis.

Updated Jul 4, 2026
One-click install
npx skills add https://github.com/mkgs-databricks-demos/aiSkillUpdater --skill databricks-ai-functions-mkgs-databricks-demos
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: databricks-ai-functions
Source: https://github.com/mkgs-databricks-demos/aiSkillUpdater/tree/main/databricks-ai-functions
Command: npx skills add https://github.com/mkgs-databricks-demos/aiSkillUpdater --skill databricks-ai-functions-mkgs-databricks-demos

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires databricks, pyspark, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

The Skill Unit addresses the need for easy integration of AI capabilities within data processing workflows, removing the complexity of setting up model endpoints and managing API keys.

Core Features & Use Cases

  • AI Function Access: Direct access to built-in Databricks AI functions for SQL and PySpark, eliminating the need for endpoint management and API keys.
  • Enhanced Text Processing: Perform advanced text analysis, sentiment scoring, and more within data pipelines.
  • Forecasting and Document Parsing: Time series forecasting and full-text document parsing, supporting document chunking for AI Search and Retrieval Augmented Generation (RAG) pipelines.
  • Use Case: Streamline text analysis on large datasets using ai_analyze_sentiment for sentiment scoring and ai_summarize for summarizing content.

Quick Start

Activate the databricks-ai-functions skill to automatically analyze sentiment and generate summaries from text data.

Frequently Asked Questions about databricks-ai-functions

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run sentiment analysis and text summarization directly in Databricks SQL?

AI functions like ai_analyze_sentiment and ai_summarize run directly in Databricks SQL and PySpark pipelines, letting you process text analysis without managing external model endpoints or API keys.

What is the best way to do batch inference for time series forecasting in PySpark?

Using Databricks AI functions in PySpark provides the best way for batch inference of time series forecasting, directly embedding forecasting capabilities into your data pipelines without managing separate endpoints.

Do I need to manage API keys to use machine learning functions in Databricks?

No, you do not need to manage API keys. Built-in Databricks AI functions provide direct access to machine learning capabilities in SQL and PySpark, removing the complexity of endpoint setup and API key management.

Does Databricks support full-text document parsing and chunking for RAG pipelines?

Yes, Databricks supports full-text document parsing and chunking for Retrieval Augmented Generation (RAG) pipelines through its suite of integrated AI functions, ensuring seamless preparation for AI Search.

Can I use Databricks AI functions for serverless batch inference on large datasets?

Yes, you can use Databricks AI functions for serverless batch inference on large datasets. These functions are optimized for serverless computing, enabling efficient text analysis and forecasting within your data pipelines.