check-upstream

Audits python-api coverage of upstream DataFusion Rust bindings and reports gaps.

595|165|Updated Jul 20, 2022

Search Tags:#audit #ffi #datafusion #python-bindings #api-coverage

Ready to run

npx skills add https://github.com/apache/datafusion-python --skill check-upstream

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: check-upstream
Source: https://github.com/apache/datafusion-python/tree/main/.ai/skills/check-upstream
Command: npx skills add https://github.com/apache/datafusion-python --skill check-upstream

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill helps ensure datafusion-python exposes the complete set of upstream DataFusion features (functions, DataFrame ops, SessionContext methods, and FFI types) so parity and API coverage are maintained.

Core Features & Use Cases

Identify missing Python bindings for scalar, aggregate, window, and table functions from upstream.
Verify DataFrame API coverage and SessionContext methods against upstream Rust bindings.
Produce a prioritized report of gaps for issue tracking and PR work.

Quick Start

Scan the repository and report any missing upstream API bindings to datafusion-python.

Frequently Asked Questions about check-upstream

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I audit Python bindings for missing upstream DataFusion API functions?▼

To audit Python bindings for missing DataFusion API functions, compare Python API definitions and __all__ entries against upstream Rust bindings to enumerate any gaps or mismatches that block parity across scalar, aggregate, window, and table functions.

What is DataFusion Python API coverage parity?▼

DataFusion Python API coverage parity means the datafusion-python project exposes the complete set of upstream DataFusion features, including DataFrame operations, SessionContext methods, and FFI types, ensuring functional equivalence between Python and Rust core.

How do I find missing DataFrame operations and SessionContext methods in datafusion-python?▼

Find missing DataFrame operations and SessionContext methods by scanning the repository to compare Python API definitions against upstream Rust bindings, producing a validated gap list suitable for issue creation or PR work.

Does the DataFusion Python audit report suggest names for missing Rust bindings?▼

Yes, the DataFusion Python audit report provides a prioritized list of API gaps including suggested Python and Rust binding names along with pointers to upstream references to facilitate issue tracking and PR work.

Can I check FFI types coverage against upstream DataFusion Rust bindings?▼

Yes, you can check FFI types coverage by comparing Python API definitions and __all__ entries directly against upstream DataFusion Rust bindings to identify missing FFI types or mismatches within the datafusion-python project.