platform-engineering-data-platform-api

What problem does it solve?

It solves the problem of tightly coupled, team-by-team access to data platform operations by providing a unified, governed API layer that other teams can safely use.

Core Features & Use Cases

• Unified self-service API: Exposes FastAPI endpoints to manage platform resources and trigger workflows (Kafka topic CRUD, Airflow DAG triggers, dbt job runs, Trino query execution, dataset catalog + lineage retrieval).
• OAuth2+JWT security with team-based RBAC: Enforces permissions using role checks and team claims to prevent unauthorized operations.
• Operational safety controls: Supports async job tracking with status polling, rate limiting per team, API versioning (v1/v2), and comprehensive audit logging of all platform operations.
• Developer enablement: Generates OpenAPI specs plus typed SDKs (Python/TypeScript) and includes Kubernetes deployment patterns and HPA scaling.

Quick Start

Use this skill to design an internal FastAPI service that lets authenticated teams trigger Airflow DAG runs, submit Trino queries asynchronously, and manage Kafka topics through RBAC-protected endpoints.