skills.rest
ivanshamaev
ivanshamaevCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

platform-engineering-data-platform-api

Expose a governed FastAPI REST API for Kafka, Airflow, dbt, and Trino operations.

14|1|Updated May 5, 2026
Search Tags:#fastapi#jwt rbac#airflow orchestration#trino async queries#kafka topic management#dbt job runs#terraform provider
One-click install
npx skills add https://github.com/ivanshamaev/de-agent-skills --skill platform-engineering-data-platform-api
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: platform-engineering-data-platform-api
Source: https://github.com/ivanshamaev/de-agent-skills/tree/main/group_skills/infra_dataops_group_skills/platform_engineering_data_platform_api
Command: npx skills add https://github.com/ivanshamaev/de-agent-skills --skill platform-engineering-data-platform-api

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It solves the problem of tightly coupled, team-by-team access to data platform operations by providing a unified, governed API layer that other teams can safely use.

Core Features & Use Cases

  • Unified self-service API: Exposes FastAPI endpoints to manage platform resources and trigger workflows (Kafka topic CRUD, Airflow DAG triggers, dbt job runs, Trino query execution, dataset catalog + lineage retrieval).
  • OAuth2+JWT security with team-based RBAC: Enforces permissions using role checks and team claims to prevent unauthorized operations.
  • Operational safety controls: Supports async job tracking with status polling, rate limiting per team, API versioning (v1/v2), and comprehensive audit logging of all platform operations.
  • Developer enablement: Generates OpenAPI specs plus typed SDKs (Python/TypeScript) and includes Kubernetes deployment patterns and HPA scaling.

Quick Start

Use this skill to design an internal FastAPI service that lets authenticated teams trigger Airflow DAG runs, submit Trino queries asynchronously, and manage Kafka topics through RBAC-protected endpoints.

Frequently Asked Questions about platform-engineering-data-platform-api

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a self-service API for data platform operations across Kafka, Airflow, dbt, and Trino?▼

A self-service API for data platform operations is built using FastAPI to expose governed REST endpoints for Kafka topic CRUD, Airflow DAG triggers, dbt job runs, and Trino query execution. It requires JWT/OAuth2 authentication with team-based RBAC to ensure safe multi-team access.

How does async job tracking work for Trino queries and Airflow DAG triggers in a FastAPI service?▼

Async job tracking for Trino queries and Airflow DAG triggers works by submitting long-running operations through the FastAPI service and providing status polling endpoints. This allows clients to retrieve execution results asynchronously without blocking the API request thread.

Can I enforce per-team rate limiting and RBAC in a FastAPI data platform API?▼

Yes, you can enforce per-team rate limiting and RBAC in a FastAPI data platform API by using team claims from JWT tokens. Role checks prevent unauthorized operations like Kafka topic deletion, while rate limiting ensures fair resource consumption across multiple teams.

What is the best way to generate typed SDKs and OpenAPI specs for internal platform APIs?▼

The best way to generate typed SDKs and OpenAPI specs for internal platform APIs is to leverage FastAPI's native OpenAPI documentation generation. This produces typed SDKs for languages like Python and TypeScript, enabling developer enablement for teams consuming the platform.

Does this FastAPI self-service API approach support Kubernetes deployment with HPA scaling?▼

Yes, this FastAPI self-service API approach supports Kubernetes deployment with HPA scaling. It includes Kubernetes deployment patterns to ensure the API layer scales horizontally to handle concurrent requests for dbt job runs and Trino async queries.

What are the limitations of using a centralized API layer for Kafka topic management and Trino queries?▼

A limitation of using a centralized API layer for Kafka topic management and Trino queries is that all platform teams must route through the governed FastAPI service. This introduces network latency and requires robust audit logging and API versioning to maintain backward compatibility.

Related Skills

Explore More Software Engineering Skills→
MybonoMybono
100

authentication-patterns

Implement OAuth2 with PKCE, JWT handling, and RBAC authentication patterns.

Community
Advanced
zero-rehqzero-rehq

api-documentation-generator

Generate OpenAPI specs from TypeScript Express, Next.js, and Fastify source code.

Community
Intermediate
ivanshamaevivanshamaev
14

trino-airflow-orchestration

Orchestrate idempotent Trino SQL pipelines in Apache Airflow with TrinoOperator.

Community
Advanced
letta-ailetta-ai
134

nginx-configuration

Configure Nginx logging, rate limiting, and custom error pages.

Official
Advanced