de-cost-optimization

Analyze data engineering cloud spend across query, compute, storage, and egress drivers.

14|1|Updated May 5, 2026
One-click install
npx skills add https://github.com/ivanshamaev/de-agent-skills --skill de-cost-optimization
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: de-cost-optimization
Source: https://github.com/ivanshamaev/de-agent-skills/tree/main/skills/de_cost_optimization
Command: npx skills add https://github.com/ivanshamaev/de-agent-skills --skill de-cost-optimization

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill solves runaway data engineering cloud spending by helping you pinpoint which queries, clusters, and storage decisions drive the highest cost—and then apply targeted reductions.

Core Features & Use Cases

  • Query and workload cost analysis for Trino/Presto, Spark, ClickHouse, and BigQuery using explain/planner signals and system query history.
  • Compute right-sizing and cluster efficiency through executor sizing, CPU utilization checks, autoscaling, and spot/preemptible strategy (with checkpointing considerations).
  • Storage and data layout optimization using partition pruning, file sizing/compaction, Z-order/clustering, materialized view economics, and lifecycle tiering.
  • FinOps cost governance with tagging, attribution, and budget alerts to produce a prioritized cost-reduction plan.

Quick Start

Ask the agent to analyze your last 7 days of Trino query history and then recommend the top 3 partitioning/clustering and compute right-sizing changes to reduce billed bytes and cluster runtime cost.

Frequently Asked Questions about de-cost-optimization

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I reduce my Trino cloud spend by analyzing query history?

Reduce Trino cloud spend by mining system query history to map billed bytes, shuffle spill indicators, and partition effectiveness, then applying targeted executor right-sizing and materialized view optimizations.

What are the best ways to optimize Spark cluster compute costs?

Optimize Spark cluster compute costs through executor right-sizing, CPU utilization checks, autoscaling, and spot or preemptible strategy planning with checkpointing considerations to reduce overall cluster runtime.

How can I use BigQuery EXPLAIN COST signals to lower data engineering costs?

Lower BigQuery data engineering costs by using EXPLAIN COST signals and system query history to identify high-billed queries, then applying partition pruning, clustering, and materialized view break-even logic.

Does this approach support ClickHouse workload cost analysis?

Yes, ClickHouse workload cost analysis is supported alongside Trino, Spark, and BigQuery, utilizing planner signals and system query history to pinpoint expensive queries and recommend compute right-sizing.

How do I implement storage lifecycle tiering to cut data engineering costs?

Implement storage lifecycle tiering by analyzing partition pruning, file sizing, compaction, and Z-order clustering effectiveness, then applying FinOps governance policies to transition data across storage tiers.

Can I set up FinOps budget alerts and cost attribution for my data workflows?

Yes, you can establish FinOps cost governance by implementing tagging, cost attribution, and budget alerts, which produces a prioritized cost-reduction plan for your data engineering workflows.