data-engineer

Turn raw Supabase application events into query-optimized analytics with materialized views.

1|Updated Mar 13, 2026
One-click install
npx skills add https://github.com/coreymaypray/sloth-skill-tree --skill data-engineer-coreymaypray
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: data-engineer
Source: https://github.com/coreymaypray/sloth-skill-tree/tree/main/plugins/maycrest-automate/skills/data-engineer
Command: npx skills add https://github.com/coreymaypray/sloth-skill-tree --skill data-engineer-coreymaypray

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Turn raw application events in Supabase into reliable, query-optimized analytics — without reaching for a separate data warehouse when Postgres can handle it.

Core Features & Use Cases

  • Design analytical schemas that separate operational and analytical data for scalable analytics.
  • Build materialized views, partitioned event-tracking tables, and idempotent ETL pipelines to ensure reliable, refreshable analytics.
  • Provide governance with audit logs, GDPR-compliant data retention, and performance profiling using EXPLAIN ANALYZE.

Quick Start

Configure a Supabase/Postgres analytics pipeline to create materialized views, incremental transforms, and run scheduled refreshes on new events.

Frequently Asked Questions about data-engineer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build analytics pipelines in Postgres without a separate data warehouse?

Analytics pipelines in Postgres use materialized views and partitioned event-tracking tables to separate operational data from query-optimized analytical data. This approach creates reliable, refreshable ETL pipelines directly within your existing database without external warehouse overhead.

What are materialized views and when do I need them for Supabase analytics?

Materialized views in Supabase cache complex query results for faster analytics reads. You need them when raw application events require query-optimized transformations, scheduled refreshes, and incremental processing to maintain performance as data volume grows.

How do I design an analytical schema in Supabase for scalable analytics?

Designing an analytical schema in Supabase involves separating operational and analytical data using partitioned event-tracking tables and materialized views. This structure supports idempotent ETL pipelines and scheduled refreshes to ensure reliable analytics at scale.

Can I handle GDPR-compliant data retention and audit logging in Postgres analytics pipelines?

GDPR-compliant data retention and audit logging are handled directly in Postgres analytics pipelines. The pipeline applies governance requirements including audit logs, data retention policies, and scheduled refreshes to maintain compliance across analytical tasks.

Does Supabase support idempotent ETL pipelines and incremental transforms for event tracking?

Supabase supports idempotent ETL pipelines and incremental transforms through Postgres materialized views and scheduled refreshes. This configuration processes new application events reliably without duplicating data during pipeline re-runs.

What's the best way to profile Postgres analytics query performance for materialized views?

Profiling Postgres analytics query performance uses EXPLAIN ANALYZE on materialized views and incremental transforms. This identifies bottlenecks in partitioned event-tracking tables and optimizes scheduled refreshes for reliable analytical query execution.