pipeline-architect-interviewer

What problem does it solve?

This Skill helps interviewers and practitioners quickly assess a candidate's ability to design scalable, observable data pipelines and to justify tool choices across ingestion, processing, storage, and serving layers.

Core Features & Use Cases

• End-to-end pipeline design coverage: ingestion, processing, storage, and serving layers, with trade-offs between batch and streaming.
• Tool-agnostic evaluation prompts: questions and problems that test instrument choices (e.g., Kafka vs Kinesis, Flink vs Spark) and architectural decision reasoning.
• Failure mode and remediation focus: scenarios for data schema evolution, late data, backpressure, and exactly-once semantics; plus mitigation strategies.
• Adaptable difficulty and problem bank integration: Phases and reference problems adjust to candidate skill level (mid, senior, staff+).
• Scorecard and feedback scaffolding: structured rubrics, sample evaluation outputs, and learning resources.

Quick Start

Provide an end-to-end data pipeline design for a real-time analytics scenario, including the data flow, tool choices, and recovery strategies.