skills.rest
edwifiguy
edwifiguyCOMMUNITY
Explore all skills by this author →
GitHub

idempotent-script-design

Implement idempotent patterns like upserts and atomic writes in scripts.

1|Updated Apr 11, 2026
Search Tags:#automation#idempotent#reliability#scripts#cron#data-pipelines
One-click install
npx skills add https://github.com/edwifiguy/era-agents-ops --skill idempotent-script-design
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: idempotent-script-design
Source: https://github.com/edwifiguy/era-agents-ops/tree/main/skills/era-agents-op/metaclaw/memory_data/skills/idempotent-script-design
Command: npx skills add https://github.com/edwifiguy/era-agents-ops --skill idempotent-script-design

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Idempotent Script Design ensures automated tasks can be run multiple times without changing outcome or duplicating data.

Core Features & Use Cases

  • Upsert and deduplicate operations
  • Atomic writes and temporary staging
  • Completion markers and checkpoints
  • Safe cron jobs and data pipelines
  • Re-runs after failures without side effects

Quick Start

Implement an idempotent pattern in your next script by checking for a marker before performing work.

Frequently Asked Questions about idempotent-script-design

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I make cron jobs safe to re-run after a failure?▼

Make cron jobs safe to re-run by implementing idempotent patterns like upserts and completion markers, which guarantee that executing the script multiple times produces no duplicate side effects or data.

What is the best way to prevent duplicate data in automated scripts?▼

Prevent duplicate data in automated scripts by applying idempotent design patterns, such as atomic writes and deduplication operations, ensuring repeated executions yield identical outcomes without altering the final state.

How do completion markers work in data pipelines?▼

Completion markers in data pipelines work by creating checkpoints that signal successful task execution, allowing the system to skip previously finished work and safely resume operations without duplicating side effects.

Does idempotent script design work for both local and cloud environments?▼

Yes, idempotent script design works across cloud or local environments, applying atomic writes and temporary staging techniques to ensure safe re-runs for any repeatable workflows or automated data pipelines.

When should I use upserts and atomic writes in automation workflows?▼

Use upserts and atomic writes in automation workflows when you need to safely re-run failed scripts, update existing records without duplicating data, and guarantee reliable execution across repeatable data pipelines.

Related Skills

Explore More Software Engineering Skills→
understudylabsunderstudylabs
10

capture-evidence

Generate harness, metric, splits, and baseline artifacts from workloads.

Official
Advanced
adamkingsburyadamkingsbury

write-script-snowflake

Create and execute parameterized Snowflake SQL scripts for data pipelines.

Community
Intermediate
p-o-ke-naep-o-ke-nae

airflow-dag-patterns

Build production Apache Airflow DAGs with reusable operator, sensor, and branching patterns.

Community
Advanced
machenjiemachenjie
4

concurrency-control

Design conflict-safe mutation plans for shared resources with deterministic locking.

Community
Advanced