Implement an LSM-tree storage engine in Go with WAL, MemTable, and SSTables.
npx skills add https://github.com/gtrig/LaightDB --skill lsm-storage-engine
Please help me install this Agent Skill. Skill: lsm-storage-engine Source: https://github.com/gtrig/LaightDB/tree/main/.cursor/skills/lsm-storage-engine Command: npx skills add https://github.com/gtrig/LaightDB --skill lsm-storage-engine
This Skill provides a complete LSM-tree storage engine implementation in Go for crash-safe writes, fast lookups, and pluggable persistence that can be used to build or modify internal/storage components like WAL, MemTable, and SSTables.
Begin by examining the WAL, MemTable, SSTable, and engine components and implement or modify them following the outlined Implementation Order.
High-intent search queries and answers about installing and using this skill.
To build an LSM-tree storage engine in Go, implement WAL append/replay with CRC, an in-memory MemTable with tombstones, SSTables with bloom filters, and a background compaction orchestrator for crash recovery and scalable persistence.
Crash recovery in an LSM storage engine works by replaying the append-only WAL to reconstruct the in-memory MemTable, ensuring crash-safe writes are restored and persisted data is not lost during unexpected failures.
Implement SSTable bloom filters to enable fast lookups by reducing unnecessary disk reads, and use a background compaction orchestrator to merge immutable SSTables, controlling read amplification across varying dataset sizes.
Yes, this LSM storage engine implementation supports fast reads and scalable persistence across varying dataset sizes by utilizing in-memory MemTables, immutable on-disk SSTables with binary search indexes, and size-based flushing.
The best way to manage deletes in a Go LSM-tree is using MemTable tombstones to mark deletions, which are then persisted to immutable SSTables and physically removed during the background compaction process.
No, you do not need external dependencies to implement this production-grade storage engine in Go, as the Skill provides complete WAL, MemTable, SSTable, and compaction components without requiring any external libraries.
GanyuanRanCreate, amend, supersede, or evaluate architecture decision records with baseline-sync constraints.
wrcopilot-orgPlan and execute disk partition operations with EaseUS Partition Master on Windows.
matejformanekImplement and debug PostgreSQL asynchronous I/O and read-stream subsystems.
hung-phanAnalyze database indexing strategies for B-tree, LSM-tree, hash, and bitmap structures.
