jsonl-store-pattern

Implement an append-only JSONL record store with multi-index retrieval.

3|Updated Mar 17, 2026
One-click install
npx skills add https://github.com/transreal/claudecode --skill jsonl-store-pattern
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: jsonl-store-pattern
Source: https://github.com/transreal/claudecode/tree/main/Claude%20Directives/skills/jsonl-store-pattern
Command: npx skills add https://github.com/transreal/claudecode --skill jsonl-store-pattern

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill provides a robust design template for persisting structured records as an append-only JSONL store while keeping efficient lookup via multiple indexes, including Windows-safe UTF-8 handling and reliable loading.

Core Features & Use Cases

  • Append-only JSONL records: Writes one JSON record per line for efficient tailing and streaming-style operations.
  • Multi-index storage (master + by-X): Duplicates each record into a master file plus axis-specific indexes (e.g., by-topic, by-source) to enable fast queries.
  • Windows CRLF + UTF-8 safe loading: Uses a ByteArray-to-string + line-splitting approach to avoid empty reads and parsing failures.
  • Safe append with OpenAppend: Includes directory creation, JSON-safe serialization, and structured error returns for failure diagnosis.
  • Pluggable debug/status checks: Verifies existence and counts to quickly detect issues such as the Windows read pitfall or JSON errors.
  • Use Case: Store claim/event records for retrieval by topic and reverse-lookup by source without introducing a database dependency.

Quick Start

Use the jsonl-store-pattern to append claim records into master.jsonl and query them by topic or source using the provided iLoadJSONL and iByXPath templates.

Frequently Asked Questions about jsonl-store-pattern

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I store JSONL records in Wolfram Language without a database?

You can store JSONL records in Wolfram Language without a database by using an append-only design that writes each record to a master file alongside axis-specific index files for fast retrieval.

Why does my JSONL file return empty reads on Windows in Wolfram Language?

Empty reads on Windows happen due to CRLF line-ending pitfalls when loading JSONL files. Using a ByteArray-based loading approach to convert bytes to strings before splitting lines prevents these parsing failures.

How do I create a multi-index append-only log for fast data retrieval?

To create a multi-index append-only log, write each record into a master JSONL file while duplicating it into by-X axis files based on sanitized index keys, enabling fast lookup by multiple dimensions.

Can I use OpenAppend for deterministic JSONL record storage in Wolfram Language?

Yes, using OpenAppend in Wolfram Language allows deterministic JSONL record storage by ensuring directory creation, UTF-8 safe JSON serialization, and structured error returns for failure diagnosis.

What is the best way to query event logs by topic without a database?

The best way to query event logs by topic without a database is to maintain pre-built axis-specific index files during append operations, allowing direct file reads filtered by sanitized index keys.

How do I serialize UTF-8 data safely for JSONL file storage in Wolfram Language?

Serialize UTF-8 data safely for JSONL storage by using JSON-safe serialization methods that sanitize index keys into safe filenames, ensuring reliable loading and preventing character encoding errors.