watchers

A watermark-based deduplication system polls RSS and GitHub on a schedule, tracking seen items to emit only new entries. This prevents duplicate notifications by maintaining state across polling runs.

RSS/Atom feeds, GitHub issues, pulls, releases, commits, and generic JSON endpoints can all be polled. The script fetches these sources on a schedule and outputs new items as Markdown.

Configure a cron job to execute the watcher scripts at your desired interval. Scripts poll sources, apply watermark-based deduplication, and output Markdown formatted for cron delivery to channels.

Yes, the script supports configurable max items per tick to control how many new entries are emitted during each scheduled run. This limits the volume of items processed per polling cycle.

Watermark-based state tracks seen items across runs. When polling RSS or JSON endpoints, the watermark identifies new items, emits only those entries, and updates the state to prevent future duplicates.

Yes, the script renders deduplicated results in Markdown format suitable for cron delivery to channels. This enables newly polled items from RSS, GitHub, or JSON endpoints to be sent directly to communication platforms.