extract-moves-from-video

Extract validated command sequences from video recordings using OCR.

Updated Apr 14, 2026
One-click install
npx skills add https://github.com/bianhaifeng789-hue/openclaw-config --skill extract-moves-from-video-bianhaifeng789-hue
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: extract-moves-from-video
Source: https://github.com/bianhaifeng789-hue/openclaw-config/tree/main/skills/tb2/extract-moves-from-video
Command: npx skills add https://github.com/bianhaifeng789-hue/openclaw-config --skill extract-moves-from-video-bianhaifeng789-hue

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps recover typed commands and inputs that appear in screen recordings by extracting and cleaning text from video frames, saving time compared to manual transcription and improving accuracy over raw OCR.

Core Features & Use Cases

  • ROI Cropping & Frame Sampling: Identify and crop the command input region and sample frames at appropriate intervals to reduce noise and processing time.
  • OCR Preprocessing: Convert frames to grayscale, apply thresholding, and perform denoising, dilation/erosion, and contrast enhancement to maximize OCR accuracy.
  • Domain-Aware Validation & Deduplication: Validate OCR outputs against a game or terminal vocabulary, normalize and fuzzy-match near-duplicates, and remove partial or spurious entries.
  • Use Case: Recover a sequence of commands from a Zork or terminal session recording to reproduce or analyze gameplay sessions and user inputs.

Quick Start

Run the workflow to extract and clean all visible typed commands from the provided screen recording.

Frequently Asked Questions about extract-moves-from-video

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract typed commands from a video recording of a terminal session?

To extract typed commands from a video recording, you can perform ROI cropping, frame sampling, and OCR preprocessing on the screen recording to isolate and read the command input region. This process uses tools like FFmpeg and Tesseract to produce a validated sequence of recovered commands.

Can I use FFmpeg and Tesseract to recover text inputs from screen recordings?

Yes, you can use FFmpeg and Tesseract to recover text inputs from screen recordings. The workflow utilizes FFmpeg for frame extraction and Tesseract for OCR, applying domain-aware validation and deduplication to clean the extracted text.

What is the best way to transcribe commands from text-based game recordings like Zork?

The best way to transcribe commands from text-based game recordings is to apply ROI cropping to isolate the input region, sample frames, and perform OCR preprocessing. Domain-aware validation against game vocabulary then removes spurious entries to yield a clean command sequence.

How does OCR preprocessing improve command recovery from video frames?

OCR preprocessing improves command recovery by converting extracted video frames to grayscale, applying thresholding, and performing denoising, dilation, erosion, and contrast enhancement. These steps maximize OCR accuracy before domain-aware validation and deduplication finalize the command sequence.

How do I remove duplicate or spurious text entries when extracting commands from video?

To remove duplicate or spurious text entries when extracting commands from video, the process applies domain-aware validation against a terminal or game vocabulary. It then normalizes and fuzzy-matches near-duplicate OCR outputs to produce a deduplicated command sequence.

Does this command recovery method work for any video with visible typed inputs?

Yes, this command recovery method works for any video with visible typed inputs. It applies to screen recordings of text-based games, terminal sessions, and any video where typed inputs are visible, using ROI cropping and OCR to extract the text.