extract-moves-from-video

Extract typed command text from video recordings of terminal sessions.

127|27|Updated Mar 27, 2026
One-click install
npx skills add https://github.com/lazyFrogLOL/Harness_Engineering --skill extract-moves-from-video-lazyfroglol
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: extract-moves-from-video
Source: https://github.com/lazyFrogLOL/Harness_Engineering/tree/main/skills/extract-moves-from-video
Command: npx skills add https://github.com/lazyFrogLOL/Harness_Engineering --skill extract-moves-from-video-lazyfroglol

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill addresses the difficulty of recovering typed command inputs from video recordings of text‑based games, terminal sessions, or any screen capture where user text is visible, eliminating the need for manual transcription.

Core Features & Use Cases

  • ROI Cropping & Frame Extraction: Automatically isolate the command input area and extract frames at appropriate intervals to reduce processing load.
  • OCR Preprocessing & Domain Validation: Apply grayscale conversion, thresholding, and game‑specific vocabularies to improve OCR accuracy and filter out invalid text.
  • Deduplication & Cleaning: Normalize and de‑duplicate extracted commands using fuzzy matching and known command lists.
  • Use Case: A developer wants to recreate a Zork gameplay walkthrough by extracting every player command from a recorded session to feed into an automated testing suite.

Quick Start

Ask the skill to extract all commands from the video file 'zork_gameplay.mp4'.

Frequently Asked Questions about extract-moves-from-video

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract typed commands from a video recording of a text-based game?

To extract typed commands from a video recording, you need to apply frame extraction, ROI cropping, and OCR preprocessing to isolate and read the terminal text. This process uses domain-specific validation to filter invalid inputs and deduplicate overlapping frames.

What do I need to OCR text from terminal session videos?

To OCR text from terminal session videos, you need FFmpeg for frame capture and an OCR engine like Tesseract. Optional Python image libraries can be used for additional image preprocessing and command deduplication.

Can I use frame extraction to recover gameplay inputs without manual transcription?

Yes, frame extraction can recover gameplay inputs automatically by capturing video frames at intervals and applying OCR to the command input area. This eliminates manual transcription by using fuzzy matching to normalize extracted commands.

Does OCR preprocessing improve accuracy for command text in game video recordings?

OCR preprocessing improves accuracy for command text in game video recordings by applying grayscale conversion and thresholding. Combining these steps with game-specific vocabularies helps filter out invalid text and ensures reliable command extraction.

How do I handle duplicate commands when extracting text from screen capture videos?

To handle duplicate commands when extracting text from screen capture videos, apply normalization and de-duplication using fuzzy matching and known command lists. This cleaning process ensures the final output contains only unique, valid gameplay commands.