screenpipe-search

Query local Screenpipe OCR, audio, and UI event data with time filters.

20.9k|2.1k|Updated Jun 19, 2024
One-click install
npx skills add https://github.com/screenpipe/screenpipe --skill screenpipe-search
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: screenpipe-search
Source: https://github.com/screenpipe/screenpipe/tree/main/apps/screenpipe-app-tauri/src-tauri/assets/skills/screenpipe-search
Command: npx skills add https://github.com/screenpipe/screenpipe --skill screenpipe-search

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill enables fast retrieval of information from locally stored screen text (OCR), audio transcriptions, and UI events by querying the Screenpipe dataset, reducing the time spent manually reviewing footage.

Core Features & Use Cases

  • Unified local search: query OCR, audio, and UI event data across time ranges.
  • Contextful recall: reconstruct meetings, app usage, and on-screen activity from historical data.
  • Use Case: For example, ask "What did I open after launching Slack yesterday?" and get precise results from the local store.

Quick Start

Use the screenpipe-search skill to query the local Screenpipe API for a specific term, such as 'project kickoff'.

Frequently Asked Questions about screenpipe-search

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I search my local screen history and audio transcriptions?

To search local screen history and audio transcriptions, query the Screenpipe dataset to retrieve OCR text, audio transcriptions, and UI events. You must specify a start_time parameter and can filter by app_name, content_type, or window_name.

What's the best way to recall on-screen app usage from yesterday?

The best way to recall on-screen app usage is to search historical UI events and OCR data via the local Screenpipe API. Query parameters like start_time, end_time, and app_name reconstruct past activity without manually reviewing footage.

Do I need the local Screenpipe API running to query OCR and UI events?

Yes, you need the local Screenpipe API running at http://localhost:3030 to query OCR and UI events. The Skill searches the local Screenpipe dataset directly and requires this endpoint to be available to return results.

Can I filter local screen and audio searches by specific application?

You can filter local screen and audio searches by a specific application using the app_name parameter. The API also supports filtering by content_type, window_name, focused status, and time range to narrow down results.

Why does my screen history search require a start_time parameter?

Your screen history search requires a start_time parameter because the local Screenpipe API mandates it to define the temporal scope of the query. Without a start_time, the API cannot bound the search for OCR, audio, and UI event data.

How does querying local screen text and audio data work?

Querying local screen text and audio data works by sending a search request to the Screenpipe API, which matches your query term against indexed OCR text, audio transcriptions, and UI events to return relevant historical activity.