skills.rest
jonmast
jonmastCOMMUNITY
Explore all skills by this author →
GitHub

screenpipe-api

Query screen activity, audio, and usage analytics via the Screenpipe REST API.

Updated Mar 24, 2016
Search Tags:#usage analytics#screen recording#audio analysis#UI element analysis#screen activity
One-click install
npx skills add https://github.com/jonmast/dotfiles --skill screenpipe-api-jonmast
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: screenpipe-api
Source: https://github.com/jonmast/dotfiles/tree/main/agents/skills/screenpipe-api
Command: npx skills add https://github.com/jonmast/dotfiles --skill screenpipe-api-jonmast

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides a comprehensive way to query and analyze a user's screen recordings, audio, UI elements, and usage analytics through the Screenpipe REST API, addressing the need for detailed insights into user activity and interactions.

Core Features & Use Cases

  • Screen Activity Search: Query the user's screen recordings and UI elements for specific keywords or app interactions.
  • Audio Analysis: Analyze and transcribe audio captured by the user, with options for retranscription and speaker identification.
  • Usage Analytics: Summarize user activity across different apps and windows, providing a comprehensive overview of user behavior.
  • Use Case: When the user asks about their productivity, meeting activities, or specific app usage over a certain period.

Quick Start

Use the screenpipe-api skill to search for screen activity from the last hour.

Frequently Asked Questions about screenpipe-api

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I search screen activity and UI elements for specific app interactions?▼

To search screen activity, you query the Screenpipe REST API using keywords or app interaction filters. This retrieves matching screen recordings and UI elements captured locally, providing detailed insights into user behavior.

How do I analyze audio recordings and identify speakers from my screen activity?▼

To analyze audio, you query the API for transcribed audio data captured by Screenpipe. It supports retranscription and speaker identification options to refine and clarify the transcribed audio analysis results.

Can I summarize user usage analytics across different apps and windows?▼

Yes, you can summarize usage analytics by querying the API for user activity over a specified period. It generates a comprehensive overview summarizing user behavior across different apps and windows.

Do I need a Screenpipe API key to retrieve UI elements and export media?▼

Yes, you need a Screenpipe API key for authentication. It is required to access the local REST API for UI element retrieval, media exports, and all screen activity query operations.

What are the limitations when querying local screen recordings over a long period?▼

Querying screen recordings over long periods depends on local Screenpipe data retention and storage capacity. It retrieves historical usage analytics, but query performance is constrained by local disk space and API limits.

Related Skills

Explore More Product & Management Skills→
screenpipescreenpipe
20.9k

screenpipe-search

Query local Screenpipe OCR, audio, and UI event data with time filters.

Official
Basic
olakai-aiolakai-ai

generate-analytics-reports

Generate terminal analytics reports from Olakai CLI data.

Official
Intermediate
adiytharpansaadiytharpansa

time-tracker

Track activities and generate productivity summaries and trends.

Community
Intermediate
syxscottsyxscott
1

screen_monitor

Capture screenshots at specified intervals and generate activity summaries.

Community
Intermediate