agent-testing-bot

Automate end-to-end verification of AI agents across native desktop messaging platforms.

82.1k|15.8k|Updated May 21, 2023

Search Tags:#messaging #E2E #Testing #Automation #BoT #MacOS

One-click install

npx skills add https://github.com/lobehub/lobehub --skill agent-testing-bot

Or copy as Structured Prompt for Agent▼

Please help me install this Agent Skill.
Skill: agent-testing-bot
Source: https://github.com/lobehub/lobehub/tree/main/.agents/skills/agent-testing-bot
Command: npx skills add https://github.com/lobehub/lobehub --skill agent-testing-bot

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill addresses the difficulty of verifying AI agent behavior in real-world, closed-source messaging environments where traditional automated testing frameworks cannot reach.

Core Features & Use Cases

Native App Automation: Drives real macOS applications (Discord, Slack, Telegram, WeChat, Lark, QQ, iMessage) using osascript and system-level bridge integration.
Visual Verification: Captures OS-level screenshots of bot responses to validate UI-based agent interactions.
Use Case: Automatically verify that a customer support agent correctly handles a specific query in a live Discord channel by sending a message, waiting for the response, and capturing the visual output for audit.

Quick Start

Use the agent-testing-bot to verify the Discord agent by sending the message '!ping' to the 'bot-testing' channel.

Frequently Asked Questions about agent-testing-bot

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I test an AI agent in a native messaging app?▼

Use the agent-testing-bot to automate message injection and screenshot capture within native macOS apps. The skill uses osascript to navigate channels, send messages, and verify responses visually.

Does this skill support headless testing in the cloud?▼

No, this skill is macOS-only and requires a GUI session. It relies on native app automation and OS-level screen capture, which cannot run in headless cloud environments.

Why are my captured screenshots appearing black?▼

Black screenshots occur when macOS Screen Recording permissions are missing or the display is locked. Ensure the target app is active, permissions are granted, and the display is kept awake using caffeinate.

Can I use this for iMessage testing?▼

Yes, iMessage testing is supported via a BlueBubbles bridge integration. It allows for testing the outbound and inbound message flow through the Electron main process and local HTTP server.