smoke-tests

Name: smoke-tests
Availability: InStock
Author: METR

Execute automated smoke tests against deployed environments using pytest.

25|11|Updated Feb 6, 2025

Search Tags:#aws #pytest #kubernetes #environment check #smoke test #deployment verification

Ready to run

npx skills add https://github.com/METR/inspect-action --skill smoke-tests

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: smoke-tests
Source: https://github.com/METR/inspect-action/tree/main/.claude/skills/smoke-tests
Command: npx skills add https://github.com/METR/inspect-action --skill smoke-tests

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill is used to ensure that deployed environments are functioning correctly after updates or deployments, catching critical issues before they impact users.

Core Features & Use Cases

Environment Verification: Runs a suite of automated tests against a deployed environment to confirm its stability and functionality.
Debugging Smoke Test Failures: Provides tools and guidance for diagnosing why smoke tests might be failing.
Use Case: After deploying a new version of the Hawk infrastructure to staging, run the smoke tests to confirm that all core services are operational and accessible.

Quick Start

Run the smoke tests against the development environment by sourcing the appropriate environment file and executing the pytest command.

Frequently Asked Questions about smoke-tests

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I verify environment stability after a Kubernetes deployment?▼

To verify environment stability after a deployment, you can run automated smoke tests against the deployed environment to confirm that all core services are operational and accessible.

What do I need to run pytest smoke tests against my deployed environments?▼

Running pytest smoke tests requires sourcing specific environment variables and configuring AWS credentials for authentication to API endpoints and warehouse databases.

Why does my smoke test fail after deploying to staging?▼

Smoke test failures after staging deployments often indicate critical service disruptions; this Skill provides tools and guidance specifically for diagnosing why your smoke tests might be failing.

When should I run automated smoke tests in my deployment workflow?▼

You should run automated smoke tests immediately after updates or deployments to catch critical environment functionality issues before they impact end users.

What is the best way to check if deployed AWS infrastructure is functioning correctly?▼

The best way to check deployed AWS infrastructure is to execute automated smoke tests that authenticate via AWS credentials to verify API endpoints and warehouse database connectivity.