LangWatch avatar

LangWatch

Official

@langwatch

0Followers
|
43Public Repos
|
41Published Skills

Offers structured engineering oversight through issue-driven implementation, architectural critique, and end-to-end browser validation for complex software repositories.

Skills Distribution
DomainDeveloper To...Software Quality A.. (40%)Engineering Lifecy.. (30%)Architectural Gove.. (30%)

Agent Skills by LangWatch

Showing 41 vetted skills indexed across 1 GitHub repositories.

langwatchlangwatch
3.5k

langwatch

Read LLM traces and coding-agent sessions from LangWatch using the langwatch CLI.

Official
Basic
langwatchlangwatch
3.5k

feature-map

Maintains the canonical LangWatch feature map JSON registry across APIs, MCP tools, CLI commands, and skills.

Official
Intermediate
langwatchlangwatch
3.5k

code-review

Reviews code diffs against LangWatch codebase rules for IDs, multitenancy, layering, and naming.

Official
Intermediate
langwatchlangwatch
3.5k

langwatch-kanban

Manage the LangWatch GitHub project board by syncing statuses, moving issues, and assigning work.

Official
Intermediate
langwatchlangwatch
3.5k

browser-pair

Drives a headed Playwright Chromium session for interactive UI feedback and live code verification.

Official
Intermediate
langwatchlangwatch
3.5k

tracing

Instrument Python and TypeScript codebases with LangWatch tracing and observability.

Official
Intermediate
langwatchlangwatch
3.5k

provider-cost-comparison

Reprice real LangWatch token usage against other model providers including cache costs.

Official
Advanced
langwatchlangwatch
3.5k

evaluations

Routes LangWatch evaluation requests to the experiments or online-evaluations skill.

Official
Basic
langwatchlangwatch
3.5k

test-cli-usability

Write scenario tests verifying CLI tools work non-interactively for AI agents.

Official
Intermediate
langwatchlangwatch
3.5k

debug-with-langwatch

Diagnose production LLM agent failures by inspecting LangWatch traces, spans, and monitor scores.

Official
Intermediate
langwatchlangwatch
3.5k

agent-improve

Turns production traces into tested agent improvements via hypotheses, scenario tests, and reviewable PRs.

Official
Advanced
langwatchlangwatch
3.5k

drive-the-ui

Executes live UI actions on the user's open LangWatch page via CLI commands.

Official
Intermediate
langwatchlangwatch
3.5k

experiments

Creates and runs LangWatch batch experiments to test agents against datasets with evaluators.

Official
Advanced
langwatchlangwatch
3.5k

test-compliance

Creates scenario and red team tests verifying agents stay observational in regulated domains.

Official
Intermediate
langwatchlangwatch
3.5k

prompt-optimization

Improves prompts on the LangWatch evaluations workbench through a measured baseline-to-candidate loop.

Official
Advanced
langwatchlangwatch
3.5k

datasets

Generate realistic synthetic evaluation datasets and upload them to LangWatch.

Official
Advanced
langwatchlangwatch
3.5k

online-evaluations

Configure LangWatch online evaluations and guardrails for production LLM traffic.

Official
Intermediate
langwatchlangwatch
3.5k

generate-rag-dataset

Generate synthetic Q&A evaluation datasets from a RAG knowledge base for LangWatch experiments.

Official
Intermediate
langwatchlangwatch
3.5k

level-up

Integrates LangWatch tracing, prompt versioning, evaluations, and simulation tests into an AI agent.

Official
Advanced
langwatchlangwatch
3.5k

agent-performance

Diagnose production AI agent behavior from LangWatch analytics and traces into an HTML report.

Official
Advanced
langwatchlangwatch
3.5k

evaluate-multimodal

Evaluate multimodal AI agents processing images, audio, and PDFs with LangWatch.

Official
Intermediate
langwatchlangwatch
3.5k

github

Clone repositories, commit changes, and open pull requests on GitHub via the gh CLI.

Official
Intermediate
langwatchlangwatch
3.5k

agent-best-practices

Audits agent codebases and LangWatch traces, scenarios, and evaluators against engineering best practices.

Official
Advanced
langwatchlangwatch
3.5k

lwql-charts

Creates saved LangWatchQL analytics charts with Vega-Lite specs and places them on dashboards.

Official
Intermediate

Frequently Asked Questions About LangWatch

FAQPage Schema
What specific engineering tasks does LangWatch enable?

LangWatch enables structured issue-driven development, automated end-to-end browser validation, and multi-perspective code review synthesis. It facilitates architectural risk assessment and ensures test specifications align with standard pyramid quality metrics through systematic audit and planning phases.

Which technical personas benefit most from these capabilities?

Software engineers, quality assurance leads, and technical architects benefit from these capabilities. It is designed for teams managing complex repositories who require rigorous oversight, consistent feature file generation, and high-fidelity validation of browser-based interfaces.

What are the prerequisites for implementing these capabilities?

Implementation requires a GitHub-based repository structure and existing support for Playwright-compatible environments. Users must define acceptance criteria within feature files to enable the planning, coding, and review loops effectively.