skills.rest
alex-quan-001
alex-quan-001COMMUNITY
Explore all skills by this author →
GitHub

o11y-data-export

Automate TiDB Cloud observability data exports to S3 storage.

Updated Jun 3, 2026
Search Tags:#observability#s3#data export#slow query#o11y#monitoring pipeline#tidb cloud
One-click install
npx skills add https://github.com/alex-quan-001/nutshell-skills --skill o11y-data-export
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: o11y-data-export
Source: https://github.com/alex-quan-001/nutshell-skills/tree/main/skills/platform/o11y-data-export
Command: npx skills add https://github.com/alex-quan-001/nutshell-skills --skill o11y-data-export

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires jq, curl, aws-cli.

What problem does it solve?

Manually exporting TiDB Cloud cluster observability data (slow queries, raw logs, SQL statements) to S3 for analysis is time-consuming and error-prone, requiring manual handling of authentication, cluster metadata resolution, and pipeline lifecycle management.

Core Features & Use Cases

  • End-to-End Pipeline Management: Create, list, retrieve, wait for activation, and delete monitoring pipelines for slow query, raw log, and SQL statement exports.
  • Flexible Cluster Resolution: Automatically resolve cluster metadata, with a fallback strategy to infer missing deploy type via the Clinic API when only cluster ID and environment are provided.
  • Direct S3 Data Access: Retrieve exported data directly from the assigned S3 bucket using AWS credentials provisioned during authentication.
  • Use Case: If you need to export last quarter's slow queries from a production TiDB cluster to S3 for performance analysis, this skill automates the entire workflow from authentication to data retrieval.

Quick Start

Use the o11y-data-export skill to create a slow query export pipeline for your TiDB Cloud cluster and download the exported data from S3.

Frequently Asked Questions about o11y-data-export

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I export TiDB Cloud slow queries to S3 for analysis?▼

You can export TiDB Cloud slow queries to S3 by creating an automated monitoring pipeline that handles authentication, cluster metadata resolution, and pipeline lifecycle management. The skill retrieves exported observability data directly from your assigned S3 bucket.

What observability data can I export from TiDB Cloud to S3?▼

Observability data you can export from TiDB Cloud includes slow queries, raw logs, and SQL statements. The skill automates the export pipeline for these data types to support downstream analysis and long-term archival in S3.

Can I automate the monitoring pipeline lifecycle for TiDB Cloud exports?▼

Yes, you can automate the monitoring pipeline lifecycle for TiDB Cloud exports. The skill manages pipeline creation, listing, retrieval, activation waiting, and deletion operations using TiDB Cloud O11Y platform APIs.

Do I need AWS credentials to retrieve exported TiDB observability data?▼

Yes, you need AWS credentials to retrieve exported TiDB observability data. The skill provisions these credentials during authentication to access and download exported monitoring data directly from the assigned S3 bucket.

How does cluster metadata resolution work when exporting TiDB logs?▼

Cluster metadata resolution for exporting TiDB logs works by automatically resolving cluster details. When only cluster ID and environment are provided, it uses a fallback strategy to infer the missing deploy type via the Clinic API.

What tools are required to run the TiDB Cloud data export automation?▼

Tools required to run the TiDB Cloud data export automation include jq, curl, and the aws-cli. These dependencies support API requests, JSON parsing, and direct S3 data retrieval operations.

Related Skills

Explore More Data & Analytics Skills→
alex-quan-001alex-quan-001

o11y-auth

Unify TiDB Cloud O11Y authentication with cached bearer, Auth0, and AWS STS credentials.

Community
Intermediate
UnicornUnicorn

query-optimization-agent

Analyze SQL queries and produce rewritten SQL, index recommendations, and execution plan comparisons.

Official
Intermediate
david-2814david-2814
3

s3

Automate S3 bucket, object, lifecycle, and access-control management via AWS CLI.

Community
Intermediate
alex-quan-001alex-quan-001

o11y-data

Access TiDB Cloud observability data across metrics, logs, and profiles.

Community
Advanced