Write or update BigQuery SQL and Python ETL scripts following Mozilla conventions.
npx skills add https://github.com/mozilla/bigquery-etl-skills --skill query-writer
Please help me install this Agent Skill. Skill: query-writer Source: https://github.com/mozilla/bigquery-etl-skills/tree/main/query-writer Command: npx skills add https://github.com/mozilla/bigquery-etl-skills --skill query-writer
Writing and maintaining BigQuery SQL queries or Python ETL scripts that adhere to specific formatting, conventions, and testing requirements is a meticulous task. This skill automates the creation, updating, and validation of these queries, ensuring consistency and reducing manual effort.
query.sql or query.py files following Mozilla's BigQuery ETL conventions, including proper formatting, partitioning, and UDF usage.sql-test-generator) whenever queries are modified, preventing regressions and ensuring data integrity.metadata-manager to update schema.yaml and metadata.yaml files when query outputs change, maintaining consistent data definitions.query.sql file, which then automatically triggers the creation of schema.yaml, metadata.yaml, and unit tests, all adhering to project standards.Write a BigQuery SQL query to aggregate daily user activity from telemetry.events into my-project.my-dataset.daily_activity_v1.
Ensure it uses @submission_date for incremental processing.
High-intent search queries and answers about installing and using this skill.
BigQuery SQL queries should follow Mozilla's ETL conventions including proper formatting, partitioning, UDF usage, and incremental processing with @submission_date. This skill automates query generation, validation, and formatting to ensure compliance with project standards.
Yes, this skill automatically checks for and updates unit tests whenever queries are modified, coordinating with test generation tools to prevent regressions and maintain data integrity.
When query outputs change, this skill integrates with metadata-manager to automatically update schema.yaml and metadata.yaml files, keeping data definitions consistent across your pipeline.
Create SQL or Python ETL scripts using this skill, which enforces incremental processing patterns and @submission_date partitioning for daily aggregations, with automatic schema and test generation.
Yes, this skill writes and updates both query.sql files and query.py Python ETL scripts, applying the same formatting conventions, validation, and test coordination to both file types.
Updating tests when queries change prevents regressions and ensures data integrity. This skill mandates test updates alongside query modifications, coordinating through sql-test-generator to keep tests synchronized.
mozillaGather BigQuery data model requirements and validate dependencies for bqetl queries.
weirdgmeDesign and implement scalable platform engineering patterns for internal developer platforms.
mozillaGenerate BigQuery SQL unit test fixtures with YAML inputs and outputs.
lubusINCreate Frappe reports using Report Builder, SQL, and Python scripts.