skills.rest
noemotiovon
noemotiovonCOMMUNITY
Explore all skills by this author →
GitHub

clean

Validate data.csv GitHub URLs and generate a cleaned CSV with metadata.

Updated Apr 7, 2026
Search Tags:#automation#etl#csv#data-quality#data-cleaning#url-validation#github-api
One-click install
npx skills add https://github.com/noemotiovon/oss-x --skill clean-noemotiovon
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: clean
Source: https://github.com/noemotiovon/oss-x/tree/main/.claude/skills/clean
Command: npx skills add https://github.com/noemotiovon/oss-x --skill clean-noemotiovon

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This tool validates all URLs in data.csv against the GitHub API, flags non-existent or non-GitHub links, and identifies potential mirrors or redirects to improve data quality.

Core Features & Use Cases

  • Validate GitHub repo and organization URLs and confirm existence
  • Flag invalid, non-GitHub, redirected, or archived/mirror entries for human review
  • Produce a cleaned output CSV with status, url_type, actual_url, and basic activity metrics like open_issues_count and total_pull_requests

Quick Start

Run the cleaning script on data.csv to validate each URL and emit a cleaned output file.

Frequently Asked Questions about clean

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate GitHub URLs in a CSV file to check if repositories exist?▼

Flag invalid data.csv URLs by running a validation script that performs GitHub API lookups to identify non-existent, redirected, or archived repositories, outputting a cleaned CSV with detailed status metadata.

How does URL validation handle redirected or archived GitHub links in data cleaning workflows?▼

URL validation identifies redirected or archived GitHub links by querying the GitHub API, classifying their status, and flagging them in the output CSV for human review alongside actual resolution URLs.

Can I resume a data cleaning task if the GitHub URL validation process is interrupted?▼

Yes, the data cleaning process implements caching for resumability, allowing you to resume GitHub URL validation tasks across repositories and organizations if the script is interrupted.

What GitHub activity metrics are included when validating CSV URLs against the GitHub API?▼

Validating CSV URLs against the GitHub API generates a cleaned output file that includes basic activity metrics such as open_issues_count and total_pull_requests alongside the URL status and type.

Does this data cleaning tool require external dependencies to validate GitHub organization URLs?▼

No external dependencies are required to validate GitHub organization URLs; the tool operates standalone to parse URLs, query the GitHub API, and produce a cleaned CSV with metadata.

Related Skills

Explore More Data & Analytics Skills→
noemotiovonnoemotiovon

classify

Classify data.csv entries into repo, organization, or unknown via URL parsing and GitHub API checks.

Community
Intermediate
gehtalexeygehtalexey

phantom-pre-filter

Filter PhantomBuster CSV exports by blacklist, duration, and title rules.

Community
Intermediate
underPressueunderPressue

senior-data-engineer

Orchestrate, validate, and optimize ETL/ELT data pipelines in Python.

Community
Intermediate
kraftvaerkkraftvaerk

umbraco-skill-validator

Validates SKILL.md files for broken links, missing references, and invalid paths.

Official
Intermediate