hunan-price

Collect Hunan engineering material prices and synchronize them to Elasticsearch.

Updated May 22, 2026

Search Tags:#data collection #Elasticsearch #government data #ETL processing #material price

Ready to run

npx skills add https://github.com/pengfit/cjt-skills --skill hunan-price

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: hunan-price
Source: https://github.com/pengfit/cjt-skills/tree/main/hunan-price
Command: npx skills add https://github.com/pengfit/cjt-skills --skill hunan-price

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, beautifulsoup4, pyyaml, elasticsearch, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the collection and synchronization of Hunan engineering material price data, streamlining the process of gathering and updating price information.

Core Features & Use Cases

Automated Data Collection: Automatically collects price data from the Hunan government's website.
ETL Processing: Performs ETL (Extract, Transform, Load) processing to clean and structure the data.
Data Synchronization: Synchronizes the processed data with an Elasticsearch index for easy access and analysis.
Use Case: This Skill can be integrated into a larger data processing pipeline for analyzing material price trends and making informed business decisions.

Quick Start

Use the hunan-price skill to sync the latest material price data from the Hunan government's website.

Frequently Asked Questions about hunan-price

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate Hunan engineering material price data collection from government websites?▼

Automate Hunan engineering material price data collection by running a script that scrapes the government website, performs ETL processing to clean and structure the data, and synchronizes the results directly into an Elasticsearch index for analysis.

What is the best way to sync web-scraped material price data into Elasticsearch?▼

Sync web-scraped material price data into Elasticsearch by applying ETL processing to extract and transform the raw prices, then loading the structured data directly into an Elasticsearch index for easy access and trend analysis.

Do I need Python and BeautifulSoup to scrape government material price data?▼

Yes, you need Python with BeautifulSoup4 for web scraping, requests for fetching pages, pyyaml for configuration, and the elasticsearch library to load the processed material price data into your Elasticsearch index.

Can I integrate engineering material price data collection into a larger ETL pipeline?▼

Yes, you can integrate this material price data collection into a larger ETL pipeline to automate the extraction, transformation, and loading of Hunan engineering prices into Elasticsearch for analyzing price trends and supporting business decisions.

How does ETL processing work for scraped engineering material price data?▼

ETL processing for scraped material price data works by extracting raw price information from the Hunan government website, transforming it into a structured format, and loading the cleaned data into an Elasticsearch index for synchronization and analysis.

What are the limitations of using automated scripts for government material price data collection?▼

Limitations include dependency on the structure of the Hunan government website, meaning changes to the site layout can break the web scraping scripts, and the need for a properly configured Elasticsearch environment to store the synchronized material price data.