henan-price

Collect, extract, transform, and synchronize Henan construction material prices to Elasticsearch.

Updated May 22, 2026

Search Tags:#data collection #data synchronization #construction #ETL processing #material prices

Ready to run

npx skills add https://github.com/pengfit/cjt-skills --skill henan-price

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: henan-price
Source: https://github.com/pengfit/cjt-skills/tree/main/henan-price
Command: npx skills add https://github.com/pengfit/cjt-skills --skill henan-price

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, beautifulsoup4, pyyaml, elasticsearch, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill automates the collection and synchronization of Henan construction material prices, streamlining the process of data acquisition and integration.

Core Features & Use Cases

Automated Data Collection: Extracts material prices from specified websites and stores them in a structured format.
ETL Processing: Cleans and transforms raw data into a usable format for analysis and visualization.
Data Synchronization: Synchronizes processed data with Elasticsearch for real-time access and analysis.
Use Case: This Skill can be integrated into a broader data pipeline for constructing material price indices or used independently for real-time price tracking.

Quick Start

Run the skill with the command: ./run.sh sync

Frequently Asked Questions about henan-price

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate construction material price collection from Henan government websites?▼

You can automate Henan construction material price collection by running the provided scripts that use Python requests and beautifulsoup4 to extract data from government websites and structure it for synchronization.

How does ETL processing work for construction material price data?▼

ETL processing for construction material price data works by extracting raw prices from source websites, transforming and cleaning the data into a structured format, and then loading it directly into Elasticsearch for real-time access and analysis.

Do I need Elasticsearch to synchronize Henan construction material prices?▼

Yes, Elasticsearch is required to synchronize Henan construction material prices. The Skill depends on the elasticsearch Python library to load and sync the processed ETL data into your Elasticsearch cluster for real-time access.

Can I use Python 3 to scrape and sync construction material prices?▼

Yes, you can use Python 3 to scrape and sync construction material prices. The Skill requires Python 3 along with requests, beautifulsoup4, pyyaml, and elasticsearch libraries to perform the complete data collection and synchronization lifecycle.

What is the best way to track Henan construction material prices in real-time?▼

The best way to track Henan construction material prices in real-time is automating the ETL pipeline to synchronize processed data directly into Elasticsearch, enabling immediate query access and continuous material price index updates.

What are the limitations of using beautifulsoup4 for government website data collection?▼

Beautifulsoup4 handles HTML parsing for data collection but is limited to static page structures. If the target government website relies heavily on dynamic JavaScript rendering, additional tools beyond this Skill's dependencies would be required for extraction.