sichuan-price

Collect and synchronize Sichuan construction material prices to Elasticsearch.

Updated May 22, 2026

Search Tags:#ETL #data collection #Elasticsearch #construction material pricing #Sichuan

Ready to run

npx skills add https://github.com/pengfit/cjt-skills --skill sichuan-price

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: sichuan-price
Source: https://github.com/pengfit/cjt-skills/tree/main/sichuan-price
Command: npx skills add https://github.com/pengfit/cjt-skills --skill sichuan-price

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, beautifulsoup4, pyyaml, elasticsearch, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the collection and synchronization of Sichuan construction material price data, saving time and effort in data acquisition and processing.

Core Features & Use Cases

Automated Data Collection: Collects data from a specified source URL and categorizes it based on classification directories.
Data Synchronization: Synchronizes the collected data to Elasticsearch for further analysis and visualization.
Use Case: This Skill can be used to automatically collect and synchronize construction material price data for 21 districts in Sichuan province, ensuring that the latest data is always available for analysis and decision-making.

Quick Start

Use the sichuan-price skill to synchronize the latest data from the source URL.

Frequently Asked Questions about sichuan-price

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I automate web scraping for construction material pricing across Sichuan districts?▼

Automating construction material pricing web scraping for Sichuan involves using Python libraries like requests and beautifulsoup4 to extract data from source URLs, categorize it by classification directories, and prepare it for synchronization to Elasticsearch.

How does ETL data synchronization to Elasticsearch work for regional price data?▼

ETL data synchronization to Elasticsearch for regional price data works by extracting categorized construction material prices via web scraping, transforming the dataset, and loading it directly into Elasticsearch indices for analysis and visualization.

Can I use this construction material pricing ETL process for 21 districts in Sichuan province?▼

Yes, the construction material pricing ETL process is specifically designed to handle data collection and synchronization across all 21 districts in Sichuan province, ensuring comprehensive regional data aggregation and continuous availability for analysis.

Do I need Python libraries to run the Sichuan construction material price data collection?▼

Yes, you need specific Python libraries including requests, beautifulsoup4, pyyaml, and elasticsearch to execute the web scraping, data parsing, configuration management, and data synchronization steps required for Sichuan construction material price data collection.

What is the best way to aggregate regional construction material price data for analysis?▼

The best way to aggregate regional construction material price data for analysis is to automate the ETL pipeline, extracting categorized prices from specified sources and synchronizing them directly to Elasticsearch for centralized querying and visualization.

Are there limitations when using web scraping for construction material pricing data collection?▼

Limitations of using web scraping for construction material pricing data collection include dependency on the structure of the specified source URL, requiring updates to the extraction scripts if the source page layout changes, and the need for continuous synchronization to Elasticsearch to maintain current data.