Collect, extract, transform, and synchronize Henan construction material prices to Elasticsearch.
npx skills add https://github.com/pengfit/cjt-skills --skill henan-price
Please help me install this Agent Skill. Skill: henan-price Source: https://github.com/pengfit/cjt-skills/tree/main/henan-price Command: npx skills add https://github.com/pengfit/cjt-skills --skill henan-price
This Skill automates the collection and synchronization of Henan construction material prices, streamlining the process of data acquisition and integration.
Run the skill with the command: ./run.sh sync
High-intent search queries and answers about installing and using this skill.
You can automate Henan construction material price collection by running the provided scripts that use Python requests and beautifulsoup4 to extract data from government websites and structure it for synchronization.
ETL processing for construction material price data works by extracting raw prices from source websites, transforming and cleaning the data into a structured format, and then loading it directly into Elasticsearch for real-time access and analysis.
Yes, Elasticsearch is required to synchronize Henan construction material prices. The Skill depends on the elasticsearch Python library to load and sync the processed ETL data into your Elasticsearch cluster for real-time access.
Yes, you can use Python 3 to scrape and sync construction material prices. The Skill requires Python 3 along with requests, beautifulsoup4, pyyaml, and elasticsearch libraries to perform the complete data collection and synchronization lifecycle.
The best way to track Henan construction material prices in real-time is automating the ETL pipeline to synchronize processed data directly into Elasticsearch, enabling immediate query access and continuous material price index updates.
Beautifulsoup4 handles HTML parsing for data collection but is limited to static page structures. If the target government website relies heavily on dynamic JavaScript rendering, additional tools beyond this Skill's dependencies would be required for extraction.
pengfitExtract engineering cost material data from the Chongqing government website and synchronize it to Elasticsearch.
pengfitExtract and synchronize Jiangxi construction material prices to Elasticsearch.
pengfitCollect Hunan engineering material prices and synchronize them to Elasticsearch.
pengfitCollect and synchronize Sichuan construction material prices to Elasticsearch.
