Extract and synchronize Jilin Province material price data to Elasticsearch.
npx skills add https://github.com/pengfit/cjt-skills --skill jilin-price
Please help me install this Agent Skill. Skill: jilin-price Source: https://github.com/pengfit/cjt-skills/tree/main/jilin-price Command: npx skills add https://github.com/pengfit/cjt-skills --skill jilin-price
This Skill automates the extraction and synchronization of material price data for Jilin Province, saving time and reducing errors in data processing.
Run the command './run.sh sync' to synchronize the latest material price data for Jilin Province.
High-intent search queries and answers about installing and using this skill.
Automate material price data extraction by using Python requests and BeautifulSoup4 to scrape source websites, then synchronize the extracted data directly to an Elasticsearch index for storage and analysis.
Filtering material price data by year and month is handled natively during the synchronization process, allowing you to target specific timeframes when extracting and syncing data to your Elasticsearch instance.
Yes, you need access to an Elasticsearch instance to store the synchronized data, along with a web scraping module to automate the extraction of material price data from the target source website.
Periodic updates and progress tracking are handled automatically during synchronization, maintaining a record of processed data to ensure material price data extraction resumes correctly without duplicating previous efforts.
Yes, BeautifulSoup4 extracts material price data specifically for government agencies or organizations involved in material price monitoring, automating the collection and analysis process to reduce manual data entry errors.
pengfitExtract and transform Huhehaote government website price data via ETL.
pengfitExtract and synchronize Jiangxi construction material prices to Elasticsearch.
pengfitCollects, processes, and synchronizes Rizhao City engineering material price data to Elasticsearch.
pengfitCollect Hunan engineering material prices and synchronize them to Elasticsearch.
