Crawl SJTU university announcements and store structured data in SQLite.
npx skills add https://github.com/xhh678876/openclaw-sjtu --skill sjtu-crawler
Please help me install this Agent Skill. Skill: sjtu-crawler Source: https://github.com/xhh678876/openclaw-sjtu/tree/main/skills/sjtu-crawler Command: npx skills add https://github.com/xhh678876/openclaw-sjtu --skill sjtu-crawler
This Skill solves the challenge of manually collecting and understanding scattered Shanghai Jiao Tong University announcements across many campus websites by turning them into structured knowledge.
Ask the AI to crawl SJTU announcements and create a structured local knowledge base from the collected notices.
High-intent search queries and answers about installing and using this skill.
To build a searchable knowledge base from university announcements, you can crawl multiple campus portals, extract the HTML content, and store it in SQLite. This process structures fragmented notices into a local database ready for retrieval.
AI distillation for announcement extraction converts raw notice content into structured fields like category, audience, deadline, required actions, summaries, and tags. This transforms unstructured text into searchable data for knowledge base construction.
You can connect crawled web announcements to a RAG pipeline by storing the distilled, structured data in SQLite. The structured fields serve as context for retrieval-augmented generation workflows to query campus information.
Yes, this announcement crawler supports configurable site sources. It applies to SJTU academic portals, administrative notices, graduate school, libraries, and IT services to collect notices across various departments.
The best way to extract deadlines and required actions from academic notices is using AI-based content distillation. It automatically identifies and structures critical dates and necessary steps from raw HTML into dedicated fields.
Yes, you can trigger reminder workflows from structured campus announcements. By extracting deadlines and required actions into structured fields, the stored data can integrate with external reminder systems.
pinakdhabuFetch and generate university question papers with proper formatting.
yonatangrossImplement RAG patterns with hybrid search, reranking, and PGVector integration.
malue-aiStore and search personal knowledge snippets in a SQLite FTS5 database.
winsorllcFetch and parse web content from specified URLs.
