politics_economy_monitor

Use requests to fetch each source page and BeautifulSoup to parse anchor tags, filtering links by text length to isolate headlines. The script iterates over a configured list of sources and returns structured results with source name, title, URL, and summary.

Fetch the page HTML with requests, parse it with BeautifulSoup, then select anchor elements whose text exceeds a length threshold to capture likely headlines. The script takes the first five matching links per source as top headlines.

It covers eight sources: JOTA, Nexo Jornal, NYT World, and BBC News Mundo for politics, plus Brazil Journal, Valor Econômico, Bloomberg, and Financial Times for economics. Sources are defined in a list and can be edited.

Scraping fails when sites require JavaScript rendering, block bots, or change their HTML structure. The script catches request exceptions per source and records the error in the output instead of crashing the whole run.

Yes, the script exposes a run() function designed for standalone execution or cron invocation. It prints the collected news list and is prepared to post results to a business MCP database when available.