What problem does it solve?
This Skill eliminates common failures in Java HTTP scraping workflows, including 403/429 bot blocks, proxy rotation issues, virtual thread performance degradation, and inconsistent request behavior between browser and Java replay, which cause scrapers to be unreliable and hard to maintain.
Core Features & Use Cases
- Resilient Proxy Fallback: Implements weighted proxy selection, circuit breakers, and success-rate-based dynamic ordering to rotate through proxy types and avoid blocked requests.
- Browser-Like Request Profiling: Uses .asChrome() and browser TLS profiles to match real browser behavior, bypassing bot detection systems like Akamai and DataDome.
- Production-Grade Error Handling: Leverages Vavr Try for composable error recovery, request deduplication to reduce redundant load, and hard timeout enforcement to prevent hanging requests.
- Use Case: For example, when building a Java scraper for retail product data that blocks standard requests, this Skill guides you to implement the full stack of proxy, header, and error handling patterns needed for reliable, long-running data collection.
Quick Start
Use the pear-proxy skill to implement a resilient Jurl-based HTTP client with proxy fallback and browser-like request headers for your Java scraping workflow.