Tagged "web-scraping"

3 articles tagged web-scraping, 25 February 2026 to 7 June 2026. Newest first.

• SourceHut Disrupted by LLM Training Crawlers: Infrastructure and Data Concerns 7 June 2026

  SourceHut experienced significant service disruptions caused by aggressive LLM training crawlers, raising critical questions about sustainability and ethics of model training data collection.

• Rust Open-Source Headless Browser for AI Agents and Web Scraping 25 April 2026

  A new Rust-based headless browser tool designed specifically for AI agents and web scraping tasks, enabling more efficient local inference workflows for agent-based applications.

• Show HN: Pluckr – LLM-Powered HTML Scraper That Caches Selectors and Auto-Heals 25 February 2026

  An LLM-driven web scraper that uses local models to intelligently extract data from HTML, caching CSS selectors and automatically adapting to page structure changes without constant retraining.