An open source project called Scrapling is gaining traction with AI agent users who want their bots to scrape sites without permission.
The development hasn’t been straightforward. Early versions of the algorithm struggled with shadows and confused driftwood for plastic bottles. We spent months refining the system through trial and ...