Reddit is suing firms SerApi, OxyLabs, AWMProxy and Perplexity for allegedly scraping its knowledge from search outcomes and utilizing it with no license, The New York Times reports. The brand new lawsuit follows legal action in opposition to AI startup Anthropic, who allegedly used Reddit content material to coach its Claude chatbot.
As of 2023, Reddit charges companies trying entry to posts and different content material within the hopes of getting cash on knowledge that might be used for AI coaching. The corporate has additionally signed licensing offers with firms like Google and OpenAI, and even constructed an AI answer machine of its own to leverage the data in customers’ posts. Scraping search outcomes for Reddit content material avoids these funds, which is why the corporate is in search of monetary damages and a everlasting injunction that stops firms from promoting beforehand scraped Reddit materials.
Among the firms Reddit is targeted on, like SerApi, OxyLabs and AWMProxy, are usually not precisely family names, however they’ve all made accumulating knowledge from search outcomes and promoting it a key a part of their enterprise. Perplexity’s inclusion within the lawsuit could be extra apparent. The AI firm wants knowledge to coach its fashions, and has already been caught seemingly copying and regurgitating materials it hasn’t paid to license. That additionally consists of reportedly ignoring the robots.txt protocol, a method for web sites to speak that they do not need their materials scraped.
Per a replica of the lawsuit offered to Engadget, Reddit had already despatched a cease-and-desist to Perplexity asking it to cease scraping posts with no license. The corporate claimed it did not use Reddit knowledge, but it surely additionally continued to quote the platform in solutions from its chatbot. Reddit says it was capable of show Perplexity was utilizing scraped Reddit content material by making a “take a look at put up” that “may solely be crawled by Google’s search engine and was not in any other case accessible anyplace on the web.” Inside a couple of hours, queries made to Perplexity’s reply engine have been capable of reproduce the content material of the put up.
“The one method that Perplexity may have obtained that Reddit content material after which used it in its ‘reply engine’ is that if it and/or its co-defendants scraped Google [search results] for that Reddit content material and Perplexity then rapidly integrated that knowledge into its reply engine,” the lawsuit claims.
When requested to remark, Perplexity offered the next assertion:
Perplexity has not but obtained the lawsuit, however we’ll at all times struggle vigorously for customers’ rights to freely and pretty entry public data. Our strategy stays principled and accountable as we offer factual solutions with correct AI, and we is not going to tolerate threats in opposition to openness and the general public curiosity.
This new lawsuit suits with the aggressive stance Reddit has taken in the direction of defending its knowledge, together with rate-limiting unknown bots and internet crawlers in 2024, and even limiting what entry the Web Archive’s Wayback Machine has to its web site in August 2025. The corporate has additionally sought to outline new phrases round how web sites are crawled by adopting the Really Simple Licensing standard, which provides licensing phrases to robots.txt.
