Site icon MSN Technology

Devs say AI crawlers dominate traffic, forcing blocks on entire countries

flood header 1152x648

flood header

Aaron explained to the ARS, “Whenever one of them draws from my target, it has the resources he has eaten and will have to pay severe cash.” “It effectively increases their costs. And seeing that none of them have made a profit yet, this is a big problem for them.”

On Friday, Cloud Flair Announced “AI maze,” a similar but more commercially polished approach. Unlike Napints, designed as an aggressive weapon against AI companies, Cloud Flair positions his device as a legitimate safety feature to protect the website owners from unauthorized scraping, as we have reported.

Cloud Flair explained in his announcement, “When we find out unauthorized crawl instead of blocking the application, we will be linked to a series of AI -infield pages that are enough to persuade a crawler to pass through them.” The company reports that AI crawlers produce more than 50 billion applications daily to their network, in which they hold about 1 % of all web traffic.

This community is also developing co -operation tools to help prevent these crawls. “ai.robots.txt“The project offers an open list of web crawlers affiliated with AI companies and provides the premium robots dot TST files that implement robots delete protocols, as well as .htaccess files that return the error pages when detecting AI crawler requests.

As it is currently standing, both have a rapid growth of AI-generated material Vigorous Online spaces and AI firms are at risk of stabilizing online resources essential through aggressive web creeping ways. The current approach is taken by some major AI companies.Expel Extensive data of open source projects without clear consent or compensation causes severe damage to the digital ecosystem on which these AI models depend.

If AI firms cooperate directly with the affected communities, it may be able to collect responsible data. However, prominent industry players have given little incentive to adopt more cooperative methods. Without a meaningful code or self -sufficiency by AI firms, the arms race is likely to increase between data from data to defense of hungry boats and open source infrastructure, which deepens the crisis for the digital ecosystem that reduces the modern Internet.

Source link

Exit mobile version