<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	>

<channel>
	<title>web crawler - AI News</title>
	<atom:link href="https://ainews.it/tag/web-crawler/feed/" rel="self" type="application/rss+xml" />
	<link>https://ainews.it/tag/web-crawler/</link>
	<description>AI News: Notizie sull&#039;intelligenza artificiale</description>
	<lastBuildDate>Mon, 28 Sep 2026 15:40:54 +0000</lastBuildDate>
	<language>it-IT</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	<generator>https://wordpress.org/?v=7.1.3</generator>

<image>
	<url>https://ainews.it/wp-content/uploads/2022/07/cropped-Favicon_Ai_2-011-150x150.png</url>
	<title>web crawler - AI News</title>
	<link>https://ainews.it/tag/web-crawler/</link>
	<width>32</width>
	<height>32</height>
</image> 
	<item>
		<title>Cloudflare contro i bot AI: Anthropic &#8220;free rider&#8221; numero uno del web</title>
		<link>https://ainews.it/cloudflare-contro-i-bot-ai-anthropic-free-rider-numero-uno-del-web/</link>
		
		<dc:creator><![CDATA[Redazione]]></dc:creator>
		<pubDate>Mon, 13 Jul 2026 07:18:45 +0000</pubDate>
				<category><![CDATA[Editoria & Media]]></category>
		<category><![CDATA[Etica]]></category>
		<category><![CDATA[anthropic]]></category>
		<category><![CDATA[privacy]]></category>
		<category><![CDATA[web crawler]]></category>
		<guid isPermaLink="false">https://ainews.it/cloudflare-contro-i-bot-ai-anthropic-free-rider-numero-uno-del-web/</guid>

					<description><![CDATA[<div><img width="600" height="400" src="https://ainews.it/wp-content/uploads/2026/07/publish_e70dfe01e51f4dee9200b92453ddcd5d-600x400.jpg" class="attachment-medium size-medium wp-post-image" alt="" style="margin-bottom: 15px;" decoding="async" fetchpriority="high" srcset="https://ainews.it/wp-content/uploads/2026/07/publish_e70dfe01e51f4dee9200b92453ddcd5d-600x400.jpg 600w, https://ainews.it/wp-content/uploads/2026/07/publish_e70dfe01e51f4dee9200b92453ddcd5d-1024x683.jpg 1024w, https://ainews.it/wp-content/uploads/2026/07/publish_e70dfe01e51f4dee9200b92453ddcd5d-300x200.jpg 300w, https://ainews.it/wp-content/uploads/2026/07/publish_e70dfe01e51f4dee9200b92453ddcd5d-768x512.jpg 768w, https://ainews.it/wp-content/uploads/2026/07/publish_e70dfe01e51f4dee9200b92453ddcd5d.jpg 1440w" sizes="(max-width: 600px) 100vw, 600px" /></div>
<p>I dati di Cloudflare mostrano che Anthropic ha un rapporto crawl-to-refer di 2.800 a 1: per ogni pagina linkata agli utenti, i suoi bot ne scansionano quasi tremila. Cloudflare ha risposto con una nuova politica che dal 15 settembre 2026 bloccherà per default i crawler AI su tutti i siti con pubblicità.</p>
<p>L'articolo <a href="https://ainews.it/cloudflare-contro-i-bot-ai-anthropic-free-rider-numero-uno-del-web/">Cloudflare contro i bot AI: Anthropic &#8220;free rider&#8221; numero uno del web</a> proviene da <a href="https://ainews.it">AI News</a>.</p>
]]></description>
		
		
		
			</item>
		<item>
		<title>Il New York Times non cederà i suoi dati gratis alle AI</title>
		<link>https://ainews.it/il-new-york-times-non-cedera-i-suoi-dati-gratis-alle-ai/</link>
		
		<dc:creator><![CDATA[Edoardo Frasso]]></dc:creator>
		<pubDate>Thu, 17 Aug 2023 10:37:21 +0000</pubDate>
				<category><![CDATA[Editoria & Media]]></category>
		<category><![CDATA[dati]]></category>
		<category><![CDATA[editoria e media]]></category>
		<category><![CDATA[google]]></category>
		<category><![CDATA[new york times]]></category>
		<category><![CDATA[web crawler]]></category>
		<guid isPermaLink="false">https://ainews.it/?p=3611</guid>

					<description><![CDATA[<div><img width="600" height="281" src="https://ainews.it/wp-content/uploads/2023/08/new-york-times-stop-data-600x281.jpg" class="attachment-medium size-medium wp-post-image" alt="New York skyscrapers with stop sign on the left side, USA." style="margin-bottom: 15px;" decoding="async" srcset="https://ainews.it/wp-content/uploads/2023/08/new-york-times-stop-data-600x281.jpg 600w, https://ainews.it/wp-content/uploads/2023/08/new-york-times-stop-data-300x140.jpg 300w, https://ainews.it/wp-content/uploads/2023/08/new-york-times-stop-data-768x359.jpg 768w, https://ainews.it/wp-content/uploads/2023/08/new-york-times-stop-data.jpg 900w" sizes="(max-width: 600px) 100vw, 600px" /></div>
<p>Il New York Times ha deciso di impedire che i suoi dati e contenuti vengano utilizzati gratuitamente per addestrare modelli di AI.</p>
<p>L'articolo <a href="https://ainews.it/il-new-york-times-non-cedera-i-suoi-dati-gratis-alle-ai/">Il New York Times non cederà i suoi dati gratis alle AI</a> proviene da <a href="https://ainews.it">AI News</a>.</p>
]]></description>
		
		
		
			</item>
	</channel>
</rss>
