Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 4 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://delosnetwork.it/robots.txt
301 MovedPermanently
https://delosnetwork.it/robots.txt
301 MovedPermanently
http://www.delosnetwork.it/robots.txt
301 MovedPermanently
https://www.delosnetwork.it/robots.txt
200 OK
Показать содержимое robots.txt
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"
"http://www.w3.org/TR/html4/loose.dtd">
<html lang="it">
<head>
<meta http-equiv="content-type" content="text/html; charset=iso-8859-1">
<title>∂| Delos Network | la rivista degli appassionati</title>
<style type="text/css">
body { background: #eee; margin: 0px; }
div#delosnetwork { background: black; text-align: left; padding-right: 10px; font: normal 10px "Verdana",sans-serif; color: white; }
div#service { float: right; }
div#service a { color: #ccc; text-decoration: none; } div#service a:hover { color: white; text-decoration: underline; }
table.main { width: 100%; border: none; border-bottom: 1px solid black; }
table.main th.fantascienza { width: 20%; background: url(img/fantascienza.gif); }
table.main th.fantasy { width: 20%; background: url(img/fantasy.gif); }
table.main th.giallo { width: 20%; background: url(img/giallo.gif); }
table.main th.horror { width: 20%; background: url(img/horror.gif); }
table.main th.thriller { width: 20%; background: url(img/thriller.gif); }
table.main td { width: 20%; padding: 0px; border-right: 1px solid #ccc; vertical-align: top; }
/* LEFT BOX */
div.APleftbox { font: normal normal 9pt "Verdana",sans-serif; color: #333; margin: 0px; padding: 0px; width: 100%; }
div.APleftbox h1 { font: normal bold 12px "Arial","Verdana",sans-serif; color: #334; border-left: 8px solid #334; padding: 0px; padding-left: 6px; margin-left: 4px; margin-top: 0px; }
div.APleftbox h1 a { color: #334; text-decoration: underline; }
div.APleftbox h1 a:hover { color: #900; text-decoration: underline; }
div.APleftbox ul { list-style-type: none; margin-left: 0px; padding: 0px; margin-top: 2px; margin-bottom: 0px; }
div.APleftbox li { padding: 2px 5px; border-bottom: 1px solid #ccc; height: 48px; poadding-top: 2px; }
div.APleftbox a { text-decoration: none; color: #333; }
div.APleftbox a:hover { text-decoration: underline; color: #C00; }
div#long-banner { background: #333; padding: 5px; text-align: center; }
div#long-banner iframe.long { border: none; width: 728px; height: 90px; }
p.copy { font: normal normal 10px "Verdana",sans-serif; color: #666; text-align: center;}
.network-news { font: normal 10pt "Lucida Grande","Lucida Sans","Trebuchet MS",sans-serif; }
.network-news ul { list-style: none; display: block; margin: 0; padding: 0; }
.network-news li { list-style: none; display: block; margin: 0; padding: 0; border-bottom: 1px solid #ccc; border-top: 1px solid white; overflow: hidden; }
.network-news li a { color: #666; text-decoration: none; display: block; padding: 10px; height: 50px; }
.network-news li a:hover { color: black; background-color: white; }
.network-news li a .network-news-canale { font-weight: bold; color: #999; }
.network-news-sf li a .network-news-canale { color: #c00; }
.network-news-fm li a .network-news-canale { color: #366; }
.network-news-sm li a .network-news-canale { color: #990; }
.network-news-hm li a .network-news-canale { color: #000; }
.network-news-tm li a .network-news-canale { color: #009; }
</style>
<!-- DFP Code -->
<script type='text/javascript' src='http://partner.googleadservices.com/gampad/google_service.js'>
</script>
<script type='text/javascript'>
GS_googleAddAdSenseService("ca-pub-7143888739702705");
GS_googleEnableAllServices();
</script>
<script type='text/javascript'>
GA_googleAddSlot("ca-pub-7143888739702705", "EXP_Fantascienza");
GA_googleAddSlot("ca-pub-7143888739702705", "LB_Fantascienza");
GA_googleAddSlot("ca-pub-7143888739702705", "MPU_Fantascienza");
</script>
<script type='text/javascript'>
GA_googleFetchAds();
</script>
<!-- End DFP Code -->
</head>
<body>
<div id="delosnetwork"><div id="service"><a href="http://www.delosnetwork.it/colophon.php">colophon</a> | <a href="http://www.delosbooks.it/">editore</a> | <a href="http://www.delosstore.it/">delos store</a></div><a href="http://www.delosnetwork.it/"><img src="img/delosnetwork.jpg" alt="Delos Network" width="504" height="68" border="0"></a></div>
<div id="long-banner"><script type='text/javascript'>GA_googleFillSlot("LB_Fantascienza");</script></div>
<table cellspacing="0" class="main">
<tr>
<th class="fantascienza"><a href="http://www.fantascienza.com"><img src="img/x.gif" alt="Fantascienza" width="160" height="50" border="0"></a></th>
<th class="fantasy"><a href="http://www.fantasymagazine.it"><img src="img/x.gif" alt="Fantasy" width="160" height="50" border="0"></a></th>
<th class="giallo"><a href="http://www.sherlockmagazine.it"><img src="img/x.gif" alt="Giallo" width="160" height="50" border="0"></a></th>
<th class="horror"><a href="http://www.horrormagazine.it"><img src="img/x.gif" alt="Horror" width="160" height="50" border="0"></a></th>
<th class="thriller"><a href="http://www.thrillermagazine.it"><img src="img/x.gif" alt="Thriller" width="160" height="50" border="0"></a></th>
</tr>
<tr>
<td>
</td>
<td>
</td>
<td>
</td>
<td>
</td>
<td>
</td>
</tr>
<tr><th class="fantascienza"><img src="img/x.gif" alt="-" width="1" height="3" border="0"></th>
<th class="fantasy"><img src="img/x.gif" alt="-" width="1" height="3" border="0"></th>
<th class="giallo"><img src="img/x.gif" alt="-" width="1" height="3" border="0"></th>
<th class="horror"><img src="img/x.gif" alt="-" width="1" height="3" border="0"></th>
<th class="thriller"><img src="img/x.gif" alt="-" width="1" height="3" border="0"></th>
</tr></table>
<div style="text-align: center; margin-top: 5px;">
<script type="text/javascript"><!--
google_ad_client = "pub-1854881235076513";
google_ad_width = 728;
google_ad_height = 90;
google_ad_format = "728x90_as";
google_ad_type = "text_image";
google_ad_channel ="1044045453";
google_color_border = "000000";
google_color_bg = "F0F0F0";
google_color_link = "0000FF";
google_color_text = "000000";
google_color_url = "008000";
//--></script>
<script type="text/javascript"
src="http://pagead2.googlesyndication.com/pagead/show_ads.js">
</script>
</div>
<p class="copy">Copyright ©2005 Associazione Culturale Delos Books - Partita Iva 04029050962 - Direttore responsabile: Franco Forte - Testata giornalistica reg. Tribunale di Milano, n. 253 del 4 aprile 2005</p>
<!-- MATOMO -->
<script>
var _paq = window._paq = window._paq || [];
_paq.push(['trackPageView']); _paq.push(['enableLinkTracking']);
(function() { var u="//analytics.delosnetwork.it/"; _paq.push(['setTrackerUrl', u+'matomo.php']);
_paq.push(['setSiteId', '13']);
var d=document, g=d.createElement('script'), s=d.getElementsByTagName('script')[0]; g.async=true; g.src=u+'matomo.js'; s.parentNode.insertBefore(g,s); })();
</script>
<!-- /MATOMO -->
<script language="javascript" src="http://www.delosnetwork.it/banner/footer/footerbanner.js"></script>
</body>
</html>
nginx