Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 3 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Показать содержимое robots.txt
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01//EN"
"http://www.w3.org/TR/html4/strict.dtd">
<html lang="en">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<title>Dave Barry</title>
<meta name="description" content="Dave Barry author of Insane City">
<meta name="keywords" content="Dave Barry, author, humorist, Miami Herald columnist, Pulitzer Prize, Insane City, Miami">
<!-- Main CSS-->
<link rel="stylesheet" href="style.css" type="text/css" media="screen" />
<!-- Google Font-->
<link href='http://fonts.googleapis.com/css?family=Strait' rel='stylesheet' type='text/css'>
<script src="SpryAssets/SpryMenuBar.js" type="text/javascript"></script>
<link href="SpryAssets/SpryMenuBarHorizontal.css" rel="stylesheet" type="text/css">
</head>
<body>
<div id="site">
<div id="wrap">
<!-- ============== -->
<!-- ! Header -->
<!-- ============== -->
<div id="header">
<a href="https://www.davebarry.com/">
<img border="0" src="https://www.davebarry.com/images-new/dave-barry_03.jpg" style="display: block;" alt="Dave Barry" width="989" height="162"></a>
</div>
<!-- ============== -->
<!-- ! Navigation -->
<!-- ============== -->
<div style="background-color:#EEE; min-height:33px; width:100%;">
<ul id="MenuBar1" class="MenuBarHorizontal">
<li><a href="https://www.davebarry.com">Home</a> </li>
<li><a href="https://www.davebarry.com/dave-barry.php">About Dave</a></li>
<li><a class="MenuBarItemSubmenu" href="#">Books</a>
<ul>
<li><a href="https://www.davebarry.com/books-by-type.php?type=Fiction">Fiction</a> </li>
<li><a href="https://www.davebarry.com/books-by-type.php?type=Nonfiction">Nonfiction</a></li>
<li><a href="https://www.davebarry.com/books-by-type.php?type=Young Adult">Young Adult</a></li>
<li><a href="https://www.davebarry.com/books-all.php">Complete List</a></li>
</ul>
</li>
<li><a href="#" class="MenuBarItemSubmenu">Columns</a>
<ul>
<li><a href="https://www.davebarry.com/columns-recent.php">Recent Columns</a></li>
<li><a href="https://www.davebarry.com/misccol/misccol.htm" target="_blank">Vintage Columns</a></li>
<li><a href="https://www.davebarry.com/columns-gift-guides.php">Annual Gift Guides</a></li>
<li><a href="https://www.davebarry.com/columns-year-in-review.php">Year in Review</a></li>
<li><a href="https://www.davebarry.com/columns-olympics.php">The Olympics</a></li>
<li><a href="https://www.davebarry.com/columns-conventions.php">Political Conventions</a></li>
</ul>
</li>
<li><a href="https://www.davebarry.com/news.php">News</a></li>
<li><a href="https://blogs.herald.com/dave_barrys_blog/" target="_blank">Blog</a></li>
<li><a href="https://www.davebarry.com/events-appearances.php">Appearances</a></li>
</ul>
</div>
<script type="text/javascript">
var MenuBar1 = new Spry.Widget.MenuBar("MenuBar1", {imgDown:"SpryAssets/SpryMenuBarDownHover.gif", imgRight:"SpryAssets/SpryMenuBarRightHover.gif"});
</script>
<!-- ============== -->
<!-- ! Content -->
<!-- ============== -->
<div id="main">
<h1>Oops...</h1>
<p>The page you are looking for no longer exists or has been renamed. Please select from the menu above.</p>
<p>Thanks!</p>
<br>
<h3> </h3>
<p><a href="http://www.miamiherald.com/283/story/1459826.html"><br>
</a></p>
</div>
<!-- ============== -->
<!-- ! Sidebar -->
<!-- ============== -->
<div align="center" id="sidebar"> <a href="book-page.php?isbn13=9781250191960"><img src="books/9781250191960.jpg" alt="A Field Guide to the Jewish People, by Dave Barry" style="margin-left: 12px; margin-top:12px; max-height: 300px; box-shadow: 0 5px 10px 0 rgba(0, 0, 0, 0.3);"></a>
<p class="center-text" style="margin-top:5px"><strong>Now available!</strong></p>
<p class="center-text" style="margin-top:5px">ORDER A COPY:<br>
<a href="https://www.amazon.com/Insane-City-Dave-Barry/dp/1501161156/" target="_blank"><img class="padding-img" border="0" src="images-new/amazon.png" width="80" alt="Amazon"></a><a href="https://www.barnesandnoble.com/w/insane-city-dave-barry/1112220358?ean=9781501161155" target="_blank"><img class="padding-img" border="0" src="images-new/bn.png" width="80" alt="Barnes & Noble"></a><a href="https://www.booksamillion.com/p/9781501161155" target="_blank"><img class="padding-img" border="0" src="images-new/bam.png" width="80" alt="Books-a-million"></a><a href="https://www.indiebound.org/book/9781501161155" target="_blank"><img class="padding-img" border="0" src="images-new/indiebound.png" width="80" alt="Indiebound"></a><a href="https://itunes.apple.com/us/book/isbn9781501161179" target="_blank"><img class="padding-img" border="0" src="images-new/ibooks.png" width="80" alt="iBooks"></a></p>
<p class="center-text" style="margin-top:5px"><strong><a href="events-appearances.php">Meet Dave on tour!</a></strong></p>
<p class="center-text">
<img src="https://www.davebarry.com/images-new/weinermo.png" alt="Follow Dave" width="118" height="64" border="0" style="margin-top:5px">
<br>
<a href="https://www.facebook.com/FunnyDaveBarry" target="_blank"><img class="padding-img" border="0" src="http://www.davebarry.com/images-new/facebook.png" width="32" height="32" alt="Facebook"></a><a href="https://twitter.com/rayadverb" target="_blank"><img class="padding-img" border="0" src="https://www.davebarry.com/images-new/twitter.png" width="32" height="32" alt="Twitter"></a></p>
<div align="center" style="width:200px; padding-left:25px;">
<!-- AddThis Button BEGIN -->
<div class="addthis_toolbox addthis_default_style addthis_32x32_style">
Share This Site:<br />
<a class="addthis_button_preferred_1"></a>
<a class="addthis_button_preferred_2"></a>
<a class="addthis_button_preferred_3"></a>
<a class="addthis_button_preferred_4"></a>
<a class="addthis_button_compact"></a>
</div>
<script type="text/javascript">var addthis_config = {"data_track_addressbar":false};</script>
<script type="text/javascript" src="//s7.addthis.com/js/300/addthis_widget.js#pubid=ra-4e8c76172d7f1ca6"></script>
<!-- AddThis Button END --></div><br />
<div align="center"><br />
<a href="https://example.us9.list-manage.com/subscribe?u=a8d81c398bbce7290bc76b573&id=3fb7f125bb" target="_blank">Sign up to get the DAVE BARRY newsletter</a>
</div><br />
<br />
<div id="postit"><H2>According to Dave:</H2>
<br>
"The problem with winter sports is that — follow me closely here — they generally take place in winter."
<br>
<br>
"Thus the metric system did not really catch on in the States, unless you count the increasing popularity of the nine-millimeter bullet."</div>
</div>
<!-- ============== -->
<!-- ! Footer -->
<!-- ============== -->
<div id="bottom">
</div>
<div align="center" id="footer">
<p><a href="index.php">Home</a> | <a href="dave-barry.php">Dave Barry</a> | <a href="books-all.php">Books</a> | <a href="columns-recent.php">Columns</a> | <a href="https://blogs.herald.com/dave_barrys_blog/" target="_blank">Blog</a><a href="/"></a> | <a href="news.php">News</a> | <a href="events-appearances.php">Appearances</a> </p>
<p> </p>
<p><a href="mailto:nolowflow@davebarry.com"><img src="https://www.davebarry.com/images/dave-barry-email.gif" alt="Email Dave Barry" width="230" height="17" border="0" /></a></p>
<p> </p>
<p>Copyright ©2000-2026 Dave Barry </p>
</div>
</div>
</div>
</body>
</html>
Apache