Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 10358 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Показать содержимое robots.txt
<html>
<head>
<meta http-equiv="Content-Type"
content="text/html; charset=iso-8859-1">
<meta name="description"
content="Funny real pictures from around the globe as well as other funny tidbits.">
<meta name="keywords"
content="funny, jokes, humor, hilarious, images, headlines, newspapers, signs, classifieds, ads, advertisements, funny pictures, funny pics, real">
<meta name="GENERATOR" content="Microsoft FrontPage 5.0">
<title>HeadlineHumor.com - Oops, this page doesn't exist!</title>
</head>
<body bgcolor="#000000" text="#FFFFFF">
<script language="javascript"><!--
var doc=document; var url=escape(doc.location.href); var date_ob=new Date();
doc.cookie='h2=o; path=/;';var bust=date_ob.getSeconds();
if(doc.cookie.indexOf('e=llo') <= 0 && doc.cookie.indexOf('2=o') > 0){
doc.write('<scr'+'ipt language="javascript" src="http://media.fastclick.net');
doc.write('/w/pop.cgi?sid=2257&m=2&v=1.7&u='+url+'&c='+bust+'"></scr'+'ipt>');
doc.cookie='he=llo; path=/;';} // -->
</script><style><!--
A.nav {font-weight:bold;color:yellow;text-decoration:none;font-size:18}
A.nav:hover {color: silver}
--></style><style><!--
A.copyright {font-weight:bold;color:yellow;text-decoration:none;font-size:10}
A.copyright:hover {color: silver}
--></style><style><!--
A.main {font-weight:bold;color:blue;text-decoration:none}
A.main:hover {color: red;text-decoration:underline}
--></style><div align="center"><center>
<table border="0" cellpadding="0" cellspacing="0" width="700">
<tr>
<td align="center"><p align="center"><a
href="http://www.headlinehumor.com"><img
src="logos/logo_large_bubble.gif" border="0" width="561"
height="56"></a></p>
</td>
</tr>
<tr>
<td><p align="center"><a
href="http://headlinehumor.com/headlines1.htm"
class="nav">Funny Headlines </a>- <a
href="http://www.headlinehumor.com/classifieds1.htm"
class="nav">Funny Classifieds </a>- <a
href="http://www.headlinehumor.com/signs.htm" class="nav">Funny
Signs</a> - <a
href="http://www.headlinehumor.com/captions" class="nav">Caption
Contest</a><br>
<a href="http://www.headlinehumor.com/dailycomics.htm"
class="nav">Daily Comics</a> - <a
href="http://www.headlinehumor.com/dailyjokes.htm"
class="nav">Daily Jokes</a> - <a
href="mailto:webmaster@headlinehumor.com" class="nav">Contact</a><br>
<br>
<!-- Conversant Media 468x60 and 728x90 Banner CODE for Headline Humor -->
<script type="text/javascript">var vclk_options = {sid:2257,media_id:1,media_type:5,version:"1.4"};</script><script class="vclk_pub_code" type="text/javascript" src="http://cdn.fastclick.net/js/adcodes/pubcode.min.js?sid=2257&media_id=1&media_type=5&version=1.4&exc=1"></script><noscript>
<a href="http://media.fastclick.net/w/click.here?sid=2257&m=1&c=1" target="_blank"><img src="http://media.fastclick.net/w/get.media?sid=2257&m=1&tp=5&d=s&c=1&vcm_acv=1.4" width="728" height="90" border="1"></a></noscript>
<!-- Conversant Media 468x60 and 728x90 Banner CODE for Headline Humor --> </p>
<div align="center"><center><table border="0"
cellpadding="0" cellspacing="0" width="675">
<tr>
<td> </td>
<td valign="top" bgcolor="#D4D4D4"><img
src="images/tl.gif" width="21" height="21"></td>
<td align="right" valign="top" bgcolor="#D4D4D4"><img
src="images/tr.gif" width="21" height="21"></td>
<td> </td>
</tr>
<tr>
<td width="25" bgcolor="#000000"> </td>
<td align="center" colspan="2" width="625"
bgcolor="#D4D4D4"><p align="center"><font
color="#000000"><br>
</font><font color="#000000" size="5"
face="Arial"><strong>Page Not Found!</strong></font></p>
<div align="center"><center><table border="0"
cellpadding="0" cellspacing="0" width="600">
<tr>
<td align="center" valign="top"
colspan="2" width="600"><p align="center"><font
color="#000000" size="4">Oops.... The
page you are looking for has either moved
or no longer exists.</font></p>
<p align="center"><a
href="http://www.headlinehumor.com"
class="main"><font size="5">Go to the
Headline Humor Main Page</font></a></p>
<p align="center"><font size="5"><!-- Conversant Media 300x250 Medium Rectangle CODE for Headline Humor -->
<script type="text/javascript">var vclk_options = {sid:2257,media_id:6,media_type:8,version:"1.4"};</script><script class="vclk_pub_code" type="text/javascript" src="http://cdn.fastclick.net/js/adcodes/pubcode.min.js?sid=2257&media_id=6&media_type=8&version=1.4&exc=1"></script><noscript>
<a href="http://media.fastclick.net/w/click.here?sid=2257&m=6&c=1" target="_blank"><img src="http://media.fastclick.net/w/get.media?sid=2257&m=6&tp=8&d=s&c=1&vcm_acv=1.4" width="300" height="250" border="1"></a></noscript>
<!-- Conversant Media 300x250 Medium Rectangle CODE for Headline Humor -->
<br>
</font></p>
<div align="center"><center><table
border="1" cellpadding="0"
cellspacing="0" width="450"
bgcolor="#FFFFFF" bordercolor="#000000">
<tr>
<td valign="top" width="225"
bgcolor="#FFFFFF"><p
align="center"><font
color="#000000" face="Verdana"><strong>Hey!
Join Our Mailing List:<br>
</strong></font><font
color="#000000"><strong><!--webbot
bot="HTMLMarkup" startspan --><form method=post action="http://members.notifylist.com/edit/joinlist" target="_blank">
<input type=hidden name="list_name" value="eyetricks-headhumor">
<input type=text name="email" value="your email address">
<input type=submit value=" Join Now! ">
</FORM><!--webbot
bot="HTMLMarkup" endspan i-checksum="11538" --></strong></font></p>
</td>
<td valign="top" width="225"><div
align="center"><center><table
border="0" cellpadding="0"
cellspacing="0" width="225">
<tr>
<td colspan="2"><p
align="center"><font
color="#000000"
face="Verdana"><strong>Special
Offers:<br>
<br>
</strong></font></p>
</td>
</tr>
<tr>
<td colspan="2"><img
src="blackbullet.gif"
width="10" height="10"> <!--#include virtual="/cgi-bin/banner4/banner.cgi" --><br>
<img
src="blackbullet.gif"
width="10" height="10"> <!--#include virtual="/cgi-bin/banner5/banner.cgi" --><br>
<img
src="blackbullet.gif"
width="10" height="10"> <!--#include virtual="/cgi-bin/banner6/banner.cgi" --></td>
</tr>
</table>
</center></div></td>
</tr>
</table>
</center></div></td>
</tr>
</table>
</center></div><p align="center"><font
color="#000000"><br>
</font></p>
</td>
<td width="25" bgcolor="#000000"> </td>
</tr>
<tr>
<td> </td>
<td valign="bottom" bgcolor="#D4D4D4"><img
src="images/bl.gif" width="21" height="21"></td>
<td align="right" valign="bottom"
bgcolor="#D4D4D4"><img src="images/br.gif"
width="21" height="21"></td>
<td> </td>
</tr>
</table>
</center></div><p align="center"><br>
<table width="728" height="90" border="0"><tr><td align="center"><iframe src="http://rcm-na.amazon-adsystem.com/e/cm?o=1&p=26&l=ur1&category=amazonhomepage&f=ifr&linkID=24c7f45a69a9a1bbd21bc10ab85ee243&t=creditcardadviso&tracking_id=creditcardadviso" width="468" height="60" scrolling="no" border="0" marginwidth="0" style="border:none;" frameborder="0"></iframe></td><tr></table><br>
<br>
</p>
</td>
</tr>
<tr>
<td><p align="center"><font size="1">Site Created and
Maintained by </font><a
href="http://www.ecardtricks.com/bwh.htm"
class="copyright"><font size="1">BWH Ventures, LLC</font></a><font
size="2"><br>
</font><font size="1">Please Email us with </font><a
href="mailto:webmaster@headlinehumor.com"
class="copyright"><font size="2">questions </font></a><font
size="1">or</font><font size="2"> </font><a
href="mailto:webmaster@headlinehumor.com"
class="copyright"><font size="2">comments</font></a></p>
</td>
</tr>
</table>
</center></div>
</body>
</html>
Apache