Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 7145 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://feedback.20fr.com/robots.txt
301 MovedPermanently
http://feedback.20fr.com/cgi-bin/feedback
200 OK
Показать содержимое robots.txt
<!--|13|1787356723|89.249.18.75|NONE|-->
<!-- content - Partner "default.partner" - File "feedback/main.htm" -->
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"><html><head>
<title>Feedback - 20fr.com</title>
<META http-equiv="X-UA-Compatible" content="IE=Edge">
<!-- env.cgi: feedback -->
<link rel="stylesheet" href="/cgi-bin/css/new_style.css?partner=20fr.com" type="text/css">
</head><body>
<div id="insidebanners">
<div id="shellouterdiv">
<DIV id="logocontainer"><a href="http://www.20fr.com"><img NAME=logo SRC=/cgi-bin/image/logo_small.gif?partner=20fr.com border=0></a></DIV>
<div id="shellinnerdiv">
<div class="areaborder">
<div id="maintable">
<div class=spot><table class="spottable"><tr valign=top><td>
<DIV ID="spotimage" class="spotimage">
<IMG src="/fs_img/cgi/feedback.gif"></DIV></td><TD width="100%">
<DIV class=spotheading>We want to hear what you have to say!</DIV>
Is there a way we can make our service even
better? Let us know and we'll see what we can do.
<BR><BR>
</td></tr></table></div>
<DIV class='section'>
<div class="sectionheading" style="">
Submit feedback:
</div>
<DIV class="sectiontextouter" >
<SPAN CLASS="sectiontext" >
<DIV class="sectiontextouter" ><SPAN CLASS="sectiontext" >Please choose the type of feedback you would
like to send.</SPAN></DIV>
<FORM METHOD="post">
<div class="tablewrapper" >
<table style="" CELLSPACING="0" CELLPADDING=4 class="normaltable">
<tr class="tablerow1" VALIGN=top>
<TD>
<A HREF="/cgi-bin/feedback?option=suggestions"><B>Suggestions</A>
</TD>
<TD>
Have a suggestion on how we can make 20fr.com
websites even better? Do you have a cool idea you
think we should implement? Have you found something
that we could improve on? Help us make
20fr.com websites the best web
community on the Internet!
</TD>
</TR>
<tr class="tablerow2" VALIGN=top>
<TD>
<A HREF="/cgi-bin/feedback?option=compliments"><B>Compliments</A>
</TD>
<TD>
Had a good experience on 20fr.com web
sites? Know a free 20fr.com web site success
story? Noticed a feature on 20fr.com web
sites that you like better than on other services?
We want to know how we're doing!
</TD>
</TR>
<tr class="tablerow1" VALIGN=top>
<TD>
<A HREF="/cgi-bin/feedback?option=complaints"><B>Complaints</A>
</TD>
<TD>
Had a bad experience on 20fr.com web sites?
Couldn't get something to work properly? Noticed
something that ought to be fixed immediately? It's
our goal to become the best free web space provider
on the Net, so this is your chance to help us know
what we're doing wrong so we can improve.
</TD>
</TR>
<tr class="tablerow2" VALIGN=top>
<TD>
<A HREF="/cgi-bin/feedback?option=wish_list"><B>Wish List</A>
</TD>
<TD>
Wishing for a utility or service on 20fr.com
web sites that we don't already offer? Tell us about
it and your wish just might come true...
</TD>
</TR>
<tr class="tablerow1" VALIGN=top>
<TD>
<A HREF="/cgi-bin/feedback?option=report_a_violation"><B>Report a Violation</A>
</TD>
<TD>
If you find a page on 20fr.com web sites that
appears to be in violation of our acceptable use
agreement, or if you received unsolicited e-mail
advertising a site on 20fr.com web sites,
please report it to our abuse team using this form.
</TD>
</TR>
</table>
</div>
</SPAN>
</DIV>
</DIV>
<div class="buttonbar">
<div class="buttonbarbutton">
<script type="text/javascript">if(history.length>1){document.writeln('<input class="wrapbutton" type="button" name="back" value="<< Back" onclick="history.go(-1);">');}</script>
</div>
</div>
</FORM>
</div>
</div>
<div class="footer footertext">
<A HREF="http://free.20m.com" TARGET="_blank" CLASS="footerlink">Free Web Hosting</A> | <A HREF="http://www.20fr.com" TARGET="_blank" CLASS="footerlink">Free Web Page</A> | <A HREF="http://www.real-cheap-domain-name-registration.com" TARGET="_blank" CLASS="footerlink">Cheap Domain Names</A> | <A HREF="http://www.00freehost.com" TARGET="_blank" CLASS="footerlink">Free Host</A> | <A HREF="http://www.20fr.com/about.htm" TARGET="_blank" CLASS="footerlink">About Free Web Pages</A> | <A HREF="http://feedback.20fr.com" TARGET="_blank" CLASS="footerlink">Feedback</A>
</div>
</div>
</div>
<div id="cobrand">
<img src="/cgi-bin/image/images/cobrand_logo.gif" vspace="5" BORDER="0">
</div>
</div>
</TD></TR></TABLE>
<SCRIPT type="text/javascript" language="javascript"><!--
if (!document.refcd) { // If refcd has already been set, don't bother.
document.refcd="";
if (document.referrer.match(/google\..*\/search/)) {
document.refcd="ORGANIC_SEARCH_GOOGLE";
} else if (document.referrer.match(/search\.msn\.com\/results/)) {
document.refcd="ORGANIC_SEARCH_MSN";
} else if (document.referrer.match(/search\.yahoo/)) {
document.refcd="ORGANIC_SEARCH_YAHOO";
} else if (document.referrer.match(/dir\.yahoo/)) {
document.refcd="ORGANIC_SEARCH_YAHOO_DIR";
} else if (document.referrer.match(/web\.ask\.com/)) {
document.refcd="ORGANIC_SEARCH_ASK.COM";
} else if (document.referrer.match(/dogpile\.com/)) {
document.refcd="ORGANIC_SEARCH_DOGPILE";
} else if (document.referrer.match(/aolsearch\.aol\.com/)) {
document.refcd="ORGANIC_SEARCH_AOL";
}
}
//--></SCRIPT>
<!-- Google Analytics Insertion Begin -->
<script type="text/javascript">
<!--
var _gaq = _gaq || [];
_gaq.push(['_setAccount', "UA-4601892-10"]);
_gaq.push(['_setDomainName', 'none']);
_gaq.push(['_setAllowLinker', true]);
_gaq.push(['_trackPageview']);
(function() {
var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
})();
-->
</script>
<!-- Google Analytics Insertion Complete -->
<!-- PrintTracker Insertion Begin -->
<script src="/fs_img/js/pt.js" type="text/javascript"></script>
<!-- PrintTracker Insertion Complete -->
</body>
</html>