Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 3 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://bbs.thing.net/robots.txt
302 Found
https://bbs.thing.net/robots.txt
302 Found
https://bbs.thing.net/login.thing
200 OK
Показать содержимое robots.txt
<html>
<head><title>THE THING BBS</title>
<SCRIPT>
function windowOpener(laden)
{
fogwindow=window.open(laden,'Services','toolbar=no,location=no,directories=no,status=no,menubar=no,scrollbars=yes,resizable=yes,width=540,height=400');
}
function istop() {
if (window != window.top) {
window.top.location=window.location;
}
}
</SCRIPT>
</head>
<BODY BGCOLOR="#000000" onload="istop();">
<form method=POST name=login action="communicator.thing" ENCTYPE="multipart/form-data">
<font face="helvetica,arial" size="1">
<P>
<TABLE BORDER="0" CELLPADDING="0" CELLSPACING="0">
<TR>
<TD WIDTH="138" ROWSPAN="2"><IMG name="commu" SRC="front/commu_weiss2_blur.gif" WIDTH="133" HEIGHT="148" ALIGN="BOTTOM" BORDER="0" ALT="become a member (its free!!) to and use our communicator!!"></TD>
<TD WIDTH="67" ROWSPAN="2"><IMG SRC="front/klammerol2.gif" WIDTH="67" HEIGHT="33" ALIGN="BOTTOM" BORDER="0"></TD>
<TD WIDTH="138" VALIGN="BOTTOM" ROWSPAN="2">
<CENTER>
<P>
<A href="#">
<IMG SRC="front/logo.gif" WIDTH="138" HEIGHT="64" ALIGN="BOTTOM" BORDER="0" ALT="THE THING"></a><IMG
SRC="front/klammeror.gif" WIDTH="130" HEIGHT="53" ALIGN="BOTTOM" ALT="one_image"
BORDER="0">
</CENTER>
</TD>
<TD WIDTH="49" HEIGHT="53"></TD>
<TD WIDTH="119" ROWSPAN="2"><a href="javascript:windowOpener('/info/');"><IMG SRC="front/info.gif" WIDTH="111" HEIGHT="30" ALIGN="BOTTOM" ALT="info about THE THING"
BORDER="0" name="info"></a><BR>
<a href="javascript:windowOpener('/services/');"><IMG SRC="front/services.gif" WIDTH="111" HEIGHT="30" ALIGN="BOTTOM" ALT="services of THE THING"
BORDER="0" name="services"></a><BR>
<BR>
<BR>
<BR>
<BR>
<BR>
</TD>
</TR>
<TR>
<TD WIDTH="49" HEIGHT="75"></TD>
</TR>
<TR>
<TD WIDTH="138" ROWSPAN="2"></TD>
<TD WIDTH="67" ROWSPAN="2"></TD>
<TD WIDTH="138" HEIGHT="121">
<CENTER>
<P><IMG SRC="front/auswahl_blur.gif" WIDTH="110" HEIGHT="136" ALIGN="BOTTOM" BORDER="0" name="menu" ALT="become a member (its free!!)">
</CENTER>
</TD>
<TD WIDTH="49" HEIGHT="121"></TD>
<TD WIDTH="119" HEIGHT="121">
<TABLE BORDER="0" CELLPADDING="0" CELLSPACING="0" WIDTH="111" HEIGHT="121">
<TR>
<TD WIDTH="13"></TD>
<TD WIDTH="85"></TD>
<TD WIDTH="13"></TD>
</TR>
<TR>
<TD WIDTH="13" HEIGHT="30"><IMG SRC="front/klammerl.gif" WIDTH="13" HEIGHT="30" ALIGN="BOTTOM" BORDER="0"></TD>
<TD WIDTH="85" HEIGHT="30"><font face="helvetica,arial" size="1">
<CENTER><P>
<input type="text" name="user" value="username" size=10>
</CENTER>
</TD>
<TD WIDTH="13" HEIGHT="30"><IMG SRC="front/klammerr.gif" WIDTH="13" HEIGHT="30" ALIGN="BOTTOM" BORDER="0"></TD>
</TR>
<TR>
<TD WIDTH="13" HEIGHT="30"><IMG SRC="front/klammerl.gif" WIDTH="13" HEIGHT="30" ALIGN="BOTTOM" BORDER="0"></TD>
<TD WIDTH="85" HEIGHT="30"><font face="helvetica,arial" size="1">
<CENTER>
<P>
<input type="password" name="pw" value="password" size=10>
</CENTER>
</TD>
<TD WIDTH="13" HEIGHT="30"><IMG SRC="front/klammerr.gif" WIDTH="13" HEIGHT="30" ALIGN="BOTTOM" BORDER="0"></TD>
</TR>
<TR VALIGN="BOTTOM">
<TD HEIGHT="60" COLSPAN="3">
<INPUT TYPE="image" SRC="front/login.gif" border="0" WIDTH=111 HEIGHT=30 value="login">
</TD>
</TR>
</TABLE>
</TD>
</TR>
<TR VALIGN="TOP">
<TD WIDTH="138" HEIGHT="91"><IMG SRC="front/klammerul.gif" WIDTH="138" HEIGHT="91" ALIGN="BOTTOM" ALT="another_image"
BORDER="0"></TD>
<TD WIDTH="49" HEIGHT="91"><IMG SRC="front/klammerum.gif" WIDTH="49" HEIGHT="91" ALIGN="BOTTOM" ALT="another_image"
BORDER="0"></TD>
<TD WIDTH="119" HEIGHT="91"><IMG SRC="front/klammerur.gif" WIDTH="64" HEIGHT="91" ALIGN="BOTTOM" ALT="another_image"
BORDER="0"></TD>
</TR>
<TR>
<TD WIDTH="138" HEIGHT="30"></TD>
<TD WIDTH="67" HEIGHT="30"></TD>
<TD WIDTH="138" HEIGHT="30">
<a href="communicator.thing"><IMG SRC="front/guest.gif" WIDTH="75" HEIGHT="30" ALIGN="RIGHT" ALT="login as a guest"
BORDER="0"></a></TD>
<TD WIDTH="49" HEIGHT="30"></TD>
<TD WIDTH="119" HEIGHT="30">
<a href=/new/><IMG SRC="front/new_member.gif"
WIDTH="111" HEIGHT="30" ALIGN="BOTTOM" ALT="become a member, IT IS FREE!!!" BORDER="0"></A></TD>
</TR>
</TABLE>
</FORM>
</BODY>
</HTML>
Apache