Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 8686 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://iconbusters.com/robots.txt
302 Found
http://www.iconbusters.com/iconbusters/index.htm
200 OK
Показать содержимое robots.txt
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"
"http://www.w3.org/TR/html4/loose.dtd">
<html>
<head>
<title>ICONBUSTERS</title>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta NAME="keywords" CONTENT="
iconbusters
Protestant Reformation Publications
Protestant Reformation
Joel Osteen
Victoria Osteen
Larry King Interview
Lakewood Church
Antichrist
Antichrist Family Photo Album
Antichrist pictures
Hypocrites
Hypocrites on Parade
Flash
Prophecy
False Prophets
Heretics
Heresy
Inquisition
Torture
Pope
Pope John Paul II
Pope Benedict XVI
Christianity
False Christianity
Futurism
Preterism
Historicism
Historicist
Revelation
Church history
Reformers
Roman Catholic Church
Mystery Babylon
Man of Sin
Beast
Mark of the Beast
Billy Graham
Alan Morrison
Alberto Rivera
R. C. Sproul
John MacArthur
Hank Hanegraaff
Hal Lindsey
Tim LaHaye
Jack Van Impe
Jerry Falwell
Arminian
Arminianism
Free Will
Catholic Clergy Sex Crimes
Pedophilia
Pedophile
Pederasty
Lechery
Sexual Abuse
Confessional
Love, Threats & Christian Hate Mail
Francis Turretin
William Whitaker
Rome
False Church
True Church
Christian
">
<meta NAME="description" CONTENT="Iconbusters and Protestant Reformation Publications exist to awaken, educate, and enlighten Christians to crucial biblical truths which are neglected and intentionally hidden by church leaders. We are an apologetic ministry specializing in prophecy and the doctrines of grace. We expose and refute false teachers and their false doctrine.">
<META HTTP-EQUIV="Pragma" CONTENT="no-cache">
<META HTTP-EQUIV="Expires" CONTENT="-1">
<style type="text/css">
<!--
body {
background-color: #000000;
margin-left: 0px;
margin-top: 0px;
}
.style3 {
color: #93bd55;
font-family: Arial, Helvetica, sans-serif;
font-size: 12px;
padding-left:10px;
}
.style4 {font-size: 12px}
a:link {
color: #93bd55;
text-decoration: none;
}
a:visited {
color: #93bd55;
text-decoration: none;
}
a:hover {
color: #FFFFFF;
text-decoration: none;
}
a:active {
color: #FFFFFF;
text-decoration: none;
}
a.new {
color:#ffe91a;
}
a.new:hover {
color:#ffffff;
}
.style5 {
color: #FF0000;
font-weight: bold;
}
.style7 {color: #FF0000}
-->
</style></head>
<body>
<table width="818" height="500" border="0" align="center" cellpadding="0" cellspacing="0" >
<tr>
<td width="818" background="images/index_bg.jpg"><table width="261" border="0" cellspacing="0" cellpadding="0">
<tr>
<td width="261" height="20"><span class="style3"><a href="http://www.iconbusters.org/">ICONBUSTERS.ORG</a></span></td>
</tr>
<tr>
<td width="261" height="20"><span class="style3"><a href="https://www.youtube.com/channel/UCdYkJSW-cbcDpNbgIb50Txg">ICONBUSTERS YouTube Channel</a></span></td>
</tr>
<tr>
<td height="20" class="style3"><span class="style4"><a href="htm/beliefs/beliefs.html">BELIEFS</a></span></td>
</tr>
<tr>
<td height="20" class="style3"><span class="style4"><a href="htm/true_ch/true_ch.html">TRUE CHRISTIANITY</a></span></td>
</tr>
<tr>
<td height="20" class="style3"><span class="style4"><a href="htm/false_ch/false_ch.html">FALSE CHRISTIANITY</a></span></td>
</tr>
<tr>
<td height="20"><span class="style3"><a href="htm/photo_album/photo_album.html">ANTICHRIST FAMILY PHOTO ALBUM</a></span></td>
</tr>
<!--
<tr>
<td height="20" class="style3"><span class="style4"> <a href="htm/hyp_parade/hyp_parade.html">HYPOCRITES ON PARADE</a></span></td>
</tr>
-->
<tr>
<td height="20" class="style3"><span class="style4"><a href="htm/heretics/heretics.html">HERETICS</a></span></td>
</tr>
<tr>
<td height="20" class="style3"><span class="style4"><a href="htm/false_prophets/false_prophets.html">FALSE PROPHETS</a></span></td>
</tr>
<tr>
<td height="20" class="style3"><span class="style4"><a href="htm/true_prophets/true_prophets.html">TRUE PROPHETS</a></span></td>
</tr>
<tr>
<td height="20" class="style3"><span class="style4"></span><a href="htm/prophecy/prophecy.html">PROPHECY</a></span></td>
</tr>
<tr>
<td height="20" class="style3"><span class="style4"><a href="htm/false_prophecy/false_prophecy.html">FALSE PROPHECY</a></span></td>
</tr>
<tr>
<td height="20" class="style3"><span class="style4"><a href="htm/false_doctrine/false_doctrine.html">FALSE DOCTRINE</a></span></td>
</tr>
<tr>
<td height="20" class="style3"><span class="style4"><a href="htm/sex_crimes/sex_crimes.html">CATHOLIC CLERGY SEX CRIMES</a></span></td>
</tr>
<tr>
<td height="20" class="style3"><span class="style4"><a href="htm/love_hate_mail/love_hate_mail.html">LOVE, THREATS & CHRISTIAN HATE MAIL</a></span></td>
</tr>
<tr>
<td height="20" class="style3"><span class="style4"><a href="htm/catalogue/catalogue.html">PUBLICATIONS</a></span></td>
</tr>
<tr>
<td height="20" class="style3"><span class="style4"><a href=" https://www.iconbusters.com/iconbusters/htm/catalogue/Wycliffite-Lollard-Commentary-on-the-Book-of-Revelation.html" class='new'>NEW PUBLICATION</a></span></td>
</tr>
<tr>
<td height="20" class="style3"><span class="style4"><a href=" https://www.iconbusters.com/iconbusters/htm/Francis-Turretin-Translated/" >FRANCIS TURRETIN LATIN TEXTS TRANSLATED FOR THE FIRST TIME</a></span></td>
</tr>
<tr>
<td height="20" class="style3">
<span class="style4"><br>
<a href="https://www.iconbusters.com/iconbusters/htm/ebook-translations/" >
<span style='color:#ffe91a; display:inline-block;margin-bottom:5px;'>NEW EPUB FIRST EVER COMPLETE LATIN TRANSLATIONS:</span></br>
Francis Turretin, On the Necessity of Secession From the Roman Church<br/>
<hr>
Archbishop James Ussher, On the Continuous Succession of the Christian Churches</a>
</span>
</td>
</tr>
<!--<tr>
<td height="20" class="style3"><a href="htm/catalogue/Antichrist in Our Midst Chapter Summaries.pdf" target="_blank"><img src="images/midst.gif" width="240" height="29" border="0"></a></td>
</tr>-->
</table></td>
</tr>
</table>
<div align="center"></div>
<!-- Start eXTReMe Non Public Tracker Code V3/5
Login: iconbus3
Help: https://www.extremetracking.com
Installation instructions:
Copy and paste this code between the two body tags into the
*source* of your pages or in your footer/template. Best is
to use a normal text editor such as notepad. -->
<script type="text/javascript" language="javascript1.2"><!--
EXs=screen;EXw=EXs.width;navigator.appName!="Netscape"?
EXb=EXs.colorDepth:EXb=EXs.pixelDepth;//-->
</script><script type="text/javascript"><!--
navigator.javaEnabled()==1?EXjv="y":EXjv="n";
EXd=document;EXw?"":EXw="na";EXb?"":EXb="na";
location.protocol=="https:"?EXprot="https":EXprot="http";
top.document.referrer?EXref=top.document.referrer:EXref=EXd.referrer;
EXd.write("<img src="+EXprot+"://nht-2.extreme-dm.com",
"/n2.g?login=iconbus3&url="+escape(document.URL)+"&pv=&",
"jv="+EXjv+"&j=y&srw="+EXw+"&srb="+EXb+"&",
"l="+escape(EXref)+" height=1 width=1>");//-->
</script><noscript><img height="1" width="1" alt=""
src="http://nht-2.extreme-dm.com/n2.g?login=iconbus3&url=nojs&j=n&jv=n&pv="/>
</noscript>
<!-- End eXTReMe Non Public Tracker Code -->
<!-- Start eXTReMe Non Public Tracker Code V3/5
Login: iconbus3
Help: https://www.extremetracking.com
Installation instructions:
Copy and paste this code between the two body tags into the
*source* of your pages or in your footer/template. Best is
to use a normal text editor such as notepad. -->
<script type="text/javascript" language="javascript1.2"><!--
EXs=screen;EXw=EXs.width;navigator.appName!="Netscape"?
EXb=EXs.colorDepth:EXb=EXs.pixelDepth;//-->
</script><script type="text/javascript"><!--
navigator.javaEnabled()==1?EXjv="y":EXjv="n";
EXd=document;EXw?"":EXw="na";EXb?"":EXb="na";
location.protocol=="https:"?EXprot="https":EXprot="http";
top.document.referrer?EXref=top.document.referrer:EXref=EXd.referrer;
EXd.write("<img src="+EXprot+"://nht-2.extreme-dm.com",
"/n2.g?login=iconbus3&url="+escape(document.URL)+"&pv=&",
"jv="+EXjv+"&j=y&srw="+EXw+"&srb="+EXb+"&",
"l="+escape(EXref)+" height=1 width=1>");//-->
</script><noscript><img height="1" width="1" alt=""
src="http://nht-2.extreme-dm.com/n2.g?login=iconbus3&url=nojs&j=n&jv=n&pv="/>
</noscript>
<!-- End eXTReMe Non Public Tracker Code -->
</body>
</html>
Apache