Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 9387 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Показать содержимое robots.txt
<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN" "http://www.w3.org/TR/REC-html40/loose.dtd">
<html>
<head>
<title>Error 404: Page not found.</title>
<meta name="Description" content="Founded to identify, scientifically evaluate, and implement through public policy promising new technologies and programs that offer practical solutions to problems facing our nation.">
<meta name="Keywords" content="peaceful solutions, crime prevention, Kosovo crisis, Congressional Prevention Coalition, genetic engineering, food safety, John Hagelin, John Fagan, consciousness, social indicators, violent crimes, public policy, emerging technologies, conflict resolution, holistic development, meta-analyses, urban development, non-violence, Arenander, world peace, violence, Yogic Flying, cost-effectiveness, alcohol abuse, recidivism, social stress, drug abuse, Transcendental Meditation, meditation, foreign policy, criminal behavior, TM program, TM-Sidhis, criminal rehabilitation, defense policies, problems of education, health care policy, sustainable organic agriculture, alternative energy, renewable energy, group for a government, Maharishi Effect, Natural Law, Perfect Government, alternative health care, mandatory labeling, stress prevention, brain research institute, neurophysiology of violence, minority health care, health promotion">
<meta name="Author" content="Craig Ridgley, Safire Internet Solutions, http://safire.net">
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<link href="/styles.css" rel="stylesheet" type="text/css">
</head>
<body bgcolor="#ffffff" marginwidth="0" marginheight="0" topmargin="0" leftmargin="0" text="#003366">
<!-- #BeginLibraryItem "/Library/masthead.lbi" --><table border="0" cellspacing="0" cellpadding="0" width="100%" background="/images/top_background.gif">
<tr>
<td>
<table border="0" cellpadding="0" cellspacing="0" width="800" background="/images/transparent.gif">
<tr>
<td><img src="/images/spacer.gif" width="169" height="1" border="0"></td>
<td><img src="/images/spacer.gif" width="99" height="1" border="0"></td>
<td><img src="/images/spacer.gif" width="433" height="1" border="0"></td>
<td><img src="/images/spacer.gif" width="99" height="1" border="0"></td>
<td><img src="/images/spacer.gif" width="1" height="1" border="0"></td>
</tr>
<tr>
<td rowspan="3"><img name="masthead_r1_c1" src="/images/masthead_r1_c1.jpg" width="169" height="180" border="0"></td>
<td><img name="masthead_r1_c2" src="/images/masthead_r1_c2.jpg" width="99" height="108" border="0"></td>
<td><img src="/images/masthead_title.gif" width="433" height="55" alt="Institute of Science, Technology and Public Policy"></td>
<td> </td>
<td><img src="/images/spacer.gif" width="1" height="108" border="0"></td>
</tr>
<tr>
<td> </td>
<td><img name="masthead_r2_c3" src="/images/masthead_r2_c3.gif" width="433" height="34" border="0"></td>
<td> </td>
<td><img src="/images/spacer.gif" width="1" height="34" border="0"></td>
</tr>
<tr>
<td><img name="masthead_r3_c2" src="/images/masthead_r3_c2.gif" width="99" height="38" border="0"></td>
<td colspan="2"><img name="masthead_r3_c3" src="/images/masthead_r3_c3.gif" width="532" height="38" border="0"></td>
<td><img src="/images/spacer.gif" width="1" height="38" border="0"></td>
</tr>
</table>
</td>
</tr>
</table><!-- #EndLibraryItem -->
<table border="0" cellspacing="0" cellpadding="0" width="800">
<tr>
<td width="185" background="/images/sidebar_repeat.gif" valign="top">
<img src="/images/spacer.gif" width="185" height="1"><br>
<!-- #BeginLibraryItem "/Library/side_nav.lbi" --><a href="/index.html"><img src="/images/sidebar_home.gif" width="150" height="22" alt="Home" border="0"></a><br>
<a href="/message.html"><img src="/images/sidebar_message.gif" width="150" height="33" alt="Message from the Director" border="0"></a><br>
<a href="/subscribe.html"><img src="/images/sidebar_subscribe.gif" width="150" height="52" alt="Subscribe to eNews" border="0"></a><br>
<a href="/news/index.html"><img src="/images/sidebar_news_flash.gif" width="150" height="21" alt="News" border="0"></a><br>
<!--<a href="/press/index.html"><img src="/images/sidebar_press.gif" width="150" height="18" alt="Press Articles" border="0"></a><br>-->
<a href="https://giving.miu.edu/restricted-gift/"><img src="/images/sidebar_contribute.gif" width="150" height="49" alt="Contributions" border="0"></a><br>
<a href="/contact.html"><img src="/images/sidebar_contact.gif" width="150" height="22" alt="Contact Us" border="0"></a><br>
<a href="http://uspeacegovernment.org"><img src="/images/sidebar_uspg.gif" width="150" height="22" alt="US Peace Government" border="0"></a><br>
<a href="http://permanentpeace.org"><img src="/images/sidebar_invin_defense.gif" width="150" height="31" alt="Creating Permanent World Peace" border="0"></a><br>
<a href="http://miu.edu"><img src="/images/sidebar_mum.gif" width="150" height="31" alt="Maharishi International University" border="0"></a><br>
<a href="/coalition/index.html"><img src="/images/sidebar_congress.gif" width="150" height="41" alt="Congressional Prevention Coalition" border="0"></a><br>
<a href="/coalition/stress_prevention.html"><img src="/images/sidebar_stress.gif" width="150" height="15" alt="Stress Prevention" border="0"></a><br>
<a href="/coalition/parity.html"><img src="/images/sidebar_health_care.gif" width="150" height="30" alt="Achieving Parity in Health Care" border="0"></a><br>
<a href="/book.html"><img src="/images/sidebar_gov_book.gif" width="150" height="49" alt="Goundbreaking New Book on Government" border="0"></a><br>
<a href="/rehabilitation/index.html"><img src="/images/sidebar_crimepre.gif" width="150" height="31" alt="Crime Prevention and Rehabilitation" border="0"></a><br>
<a href="/military_science/index.html"><img src="/images/sidebar_military.gif" width="150" height="31" alt="Center for Advanced Military Science" border="0"></a><br>
<!--<a href="/veterans/index.html"><img src="/images/sidebar_veterans.gif" width="150" height="66" alt="Veterans Administrative Coverage for TM Technique" border="0"></a><br>-->
<a href="/genetic_engineering.html"><img src="/images/sidebar_gen_eng.gif" width="150" height="49" alt="Genetic Engineering" border="0"></a><br>
<a href="/bri/index.html"><img src="/images/sidebar_br_res_inst.gif" width="150" height="31" alt="Brain Research Institute" border="0"></a><br>
<a href="/bri/reversing_violence.html"><img src="/images/sidebar_reversing.gif" width="150" height="45" alt="Reversing Violence" border="0"></a><br>
<a href="/crime_prevention/index.html"><img src="/images/sidebar_wash_dc.gif" width="150" height="56" alt="Crime Prevention" border="0"></a><br>
<a href="/crime_prevention/voodoo_rebuttal.html"><img src="/images/sidebar_rebuttal.gif" width="150" height="42" alt="Rebuttal" border="0"></a><br>
<a href="/crime_prevention/voodoo_bookreview.html"><img src="/images/sidebar_voodoo.gif" width="150" height="29" alt="Book Review" border="0"></a><br>
<img src="/images/sidebar_info.gif" width="150" height="174" alt="Contact Information" border="0">
<!-- #EndLibraryItem --></td>
<td valign="top">
<h3 align="center">This page has
moved.</h3>
<p align="center"><font size="2"><a href="/index.html">Return
to our Home page.</a><br><img src="/images/spacer.gif" width="615" height="1"></font></p>
</td>
</tr>
</table>
<table border="0" cellspacing="0" cellpadding="0" width="800">
<tr>
<td width="185" background="/images/sidebar_repeat.gif" valign="top"><img src="/images/spacer.gif" width="185" height="20"></td>
<td valign="top"><img src="/images/spacer.gif" width="615" height="1"></td>
</tr>
</table>
<table border="0" cellspacing="0" cellpadding="0" width="100%">
<tr>
<td bgcolor="#003399" colspan="2"><img src="/images/spacer.gif" width="1" height="1"></td>
</tr>
</table>
<table border="0" cellspacing="0" cellpadding="0" width="100%">
<tr>
<td colspan="3" bgcolor="#003399"><img src="/images/spacer.gif" width="1" height="4"></td>
</tr>
<tr>
<td align="center" width="185" bgcolor="#003399"><img src="/images/spacer.gif" width="185" height="1"></td>
<td width="615" align="center" nowrap bgcolor="#003399" class="bottom_nav">
<a href="/index.html">Home</a> |
<a href="/message.html">Message from Director</a> |
<a href="/subscribe.html">Subscribe to eNews</a> |
<a href="/news/index.html">News</a> |
<a href="/contact.html">Contact Us</a><br>
<a href="/coalition/index.html">Congressional Prevention Coalition</a> |
<a href="/book.html">Groundbreaking New Book</a> |
<a href="/rehabilitation/index.html">Crime Prevention</a> |
<a href="/genetic_engineering.html">Genetic Engineering</a><br>
<a href="/bri/index.html">Brain Research Institute</a> |
<a href="/crime_prevention/index.html">Crime Prevention</a> |
<a href="http://permanentpeace.org">Creating Permanent World Peace</a> |
<a href="/links.html">Links</a>
</td>
<td align="center" width="90%" bgcolor="#003399"><img src="/images/spacer.gif" width="1" height="1"></td>
</tr>
<tr>
<td colspan="3" bgcolor="#003399"><img src="/images/spacer.gif" width="1" height="8"></td>
</tr>
<tr>
<td colspan="3"><img src="/images/spacer.gif" width="1" height="20"></td>
</tr>
</table>
</body>
</html>
Apache