Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 13491 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Показать содержимое robots.txt
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html>
<head>
<title>Home</title>
<link rel="stylesheet" type="text/css" href="http://198.65.120.114/stylesheet.php?templateid=15" />
<meta name="Description" content="" />
<meta name="Keywords" content="" />
<script language="JavaScript" src="/menu.js"></script>
<!--
<script language="JavaScript" src="javascript.js"></script>
<link rel="alternate stylesheet" type="text/css" href="stylesheets/sm_contLow_fontSmall.css" title="Low Contrast, Small Font" />
<link rel="alternate stylesheet" type="text/css" href="stylesheets/sm_contLow_fontMed.css" title="Low Contrast, Medium Font" />
<link rel="alternate stylesheet" type="text/css" href="stylesheets/sm_contLow_fontLarge.css" title="Low Contrast, Large Font" />
<link rel="alternate stylesheet" type="text/css" href="stylesheets/sm_contHigh_fontReg.css" title="High Contrast, Standard Font" />
<link rel="alternate stylesheet" type="text/css" href="stylesheets/sm_contHigh_fontSmall.css" title="High Contrast, Small Font" />
<link rel="alternate stylesheet" type="text/css" href="stylesheets/sm_contHigh_fontMed.css" title="High Contrast, Medium Font" />
<link rel="alternate stylesheet" type="text/css" href="stylesheets/sm_contHigh_fontLarge.css" title="High Contrast, Large Font" />
-->
<link rel="stylesheet" type="text/css" href="/stylesheets/sm_contLow_fontReg.css" title="Low Contrast, Standard Font" />
</head>
<body>
<!-- Sun-Maid Logo -->
<div id="sunmaid_logo"><a href="/"><img src="/images/sunmaid_logo.jpg" width="92" height="105" border="0" alt="Sun-Maid.com"></a></div>
<!-- Main Menu -->
<div id="menu_main">
<table cellspacing="0">
<tr>
<td width="163"><img src="/images/spacer.gif" width="163" height="1" border="0" /></td>
<td><a href="/about.html" onmouseover="imgOver('menu_about','menu_about-over');" onmouseout="imgOver('menu_about','menu_about');"><img name="menu_about" src="/images/menu_about.gif" width="106" height="31" border="0" alt="About Sun-Maid" /></a></td>
<td><img src="/images/menu_seperator.gif" width="1" height="31" border="0" /></td>
<td><a href="/recipes.html" onmouseover="imgOver('menu_recipes','menu_recipes-over');" onmouseout="imgOver('menu_recipes','menu_recipes');"><img name="menu_recipes" src="/images/menu_recipes.gif" width="61" height="31" border="0" alt="Recipes" /></a></td>
<td><img src="/images/menu_seperator.gif" width="1" height="31" border="0" /></td>
<td><a href="/healthyliving.html" onmouseover="imgOver('menu_healthyliving','menu_healthyliving-over');" onmouseout="imgOver('menu_healthyliving','menu_healthyliving');"><img name="menu_healthyliving" src="/images/menu_healthyliving.gif" width="96" height="31" border="0" alt="Healthy Living" /></a></td>
<td><img src="/images/menu_seperator.gif" width="1" height="31" border="0" /></td>
<td><a href="/products.html" onmouseover="imgOver('menu_products','menu_products-over');" onmouseout="imgOver('menu_products','menu_products');"><img name="menu_products" src="/images/menu_products.gif" width="69" height="31" border="0" alt="Products" /></a></td>
<td><img src="/images/menu_seperator.gif" width="1" height="31" border="0" /></td>
<td><a href="http://altapacific.com/secure/sunmaidgs2/" onmouseover="imgOver('menu_giftshop','menu_giftshop-over');" onmouseout="imgOver('menu_giftshop','menu_giftshop');"><img name="menu_giftshop" src="/images/menu_giftshop.gif" width="68" height="31" border="0" alt="Gift Shop" /></a></td>
<td width="230">
<div id="search_box" align="right">
<table cellspacing="0">
<form name="search" method="get" action="/search/search.php">
<tr>
<td><img name="search_text" src="/images/search_text.gif" width="44" height="31" border="0" alt="Search" /></td>
<td><input name="query" type="text" value="" onclick="clickclear(this, 'search text');" onblur="clickrecall(this,'search text');" style="font-family: arial,helvetica; font-size: 11px; padding: 1px 3px 0 3px;"></td>
<td><a href="javascript: document.search.submit();"><img name="search_go" src="/images/search_go.gif" width="37" height="31" border="0" alt="Go!" /></a></td>
</tr>
</form>
</table>
</div>
</td>
<td width="20"><img src="/images/menu_curve-right.gif" width="20" height="31" border="0" /></td>
</tr>
<tr>
<td colspan="12" class="bg_orange"><img src="/images/spacer.gif" width="1" height="1" border="0" /></td>
</tr>
</table>
</div>
<!-- Lower Menu -->
<div id="menu_lower">
<table cellspacing="0">
<tr>
<td rowspan="2"><img src="/images/menu_curve-lower.gif" width="13" height="19" border="0" /></td>
<td><a href="/industrial.html" onmouseover="imgOver('menu_industrial','menu_industrial-over');" onmouseout="imgOver('menu_industrial','menu_industrial');"><img name="menu_industrial" src="/images/menu_industrial.gif" width="102" height="18" border="0" alt="Industrial Products" /></a></td>
<td><img src="/images/menu_seperator-lower.gif" width="1" height="18" border="0" /></td>
<td><a href="/foodservice.html" onmouseover="imgOver('menu_foodservice','menu_foodservice-over');" onmouseout="imgOver('menu_foodservice','menu_foodservice');"><img name="menu_foodservice" src="/images/menu_foodservice.gif" width="79" height="18" border="0" alt="Food Service" /></a></td>
<td><img src="/images/menu_seperator-lower.gif" width="1" height="18" border="0" /></td>
<td><a href="/international.html" onmouseover="imgOver('menu_international','menu_international-over');" onmouseout="imgOver('menu_international','menu_international');"><img name="menu_international" src="/images/menu_international.gif" width="77" height="18" border="0" alt="International" /></a></td>
<td><img src="/images/menu_seperator-lower.gif" width="1" height="18" border="0" /></td>
<td><a href="/brandlicensing.html" onmouseover="imgOver('menu_brandlicensing','menu_brandlicensing-over');" onmouseout="imgOver('menu_brandlicensing','menu_brandlicensing');"><img name="menu_brandlicensing" src="/images/menu_brandlicensing.gif" width="98" height="18" border="0" alt="Brand Licensing" /></a></td>
</tr>
<tr>
<td colspan="7" class="bg_orange"><img src="/images/spacer.gif" width="1" height="1" border="0" /></td>
</tr>
</table>
</div>
<!-- Top Right Sub-Menu -->
<div id="menu_sub">
<table cellspacing="0">
<tr>
<td><a href="/contact.html"><img name="menu_contact" src="/images/menu_contact.gif" width="61" height="20" border="0" alt="Contact Us" /></a></td>
<td><img src="/images/menu_seperator-sub.gif" width="1" height="20" border="0" /></td>
<td><a href="/emailupdates.html"><img name="menu_emailupdates" src="/images/menu_emailupdates.gif" width="84" height="20" border="0" alt="Email Updates" /></a></td>
<td><img src="/images/menu_seperator-sub.gif" width="1" height="20" border="0" /></td>
<td><a href="/help.html"><img name="menu_help" src="/images/menu_help.gif" width="34" height="20" border="0" alt="Help" /></a></td>
<!--<td><img src="/images/menu_seperator-sub.gif" width="1" height="20" border="0" /></td>
<td><a href="/contrast.html"><img src="/images/menu_contrast.gif" width="126" height="20" border="0" alt="Contrast and Type Size" /></a></td>-->
</tr>
</table>
</div>
<!-- Red Background With White Ribbon Image
<div id="bg_home-header"></div> -->
<div id="home_title"><img src="/images/landing/titles/home_landing.jpg" width="800" height="319" alt="Sun-Maid" /></div>
<div id="flash_description" class="bgred">
<img width="152" height="17" border="0" src="/images/title_flash-home.gif" alt="The Sun-Maid Girl" />
<br />The Sun-Maid girl trademark was inspired by a real person – Lorraine Collett Petersen, who in 1915 lived in the Fresno, California, area where the company began its operations. Life then was simpler, less hectic – and red sunbonnets were the fashion.
<br /><a class="sm" href="/about/sunmaid_girl">» LEARN MORE</a>
</div>
<div id="feat_product"><div align="center">
<table cellspacing="0">
<tr>
<td><img src="/images/feat_topleft-corner.gif" width="10" height="10" border="0" /></td>
<td style="background-image: url(/images/feat_topline.gif); background-repeat: repeat-x;"></td>
<td><img src="/images/feat_topright-corner.gif" width="11" height="10" alt=""></td>
</tr>
<tr>
<td style="background-image: url(/images/feat_leftline.gif); background-repeat: repeat-y;"></td>
<td><object width="69" height="123" title="Featured Products" codebase="http://download.macromedia.com/pub/shockwave/cabs/flash/swflash.cab#version=7,0,19,0" classid="clsid:D27CDB6E-AE6D-11cf-96B8-444553540000" >
<param value="/swf/feat_product-flash.swf" name="movie" />
<param value="high" name="quality" />
<embed width="69" height="123" type="application/x-shockwave-flash" pluginspage="http://www.macromedia.com/go/getflashplayer" quality="high" src="/swf/feat_product-flash.swf" >
</embed>
</object></td>
<td style="background-image: url(/images/feat_rightline.gif); background-repeat: repeat-y;"></td>
</tr>
<tr>
<td><img src="/images/feat_bottomleft-corner.gif" width="10" height="11" border="0" /></td>
<td style="background-image: url(/images/feat_bottomline.gif); background-repeat: repeat-x;"></td>
<td><img src="/images/feat_bottomright-corner.gif" width="11" height="11" border="0" /></td>
</tr>
</table>
</div></div>
<div id="grapes_sunshine">
<table cellspacing="0" border=0>
<tr valign="bottom">
<td width="3" style="background-image: url(/images/divider_repeat.gif); background-repeat: repeat-y;"><img src="/images/spacer.gif" width="1" height="20" border="0" /></td>
<td width="12" rowspan="3"><img src="/images/spacer.gif" width="1" height="1" /></td>
<td style="padding-left:15px;"><a href="/healthyliving/grapes_and_sunshine"><img src="/images/GrapesandSunshine_logo_200p.gif" width="200" height="53" border="0" alt="Grapes and Sunshine" /></a></td>
</tr>
<tr>
<td width="3" style="background-image: url(/images/divider_repeat.gif); background-repeat: repeat-y;"><img src="/images/spacer.gif" width="1" height="1" border="0" /></td>
<td style="padding-left:15px;">
<table cellspacing="0">
<tr>
<td colspan="2">
Sunlight travels 93 million miles to turn our grapes into Sun-Maid Raisins.
And that's all we put in… grapes and sunshine.
Sun-Maid Raisins - nothing but grapes and sunshine.</td>
</tr>
<tr>
<td width="9" style="padding: 2px;"></td>
<td width="100%" style="padding: 2px;"><a class="sm" href="/healthyliving/grapes_and_sunshine">» MORE</a></td>
</tr>
</table>
</td>
</tr>
</table>
</div>
<div id="feat_recipe">
<table cellspacing="0" border=0>
<tr>
<td></td>
<td rowspan="3" width="20"></td>
<td><a href="/recipes/recipe/French_Apple_Pie_with_Crumb_Topping.html"><img src="/images/title_featrecipe.gif" width="170" height="17" border="0" alt="Featured Recipe"></a></td>
</tr>
<tr>
<td rowspan="2" width="2" style="background-image: url(/images/divider_repeat.gif); background-repeat: repeat-y;"></td>
<td><a href="/recipes/recipe/French_Apple_Pie_with_Crumb_Topping.html"><img src="/images/img_featrecipe.gif" width="170" height="133" border="0" alt=""></a></td>
</tr>
<tr>
<td style="padding-left:12px;">
<table cellspacing="0">
<tr>
<td colspan="2" class="title"><a href="/recipes/recipe/French_Apple_Pie_with_Crumb_Topping.html"><span class="title">French Raisin Apple Pie</span></a></td>
</tr>
<tr>
<td colspan="2">Sun-Maid raisins and dried fruits have been added to cookies, breads,
salads, main dishes, side dishes, and desserts for over 90 years.</td>
</tr>
<tr>
<td width="9" style="padding: 2px;"></td>
<td width="100%" style="padding: 2px;"><a class="sm" href="/recipes/recipe/French_Apple_Pie_with_Crumb_Topping.html">» GET RECIPE</a></td>
</tr>
</table>
</td>
</tr>
</table>
</div>
<!-- Main body including light red side borders and footer -->
<div id="body_home">
<table width="800" cellspacing="0" border=0>
<tr>
<td class="bg_red2"><img src="/images/spacer.gif" width="1" height="1" border="0" /></td>
<td width="29"></td>
<td width="280" class="body_home">
<img width="129" height="31" border="0" alt="Welcome" src="/images/title_welcome.gif" /><br />
From ancient civilizations through modern times, people have eaten raisins and other naturally dried fruits for energy, for convenience, and because they taste good. At Sunmaid.com you will find information on our nutritious and delicious products, as well as mouth-watering recipes for every occasion.
</td>
<td width="489"></td>
<td class="bg_red2"><img src="/images/spacer.gif" width="1" height="1" border="0" /></td>
</tr>
<tr>
<td class="bg_red2"><img src="/images/spacer.gif" width="1" height="1" border="0" /></td>
<td width="29" colspan="3"> </td>
<td class="bg_red2"><img src="/images/spacer.gif" width="1" height="1" border="0" /></td>
</tr>
<tr>
<td colspan="5">
<table width="100%" cellspacing="0">
<tr>
<td id="footer_curve"><img src="/images/foot_leftcurve.gif" width="10" height="35" border="0" /></td>
<td id="footer_home" width="100%">
<a href="/legal_privacy.html">Privacy</a> |
<a href="/legal_terms.html">Terms & Conditions</a> |
<a href="/sitemap.html">Sitemap</a><br />
©Copyright 2006 Sun-Maid
</td>
<td id="footer_curve"><img src="/images/foot_rightcurve.gif" width="10" height="35" border="0" /></td>
</tr>
</table>
</td>
</tr>
</table>
</div>
</body>
</html>
<!-- Gen'd 0.253566 wallclock seconds, 0.24 CPU seconds (wait percent=94.65 , avg load=0) by CMSms (cached) w/w 20 -->