Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 8749 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Показать содержимое robots.txt
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<meta name="google-site-verification" content="FszTstcHbtI-ZKVw_BBIKf5N6IqjAG6ABGBl59aVrlA" />
<!-- Global site tag (gtag.js) - Google Analytics -->
<script async src="https://www.googletagmanager.com/gtag/js?id=UA-135376018-1">
</script>
<script>
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'UA-135376018-1');
</script>
<!-- Begin IA Modifications -->
<META http-equiv="PICS-Label" content='(PICS-1.1 "http://www.classify.org/safesurf/" l gen true for "http://www.aswgt.com" r (SS~~000 6 SS~~002 1 SS~~009 3))'>
<title>Rattan canes, punishment canes, punishment paddles, adult s/m toys, floggers</title>
<META NAME="MSSmartTagsPreventParsing" CONTENT="TRUE">
<META NAME="keywords" CONTENT="rattan canes, punishment canes, punishment paddles, adult s/m toys, floggers,
spanking paddles, crapper, female corporal punishment, bachelorette party gifts, cuffs and collars, leather paddles, kinky gifts, bdsm gear, spanking toys,
bdsm toys,whips leather">
<META NAME="description" CONTENT="rattan canes, punishment canes, punishment paddles, adult s/m sex toys, bachelorette party gifts, floggers,
spanking paddles, crapper, female corporal punishment, leather paddles, kinky gifts, bdsm greeting cards, bdsm gear">
<META NAME="rating" CONTENT="General">
<META NAME="MS.LOCALE" CONTENT="EN-US">
<META NAME="CATEGORY" CONTENT="home page">
<META NAME="robots" CONTENT="index,follow">
<META http-equiv="Classification" CONTENT="rattan canes">
<META NAME="URL" CONTENT="http://www.aswgt.com">
<META NAME="revisit-after" CONTENT="31 days">
<META NAME="VW96.objecttype" CONTENT="rattan canes, punishment canes, punishment paddles,s/m sex toys,
floggers, spanking paddles, female corporal punishment, leather paddles, kinky gifts, bdsm gear,
spanking toys, bdsm toys, bdsm greeting cards,">
<META NAME="DC.Title" CONTENT="rattan canes, punishment canes, punishment paddles, s/m toys, floggers">
<META NAME="DC.Subject" CONTENT="rattan canes, punishment canes, punishment paddles,s/m toys, floggers,
spanking paddles, corporal punishment, leather paddles, kinky gifts, bdsm gear, spanking toys,
bdsm toys,, whips leather">
<META NAME="DC.Description" CONTENT="rattan canes, punishment canes, punishment paddles, adult s/m toys,
floggers, spanking paddles, crapper, female corporal punishment, leather paddles, kinky gifts, bdsm greeting cards, bdsm gear">
<META NAME="DC.Coverage.PlaceName" CONTENT="Global">
<!--rattan canes, punishment canes, punishment paddles, adult s/m toys,
floggers, spanking paddles, crapper, female corporal punishment, cuffs and
collars, leather paddles, kinky gifts, bdsm gear, spanking toys, bdsm toys,
bdsm greeting cards, whips leather-->
<!-- End IA Modifications -->
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<title>Adam and Gillian's Sensual Whips and Toys </title>
<link href="bestjustify.css" rel="stylesheet" type="text/css" />
</head>
<body>
<table width="1010" border="0" align="center" cellpadding="0" bgcolor="#FFFFFF">
<tr>
<td width="1006"><img src="images/header2.fw.png" alt="Adam and Gillian's Sensual Whips and Toys" width="1000" height="178" title="Welcome to Adam and Gillian's Sensual Whips and Toys" /></td>
</tr>
<tr>
<td height="113">
<div align="center">
<table width="850" border="0" cellpadding="5" cellspacing="5">
<tr>
<td width="425">
<div align="center"><a href="https://www.aswgt.com/19AlphabeticalProductList.html" target="_blank"><strong><font face="Verdana, Arial, Helvetica, sans-serif">Alphabetical
Product List </font></strong></a></div>
</td>
<td width="399">
<div align="center"><a href="https://www.aswgt.com/biography.html" target="_blank"><strong><font face="Verdana, Arial, Helvetica, sans-serif">
About Us</font></strong></a></div>
</td>
</tr>
</table>
<p><font face="Verdana, Arial, Helvetica, sans-serif"><b><font size="5" color="#CC0000">We
are still shipping and the Postal Service is up and running. <br>
So ... orders <i>are</i> in order!</font></b></font></p>
</div></td>
</tr>
<tr>
<td><div align="center">
<table width="900" border="1" cellpadding="4">
<tr>
<td width="275" height="231">
<div align="center"><a href="floggers.html"><img src="images/floggers.fw.png" alt="Floggers from Adam and Gillian's " width="320" height="209" border="0" title="Floggers from Adam and Gillian's" /></a></div>
</td>
<td width="243" valign="top">
<div align="center"><a href="/welcome.html"><img src="images/ENTER.fw.png" width="320" height="213" border="0" usemap="#Map" /></a></div>
</td>
<td width="344">
<div align="center"><a href="/braidedwhips.html"><img src="images/whips.fw.png" width="320" height="190" title="Whips from Adam and Gillian's" border="0" alt="Whips from Adam and Gillian's" /></a></div>
</td>
</tr>
<tr>
<td>
<div align="center"><a href="/canes.html"><img src="images/Canes.fw.png" alt="Canes from Adam and Gillian's" width="320" height="168" title="Canes from Adam and Gillian's" border="0" /></a></div>
</td>
<td>
<div align="center"><a href="/straps.html"><img src="images/straps.fw.png" alt="Straps from Adam and Gillian's" width="320" height="238" border="0" title="Straps from Adam and Gillian's" /></a></div>
</td>
<td>
<div align="center"><a href="/paddles.html"><img src="images/paddles.fw.png" alt="Paddles from Adam and Gillian's" width="320" height="226" title="Paddles from Adam and Gillian's" border="0" /></a></div>
</td>
</tr>
</table>
<h3><font face="Verdana, Arial, Helvetica, sans-serif"><b><font size="+2">...
and much more.</font></b></font></h3>
</div>
</td>
</tr>
<tr>
<td height="203" valign="top">
<blockquote>
<blockquote>
<h3 align="center"><strong><em><font color="#000099" face="Verdana, Arial, Helvetica, sans-serif">Adam
and Gillian's </font></em></strong><font color="#000099" face="Verdana, Arial, Helvetica, sans-serif">offer
outstanding value at a reasonable price. Designed for pleasure and
built to last, our sensual floggers, leather paddles, punishment straps,
rattan canes, braided whips, toy-ture devices and other implements
of affection for the BDSM, Spankers and CP communities have become
"world famous."</font></h3>
<h3 align="center"><font color="#000099" face="Verdana, Arial, Helvetica, sans-serif">We
offer what is possibly the widest variety of domination implements
bench-crafted in one workshop by experienced lifestyle devotees.</font></h3>
<h3 align="center"> </h3>
<h3 align="center"><font face="Verdana, Arial, Helvetica, sans-serif"><strong><em><font color="#990000" size="5">What
can we make for you?</font></em></strong></font></h3>
<p align="center"><strong><em></em></strong></p>
</blockquote>
</blockquote></td>
</tr>
<tr>
<td height="100">
<div align="center"><font size="5" face="Verdana, Arial, Helvetica, sans-serif"><i>Adam
<font size="4">and</font> Gillian's Sensual Whips <font size="4">and</font>
Toys</i></font> <font face="Verdana, Arial, Helvetica, sans-serif"><br />
<font size="4">40 Grant Avenue, Copiague NY 11726-3817 <br />
<strong>(631) 842-1711</strong> siradam@ix.netcom.com</font></font></div>
</td>
</tr>
<tr>
<td>
<p align="center"><img src="images/CreditCards-horiz-06.jpg" alt="Adam and Gillian's Sensual Whips and Toys" width="105" height="24" />
<font face="Verdana, Arial, Helvetica, sans-serif">©aswgt, inc. 2022</font></p>
</td>
</tr>
</table>
<map name="Map" id="Map">
<area shape="rect" coords="234,-258,543,-56" href="https://www.aswgt.com/welcome.html" alt="ASWGT SENSUAL WHIPS & TOYS WEBSITE ENTER" title="ASWGT SENSUAL WHIPS & TOYS WEBSITE ENTER" />
</map>
</body>
</html>
nginx