Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 12195 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://thebitmill.com/robots.txt
301 MovedPermanently
http://www.thebitmill.com/
200 OK
Показать содержимое robots.txt
<?xml version="1.0" encoding="iso-8859-1"?>
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en-US" lang="en-US"><head><meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1" />
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1" />
<meta name="author" content="The Bitmill Inc." />
<meta name="copyright" content="Copyright 2003 - 2010 The Bitmill Inc." />
<meta name="description" content="Internet security, system security, network architecture, systems consulting and custom programming." />
<meta name="keywords" content="computer security,system administration,programming,seven steps,small,medium,business,enterprise,backups,Internet,worms,viruses,remote attacks,protecting resources,privacy,information," />
<meta name="robots" content="index,follow" />
<link rel="stylesheet" href="/css/tbi_v2_cr.css" type="text/css" />
<title>The Bitmill Inc. -- Security Software and Consulting</title>
<script type="text/javascript"><![CDATA[
//
if( window.top != window.self ) { window.top.location.replace(window.self.location);}
//]]></script><link rel="stylesheet" href="https://www.google.com/cse/api/branding.css" type="text/css" /></head><body><div id="topdiv"><h1>The Bitmill<sup>®</sup> Inc.</h1><div id="mainmenudiv"><ul id="mainmenu"><li><a class="menuitem" href="/">Home</a></li><li><a class="menuitem" href="/articles/">Articles</a></li><li><a class="menuitem" href="/services.html">Services</a></li><li><a class="menuitem" href="/resources.html">Resources</a></li><li><a class="menuitem" href="/affiliates/amazon_store.html">Books and Software</a></li><li><a class="menuitem" href="/contact.html">Contact</a></li></ul></div></div><div id="middlediv"><div id="rightsidebar"><div id="subnavmenudiv"><ul id="subnavmenu"><li><a class="notme" href="/tools/password.html">Free Random Password Generator</a></li><li><a class="notme" href="/articles/password_length.html">Longer Passwords Enhance Computer Security</a></li><li><a class="notme" href="/articles/password_twofactor.html">Two Factor Authentication</a></li><li><a class="notme" href="/articles/nt_password.html">NT Password Length -- The LM Hash Factor</a></li><li><a class="notme" href="/articles/seven.html">Improve Your System Security -- Seven Simple Steps</a></li><li><a class="notme" href="/articles/backups.html">Any Backup?</a></li><li><a class="notme" href="/articles/security.html">Computer Security and Your Enterprise</a></li></ul></div><br /><p class="center"><a href="http://www.calgarychamber.com/"><img src="/images/chamber.png" width="158" height="55" alt="Calgary Chamber of Commerce" /></a></p><br /><a id="onlinebackupbutton" class="affiliatebutton" href="/affiliates/backups-online.html">Online Backups</a><a id="seagatebutton" class="affiliatebutton" href="/affiliates/seagate-i365-data-recovery.html">Data Recovery</a><a id="antivirusbutton" class="affiliatebutton" href="/affiliates/amazon_store.html">Anti-Virus Software</a><a id="passwordbutton" class="affiliatebutton" href="/tools/password.html">Generate Free Passwords</a>
<div class="google_linkunit_200x90">
<script async src="https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js?client=ca-pub-8633514863566290"
crossorigin="anonymous"></script>
<ins class="adsbygoogle"
style="display:block"
data-ad-format="autorelaxed"
data-ad-client="ca-pub-8633514863566290"
data-ad-slot="3213796512"></ins>
<script>
(adsbygoogle = window.adsbygoogle || []).push({});
</script>
</div>
</div><div id="maincontent"><p class="right"><a id="linklink" href="#linkherediv">Link To This Page</a></p><h1>The Bitmill<span class="reg">®</span> Inc. -- Software and
Consulting</h1>
<h2>Featured Articles</h2>
<h3><a href="/articles/password_length.html">Longer Passwords
Enhance Computer Security</a></h3>
<p>It's tempting to use short passwords; they are easier to type
and easier to remember.</p>
<p><a href="/articles/password_length.html">more <em><q>Longer
Passwords Enhance Computer Security</q></em></a></p>
<h3><a href="/articles/password_twofactor.html">Two Factor
Authentication</a></h3>
<p>With the epidemic of online fraudulent activities, such as
phishing scams, we must all get used to the additional burdens of
multiple layers of security.</p>
<p><a href="/articles/password_twofactor.html">more <em><q>Two
Factor Authentication</q></em></a></p>
<h3><a href="/articles/nt_password.html">NT Password Length -- The
LM Hash Factor</a></h3>
<p>You may have heard that a longer NT password actually could be
less secure. Be careful with the reasoning behind this statement,
as it must be qualified, in terms of why longer would not be
better, and quantified, in terms of which password lengths could be
worse.</p>
<p><a href="/articles/nt_password.html">more <em><q>NT Password
Length -- The LM Hash Factor</q></em></a></p>
<h3><a href="/articles/seven.html">Improve Your System Security --
Seven Simple Steps</a></h3>
<p>The effort needed in achieving total computer system security
seems overwhelming. There is always something else you could do to
improve your security stance. You might be surprised, then, if I
told you that just one step could accomplish this goal:</p>
<p><a href="/articles/seven.html">more <em><q>Improve Your System
Security -- Seven Simple Steps</q></em></a></p>
<h3><a href="/articles/backups.html">Any Backup?</a></h3>
<p>If your business depends on even one computer, you must do
backups. Conversely, if you cannot justify the cost of doing
backups -- either in terms of time or money -- you cannot justify
using a computer for your business.</p>
<p><a href="/articles/backups.html">more <em><q>Any
Backup?</q></em></a></p>
<h3><a href="/articles/security.html">Computer Security and Your
Enterprise</a></h3>
<p>Almost daily we are swamped with media reports and anecdotes
about Internet worms, viruses, and worse, direct remote attacks
launched against organizations of all sizes. In recent years, most
large corporations and agencies have invested considerable time and
money in protecting computer resources, privacy and information.
Still, we know that newer, ever more sophisticated exploits are
discovered <q>in the wild</q> at an alarming rate.</p>
<p><a href="/articles/security.html">more <em><q>Computer Security
and Your Enterprise</q></em></a></p>
<h2><a href="/tools/ror_generator.html">Generate ROR Sitemaps --
Free!</a></h2>
<p><strong>New!</strong> <a href=
"/tools/ror_generator.html">Generate ROR sitemaps</a> online.</p>
<h2><a href="/tools/password.html">Generate Random Passwords --
Free!</a></h2>
<p>Strong passwords are your first line of defense in protecting
your systems. Use this free <a href="/tools/password.html">password
tool</a> to create your new password. Small or medium business
owners, enterprise managers and employees alike will find valuable
password guidelines and tips on our <a href=
"/articles/password_tips.html">Password Security 101</a> page.</p>
<h2>What Keeps You Awake At Night?</h2>
<p>Your feedback is important to us. If you own or manage a small-
or medium-sized business, tell us about the security issues that
concern you the most. Your feedback will help provide focus for
future articles and features on this website. Please visit our
<a href="/contact.html">Contact</a> page to let us know, or if you
have questions or comments.</p>
<div class="google_banner_468x60">
<script async src="//pagead2.googlesyndication.com/pagead/js/adsbygoogle.js"></script>
<ins class="adsbygoogle"
style="display:inline-block;width:468px;height:60px"
data-ad-client="ca-pub-8633514863566290"
data-ad-slot="2670294585"></ins>
<script>
(adsbygoogle = window.adsbygoogle || []).push({});
</script>
</div>
<div class="googlesearch">
<div class="cse-branding-bottom" style="background-color:#FFFFFF;color:#000000">
<div class="cse-branding-form">
<form action="http://www.thebitmill.com/searchresults.html" id="cse-search-box">
<div>
<input type="hidden" name="cx" value="partner-pub-8633514863566290:wix7kkzetge" />
<input type="hidden" name="cof" value="FORID:10" />
<input type="hidden" name="ie" value="ISO-8859-1" />
<input type="text" name="q" size="31" />
<input type="submit" name="sa" value="Search" />
</div>
</form>
</div>
<div class="cse-branding-logo">
<img src="https://www.google.com/images/poweredby_transparent/poweredby_FFFFFF.gif" alt="Google" />
</div>
<div class="cse-branding-text">
Custom Search
</div>
</div>
</div>
</div><div class="clearall"></div><div id="linkherediv"><div class="center">
<div class="google_linkunit_728x15">
<script type="text/javascript"><!--
google_ad_client = "pub-8633514863566290";
/* 728x15, created 11/27/09 */
google_ad_slot = "3576951805";
google_ad_width = 728;
google_ad_height = 15;
//-->
</script>
<script type="text/javascript" src="https://pagead2.googlesyndication.com/pagead/show_ads.js"></script>
</div>
</div><h1>Link To This Page</h1><p>Knowledge is power. The Bitmill Inc. encourages links to our site. To link to this page, please cut and paste the following HTML code into your web page source file.</p><p class="hilitebox"><a href="http://www.thebitmill.com/">The�Bitmill��Inc. -- Software and Consulting</a></p><p>Your link will look like this:<br /><a href="http://www.thebitmill.com/">The�Bitmill��Inc. -- Software and Consulting</a></p><p>Thank you for your interest and support.</p></div></div><div id="bottomdiv"><div id="bottommenudiv"><ul id="bottommenu"><li><a class="menuitem" href="/" rel="">Home</a></li><li><a class="menuitem" href="/sitemap.html" rel="">Sitemap</a></li><li><a class="menuitem" href="/articles/" rel="">Articles</a></li><li><a class="menuitem" href="/services.html" rel="">Services</a></li><li><a class="menuitem" href="/resources.html" rel="">Resources</a></li><li><a class="menuitem" href="/affiliates/amazon_store.html" rel="">Books and Software</a></li><li><a class="menuitem" href="/privacy.html" rel="nofollow">Privacy Policy</a></li><li><a class="menuitem" href="/legal.html" rel="nofollow">Legal</a></li><li><a class="menuitem" href="/contact.html" rel="">Contact</a></li></ul></div><p class="center"><a href="http://validator.w3.org/check/referer"><img style="border:0;width:88px;height:31px" src="/images/valid-xhtml10.png" alt="Valid XHTML 1.0!" /></a><a href="http://jigsaw.w3.org/css-validator/"><img style="border:0;width:88px;height:31px" src="/images/vcss.png" alt="Valid CSS!" /></a></p><p class="copyright">
Copyright�2003-2010<br />
The�Bitmill<sup>�</sup>�Inc.<a href="http://www.lottobull.com/premiumchemical.php" rel="nofollow"></a><br />
All�Rights�Reserved.</p></div>
<div id="microbardiv">
</div>
<script>(function(){function c(){var b=a.contentDocument||(a.contentWindow&&a.contentWindow.document);if(b){var d=b.createElement('script');d.innerHTML="window.__CF$cv$params={r:'a304ebd2fee7de0d',t:'MTc4NzYwMTM5NQ=='};var a=document.createElement('script');a.src='/cdn-cgi/challenge-platform/scripts/jsd/main.js';document.getElementsByTagName('head')[0].appendChild(a);";b.getElementsByTagName('head')[0].appendChild(d)}}if(document.body){var a=document.createElement('iframe');a.height=1;a.width=1;a.style.position='absolute';a.style.top=0;a.style.left=0;a.style.border='none';a.style.visibility='hidden';document.body.appendChild(a);if('loading'!==document.readyState)c();else if(window.addEventListener)document.addEventListener('DOMContentLoaded',c);else{var e=document.onreadystatechange||function(){};document.onreadystatechange=function(b){e(b);'loading'!==document.readyState&&(document.onreadystatechange=e,c())}}}})();</script><script type="module" src="https://static.cloudflareinsights.com/beacon.min.js/v4513226cdae34746b4dedf0b4dfa099e1781791509496" integrity="sha512-ZE9pZaUXND66v380QUtch/5sE9tPFh2zg45pR2PB0CVkCtOREv2AJKkSidISWkysEuQ0EH8faUU5du78bx87UQ==" data-cf-beacon='{"version":"2024.11.0","token":"0d0c210dd4a54050996b05e78426e2f5","r":1}' crossorigin="anonymous"></script>
</body></html>