Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 3 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://anegdote.com/robots.txt
302 Found
http://www.bitspan.rs/
301 MovedPermanently
https://www.bitspan.rs/
200 OK
Показать содержимое robots.txt
<!doctype html>
<html>
<head>
<meta charset="utf-8">
<title>BITSPAN - Software Development</title>
<link rel="shortcut icon" href="favicon.png" type="image/x-icon" />
<meta name="viewport" content="width=device-width, initial-scale=1.0">
<!-- HTML5 shim, for IE6-8 support of HTML5 elements -->
<!--[if lt IE 9]>
<script src="../assets/js/html5shiv.js"></script>
<![endif]-->
<!-- Stylesheet /-->
<link href="//netdna.bootstrapcdn.com/twitter-bootstrap/2.3.1/css/bootstrap-combined.no-icons.min.css" rel="stylesheet">
<link href="//netdna.bootstrapcdn.com/font-awesome/3.1.1/css/font-awesome.css" rel="stylesheet">
<link rel="stylesheet" href="css/style.css">
<link rel="stylesheet" href="css/style-responsive.css">
<link rel="stylesheet" type="text/css" href="css/jquery.fancybox.css" media="all" />
</head>
<body>
<script>
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
ga('create', 'UA-44361033-1', 'bitspan.rs');
ga('send', 'pageview');
</script>
<!-- HEADER HOME -->
<section id="home">
<div class="row centered">
<h1 class="fade-it"><img alt="Bitspan" src="img/bitspan.png"></h1>
<div class="flexslider">
<ul class="slides">
<li>
<h2>software development</h2>
</li>
<li><h2>complete web solutions...</h2></li>
<li><h2>... powering your business.</h2></li>
</ul>
</div>
</div>
<!-- LITTLE LOGO SEE WHAT WE DO -->
<div id="down_button" class="fade-it"><a href="#whatwedo"></a></div>
<div class="social-header hidden-phone">
<a href="#whatwedo">What We Do</a>
<a href="#contact">Contact</a>
</div>
<!-- END LITTLE LOGO SEE WHAT WE DO -->
</section>
<!-- END HEADER HOME -->
<!-- NAVIGATION -->
<div class="navbar-wrapper">
<div class="navbar" id="navigation">
<div class="navbar-inner">
<button type="button" class="btn btn-navbar collapsed" data-toggle="collapse" data-target=".nav-collapse">
<span class="icon-bar"></span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
</button>
<a class="brand" href=""> <img src="img/bitspan_small.png"></a>
<div class="nav-collapse collapse" >
<ul class="nav pull-right">
<li><a href="#home" class="selected">Home</a></li>
<li><a href="#whatwedo">What We Do</a></li>
<li><a href="#contact">Contact</a></li>
</ul>
</div>
</div>
</div>
</div>
<!--</div>-->
<!-- END NAVIGATION --><!-- WHAT WE DO SECTION -->
<section id="whatwedo">
<div class="container">
<div class="row">
<div class="span12 centered">
<h2>What We Do</h2>
<div class="breaker"><span class="left"></span><div class="feather"></div><span class="right"></span></div>
</div>
</div>
<div class="row">
<div class="span12 centered">
<p class="subtittle" >complete web-based solutions </p>
</div>
</div>
<div class="row">
<div class="span3">
<div class="box">
<div class="box_icon">
<i class="icon-code icon-3x"></i>
</div>
<h6><strong>Development</strong></h6>
<p>
Bitspan offers complete development of sites and applications and integration with database and services.
</p>
</div>
</div>
<div class="span3">
<div class="box">
<div class="box_icon">
<i class="icon-pencil icon-3x"></i>
</div>
<h6><strong>Consulting</strong></h6>
<p>
Each website is unique and we will help you develop your idea into a full-fledged working product.
</p>
</div>
</div>
<div class="span3">
<div class="box">
<div class="box_icon">
<i class="icon-keyboard icon-3x"></i>
</div>
<h6><strong>Maintenance</strong></h6>
<p>
Web hosting, database management, domain registartion, DNS setup... We worry about it, so you don't have to.
</p>
</div>
</div>
<div class="span3">
<div class="box">
<div class="box_icon">
<i class="icon-camera icon-3x"></i>
</div>
<h6><strong>Design</strong></h6>
<p>
Provide us with a design, or we can help you create memorable web presence.
</p>
</div>
</div>
</div>
</div>
</section>
<!-- END SERVICES -->
<!-- CONTACT SECTION -->
<section id="contact">
<div class="container">
<div class="row">
<div class="span12 centered">
<h2>Contact us</h2>
<div class="breaker">
<span class="left"></span>
<div class="feather"></div>
<span class="right"></span>
</div>
</div>
</div>
<div class="row">
<div class="span12 centered">
<p class="subtittle" >Think we might help? We'd love to hear from you.</p>
</div>
</div>
<div class="row">
<div class="span7">
<p>If you are looking for a reliable partner for building your online business, please get in touch. Bitspan can help you every step of the way - from the initial planning to development and system administration for your site.</p>
<p>Our expertise is in:</p>
<ul>
<li>Network programming, web services and data mining using appropriate technologies</li>
<li>Building robust and versatile web applications</li>
<li>Mobile-first development</li>
<li>Database architecture and management</li>
<li>Server administration</li>
</ul>
<p>It is our policy not to publically advertise on our clients' websites, so please get in touch and we can provide you with our portfolio.</p>
</div>
<div class="span5">
<div class="info">
<p class="contactEmail">Email: <a href="mailto:office@bitspan.rs">office@bitspan.rs</a></p>
</div>
</div>
</div>
</div>
</section>
<!-- END CONTACT SECTION -->
<!-- FOOTER -->
<footer>
<!-- COPYRIGHT -->
<div class="container">
<div class="row">
<div class="span6 center">
<img alt="Bitspan" src="img/bitspan_footer.png">
</div>
<div class="span6">
<p class="copyright text-right center">
<a href="#home">Home</a> | <a href="#whatwedo">What We Do</a> | <a href="#contact">Contact</a>
</p>
<p class="copyright text-right center">© 2010 - 2026 Bitspan </p>
</div>
</div>
</div>
</footer>
<!-- END FOOTER -->
<!-- JAVA SCRIPTS -->
<script src="js/jquery-1.9.1.min.js" type="text/javascript"></script>
<script src="js/modernizr.custom.js" type="text/javascript" ></script>
<script src="js/jquery.scrollto.js"></script>
<script src="js/waypoints.min.js" type="text/javascript"></script>
<script src="js/jquery.tweet.js" type="text/javascript"></script>
<script src="js/custom.js" type="text/javascript"></script>
<script src="js/bootstrap.js"></script>
<script src="js/jquery.flexslider.js"></script>
<script src="js/jquery.fancybox.pack.js" type="text/javascript" ></script>
<script src="js/jquery.fancybox-media.js?v=1.0.0" type="text/javascript"></script>
<script src="js/retina.js"></script>
<script type="text/javascript">
var sc_project=9540165;
var sc_invisible=1;
var sc_security="8e861576";
var scJsHost = (("https:" == document.location.protocol) ?
"https://secure." : "http://www.");
document.write("<sc"+"ript type='text/javascript' src='" +
scJsHost+
"statcounter.com/counter/counter.js'></"+"script>");
</script>
<noscript><div class="statcounter"><a title="hit counter"
href="http://statcounter.com/free-hit-counter/"
target="_blank"><img class="statcounter"
src="http://c.statcounter.com/9540165/0/8e861576/1/"
alt="hit counter"></a></div></noscript>
<!--
*************** RETINA JS FUNCTIONALITY ****************
The script assumes you use Apple's prescribed high-resolution modifier (@2x) to denote
high-resolution image variants on your server.
For example, if you have an image on your page that looks like this:
<img src="/images/my_image.png" />
The script will check your server to see if an alternative image exists at this path:
"/images/my_image@2x.png"
That's it!
:)
<!--RETINA JS END-->
<!-- END JAVA SCRIPTS -->
</body>
</html>
nginx