Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 8577 байт. Загружен за: 0сек.
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://diegolopez.es/robots.txt
302 Found
http://diegolopez.es/en
200 OK
Показать содержимое robots.txt
<!DOCTYPE html>
<html>
<head>
<script type="text/javascript" src="/common/js/fb.js"></script>
<script type="text/javascript" src="/js/jquery-1.11.1.min.js"></script>
<script type="text/javascript" src="/js/_main.js"></script>
<link rel="canonical" href="http://diegolopez.es" />
<link rel="stylesheet" type="text/css" href="/css/index.css" />
<script type="text/javascript" src="/common/js/preload.js"></script>
<script type="text/javascript" src="/js/index.js"></script>
<script type="text/javascript" src="/js/jquery.backstretch.min.js"></script>
<script type="text/javascript" src="/js/jquery.mousewheel.js"></script>
<script type="text/javascript" src="/js/jquery.easing.1.3.min.js"></script>
<script type="text/javascript" src="/js/rightButton.js"></script>
<title>When nature becomes art. Andalusian Nature Photographer. - Diego Lopez - Nature Photographer</title>
<link rel="shortcut icon" type="image/png" href="/images/favicon.png" />
<link rel="apple-touch-icon" href="/images/ios-icon57.png" />
<link rel="apple-touch-icon" sizes="72x72" href="/images/ios-icon72.png" />
<link rel="apple-touch-icon" sizes="114x114" href="/images/ios-icon114.png" />
<meta charset="utf-8" />
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1" />
<!--<meta name="viewport" content="width=device-width, initial-scale=1, maximum-scale=1" />-->
<meta name="viewport" content="width=device-width, initial-scale=1.0, maximum-scale=1.0, user-scalable=0" />
<meta name="language" content="en" />
<link href="http://fonts.googleapis.com/css?family=Open+Sans:600,700|Abel" rel="stylesheet" type="text/css" />
<!--<link rel="stylesheet" type="text/css" href="/common/css/pure.css" />-->
<link rel="stylesheet" type="text/css" href="/common/css/init.css" />
<link rel="stylesheet" type="text/css" href="/css/main.css" />
<!--<link rel="stylesheet" type="text/css" href="/common/css/960gs/960.css" />-->
<!--<link rel="stylesheet" type="text/css" href="/common/css/960gs/960_12_col.css" />-->
<meta property="og:title" content="When nature becomes art. Andalusian Nature Photographer. - Diego Lopez - Nature Photographer" />
<meta property="og:type" content="website" />
<meta property="og:url" content="http://diegolopez.es/en" />
<meta property="og:description" content="Join us on this journey of experiences and discover the art of nature. The best images of the nature of Andalusia." />
<meta property="og:image" content="http://diegolopez.es/images/logoBig.png" /> <meta name="description" content="Join us on this journey of experiences and discover the art of nature. The best images of the nature of Andalusia." />
<meta name="keywords" content="" />
<!-- <link rel="stylesheet" href="https://dl.dropboxusercontent.com/s/5eyy79kon6uacdk/metaViewer.css">
<script src="https://dl.dropboxusercontent.com/s/849qb6upoblzoi6/metaViewer.js"></script>
<style type="text/css">.metaViewer{margin-left:-650px;}</style> -->
</head>
<body id="index"><script type="text/javascript">
/*<![CDATA[*/
$PRELOAD(['/up/galerias/2/foto/cazorla13-118.jpg','/up/galerias/9/foto/17.jpg'],"preloader");
/*]]>*/
</script>
<a class="menuButton" href="javascript:void(0)"
data-toggle="/en/site/toggleMenu">Menu</a>
<div class="menuBox">
<div class="i18n">
<a class="first " href="/es">Esp</a><a class="active" href="/en">Eng</a> </div>
<div class="menuInner">
<a id="logo" class="notext" href="http://diegolopez.es">Diego Lopez - Nature Photographer</a>
<ul class="menu">
<li class="first"><a id="opHome" class="half notext" href="http://diegolopez.es">Inicio</a></li><li><a id="opBio" class="half" href="/en/bio">Bio</a></li><li><a id="opGalerias" data-toggle="/en/site/toggleSubmenu" class="half subMenu " href="javascript:void(0)">Galleries</a><ul id="subMenuGalerias"><li><a class=" first" href="/en/galeria/2/andalusia">Andalusia</a></li><li><a href="/en/galeria/9/the-colour-kingdom">The colour kingdom</a></li><li><a href="/en/galeria/3/alive">Alive</a></li><li><a href="/en/galeria/15/andalusian-rural-landscape">Andalusian rural landscape</a></li><li><a href="/en/galeria/6/spaces">SPACES</a></li><li><a href="/en/galeria/1/serenity">Serenity</a></li><li><a href="/en/galeria/14/finland-autumn">finland autumn</a></li><li><a href="/en/galeria/11/decode">DECODE</a></li><li><a href="/en/galeria/8/battlefield">Battlefield</a></li></ul><div class="clear"></div></li><li><a id="opVideo" class="half" data-defaultlink="/en/galeria/13/video" data-vimeolink="http://vimeo.com/diegolopeznaturephoto" href="/en/galeria/13/video">Video</a></li><li><a id="opArte" class="half" href="/en/galeria/10/art">Art</a></li><li><a id="opViajes" class="half" target="_blank" href="http://www.wildphotoescape.com/en/viajes">Tours</a></li><li><a id="opBlog" target="_blank" class="half" href="http://www.diegolopez.es/blog/">Blog</a></li><li><a id="opContacto" class="half last" href="/en/contact">Contact</a></li> </ul>
<a href="http://www.wildphotoescape.com/" class="half notext" id="wild-photo-escape" class="notext" title="Wild Photo Escape" target="_blank">Wild Photo Escape</a>
<div class="socialNets half">
<a href='https://www.facebook.com/pages/diegolopezes-Nature-Photographer/186907164680420' id='social-fb' target='_blank' class='social notext' title='Follow me on Facebook'>Follow me on Facebook</a><a href='https://plus.google.com/u/0/104023244521552835317/posts/p/pub' id='social-gp' target='_blank' class='social notext' title='Follow me on Google+'>Follow me on Google+</a><a href='http://vimeo.com/diegolopeznaturephoto' id='social-vm' target='_blank' class='social notext' title='Follow me on Vimeo'>Follow me on Vimeo</a><a href='http://500px.com/diegolopez' id='social-5p' target='_blank' class='social notext' title='Follow me on 500px'>Follow me on 500px</a> </div>
<div class="clear tall"></div>
</div>
</div>
<div id="blocks">
<div class="block first">
<a class="scrollUp"></a>
<a class="info"></a>
<a class="scrollDown"></a>
</div>
<div class="block widthBg" data-image="/up/galerias/2/foto/cazorla13-118.jpg" data-key="block0">
<a class="scrollUp"></a>
<a class="info" href="/en/galeria/2/andalusia"><div>Andalusia<span>Enter</span></div></a>
<a class="scrollDown"></a>
</div> <div class="block widthBg" data-image="/up/galerias/9/foto/17.jpg" data-key="block1">
<a class="scrollUp"></a>
<a class="info" href="/en/galeria/9/the-colour-kingdom"><div>The colour kingdom<span>Enter</span></div></a>
<a class="scrollDown"></a>
</div> <div class="block widthBg" data-image="/up/galerias/3/foto/3.jpg" data-key="block2">
<a class="scrollUp"></a>
<a class="info" href="/en/galeria/3/alive"><div>Alive<span>Enter</span></div></a>
<a class="scrollDown"></a>
</div> <div class="block widthBg" data-image="/up/galerias/15/foto/1920x1080.jpg" data-key="block3">
<a class="scrollUp"></a>
<a class="info" href="/en/galeria/15/andalusian-rural-landscape"><div>Andalusian rural landscape<span>Enter</span></div></a>
<a class="scrollDown"></a>
</div> <div class="block widthBg" data-image="/up/galerias/6/foto/-rrl0557.jpg" data-key="block4">
<a class="scrollUp"></a>
<a class="info" href="/en/galeria/6/spaces"><div>SPACES<span>Enter</span></div></a>
<a class="scrollDown"></a>
</div> <div class="block widthBg" data-image="/up/galerias/1/foto/1.jpg" data-key="block5">
<a class="scrollUp"></a>
<a class="info" href="/en/galeria/1/serenity"><div>Serenity<span>Enter</span></div></a>
<a class="scrollDown"></a>
</div> <div class="block widthBg" data-image="/up/galerias/14/foto/portada.jpg" data-key="block6">
<a class="scrollUp"></a>
<a class="info" href="/en/galeria/14/finland-autumn"><div>finland autumn<span>Enter</span></div></a>
<a class="scrollDown"></a>
</div> <div class="block widthBg" data-image="/up/galerias/11/foto/bn-portada2.jpg" data-key="block7">
<a class="scrollUp"></a>
<a class="info" href="/en/galeria/11/decode"><div>DECODE<span>Enter</span></div></a>
<a class="scrollDown"></a>
</div> <div class="block widthBg" data-image="/up/galerias/8/foto/portada.jpg" data-key="block8">
<a class="scrollUp"></a>
<a class="info" href="/en/galeria/8/battlefield"><div>Battlefield<span>Enter</span></div></a>
<a class="scrollDown"></a>
</div></div>
<script type="text/javascript">
/*<![CDATA[*/
/*]]>*/
</script>
</body>
</html>
nginx