Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 3 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://coreyfishes.com/robots.txt
301 MovedPermanently
https://coreyfishes.com/robots.txt
302 Found
https://coreyfishes.com/error/404/
200 OK
Показать содержимое robots.txt
<!DOCTYPE html>
<html class="k-lens-error">
<head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1">
<meta name="description" content="Corey Arnold is an American photographer and commercial fisherman from Portland, Oregon and Alaska." />
<meta name="author" content="Corey Arnold - Photographer" />
<meta name="keywords" content="photography, Corey Arnold, portfolio, commercial fishing, sea, adventure, artist, Portland, documentary, seafood, bering sea" />
<meta name="viewport" content="width=device-width, initial-scale=1, minimum-scale=1, maximum-scale=1">
<link rel="shortcut icon" type="image/x-icon" href="https://coreyfishes.com/koken/storage/themes/coreyarnold/favicon.ico"/>
<title>404 -
Corey Arnold - Photographer</title>
<link rel="stylesheet" type="text/css" href="/koken/storage/themes/coreyarnold/css/normalize.css" />
<link rel="stylesheet" type="text/css" href="/koken/storage/themes/coreyarnold/css/kicons.css" />
<link rel="stylesheet" type="text/css" href="/koken/storage/themes/coreyarnold/css/kshare.css" />
<link rel="stylesheet" type="text/css" href="/koken/storage/themes/coreyarnold/css/ca-icons.css" />
<link rel="stylesheet" type="text/css" href="/koken/storage/themes/coreyarnold/css/coreyarnold.css" />
<link id="koken_settings_css_link" rel="stylesheet" type="text/css" href="/settings.css.lens" />
<!--[if IE]>
<script src="/koken/app/site/themes/common/js/html5shiv.js"></script>
<![endif]-->
<meta name="generator" content="Koken 0.22.24" />
<meta name="theme" content="CoreyArnold (Based on Boulevard theme) 1.3.8" />
<script src="//ajax.googleapis.com/ajax/libs/jquery/1.12.4/jquery.min.js"></script>
<script>window.jQuery || document.write('<script src="/koken/app/site/themes/common/js/jquery.min.js"><\/script>')</script>
<script src="/koken.js?0.22.24"></script>
<script>$K.location = $.extend($K.location, {"here":"\/error\/404\/","parameters":{"page":1,"url":"\/error\/404\/","base_folder":"\/"},"page_class":"k-lens-error"});</script>
<link rel="alternate" type="application/atom+xml" title="Corey Arnold - Photographer: All uploads" href="/feed/content/recent.rss" />
<link rel="alternate" type="application/atom+xml" title="Corey Arnold - Photographer: Essays" href="/feed/essays/recent.rss" />
<link rel="alternate" type="application/atom+xml" title="Corey Arnold - Photographer: Timeline" href="/feed/timeline/recent.rss" />
<script type="text/javascript" src="//use.typekit.net/qss0wrn.js"></script>
<script type="text/javascript">try{Typekit.load();}catch(e){}</script>
<script src="/koken/app/site/themes/common/js/jquery.pjax.js?0.22.24"></script>
<script src="/koken/storage/themes/coreyarnold/js/jquery.mousewheel.js"></script>
<script src="/koken/storage/themes/coreyarnold/js/corey-arnold.js"></script>
<script src="/koken/storage/themes/coreyarnold/js/tinynav.min.js"></script>
<script src="/koken/storage/themes/coreyarnold/js/jquery.sidr.min.js"></script>
<script src="/koken/storage/themes/coreyarnold/js/jquery-ui-1.9.2.custom.min.js"></script>
<script type="text/javascript">
var _gaq = _gaq || [];
_gaq.push(['_setAccount', 'UA-641372-7']);
_gaq.push(['_trackPageview']);
_gaq.push(['_anonymizeIP', false]);
(function() {
var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
})();
</script>
</head>
<body class="k-lens-error">
<div id="container">
<header>
<div class="in">
<div id="site-title">
<a id="nav-link" href="#" class="ico-menu"></a> <a href="/" title="Home" data-koken-internal><img src="/koken/storage/themes/coreyarnold/img/logo_ca.svg" alt="Corey Arnold - Photographer" class="custom_logo"></a>
<!-- <h2 class="tag">Photographer / Fisherman</h2>
-->
</div>
<div id="nav-box">
<nav>
<ul class="k-nav-list k-nav-root "><li><a data-koken-internal title="Cities Gone Wild" href="/albums/urban-wildlife-national-geographic/">Cities Gone Wild</a></li><li><a data-koken-internal title="Unplugging the Selfie Generation" href="/albums/millennials-in-the-parks/">Unplugging the Selfie Generation</a></li><li><a data-koken-internal title="Aleutian Dreams" href="/albums/aleutian-dreams/">Aleutian Dreams</a></li><li><a data-koken-internal title="Hornsund" href="/albums/svalbard/">Hornsund</a></li><li><a data-koken-internal title="Graveyard Point" href="/albums/graveyard-point/">Graveyard Point</a></li><li><a data-koken-internal title="Fish-Work: The Bering Sea" href="/albums/fish-work-bering-sea/">Fish-Work: The Bering Sea</a></li><li><a data-koken-internal title="Fish-Work Europe" href="/albums/fish-work-europe/">Fish-Work Europe</a></li><li><a data-koken-internal title="Human Animals" href="/albums/human-animals/">Human Animals</a></li><li><a data-koken-internal title="Nord Norge" href="/albums/travels-in-norway/">Nord Norge</a></li><li><a data-koken-internal title="Fishing With My Dad" href="/albums/fishing-with-my-dad/">Fishing With My Dad</a></li><li><a data-koken-internal title="Wolf Tide" href="/albums/wolf-tide/">Wolf Tide</a></li></ul> <ul class="k-nav-list k-nav-root "><li><a data-koken-internal title="All Work Archives" href="/albums/">All Work Archives</a></li><li><a data-koken-internal title="Exhibitions" href="/exhibitions/">Exhibitions</a></li><li><a data-koken-internal title="Commissioned" href="/commissioned-1/">Commissioned</a></li><li><a data-koken-internal title="Press" href="/press-2/">Press</a></li></ul> <div style="display:inline-block;width:120px;">
<ul class="k-nav-list k-nav-root "><li><a target="_blank" title="Blog" href="http://blog.coreyfishes.com">Blog</a></li><li><a target="_blank" title="Store" href="http://coreyfishes.bigcartel.com/">Store</a></li><li><a data-koken-internal title="About" href="/about-5/">About</a></li><li><a data-koken-internal title="Contact" href="/contact/">Contact</a></li></ul> <div id="icons">
<a href="mailto:corey@coreyfishes.com" title="Email" class="email"><i class="kicon-email"></i></a><a href="http://facebook.com/coreyfishes" title="Facebook"><i class="kicon-facebook"></i></a> <a target="blank" href="http://instagram.com/arni_coraldo" class="ico-instagram"></a><a href="http://twitter.com/coreyfishes" title="Twitter"><i class="kicon-twitter"></i></a> </div>
</div>
</nav>
</div>
</header>
<div id="lane">
Whoops: 404. <a href="/" title="Head back home">Head back home</a>.
</div>
<footer>
</footer>
<script src="/koken/app/site/themes/common/js/share.js?0.22.24"></script>
</div> <!-- close #container -->
<span id="copyright">All images copyright Corey Arnold 2018</span>
</body>
</html>
PrestaShop
Apache