Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 3 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://foleygallery.com/robots.txt
301 MovedPermanently
http://www.foleygallery.com//robots.txt
302 Found
http://www.foleygallery.com/exception/info
200 OK
Показать содержимое robots.txt
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset='utf-8'>
<meta content='width=device-width, initial-scale=1.0, user-scalable=yes' name='viewport'>
<link rel="stylesheet" href="https://cdnjs.cloudflare.com/ajax/libs/Swiper/4.4.6/css/swiper.min.css"
integrity="sha256-5l8WteQfd84Jq51ydHtcndbGRvgCVE3D0+s97yV4oms=" crossorigin="anonymous" />
<meta name="robots" content="noindex, nofollow">
<link rel="stylesheet" href="/build/frontendBase.c4f2e1f3.css">
<meta name="description" content="FOLEY brings together fine line and obsessive precision in the disciplines of drawing, cut paper, painting, and photography. Michael Foley opened Foley Gallery in the fall of 2004 after several years of working with notable photography galleries including Fraenkel Gallery, Howard Greenberg Gallery, and Yancey Richardson Gallery. He is on the faculty of the School of Visual Arts where he teaches and lectures on issues in contemporary photography.">
<title>Foley Gallery</title>
<link rel="shortcut icon" href="https://s3.amazonaws.com/files.collageplatform.com.prod/image_cache/favicon/application/5a591ba86aa72cee7e8b4567/9f9940b9d6cf8533eb53024ec346c85a.png">
<meta property="og:description" content="FOLEY brings together fine line and obsessive precision in the disciplines of drawing, cut paper, painting, and photography. Michael Foley opened Foley Gallery in the fall of 2004 after several years of working with notable photography galleries including Fraenkel Gallery, Howard Greenberg Gallery, and Yancey Richardson Gallery. He is on the faculty of the School of Visual Arts where he teaches and lectures on issues in contemporary photography." />
<meta property="twitter:description" content="FOLEY brings together fine line and obsessive precision in the disciplines of drawing, cut paper, painting, and photography. Michael Foley opened Foley Gallery in the fall of 2004 after several years of working with notable photography galleries including Fraenkel Gallery, Howard Greenberg Gallery, and Yancey Richardson Gallery. He is on the faculty of the School of Visual Arts where he teaches and lectures on issues in contemporary photography." />
<link type="text/css" rel="stylesheet" href="//fast.fonts.net/cssapi/b5014fcf-f609-453c-af9d-7748ae9232e9.css"/>
<meta name="google-site-verification" content="fLRScljRkUAuTBF1_afzs55xrlsXUVlqwYgyxB7vVqs" />
<link rel="stylesheet" type="text/css" href="/style.bd5749d9d67832823c8d4f25cb85b304.css"/>
<script type="text/javascript">
if (!location.hostname.match(/^www\./)) {
if (['foleygallery.com'].indexOf(location.hostname) > -1) {
location.href = location.href.replace(/^(https?:\/\/)/, '$1www.')
}
}
</script>
<script src="//ajax.googleapis.com/ajax/libs/jquery/1.11.2/jquery.min.js"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/Swiper/4.4.6/js/swiper.min.js"
integrity="sha256-dl0WVCl8jXMBZfvnMeygnB0+bvqp5wBqqlZ8Wi95lLo=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/justifiedGallery/3.6.5/js/jquery.justifiedGallery.min.js"
integrity="sha256-rhs3MvT999HOixvXXsaSNWtoiKOfAttIR2dM8QzeVWI=" crossorigin="anonymous"></script>
<script>window.jQuery || document.write('<script src=\'/build/jquery.8548b367.js\'><\/script>');</script>
<script src="/build/runtime.d94b3b43.js"></script><script src="/build/jquery.8548b367.js"></script>
<script src="/build/jquery.nicescroll.min.js.db5e58ee.js"></script>
<script src="/build/jquery.lazyload.min.js.32226264.js"></script>
<script src="/build/vendorJS.fffaa30c.js"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/jarallax/1.12.4/jarallax.min.js" integrity="sha512-XiIA4eXSY4R7seUKlpZAfPPNz4/2uzQ+ePFfimSk49Rtr/bBngfB6G/sE19ti/tf/pJ2trUbFigKXFZLedm4GQ==" crossorigin="anonymous" referrerpolicy="no-referrer"></script>
<script type="text/javascript">
var langInUrl = false;
var closeText = "Close";
var zoomText = "Zoom";
</script>
<script type="text/javascript">
$(document).ready(function () {
$('body>#supersized, body>#supersized-loader').remove();
});
var frontendParams = {
currentScreen: null,
};
</script>
<script src="/build/headerCompiledJS.3b1cf68a.js"></script>
<script src="/build/frontendBase.4818ec01.js"></script>
<script type="text/javascript">
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'UA-132203922-1');
</script>
<!-- Global site tag (gtag.js) - Google Analytics -->
<script async src="https://www.googletagmanager.com/gtag/js?id=UA-132203922-1"></script>
<script>
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'UA-132203922-1');
</script>
<script type="text/javascript" src="/scripts.c3f7d4d29477852b3c7cb6b755ee3a3e.js"></script>
<script src="https://www.recaptcha.net/recaptcha/api.js?render=6LfIL6wZAAAAAPw-ECVAkdIFKn-8ZQe8-N_5kUe8"></script>
</head>
<body class="
">
<header class='main-header error-page '>
<div class='container'>
<a class='logo' href='/'><img itemprop="image" class="alt-standard" alt="Foley Gallery" src="https://s3.amazonaws.com/files.collageplatform.com.prod/application/5a591ba86aa72cee7e8b4567/8e73ccc441064aa8a3b664d5fc8ec661.png" width="250"/></a><nav class='main'><a href="/shows">Shows</a><a href="/talent">Talent</a><a href="/shop">Shop</a><a href="/news">News</a><a href="/details">Details</a></nav><nav class='languages'></nav><div class="mobile-menu-wrapper"><nav class='mobile'><a class="menu" href="#">Menu</a><div class="navlinks"><a href="/shows">Shows</a><a href="/talent">Talent</a><a href="/shop">Shop</a><a href="/news">News</a><a href="/details">Details</a></div></nav></div>
</div>
</header>
<div id="contentWrapper" tabindex="-1" class="contentWrapper">
<div class='container'>
<div class='text paragraph-styling'>
<div class="container">
<header class="section-header divider"><h1>Error 404</h1></header>
<div class='container'>
<p>Sorry, the page you've requested does not exist. Please continue to the <a
href="/">homepage</a>.</p>
</div>
</div>
</div>
</div>
</div>
<footer class="divider show4col"><div class="container clearfix"><div class='divider'></div><div class='footer-cols'><div class="footer-col1"><p>Foley Gallery</p></div><div class="footer-col2"><p><span style="letter-spacing: 0.24px;">59 Orchard Street New York, NY 10002</span></p></div><div class="footer-col3"><p><span style="letter-spacing: 0.24px;">212.244.9081</span></p></div></div><span><a href="/site-index" class="footer-siteindex">Site Index</a></span></div></footer>
</body>
</html>
nginx