Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 8377 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://persvr.org/robots.txt
301 MovedPermanently
https://dojotoolkit.org/
200 OK
Показать содержимое robots.txt
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, minimum-scale=0.75, maximum-scale=1">
<meta name="format-detection" content="telephone=no">
<link rel="stylesheet" href="/css/index.css?1733666882429">
<script>
dojoConfig = { async: true, deps: [ 'dtk/nav' ] }
</script>
<script type="text/javascript" src="/scripts/dojo/dojo/dojo.js?1.17.3"></script>
<link rel="icon" href="/images/favicons/favicon.ico">
<link rel="apple-touch-icon-precomposed" href="/images/favicons/apple-touch-icon-precomposed.png">
<link rel="apple-touch-icon-precomposed" sizes="72x72" href="/images/favicons/apple-touch-icon-72x72-precomposed.png">
<link rel="apple-touch-icon-precomposed" sizes="114x114" href="/images/favicons/apple-touch-icon-114x114-precomposed.png">
<link rel="apple-touch-icon-precomposed" sizes="120x120" href="/images/favicons/apple-touch-icon-120x120-precomposed.png">
<link rel="apple-touch-icon-precomposed" sizes="144x144" href="/images/favicons/apple-touch-icon-144x144-precomposed.png">
<link rel="apple-touch-icon-precomposed" sizes="152x152" href="/images/favicons/apple-touch-icon-152x152.png">
<title>Dojo Toolkit</title>
</head>
<body class="home">
<div class="nav">
<div class="row">
<div class="small-3 columns">
<a href="/" class="navLogo icon-dojo icon"></a>
</div>
<div class="small-9 columns text-right">
<div class="mobileMenuToggle" data-menu-toggle></div>
<div class="menu">
<div class="mobileHeader">Menu</div>
<ul class="inline-list menuItems right">
<li><a href="/download/" class="downloadLink">Get Dojo</a></li>
<li><a href="/documentation/" class="docsLink">Docs</a></li>
<li><a href="/community/" class="communityLink">Community</a></li>
<li><a href="/blog/" class="blogLink">Blog</a></li>
</ul>
</div>
</div>
</div>
</div>
<main>
<section class="banner">
<div class="row">
<div class="small-12 columns small-centered bannerItem">
<div class="constrain">
<p><a href="https://dojo.io/"><img src="/images/projects/dojoio-256.png" class="bannerLogo" alt="dojo.io"></a> Visit <a href="https://dojo.io/">dojo.io</a> for documentation, examples, and more on Dojo, the Progressive Framework for Modern Web Apps and successor to the Dojo Toolkit</p>
</div>
</div>
</div>
</section>
<section class="heading">
<div class="text-center">
<div class="row">
<div class="small-centered medium-10 large-10 columns">
<h1>Dojo Toolkit 1.17</h1>
<p class="tagline">A JavaScript toolkit that saves you time and scales with your development process. Provides everything you need to build a Web app. Language utilities, UI components, and more, all in one place, designed to work together perfectly.</p>
<a href="/download/"><span class="button">Get Dojo</span></a>
</div>
</div>
</div>
</section>
<section class="trusted">
<div class="row">
<h2 class="sectionTitle">Trusted by</h2>
<div class="constrain">
<span class="company-cisco"></span>
<span class="company-jpmorgan"></span>
<span class="company-esri"></span>
<span class="company-intuit"></span>
<span class="company-adp"></span>
<span class="company-fanniemae"></span>
<span class="company-marriott"></span>
<span class="company-vmware"></span>
<span class="company-philips"></span>
<span class="company-ibm"></span>
<span class="company-mathworks"></span>
<span class="company-pearson"></span>
</div>
</div>
</section>
<section class="use">
<div class="row">
<div class="constrain">
<div class="three-up-icons">
<div class="medium-4 columns iconBlock guide" data-href="/reference-guide/">
<a href="/reference-guide/" class="icon-guide"></a>
<h4 class="blockLink"><a href="/reference-guide/">Reference Guide</a></h4>
<p>Documentation and examples for every part of The Dojo Toolkit.</p>
</div>
<div class="medium-4 columns iconBlock tutorials" data-href="/documentation/#tutorials">
<h3 class="sectionTitle">Use Dojo</h3>
<a href="/documentation/#tutorials" class="icon-tutorials"></a>
<h4 class="blockLink"><a href="/documentation/#tutorials">Tutorials</a></h4>
<p>Step-by-step guides focused on using Dojo to develop web apps.</p>
</div>
<div class="medium-4 columns iconBlock api" data-href="/api/">
<a href="/api/" class="icon-api"></a>
<h4 class="blockLink"><a href="/api/">API</a></h4>
<p>The hardcore, no-fluff API documentation for the Dojo Toolkit.</p>
</div>
</div>
</div>
</div>
</section>
<section class="support">
<div class="row">
<h2 class="sectionTitle" id="support">Help & Support</h2>
<div class="medium-2 columns medium-offset-0">
<a href="https://discourse.dojo.io/c/dojo1" class="icon mailingList">Dojo on Discourse</a>
</div>
<div class="medium-2 columns">
<a href="http://irc.lc/freenode/dojo/dtk_web_client@@@" class="icon irc">#dojo on IRC</a>
</div>
<div class="medium-2 columns">
<a href="https://gitter.im/dojo/dojo" class="icon irc">Dojo on Gitter</a>
</div>
<div class="medium-2 columns">
<a href="https://github.com/dojo/dojo" class="icon bug">Dojo on GitHub</a>
</div>
<div class="medium-2 columns">
<a href="http://stackoverflow.com/questions/tagged/dojo" class="icon stackoverflow">Stack Overflow</a>
</div>
<div class="medium-2 columns end">
<a href="https://www.sitepen.com" class="icon support">Commercial Support</a>
</div>
</div>
</section>
<section class="join">
<div class="row">
<div class="small-12 small-centered columns">
<div class="becomeContributor"><a href="/community/#contribute"><span class="button">Become a Contributor</span></a></div>
<div class="soc">
<a href="https://github.com/dojo" class="icon-github icon" title="Dojo on Github"></a>
<a href="http://twitter.com/DojoFramework" class="icon-twitter icon" title="Dojo on Twitter"></a>
<a href="https://www.facebook.com/groups/4375511291/" class="icon-facebook icon" title="Dojo on Facebook"></a>
<a href="https://plus.google.com/106701567946037375891/posts" class="icon-gplus icon" title="Dojo on Google Plus"></a>
</div>
</div>
</div>
</section>
<footer class="footer">
<div class="row">
<span class="foundation"><a href="https://openjsf.org/"><img
src="/images/foundation/openjs_foundation-logo-horizontal-color-dark_background.png" class="logo"
alt="OpenJS Foundation Logo"></a></span>
<p>Copyright <a href="https://openjsf.org">OpenJS Foundation</a> and Dojo Toolkit contributors. All rights
reserved. The <a href="https://openjsf.org">OpenJS Foundation</a> has registered trademarks and uses
trademarks. For a list of trademarks of the <a href="https://openjsf.org">OpenJS Foundation</a>, please see
our <a href="https://trademark-policy.openjsf.org">Trademark Policy</a> and <a
href="https://trademark-list.openjsf.org">Trademark List</a>. Node.js is a trademark of Joyent, Inc. and
is used with its permission. Trademarks and logos not indicated on the <a
href="https://trademark-list.openjsf.org">list of OpenJS Foundation trademarks</a> are trademarks™
or registered® trademarks of their respective holders. Use of them does not imply any affiliation with
or endorsement by them.</p>
<p><a href="https://openjsf.org">The OpenJS Foundation</a> | <a href="https://terms-of-use.openjsf.org">Terms of
Use</a> | <a href="https://privacy-policy.openjsf.org">Privacy Policy</a> | <a
href="https://bylaws.openjsf.org">OpenJS Foundation Bylaws</a> | <a
href="https://trademark-policy.openjsf.org">Trademark Policy</a> | <a
href="https://trademark-list.openjsf.org">Trademark List</a> | <a
href="https://www.linuxfoundation.org/cookies">Cookie Policy</a> | <a href="/license.html">Dojo
Toolkit License Information</a>
</p>
<script>
(function (i, s, o, g, r, a, m) {
i['GoogleAnalyticsObject'] = r; i[r] = i[r] || function () {
(i[r].q = i[r].q || []).push(arguments)
}, i[r].l = 1 * new Date(); a = s.createElement(o),
m = s.getElementsByTagName(o)[0]; a.async = 1; a.src = g; m.parentNode.insertBefore(a, m)
})(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
ga('create', 'UA-22088032-1', 'auto');
ga('send', 'pageview');
</script>
</div>
</footer>
</main>
</body>
</html>
Cloudflare