Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 3 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
https://thinkport.org/robots.txt
302 Found
https://www.thinkport.org/page-no-longer-available.html
302 Found
https://thinkport.org/page-no-longer-available.html
200 OK
Показать содержимое robots.txt
<!DOCTYPE html>
<html lang="en">
<head>
<!-- Google Tag Manager -->
<script>(function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':
new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],
j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src=
'https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);
})(window,document,'script','dataLayer','GTM-NW79NRB');</script>
<!-- End Google Tag Manager -->
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>Thinkport.org | Leaders in Educational Products</title>
<link rel="shortcut icon" href="assets/img/thinkport.ico" />
<!-- CSS START -->
<link href="assets/css/bootstrap.min.css" rel="stylesheet">
<link href="assets/css/style.css" rel="stylesheet">
<link href="search/search.css" rel="stylesheet">
<!-- CSS END -->
<!--[if lt IE 9]>
<script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
<script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
<![endif]-->
<script>
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
ga('create', 'UA-70860467-1', 'auto');
ga('send', 'pageview');
</script>
</head>
<body>
<!-- Google Tag Manager (noscript) -->
<noscript><iframe src="https://www.googletagmanager.com/ns.html?id=GTM-NW79NRB"
height="0" width="0" style="display:none;visibility:hidden"></iframe></noscript>
<!-- End Google Tag Manager (noscript) -->
<!-- LOADER START -->
<div class="loader-wrapper">
<div class="spinner">
<div class="rect1"></div>
<div class="rect2"></div>
<div class="rect3"></div>
<div class="rect4"></div>
<div class="rect5"></div>
</div>
</div>
<!-- LOADER END -->
<!-- HEADER START -->
<div id="headerContent"></div>
<!-- HEADER END -->
<!-- SITE CONTENT WRAPPER START -->
<div class="site-content-wrapper">
<div class="container">
<!-- FEATURED POST START -->
<!--article class="featured-post">
<a href="single.html" title="Single">
<div class="featured-post-image" style="background-image:url(assets/img/featured-post.jpg);">
<div class="featured-post-desc">
<div class="category">Discovery</div>
<h2>They Are The Most Wonderful Places I Have Ever Seen. That Day We Walked Until It Got Dark</h2>
<ul class="post-information">
<li><i class="fa fa-user"></i> Stew Jackson</li>
<li><i class="fa fa-calendar"></i> June, 18, 2015</li>
<li><i class="fa fa-comment"></i> 2 Comment</li>
</ul>
</div>
</div>
</a>
</article-->
<!-- FEATURED POST END -->
<!-- SITE CONTENT START -->
<div class="site-content">
<div class="row">
<!-- SITE CONTENT LEFT START -->
<div class="col-lg-9 col-sm-9 col-xs-12 site-content-left nopaddingleft">
<!-- HOME GRID PAGE START -->
<div class="grid-home-page homepage-version-tree clearfix">
<p class="breadcrumb"><a href="index.html">Home</a> — Page No Longer Available!</p>
<h2>Whoops!</h2>
<p>You have reached a page on Thinkport that is no longer available. </p>
<p>Please try the following pages to find your content: </p>
<p>Thinkport Home: <a href="https://www.thinkport.org/index.html">https://www.thinkport.org/index.html</a><br>
Thinkport Learning Resources: <a href="https://www.thinkport.org/learning-resources-overview.html">https://www.thinkport.org/learning-resources-overview.html </a><br>
Thinkport Online Courses: <a href="https://www.thinkport.org/online-courses-overview.html">https://www.thinkport.org/online-courses-overview.html </a><br>
Thinkport Education Community: <a href="https://www.thinkport.org/family.html">https://www.thinkport.org/family.html</a><br>
Thinkport Search: <a href="https://www.thinkport.org/search/search_results.html?search_text=">https://www.thinkport.org/search/search_results.html?search_text=</a></p>
<p>Need help finding something in particular? Email us at <strong><a href="mailto:thinkport@mpt.org">thinkport@mpt.org</a></strong>.</p>
<p>Thank you, the Thinkport Team </p>
<div>
<div> </div>
<div> </div>
</div>
<p> </p>
</div>
<!-- HOME GRID PAGE END -->
</div>
<!-- SITE CONTENT LEFT END -->
<!-- SITE CONTENT RIGHT START -->
<div class="col-lg-3 col-sm-3 col-xs-12 site-content-right">
<aside class="sidebar-right sidebar">
<!-- WIDGET START -->
<div class="sidebar-right-wrap widget-box widget_newsletter">
<div class="widget-title">
<h4>Contact Us</h4>
</div>
Looking for more information? We're here to help.
<a href="https://www.google.com/url?q=https://docs.google.com/forms/d/e/1FAIpQLSdTNjGh2rBxygof6B1zud47wDllMOVjILB8km6LLrfKm9wK1g/viewform?usp%3Dsf_link&sa=D&source=hangouts&ust=1585150064742000&usg=AFQjCNE-qHJyHqrheury2BNmNqaj_rAy6g" target="_blank"><button type="submit" class="newsletter-button" style="background-color: mediumvioletred">Contact Us</button></a>
</div>
<!-- WIDGET END -->
<!-- WIDGET START -->
<div class="sidebar-right-wrap widget-box widget_text">
<div class="widget-title">
<h4>MPT</h4>
</div>
<div class="widget-content">
<a href="http://www.mpt.org/kids/" target="_blank"><img src="assets/img/mptlogoblack.jpg" alt="mpt logo" /></a><br>Visit <a href="http://www.mpt.org/kids/" target="_blank">MPT's guide</a> to educational programs for children. </div>
</div>
<!-- WIDGET END -->
<!-- WIDGET START -->
<!--div class="sidebar-right-wrap widget-box widget_jupios_about_widget">
<div class="widget-title">
<h4>About Us</h4>
</div>
<div class="widget-content">
<img src="assets/img/about-thinkport.png" alt="About" />
<p class="content">Thinkport is committed to providing excellent education products and resourses to Maryland educators and families.</p>
<br>
<p class="content" align="right"><a href="about.html">» Learn more</a></p>
</div>
</div-->
<!-- WIDGET END -->
<!-- WIDGET START -->
<!--div class="sidebar-right-wrap widget-box widget_categories">
<div class="widget-title">
<h4>Categories</h4>
</div>
<div class="widget-content">
<select>
<option value="-1">Select Category</option>
<option class="level-0" value="1">Fashion</option>
<option class="level-0" value="3">Life</option>
<option class="level-0" value="4">Sports</option>
</select>
</div>
</div-->
<!-- WIDGET END -->
<!-- WIDGET START -->
<div class="sidebar-right-wrap widget-box widget_newsletter">
<div class="widget-title">
<h4>Newsletter</h4>
</div>
Please subscribe to our newsletter!
<a href="https://public.govdelivery.com/accounts/MDPT/subscriber/new?qsp=MDPT_2" target="_blank"><button type="submit" class="newsletter-button">Subscribe</button></a>
</div>
<!-- WIDGET END -->
<!-- WIDGET START -->
<!--div class="sidebar-right-wrap widget-box widget_text">
<div class="widget-title">
<h4>Facebook</h4>
</div>
<div class="widget-content">
<div id="fb-root"></div>
<div class="fb-page" data-href="https://www.facebook.com/thinkport" data-width="100%" data-height="350" data-small-header="false" data-adapt-container-width="true" data-hide-cover="false" data-show-facepile="true" data-show-posts="false"></div>
</div>
</div-->
<!-- WIDGET END -->
<!-- WIDGET START -->
<!--div class="sidebar-right-wrap widget-box widget_instagram">
<div class="widget-title">
<h4>Instagram</h4>
</div>
<div class="widget-content">
<ul class="instagram-pics">
<li><a href="#" ><img src="assets/img/instagram1.jpg" alt="Instagram Image"></a></li>
<li><a href="#" ><img src="assets/img/instagram2.jpg" alt="Instagram Image"></a></li>
<li><a href="#" ><img src="assets/img/instagram3.jpg" alt="Instagram Image"></a></li>
<li><a href="#" ><img src="assets/img/instagram4.jpg" alt="Instagram Image"></a></li>
<li><a href="#" ><img src="assets/img/instagram5.jpg" alt="Instagram Image"></a></li>
<li><a href="#" ><img src="assets/img/instagram6.jpg" alt="Instagram Image"></a></li>
</ul>
</div>
</div-->
<!-- WIDGET END -->
</aside>
<br clear="all">
</div>
<!-- SITE CONTENT RIGHT END -->
</div>
</div>
<!-- SITE CONTENT END -->
</div>
</div>
<!-- SITE CONTENT WRAPPER END -->
<!-- FOOTER START -->
<footer class="footer">
<!-- INSTAGRAM START -->
<!--div class="footer-instagram">
<div id="owl2row-plugin" class="owl-carousels">
<div class="title">MPT On Instagram</div>
<div id="instafeed" class="owl2row-plugin"></div>
</div>
</div-->
<!-- INSTAGRAM END -->
<div class="footer-widget">
<div class="container">
<div class="row">
<aside class="sidebar-footer sidebar">
<!-- WIDGET START -->
<!--div class="col-sm-4 col-xs-12">
<div class="sidebar-right-wrap widget-box widget_text">
<div class="widget-title">
<h4>Text Widget</h4>
</div>
<div class="widget-content">
<p>Class aptent taciti sociosqu ad litora torquent per conubia nostra, per inceptos himenaeos. Curabitur sit amet euismod magna. Aliquam metus augue, vulputate quis dolor auctor, fringilla luctus diam. Sed nunc ex, placerat nec ullamcorper luctus, efficitur sed.</p>
<p>Class aptent taciti sociosqu ad litora torquent per conubia nostra, per inceptos himenaeos.</p>
</div>
</div>
</div-->
<!-- WIDGET END -->
<!-- WIDGET START -->
<!--div class="col-sm-4 col-xs-12">
<div class="sidebar-right-wrap widget-box widget_jupios_latest_latest_posts_widget">
<div class="widget-title">
<h4>Latest Posts</h4>
</div>
<div class="widget-content">
<ul class="latest-posts-widget">
<li>
<div class="image">
<a href="single.html">
<img src="assets/img/news18.jpg" alt="News">
</a>
</div>
<div class="category"><a href="category.html">Business</a></div>
<h3><a href="single.html">They Are The most Wonderful Places I Have Ever Seen. That Day We Walked Until It Got Dark</a></h3>
<div class="date"><i class="fa fa-calendar"></i> June, 18, 2015</div>
</li>
<li>
<div class="image">
<a href="single.html">
<img src="assets/img/news19.jpg" alt="News">
</a>
</div>
<div class="category"><a href="category.html">Business</a></div>
<h3><a href="single.html">Fashion Fades Only Style Remains The Same</a></h3>
<div class="date"><i class="fa fa-calendar"></i> June, 18, 2015</div>
</li>
</ul>
</div>
</div>
</div-->
<!-- WIDGET END -->
<!-- WIDGET START -->
<!--div class="col-sm-4 col-xs-12">
<div class="sidebar-right-wrap widget-box widget_tags">
<div class="widget-title">
<h4>Tags</h4>
</div>
<div class="widget-content">
<div class="tagcloud">
<a href="#">Alternative</a>
<a href="#">Magazine</a>
<a href="#">Trend</a>
<a href="#">Post Formats</a>
<a href="#">Arts</a>
<a href="#">Politics</a>
<a href="#">Blogger</a>
<a href="#">Clean</a>
<a href="#">Categories</a>
<a href="#">Code</a>
<a href="#">Posts</a>
<a href="#">Modern</a>
<a href="#">WordPress</a>
<a href="#">Man</a>
<a href="#">Female</a>
</div>
</div>
</div>
</div-->
<!-- WIDGET END -->
<p align="center"><a href="index.html">Home</a> | <a href="about.html">About</a> | <a href="contact.html">Contact</a> | <a href="privacy.html">Privacy</a> <!--<a| href="sitemap.html">Sitemap</a>--></p>
</aside>
</div>
</div>
</div>
<!-- COPYRIGHT START -->
<div class="copyright">
<div class="container">
<p>© <a href="http://www.mpt.org/" target="_blank">Maryland Public Television</a></p>
<div class="top-icon"><i class="fa fa-chevron-up"></i></div>
</div>
</div>
<!-- COPYRIGHT END -->
</footer>
<!-- FOOTER END -->
<!-- JAVASCRIPT START -->
<script src="assets/js/jquery.min.js"></script>
<script src="assets/js/bootstrap.min.js"></script>
<script src="assets/js/jupios.js"></script>
<!--SEARCH-->
<!-- <script type="text/javascript" src="search/search.js"></script>
<script type="text/javascript" src="search/search-init.js"></script> -->
<!--SEARCH END-->
<!-- JAVASCRIPT END -->
</body>
</html>
Apache