Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 4 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://fcforum.net/robots.txt
301 MovedPermanently
https://fcforum.net/robots.txt
302 Found
https://fcforum.net/404
301 MovedPermanently
https://fcforum.net/404/
200 OK
Показать содержимое robots.txt
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html xmlns="http://www.w3.org/1999/xhtml" lang="es-ES" prefix="og: http://ogp.me/ns#">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
<title>Free Culture Forum - 404</title>
<meta name="generator" content="WordPress 4.5.3" /> <!-- leave this for stats -->
<meta name=viewport content="width=device-width, initial-scale=1">
<link rel="shortcut icon" href="https://fcforum.net/wp-content/themes/lonelytree/images/favicon.ico" />
<link rel="alternate" type="application/rss+xml" title="Free Culture Forum RSS" href="https://fcforum.net/feed" />
<link rel="pingback" href="https://fcforum.net/xmlrpc.php" />
<link rel="alternate" type="application/rss+xml" title="Free Culture Forum » Inicio RSS de los comentarios" href="https://fcforum.net/inici/feed" />
<link rel='https://api.w.org/' href='https://fcforum.net/wp-json/' />
<link rel="EditURI" type="application/rsd+xml" title="RSD" href="https://fcforum.net/xmlrpc.php?rsd" />
<link rel="wlwmanifest" type="application/wlwmanifest+xml" href="https://fcforum.net/wp-includes/wlwmanifest.xml" />
<meta name="generator" content="WordPress 4.5.3" />
<link rel='shortlink' href='https://fcforum.net/404' />
<style type="text/css">
.qtranxs_flag_es {background-image: url(https://fcforum.net/wp-content/plugins/qtranslate/flags/es.png); background-repeat: no-repeat;}
.qtranxs_flag_en {background-image: url(https://fcforum.net/wp-content/plugins/qtranslate/flags/gb.png); background-repeat: no-repeat;}
.qtranxs_flag_ca {background-image: url(https://fcforum.net/wp-content/plugins/qtranslate/flags/ca.alt.png); background-repeat: no-repeat;}
</style>
<link hreflang="es" href="https://fcforum.net/404" rel="alternate" />
<meta name="generator" content="qTranslate-X 3.4.6.8" />
</head>
<body class="lang-es">
<div id="wrapper"> <!-- #wrapper ends in footer.php -->
<header>
<div id="logo">
<h1><a href="https://fcforum.net/"><img src="/wp-content/uploads/2016/08/free-culture-forum-derechos-democraticos-era-digital.png" alt="Free Culture Forum: Observatorio de Derechos Democráticos en la Era Digital"/></a>
</h1>
</div>
</header>
<div id="menuStyle">
<nav class="nav">
<div class="menu-home-menu-container"><ul id="menu-home-menu" class="menu nav-list"><li id="menu-item-3038" class="menu-item menu-item-type-post_type menu-item-object-page current-menu-item page_item page-item-2515 current_page_item menu-item-3038"><a href="https://fcforum.net/">Inicio</a></li>
<li id="menu-item-3046" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-3046"><a href="https://2009.fcforum.net/"><span>2009</span></a></li>
<li id="menu-item-3045" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-3045"><a target="_blank" href="https://2010.fcforum.net/">2010</a></li>
<li id="menu-item-3044" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-3044"><a href="https://2011.fcforum.net">2011</a></li>
<li id="menu-item-3041" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-3041"><a href="https://2012.fcforum.net/">2012</a></li>
<li id="menu-item-3040" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-3040"><a href="https://2013.fcforum.net/">2013</a></li>
<li id="menu-item-3043" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-3043"><a href="https://2014.fcforum.net/">2014</a></li>
<li id="menu-item-3042" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-3042"><a href="https://2015.fcforum.net/">2015</a></li>
<li id="menu-item-3053" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-3053"><a target="_blank" href="http://in-progress.fcforum.net/">Otros proyectos</a></li>
<li id="menu-item-3052" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-3052"><a target="_blank" href="http://d-evolution.fcforum.net/">D-Evolution</a></li>
</ul></div>
</nav>
</div>
<div id="qtranslate-mobil">
<ul class="language-chooser language-chooser-text qtranxs_language_chooser" id="qtranslate-chooser">
<li class="lang-es active"><a href="https://fcforum.net/" hreflang="es" title="ES (es)" class="qtranxs_text qtranxs_text_es"><span>ES</span></a></li>
<li class="lang-en"><a href="https://fcforum.net/en/" hreflang="en" title="EN (en)" class="qtranxs_text qtranxs_text_en"><span>EN</span></a></li>
<li class="lang-ca"><a href="https://fcforum.net/ca/" hreflang="ca" title="CA (ca)" class="qtranxs_text qtranxs_text_ca"><span>CA</span></a></li>
</ul><div class="qtranxs_widget_end"></div>
</div>
<div class="container">
<div id="qtranslate">
<ul class="language-chooser language-chooser-text qtranxs_language_chooser" id="qtranslate-chooser">
<li class="lang-es active"><a href="https://fcforum.net/" hreflang="es" title="ES (es)" class="qtranxs_text qtranxs_text_es"><span>ES</span></a></li>
<li class="lang-en"><a href="https://fcforum.net/en/" hreflang="en" title="EN (en)" class="qtranxs_text qtranxs_text_en"><span>EN</span></a></li>
<li class="lang-ca"><a href="https://fcforum.net/ca/" hreflang="ca" title="CA (ca)" class="qtranxs_text qtranxs_text_ca"><span>CA</span></a></li>
</ul><div class="qtranxs_widget_end"></div>
</div>
</div>
<div class="posts-wrap">
<div class="posts-wrap">
<div style="padding:20px 5%;"><p style="font-size:50px;margin-bottom:20px;">Ooops...</p>
<h1 style="font-size:100px;display:block;line-height:100px; padding-bottom:30px">404 :-/</h1>
</div>
</div>
<div style="clear:both"></div>
<footer>
<div style="text-align:center;">
Un proyecto de<br /><a href="https://xnet-x.net" title="ir a la web de Xnet" target="_blank" style="color: #d20459;"><img src="/wp-content/uploads/2015/11/xnet-150x150.png" alt="Xnet" style="width:100px"/></a>
</div>
<div style="text-align:left;">
<a rel="license" href="http://creativecommons.org/licenses/by-sa/3.0/">Licence CC BY-SA 3.0</a><br>
<a href="https://xnet-x.net/img/free-culture-forum-desc.png">Download FCForum Logo</a><br>
<a href="https://xnet-x.net/privacidad-y-condiciones">Política de Privacidad</a>
</div>
<div style="clear:both;"></div>
</footer>
<link rel="stylesheet" type="text/css" href="https://fcforum.net/wp-content/themes/lonelytree/style-home.css" media="screen">
<link rel='stylesheet' id='skeleton-body-fonts-css' href='https://fcforum.net/wp-content/themes/lonelytree/fonts/Droid-Sans?family=Droid+Sans:400,700' type='text/css' media='all' />
<script>var pltNewTabURLs = ["https:\/\/2010.fcforum.net\/","http:\/\/in-progress.fcforum.net\/","http:\/\/d-evolution.fcforum.net\/"];(function(){(function(e){var t;t=e.jQueryWP||e.jQuery;return t(function(e){return typeof e.fn.on=="function"?e("body").on("click","a",function(t){var n;n=e(this);if(e.inArray(n.attr("href"),pltNewTabURLs)>-1)return n.attr("target","_blank")}):typeof console!="undefined"&&console!==null?console.log("Page Links To: Some other code has overridden the WordPress copy of jQuery. This is bad. Because of this, Page Links To cannot open links in a new window."):void 0})})(window)}).call(this);</script>
</div> <!-- end div#wrapper, begins in header.php -->
<script type="text/javascript" src="/wp-content/themes/lonelytree/js/mobile-responsive.js" async="async"></script>
<script type="text/javascript" src="/wp-content/themes/lonelytree/js/mobile-detect.js" defer="defer"></script>
<script type="text/javascript" src="/wp-content/themes/lonelytree/js/piwik.js" async="async"></script>
<noscript><p><img src="//piwik.xnet-x.net/piwik.php?idsite=13" style="border:0;" alt="" /></p></noscript>
</body>
</html>
WordPress
Apache