Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 3 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://emeld.org/robots.txt
301 MovedPermanently
https://linguistlist.org/emeld
301 MovedPermanently
https://linguistlist.org/emeld/
200 OK
Показать содержимое robots.txt
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<title> EMELD | The LINGUIST List </title>
<meta name="viewport" content="width=device-width, initial-scale=1.0"/>
<meta name="description" content=""/>
<meta name="author" content=""/>
<!-- Social Media icons -->
<meta property="og:image" content="http://linguistlist.org/static/img/lllogo-large.jpg" />
<meta property="og:image:secure_url" content="https://linguistlist.org/static/img/lllogo-large.jpg" />
<meta property="og:description" content="The LINGUIST List, International Linguistics Community Online." />
<!-- Favicons -->
<link rel="shortcut icon" href="/static/img/favicon.ico">
<!-- styles -->
<link rel="stylesheet" href="/static/css/bootstrap.min.css" media="screen">
<link rel="stylesheet" href="/static/css/bootstrap-theme.min.css" media="screen">
<link rel="stylesheet" href="https://ajax.googleapis.com/ajax/libs/jqueryui/1.12.1/themes/smoothness/jquery-ui.css">
<link rel="stylesheet" href="/static/css/chosen.css">
<link href="https://cdnjs.cloudflare.com/ajax/libs/select2/4.0.6-rc.0/css/select2.min.css" rel="stylesheet" />
<link href="https://gitcdn.github.io/bootstrap-toggle/2.2.2/css/bootstrap-toggle.min.css" rel="stylesheet">
<link rel="stylesheet" href="/static/css/style.css?2" media="screen">
<link href="https://fonts.googleapis.com/css?family=Quicksand" rel="stylesheet">
<!-- Google recaptcha v2 -->
<script src="https://www.recaptcha.net/recaptcha/api.js" async defer></script>
<!-- Google Analytics -->
<script async src="https://www.googletagmanager.com/gtag/js?id=G-G6Q231336D"></script>
<script>
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'G-G6Q231336D');
</script>
<link href="/static/fontawesome-free-7.3.1-web/css/fontawesome.css" rel="stylesheet" />
<link href="/static/fontawesome-free-7.3.1-web/css/brands.css" rel="stylesheet" />
<link href="/static/fontawesome-free-7.3.1-web/css/solid.css" rel="stylesheet" />
<link href="/static/fontawesome-free-7.3.1-web/css/svg.css" rel="stylesheet" />
</head>
<body data-spy="scroll" data-target="#myScrollspy" data-offset="20">
<div id="wrap">
<nav class="navbar navbar-toggleable-md navbar-custom navbar-fixed-top">
<div class="container-fluid"> <!-- style="padding: 0 15px" -->
<div class="navbar-header">
<button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".navbar-collapse" aria-label="collapse menu">
<span class="icon-bar"></span>
<span class="icon-bar"></span>
<span class="icon-bar"></span>
</button>
<a class="navbar-brand" href="/">
<img class='brand' height='30' alt="LINGUIST List" src="/static/img/TransparentLogo.png"/>
</a>
</div>
<div class="collapse navbar-collapse" id="navbar">
<ul class="nav navbar-nav">
<li class="dropdown">
<a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false">BROWSE<i class="fa fa-caret-down" aria-hidden="true" style="margin-left: 2px; font-size: x-small"></i></a>
<ul class="dropdown-menu">
<li><a href="/issues/">All Posts</a></li>
<li role="separator" class="divider"></li>
<li><a href="/books/">Books and Reviews</a></li>
<li><a href="/journals/">Journals and Papers</a></li>
<li><a href="/career/search/">Careers/Jobs</a></li>
<li><a href="/events/">Conferences and Events</a></li>
<li><a href="/announcements/">Announcements</a></li>
<li><a href="/discussion/">Discussion</a></li>
<li><a href="/studentportal/">For Students</a></li>
<li><a href="/cookbook/">Cookbook</a></li>
</ul>
</li>
<li class="dropdown">
<a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false">SERVICES<i class="fa fa-caret-down" aria-hidden="true" style="margin-left: 2px; font-size: x-small"></i></a>
<ul class="dropdown-menu">
<li><a href="/mailinglist/">Mailing List</a></li>
<!--<li><a href="https://askaling.linguistlist.org" target="_blank">Ask a Linguist</a></li>-->
<li><a href="https://easyabs.linguistlist.org/" target="_blank">EasyAbs</a></li>
<!--<li><a href="https://geoling.linguistlist.org/" target="_blank">GeoLing</a></li>-->
<!--<li><a href="http://multitree.org/" target="_blank">Multitree</a></li>-->
<li role="separator" class="divider"></li>
<li><a href="/rss/">RSS</a></li>
<li><a href="/socialmedia/">Social Media</a></li>
<li><a href="/ai/">Alexa</a></li>
<li role="separator" class="divider"></li>
<li><a href="/projects/">Archived Projects</a></li>
</ul>
</li>
<li class="nav-item">
<a href="/submit/">SUBMIT</a>
</li>
<li class="nav-item">
<a href="/subscribe/">SUBSCRIBE</a>
</li>
<li class="nav-item">
<a href="https://www.paypal.com/donate/?hosted_button_id=87C2AXTVC4PP8">DONATE</a>
</li>
<!--li class="dropdown">
<a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false">RESOURCES<i class="fa fa-caret-down" aria-hidden="true" style="margin-left: 2px; font-size: x-small"></i></a>
<ul class="dropdown-menu">
</ul>
</li-->
<li class="dropdown">
<a href="#" class="dropdown-toggle" data-toggle="dropdown" role="button" aria-haspopup="true" aria-expanded="false">ABOUT<i class="fa fa-caret-down" aria-hidden="true" style="margin-left: 2px; font-size: x-small"></i></a>
<ul class="dropdown-menu">
<li><a href="/about/">About Us</a></li>
<li><a href="/policies/">Policies</a></li>
<li><a href="/supporters/">Supporters</a></li>
<li><a href="/staff/">Staff</a></li>
<li><a href="/faq/">FAQ</a></li>
</ul>
</li>
<li class="nav-item">
<a href="/accounts/login/?next=/emeld/">LOGIN</a>
</li>
</ul>
<!-- Right side of Navbar -->
<div class="pull-right navbar-right">
<form class="navbar-form pull-right navbar-brand" style="margin-top: 15px" method="get" action="/issues/" name="googlesearch">
<div class="form-group">
<input type="text" name="query" class="form-control pull-right" placeholder="Search" aria-label="search">
</div>
<button type="submit" class="btn btn-default" aria-label="search"><span class="glyphicon glyphicon-search" aria-hidden="true"></span></button>
</form>
</div>
</div>
</div>
</nav>
<main>
<div class="container">
<div class="row">
<div class="col-lg-12">
<br class="spacer-2">
<h1 class="page-header">The EMELD website is no longer available</h1>
<br/>
<p>The LINGUIST List no longer maintains the EMELD website. You may find one of the following resources useful instead:</p>
<ul>
<li><a href="https://archivingforthefuture.teachable.com">Archiving for the Future</a></li>
<li><a href="https://www.vtfolklife.org/fieldwork-guides">Vermont Folklife Fieldwork and Research Guides</a></li>
<li><a href="https://corsal.unt.edu/curriculum">CORSAL Collaborative Digital Language Archiving Curriculum</a></li>
<li><a href="https://meap.library.ucla.edu/applicants/applicant-resources">Modern Endangered Archives Program resources</a></li>
</ul>
<p>An archive of some of the contents of the EMELD website can be found <a href="https://github.com/linguistlist/emeld">on GitHub</a>.</p>
</div>
</div>
</div>
</main>
</div>
<!-- Bootstrap core JavaScript
================================================== -->
<!-- Placed at the end of the document so the pages load faster -->
<script src="/static/js/libs/jquery-2.1.3.min.js"></script>
<script src="/static/js/libs/jquery-ui.min.js"></script>
<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.7/js/bootstrap.min.js" integrity="sha384-Tc5IQib027qvyjSMfHjOMaLkfuWVxZxUPnCJA7l2mCWNIpG9mGCD8wGNIcPD7Txa" crossorigin="anonymous"></script><!--bootstrap 3.7.7-->
<script type="text/javascript" src="/static/js/plugins/jquery.jscroll.js"></script>
<script src="/static/js/select2.full.min.js"></script>
<script type="text/javascript" src="/static/js/selection.js"></script>
<script type="text/javascript" src="/static/js/plugins/chosen.jquery.min.js"></script>
<script type="text/javascript" src="/static/js/app.js"></script>
<!-- FOOTER -->
<!-- Beginning of Footer -->
<footer id="page-footer">
<div class="container text-center">
<ul class="list-unstyled">
<li class="pull-left">
<a href="/policies/">Policies</a>
</li>
<li class="pull-left">
<a href="/cookies/">Cookies</a>
</li>
<li class="pull-left">
<a href="/about/#contact">Contact</a>
</li>
<li class="socialmedia pull-right">
<a href="https://www.linkedin.com/company/linguist-list" class="social-icon" alt="LinkedIn" aria-label="LinkedIn"><i class="fa-brands fa-linkedin" alt="Linkedin"></i></a>
<a href="https://www.facebook.com/linguistlist" class="social-icon" alt="Facebook" aria-label="Facebook"><i class="fa-brands fa-facebook" alt="Facebook"></i></a>
<a href="https://twitter.com/linguistlist" class="social-icon" alt="X" aria-label="X"><i class="fa-brands fa-x-twitter" alt="X"></i></a>
<a href="https://bsky.app/profile/linguistlist.bsky.social" class="social-icon" alt="Bluesky" aria-label="Bluesky"><i class="fa fa-brands fa-bluesky" alt="Bluesky"></i></a>
<a href="/rss/" class="social-icon" alt="RSS feeds" aria-label="RSS feeds"><i class="fa fa-rss" alt="RSS feed"></i></a>
</li>
</ul>
</div>
</footer>
<script type="text/javascript">
// Normally the menu bar is 60px tall, but if you zoom the right amount
// the search box shifts to a second line so it's 120px, blocking some
// content. Adding padding to <body> fixes this.
function add_padding() {
let ln = Math.max($('nav').height(), 60) - 60;
$('body').css('padding-top', ln + 'px');
}
$(add_padding);
$(window).resize(add_padding);
</script>
<script type="module" src="https://static.cloudflareinsights.com/beacon.min.js/v4513226cdae34746b4dedf0b4dfa099e1781791509496" integrity="sha512-ZE9pZaUXND66v380QUtch/5sE9tPFh2zg45pR2PB0CVkCtOREv2AJKkSidISWkysEuQ0EH8faUU5du78bx87UQ==" data-cf-beacon='{"version":"2024.11.0","token":"fecee459e8094cb9a105abbd1a130d43"}' crossorigin="anonymous"></script>
</body>
</html>