Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 4 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://mail.haskell.org/robots.txt
301 MovedPermanently
https://mail.haskell.org/robots.txt
301 MovedPermanently
https://mailman.haskell.org/
301 MovedPermanently
https://mailman.haskell.org/mailman3/lists/
200 OK
Показать содержимое robots.txt
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="UTF-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>
List Index - Haskell.org
</title>
<link rel="shortcut icon" href="/static/postorius/img/favicon.ico">
<link rel="stylesheet" href="/static/postorius/libs/bootstrap/css/bootstrap.min.css">
<link rel="stylesheet" href="/static/django-mailman3/css/main.css">
<link rel="stylesheet" href="/static/postorius/css/style.css">
<link rel="stylesheet" href="/static/postorius/libs/fonts/font-awesome/css/font-awesome.min.css" type="text/css" media="all" />
<noscript><style> .jsonly { display: none } </style></noscript>
</head>
<body>
<header class="navbar navbar-expand-lg bd-navbar">
<nav class="container-xxl bd-gutter navbar-default navbar-expand-md">
<div class="navbar-header d-flex align-items-center flex-grow-1 flex-md-grow-0">
<button type="button" class="navbar-toggler collapsed" data-bs-toggle="collapse" data-bs-target="#header-nav" aria-expanded="false">
<span class="sr-only">Toggle navigation</span>
<span class="fa fa-bars"></span>
</button>
<a class="navbar-brand me-0 me-lg-2 flex-grow-1" href="/mailman3/lists/">
<span><img src="/static/postorius/img/mailman_logo_small_trans.png" alt="Mailman logo"/> Postorius</span>
</a>
<ul class="navbar-nav d-md-none flex-row">
<li class="nav-item me-2"><a class="nav-link" href="/accounts/login/?next=/mailman3/lists/">
<span class="fa fa-sign-in"></span>
Sign In
</a>
<li class="nav-item"><a class="nav-link" href="/accounts/signup/?next=/mailman3/lists/">
<span class="fa fa-user-plus"></span>
Sign Up
</a>
</ul>
</div>
<div class="collapse navbar-collapse" id="header-nav">
<ul class="navbar-nav me-auto mb-2 mb-lg-0">
<li class="nav-item"><a href="/mailman3/lists/" class="nav-link">
<span class="fa fa-envelope"></span>
Lists
</a></li>
<li class="nav-item"><a href="/archives/" class="nav-link">
<span class="fa fa-comment"></span>
Archives
</a></li>
</ul>
<ul class="navbar-nav d-none d-md-flex">
<li class="nav-item"><a class="nav-link" href="/accounts/login/?next=/mailman3/lists/">
<span class="fa fa-sign-in"></span>
Sign In
</a>
<li class="nav-item"><a class="nav-link" href="/accounts/signup/?next=/mailman3/lists/">
<span class="fa fa-user-plus"></span>
Sign Up
</a>
</ul>
</div>
</nav>
</header>
<div class="container-xxl" role="main">
<header class="page-header">
Mailing Lists
</header>
<div class="row mb-3">
</div>
<div class="table-responsive">
<table class="table table-bordered table-striped">
<thead>
<tr>
<th>List name</th>
<th>Post address</th>
<th>Description</th>
</tr>
</thead>
<tbody>
<tr>
<td>
<a href="/mailman3/lists/arch-haskell.haskell.org/">arch-haskell</a>
</td>
<td>arch-haskell@haskell.org</td>
<td>Haskell on Arch Linux Development</td>
</tr>
<tr>
<td>
<a href="/mailman3/lists/beginners.haskell.org/">Beginners</a>
</td>
<td>beginners@haskell.org</td>
<td>The Haskell-Beginners Mailing List - Discussion of primarily beginner-level topics related to Haskell</td>
</tr>
<tr>
<td>
<a href="/mailman3/lists/blobs.haskell.org/">Blobs</a>
</td>
<td>blobs@haskell.org</td>
<td>Development of the Blobs diagram editor</td>
</tr>
<tr>
<td>
<a href="/mailman3/lists/c2hs.haskell.org/">C2hs</a>
</td>
<td>c2hs@haskell.org</td>
<td>C->Haskell binding generator</td>
</tr>
<tr>
<td>
<a href="/mailman3/lists/cabal-devel.haskell.org/">cabal-devel</a>
</td>
<td>cabal-devel@haskell.org</td>
<td>Development discussion for the Cabal package system</td>
</tr>
<tr>
<td>
<a href="/mailman3/lists/cvs-hugs.haskell.org/">Cvs-hugs</a>
</td>
<td>cvs-hugs@haskell.org</td>
<td>Hugs CVS commit messages</td>
</tr>
<tr>
<td>
<a href="/mailman3/lists/cvs-nhc98.haskell.org/">Cvs-nhc98</a>
</td>
<td>cvs-nhc98@haskell.org</td>
<td>nhc98 CVS commit messages</td>
</tr>
<tr>
<td>
<a href="/mailman3/lists/data-haskell.haskell.org/">Data-Haskell</a>
</td>
<td>data-haskell@haskell.org</td>
<td>Data Haskell</td>
</tr>
<tr>
<td>
<a href="/mailman3/lists/database-devel.haskell.org/">database-devel</a>
</td>
<td>database-devel@haskell.org</td>
<td>Database programming with Haskell</td>
</tr>
<tr>
<td>
<a href="/mailman3/lists/education.haskell.org/">Education</a>
</td>
<td>education@haskell.org</td>
<td>Education</td>
</tr>
</tbody>
</table>
</div>
<div class="paginator">
<div class="row">
<nav aria-label="Page navigation" class="d-flex justify-content-center">
<ul class="pagination">
<li class="page-item disabled"><a href="#" class="page-link">← Previous</a></li>
<li class="page-item active"><span class="page-link" aria-label="Current Page, Page 1" aria-current="true">1</span></li>
<li class="page-item"><a href="?page=2" class="page-link" aria-label="Goto Page 2">2</a></li>
<li class="page-item"><a href="?page=3" class="page-link" aria-label="Goto Page 3">3</a></li>
<li class="page-item"><a href="?page=4" class="page-link" aria-label="Goto Page 4">4</a></li>
<li class="page-item"><a href="?page=5" class="page-link" aria-label="Goto Page 5">5</a></li>
<li class="page-item"><a href="?page=6" class="page-link" aria-label="Goto Page 6">6</a></li>
<li class="page-item">
<a href="?page=2" class="page-link">
Next →
</a>
</li>
</ul>
</nav>
</div>
<div class="row">
<form class="form-inline jump-to-page" action="" method="get">
<label>
Jump to page:
</label>
<select name="page">
<option value="1"
selected>
1
</option>
<option value="2"
>
2
</option>
<option value="3"
>
3
</option>
<option value="4"
>
4
</option>
<option value="5"
>
5
</option>
<option value="6"
>
6
</option>
</select>
</form>
<form class="" action="" method="get">
<label>Results per page:</label>
<select name="count">
<option value="10"
selected="selected"
>10
</option>
<option value="25"
>25
</option>
<option value="50"
>50
</option>
<option value="100"
>100
</option>
<option value="200"
>200
</option>
</select>
<input type="submit" class="btn btn-primary btn-sm" value="Update" />
</form>
</div>
</div>
</div>
<footer class="footer">
<div class="container">
<p class="text-center">
<a href="https://postorius.readthedocs.org">Postorius Documentation</a>
•
<a href="https://list.org">GNU Mailman</a>
•
Postorius Version 1.3.13
</p>
</div>
</footer>
<script src="/static/postorius/libs/jquery/jquery-3.6.0.min.js"></script>
<script src="/static/postorius/libs/bootstrap/js/bootstrap.bundle.min.js"></script>
<script src="/static/django-mailman3/js/main.js"></script>
<script src="/static/postorius/js/script.js" defer></script>
<script>
// Add the .js-enabled class to the body so we can style the elements
// depending on whether Javascript is enabled.
$(document).ready(function(){
$("body").addClass("js-enabled");
$(".gravatar").addClass("rounded-circle");
});
</script>
</body>
</html>
nginx