Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 3 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://canadiana.org/robots.txt
302 Found
http://www.canadiana.ca/
301 MovedPermanently
https://www.canadiana.ca/
200 OK
Показать содержимое robots.txt
<!doctype html>
<html id="html" lang="en" class="vh-100">
<head>
<title> Canadiana</title>
<meta charset="utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1" />
<meta name="author" content="Canadiana" />
<link href="https://fonts.googleapis.com/css?family=Roboto&display=swap" rel="stylesheet">
<link rel="stylesheet" href="https://www.canadiana.ca/static/css/online.css?cssr=22" />
<link rel="icon" href="https://www.canadiana.ca/static/images/icons/32.png" sizes="32x32" />
<link rel="icon" href="https://www.canadiana.ca/static/images/icons/128.png" sizes="128x128" />
<link rel="icon" href="https://www.canadiana.ca/static/images/icons/192.png" sizes="192x192" />
<link rel="shortcut icon" href="https://www.canadiana.ca/static/images/icons/196.png" sizes="196x196" />
<link rel="apple-touch-icon" href="https://www.canadiana.ca/static/images/icons/152.png" sizes="152x152" />
<link rel="apple-touch-icon" href="https://www.canadiana.ca/static/images/icons/180.png" sizes="180x180" />
<meta name="theme-color" content="#1d808b" />
</head>
<body class="d-flex flex-column vh-100 action-index" style="background-size: cover; background-image: url('/static/images/banners/oocihm.8_04048_394@31.jpg')">
<a href="#main" id="skipLink">Skip to main content</a>
<header>
<div class="container">
<div class="row py-3">
<h1 class="header-title">
<a href="https://www.canadiana.ca/">
<img id="headerTitle" src="/static/images/canadiana-tag-white.svg" alt="Canadiana" />
</a>
</h1>
<div class="header-button">
<button class="btn btn-lg menu-open">
<svg xmlns="http://www.w3.org/2000/svg" focusable="false" width="32" height="32" fill="currentColor" viewBox="0 0 16 16">
<path d="M3 9.5a1.5 1.5 0 1 1 0-3 1.5 1.5 0 0 1 0 3zm5 0a1.5 1.5 0 1 1 0-3 1.5 1.5 0 0 1 0 3zm5 0a1.5 1.5 0 1 1 0-3 1.5 1.5 0 0 1 0 3z"/>
</svg>
<span class="sr-only">Open menu</span>
</button>
<button class="btn btn-lg btn-primary menu-close">
<svg xmlns="http://www.w3.org/2000/svg" focusable="false" width="32" height="32" fill="currentColor" viewBox="0 0 16 16">
<path d="M4.646 4.646a.5.5 0 0 1 .708 0L8 7.293l2.646-2.647a.5.5 0 0 1 .708.708L8.707 8l2.647 2.646a.5.5 0 0 1-.708.708L8 8.707l-2.646 2.647a.5.5 0 0 1-.708-.708L7.293 8 4.646 5.354a.5.5 0 0 1 0-.708z"/>
</svg>
<span class="sr-only">Close menu</span>
</button>
</div>
<nav class="header-links">
<ul class="small-links">
<li>
<a href="http://www.canadiana.ca/terms">Terms of Service</a>
</li>
<li>
<b>English</b> | <a href="https://www.canadiana.ca/?usrlang=fr">Français</a>
</li>
<li>
<a class="sm-icon facebook" href="https://www.facebook.com/CRKNRCDR/">
<span class="sr-only">Facebook</span>
</a>
<a class="sm-icon bluesky" href="https://bsky.app/profile/crkn-rcdr.bsky.social">
<span class="sr-only">bluesky</span>
</a>
<a class="sm-icon linkedin" href="https://www.linkedin.com/mwlite/company/canadian-research-knowledge-network">
<span class="sr-only">LinkedIn</span>
</a>
</li>
</ul>
<ul class="large-links">
<li>
<a href="https://www.crkn-rcdr.ca/en/canadiana">About</a>
</li>
<li>
<a href="//heritage.canadiana.ca/">Héritage</a>
</li>
<li>
<a href="https://www.crkn-rcdr.ca/en">CRKN</a>
</li>
<li>
<a href="https://www.crkn-rcdr.ca/en/whats-new-canadiana-collections">What's New</a>
</li>
<li>
<a target="_blank" href="https://www.crkn-rcdr.ca/en/canadiana-citation-guide">Citation Guide</a>
</li>
<li>
<a href="https://www.crkn-rcdr.ca/en/contact-us">Contact Us</a>
</li>
</ul>
</nav>
</div>
</div>
</header>
<main role="main" id="main" class="flex-grow-1">
<div class="above-fold d-flex flex-column">
<div class="container my-auto">
<div class="row justify-content-center">
<div class="col-lg-8 mt-3">
<form id="searchForm" method="POST" action="https://www.canadiana.ca/search/post">
<input type="hidden" name="handler" value="general" />
<div class="input-group">
<input type="text" id="search" autofocus class="form-control form-control-lg" name="q" placeholder="Search this collection" />
<label for="search" class="sr-only">Search this collection</label>
<div class="input-group-append">
<button type="submit" class="btn btn-lg btn-primary" title="Search" data-toggle="tooltip" value="submit">
<svg xmlns="http://www.w3.org/2000/svg" focusable="false" width="24" height="24" fill="currentColor" viewBox="0 0 16 16">
<path d="M11.742 10.344a6.5 6.5 0 1 0-1.397 1.398h-.001c.03.04.062.078.098.115l3.85 3.85a1 1 0 0 0 1.415-1.414l-3.85-3.85a1.007 1.007 0 0 0-.115-.1zM12 6.5a5.5 5.5 0 1 1-11 0 5.5 5.5 0 0 1 11 0z"/>
</svg>
<span class="sr-only">Search</span>
</button>
<a class="btn btn-lg btn-light" href="/search-tips" title="Help" data-toggle="tooltip">
<svg xmlns="http://www.w3.org/2000/svg" focusable="false" width="24" height="23" fill="currentColor" viewBox="0 0 16 16">
<path d="M8 15A7 7 0 1 1 8 1a7 7 0 0 1 0 14zm0 1A8 8 0 1 0 8 0a8 8 0 0 0 0 16z"/>
<path d="M5.255 5.786a.237.237 0 0 0 .241.247h.825c.138 0 .248-.113.266-.25.09-.656.54-1.134 1.342-1.134.686 0 1.314.343 1.314 1.168 0 .635-.374.927-.965 1.371-.673.489-1.206 1.06-1.168 1.987l.003.217a.25.25 0 0 0 .25.246h.811a.25.25 0 0 0 .25-.25v-.105c0-.718.273-.927 1.01-1.486.609-.463 1.244-.977 1.244-2.056 0-1.511-1.276-2.241-2.673-2.241-1.267 0-2.655.59-2.75 2.286zm1.557 5.763c0 .533.425.927 1.01.927.609 0 1.028-.394 1.028-.927 0-.552-.42-.94-1.029-.94-.584 0-1.009.388-1.009.94z"/>
</svg>
<span class="sr-only">Help</span>
</a>
</div>
</div>
</form>
</div>
</div>
</div>
<div class="banner-credit">
<a href="https://www.canadiana.ca/view/oocihm.8_04048_394/31">The Canadian horticulturist : Vol. 33, no. 10 (Oct. 1910)</a>
</div>
</div>
<div class="below-fold">
<div class="container pt-3 pb-3">
<div class="row row-cols-1 row-cols-sm-2 row-cols-lg-2">
<div class="col mb-2">
<div class="card">
<img class="card-img-top ca-front-card" src="/static/images/cards/monog.jpg" alt="A descriptive image" />
<div class="card-body">
<h3 class="card-title h5 font-weight-bold d-flex">
<a href="https://www.canadiana.ca/collection-monog">
Monographs
</a>
</h3>
<p>
The Monographs collection, spanning three and a half centuries of Canadian documentary history, holds rich primary materials exploring a wide range of subjects and disciplines.
<a href="https://www.canadiana.ca/collection-monog">Read more »</a>
</p>
</div>
<div class="card-footer">
<a href="https://www.canadiana.ca/search/browsable?so=oldest&collection=monog">Browse this collection</a>
</div>
</div>
</div>
<div class="col mb-2">
<div class="card">
<img class="card-img-top ca-front-card" src="/static/images/cards/serials.jpg" alt="A descriptive image" />
<div class="card-body">
<h3 class="card-title h5 font-weight-bold d-flex">
<a href="https://www.canadiana.ca/collection-serials">
Serials: Periodicals, Annuals and Newspapers
</a>
</h3>
<p>
The Serials collection includes a wide range of dailies, weeklies, specialized journals and mass-market magazines, as well as city directories and annual reports from churches, schools, and corporations.
<a href="https://www.canadiana.ca/collection-serials">Read more »</a>
</p>
</div>
<div class="card-footer">
<a href="https://www.canadiana.ca/search/browsable?collection=serials&so=oldest">Browse this collection</a>
</div>
</div>
</div>
<div class="col mb-2">
<div class="card">
<img class="card-img-top ca-front-card" src="/static/images/cards/govpubs.jpg" alt="A descriptive image" />
<div class="card-body">
<h3 class="card-title h5 font-weight-bold d-flex">
<a href="https://www.canadiana.ca/collection-govpubs">
Government Publications
</a>
</h3>
<p>
The Government Publications collection includes over 1.7 million pages of historical pre-1920 colonial, provincial and federal government documents.
<a href="https://www.canadiana.ca/collection-govpubs">Read more »</a>
</p>
</div>
<div class="card-footer">
<a href="https://www.canadiana.ca/search/browsable?so=oldest&collection=govpubs">Browse this collection</a>
</div>
</div>
</div>
<div class="col mb-2">
<div class="card">
<img class="card-img-top ca-front-card" src="/static/images/cards/maps.jpg" alt="A descriptive image" />
<div class="card-body">
<h3 class="card-title h5 font-weight-bold d-flex">
<a href="https://www.canadiana.ca/collection-maps">
Maps
</a>
</h3>
<p>
The Maps collection currently contains nearly 22,000 Canadian maps digitized from the 1:50,000 scale National Topographic Series. The maps date from 1905 to 2012 and cover all of the Canadian provinces and territories.
<a href="https://www.canadiana.ca/collection-maps">Read more »</a>
</p>
</div>
<div class="card-footer">
<a href="/collection-maps-provinces">Browse by Province/Territory</a>
or
<a href="/search?collection=maps">Browse this collection</a>
</div>
</div>
</div>
</div>
<div class="border rounded pt-3 pl-3 pr-3 mb-3">
<h3>Statement on problematic content and descriptions in Canadiana</h3>
<p>
The Canadiana Collections contain content created over five centuries that
tell an incomplete, oftentimes distorted and, sometimes harmful, story of
Canada. The content, metadata, and resource descriptions in the Canadiana
Collections contain language that reflects the biases, norms, and perspectives
of the time in which they were created. This includes harmful and offensive
wording, cultural references, and stereotypes. In order to accurately reflect
the attitudes and viewpoints of the time in which these historical records
were created, objects in the Canadiana collections are unchanged. In
recognition of the harmful or painful impact of language and images, CRKN
staff are actively committed to:
</p>
<ul>
<li>
support and actively participate in efforts to update and change
international standards for descriptions to ensure that descriptions are
inclusive, respectful, and do not cause harm
</li>
<li>
replace inappropriate language in the metadata and resource descriptions
introduced during legacy cataloguing practices
</li>
</ul>
<p>This is an ongoing process.</p>
<p>
If you see records with inappropriate language or content that you think CRKN
should review, please fill out our
<a
href="https://www.crkn-rcdr.ca/sites/crkn/files/2021-09/Final%20-%20Review%20Request%20Process%20for%20the%20Canadiana%20Collection%20-%20EN.pdf"
>Review Submission Form</a
>.
</p>
</div>
</div>
</div> </main>
<footer class="mt-auto bg-dark text-white">
<div class="container-lg">
<div class="row py-3 small">
<p class="col-lg text-center text-lg-left">
<a href="http://www.canadiana.ca/?usrlang=en">
<img src="/static/images/canadiana-logo-inverted.svg" alt="Canadiana" height="50" />
</a>
</p>
<p class="col-lg-5 text-center">
<a href="http://www.canadiana.ca/terms">Terms of Service</a>
<br />
© 2026 Canadian Research Knowledge Network
<a href="https://www.crkn-rcdr.ca/en/contact-us">
<img src="/static/images/interface/phone.svg" alt="Contact Us" />
</a>
</p>
<p class="col-lg text-center text-lg-right">
<a href="https://www.crkn-rcdr.ca/en" class="d-inline-block">
<img src="/static/images/crkn-logo-inverted.svg" alt="Canadian Research Knowledge Network" height="50" />
</a>
</p>
</div>
</div>
</footer>
<div id="imageCache" aria-hidden="true"></div>
<!--[if lte IE 9]>
<div id="noFlexWarning" aria-hidden="true">
<h2>Your browser may not be supported. Please consider downloading a more modern browser.</h2>
<ul>
<li><a href="https://www.mozilla.org/en-CA/firefox/new/">Mozilla Firefox</a></li>
<li><a href-"https://www.google.com/chrome/">Google Chrome</a></li>
<li><a href="https://www.microsoft.com/en-us/edge">Microsoft Edge</a></li>
</ul>
</div>
![endif]-->
<script src="https://www.canadiana.ca/static/js/cap.js?r=26" type="text/javascript"></script>
<!-- Global site tag (gtag.js) - Google Analytics -->
<script async src="https://www.googletagmanager.com/gtag/js?id=UA-162937182-1"></script>
<script>
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'UA-162937182-1');
</script>
</body>
<!-- Matomo -->
<script>
var _paq = window._paq = window._paq || [];
/* tracker methods like "setCustomDimension" should be called before "trackPageView" */
_paq.push(['trackPageView']);
_paq.push(['enableLinkTracking']);
(function() {
var u="https://matomo.lib.sfu.ca/library/";
_paq.push(['setTrackerUrl', u+'matomo.php']);
_paq.push(['setSiteId', '49']);
var d=document, g=d.createElement('script'), s=d.getElementsByTagName('script')[0];
g.async=true; g.src=u+'matomo.js'; s.parentNode.insertBefore(g,s);
})();
</script>
<!-- End Matomo Code -->
</html>