Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 9516 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://cloud.clz.com/robots.txt
301 MovedPermanently
https://cloud.clz.com/robots.txt
200 OK
Показать содержимое robots.txt
<!DOCTYPE html>
<html lang="en">
<head>
<title>This page is not available</title>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8"/>
<meta name="keywords" content="online, database, catalog, organize, inventory, collection, cloud, collectorz, clz"/>
<meta name="description" content=""/>
<meta name="viewport" content="width=device-width, minimum-scale=1.0, maximum-scale=1.0, user-scalable=no"/>
<meta name="format-detection" content="telephone=no"/>
<meta name="theme-color" content="#0082A6"/>
<meta name="robots" content="noindex,nofollow"/>
<!-- Start twitter card specific meta tags -->
<meta name="twitter:card" content="summary_large_image"/>
<meta name="twitter:site" content="@collectorz"/>
<!-- End twitter card specific meta tags -->
<!-- Start opengraph metatags -->
<meta property="fb:app_id" content="128494510540223"/>
<meta property="og:locale" content="en_US"/>
<!-- CSRF Token -->
<meta name="csrf_token" content="523ff7ea6d6eb4de290bc664733c5d86fc6952fbabdbc7caf4c4391649d3d178">
<meta property="og:title" content="This page is not available"/>
<meta property="og:image" content="https://app-assets.clz.com/static/images/screenshots/fb-cloud-all2.jpg"/>
<meta property="og:type" content="website"/>
<meta property="og:description" content=""/>
<meta property="og:site_name" content=""/>
<!-- End opengraph metatags -->
<!-- global stylesheets -->
<link type="text/css" rel="stylesheet" href="https://app-assets.clz.com/static/css/bootstrap-3.4.1.min.css">
<link type="text/css" rel="stylesheet" href="https://app-assets.clz.com/static/fonts/gilroy/css/all.css">
<link type="text/css" rel="stylesheet" href="https://app-assets.clz.com/static/fonts/fa6pro/css/all.min.css">
<link rel="stylesheet" type="text/css" href="https://app-assets.clz.com/static/css/app.css?v=1786535156"/>
<link rel="apple-touch-icon" href="https://app-assets.clz.com/static/images/branding/favicon-512.png" sizes="any" type="image/png">
<link rel="icon" href="https://app-assets.clz.com/static/images/branding/favicon-512.png" sizes="any" type="image/png">
<link rel="image_src" href="https://app-assets.clz.com/static/images/screenshots/fb-cloud-all2.jpg" />
<!-- Google Tag Manager -->
<script nonce="b386de75ea24f834b3d23c61">(function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':
new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],
j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src=
'https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);
})(window,document,'script','dataLayer','GTM-5SK72HCQ');</script>
<!-- End Google Tag Manager -->
</head>
<body class="cloud content page-home page-public page-error" data-siteroot="https://cloud.clz.com/" data-clouduser="">
<!--PreLoad Google Fonts -->
<div class="fonts" style="color: transparent;">
<div style="font-weight: 400; height: 0; font-family: Gilroy;">400</div>
<div style="font-weight: 700; height: 0; font-family: Gilroy;">700</div>
<div style="font-weight: 900; height: 0; font-family: Gilroy;">900</div>
</div>
<!--Javascript Alert -->
<noscript>
<div class="alert alert-danger" style="margin:0;"> For full functionality of this site it is necessary to enable JavaScript.</div>
</noscript>
<!-- Google Tag Manager (noscript) -->
<noscript>
<iframe src="https://www.googletagmanager.com/ns.html?id=GTM-5SK72HCQ" height="0" width="0" style="display:none;visibility:hidden"></iframe>
</noscript>
<!-- End Google Tag Manager (noscript) -->
<!--Begin Wrap-->
<div class="wrap">
<div class="navbar-static-top topbar" role="navigation">
<div class="container">
<div class="topbar-logo">
<a class="topbar-brand" href="https://cloud.clz.com/"><img src="https://app-assets.clz.com/static/images/branding/clz.svg"></a>
</div>
<div class="navbar-header">
</div>
<button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#navbar-collapse">
<i class="fa fa-caret-down"></i>
<i class="fa fa-caret-up"></i>
</button>
<a id="calltoaction" href="https://app.clz.com" class="btn btn-success text">
<strong>CLZ Web - Catalog your online</strong><br>
<span class="subtext">Add/Edit directly on your cloud database. <u>Learn More.</u></span>
<i class="fa fa-angle-double-right"></i>
</a>
<div id="topbar-rightbuttons-container">
<div class="dropdown">
<span class="topbar-button" type="button" id="helpDropdown" data-toggle="dropdown" aria-expanded="true"> <i
class="fa fa-question-circle fa-lg"></i> <i class="fa fa-caret-down"></i> </span>
<ul class="dropdown-menu pull-right" role="menu" aria-labelledby="helpDropdown">
<li><a href="https://help.clz.com" target="_blank" rel="noopener">Support</a></li>
</ul>
</div>
</div>
<div class="collapse navbar-collapse" id="navbar-collapse">
<ul class="nav navbar-nav">
<li class="navbar-movies">
<a class="topbar-section-button" href="https://cloud.clz.com/movies/"><span>Movies</span></a>
</li>
<li class="navbar-books">
<a class="topbar-section-button" href="https://cloud.clz.com/books/"><span>Books</span></a>
</li>
<li class="navbar-music">
<a class="topbar-section-button" href="https://cloud.clz.com/music/"><span>Music</span></a>
</li>
<li class="navbar-comics">
<a class="topbar-section-button" href="https://cloud.clz.com/comics/"><span>Comics</span></a>
</li>
<li class="navbar-games">
<a class="topbar-section-button" href="https://cloud.clz.com/games/"><span>Games</span></a>
</li>
</ul>
</div>
</div>
</div>
<div class="appbar">
<div class="appbar-container">
<div class="row">
<div class="col-xs-12">
<div class="pull-right">
</div>
</div>
</div>
</div>
</div>
<!--Begin Main Content-->
<div class="container content">
<div id="content-data">
<div class="static-content">
<div id="top-text">
<h2 id="top-title">
<img width="40" class="hidden-xs" src="https://app-assets.clz.com/static/images/cloud-dark.png"> This user can not be found
</h2>
<p>The link you followed may be broken, or the user may have been removed.</p>
<p><a href="javascript:history.back()">Go back to the previous page</a> ·
<a href="https://cloud.clz.com">Go back to Home</a><br/></p>
</div>
</div>
</div>
</div>
<!--End Main Content-->
</div>
<!--End Wrap-->
<a class="back-to-top"><i class="fa fa-arrow-up fa-lg"></i></a>
<!--Begin footer-->
<div class="site-footer">
<div class="container">
<p>
<a href="https://cloud.clz.com">CLZ Cloud</a> © Copyright 2000-2026 ·
<a href="https://clz.com" target="_blank">CLZ.com</a>
<span class="footer-links">
· <a href="https://clz.com/terms-of-use" target="_blank">Terms of Use</a>
· <a href="https://clz.com/privacy-policy" target="_blank">Privacy Policy</a>
</span>
</p>
</div>
</div>
<!--End footer-->
<script src="https://app-assets.clz.com/static/js/jquery-3.5.1.min.js"></script>
<script src="https://app-assets.clz.com/static/js/jquery-ui-1.12.1-sortable.min.js"></script>
<script src="https://app-assets.clz.com/static/js/bootstrap-3.4.1.min.js"></script>
<script src="https://app-assets.clz.com/static/js/bootbox-5.3.4.min.js"></script>
<script src="https://app-assets.clz.com/static/js/lazyload.jquery.js?c=3"></script>
<script src="https://app-assets.clz.com/static/js/lazysizes.min.js"></script>
<script src="https://app-assets.clz.com/static/js/core.js?v=1786535156"></script>
<script src="https://app-assets.clz.com/static/js/connect.js?v=1786535156"></script>
<script src="https://app-assets.clz.com/static/js/connect-findcover.js?v=1786535156" defer></script>
<!-- Icons -->
<div style="display:none;">
<svg xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" width="24px" height="24px" viewBox="0 0 24 24" version="1.1">
<g id="boxset-inherit-icon" stroke="none" fill="none" fill-rule="evenodd" stroke-width="1">
<g transform="translate(12, 12) rotate(90) translate(-12, -12)translate(0, -0)">
<polygon points="0 0 24 0 24 24 0 24" />
<path d="M20,8 L4,8 L4,6 L20,6 L20,8 Z M18,2 L6,2 L6,4 L18,4 L18,2 Z M22,12 L22,20 C22,21.1 21.1,22 20,22 L4,22 C2.9,22 2,21.1 2,20 L2,12 C2,10.9 2.9,10 4,10 L20,10 C21.1,10 22,10.9 22,12 Z" fill="currentColor" fill-rule="nonzero" />
</g>
</g>
</svg>
</div>
</body>
</html>
nginx