Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 3 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://isoldeop.web.cern.ch/robots.txt
302 Found
https://isoldeop.web.cern.ch/robots.txt
302 Found
https://auth.cern.ch/auth/realms/cern/protocol/openid-connect/auth?state=645b37e864ab04b1eb3b9e17fb043aeb&nonce=04dd2e9b4252198149f3550c0fbea62e&client_id=webframeworks-app-catalogue-isoldeop-wp&response_type=code&scope=openid email profile&redirect_uri=https%3A%2F%2Fisoldeop.web.cern.ch%2Fredirect_uri
200 OK
Показать содержимое robots.txt
<!DOCTYPE html>
<html lang="en" class="login-pf">
<head>
<meta charset="utf-8">
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8" />
<meta name="robots" content="noindex, nofollow">
<meta name="viewport" content="width=device-width,initial-scale=1"/>
<title>Sign in to CERN</title>
<link rel="icon" href="/auth/resources/cywqa/login/keycloak-cern-theme/img/favicon.ico" />
<link href="/auth/resources/cywqa/common/keycloak/vendor/patternfly-v4/patternfly.min.css" rel="stylesheet" />
<link href="/auth/resources/cywqa/common/keycloak/vendor/patternfly-v3/css/patternfly.min.css" rel="stylesheet" />
<link href="/auth/resources/cywqa/common/keycloak/vendor/patternfly-v3/css/patternfly-additions.min.css" rel="stylesheet" />
<link href="/auth/resources/cywqa/common/keycloak/lib/pficon/pficon.css" rel="stylesheet" />
<link href="/auth/resources/cywqa/login/keycloak-cern-theme/css/login.css" rel="stylesheet" />
<link href="/auth/resources/cywqa/login/keycloak-cern-theme/css/cern-login.css" rel="stylesheet" />
<link href="/auth/resources/cywqa/login/keycloak-cern-theme/css/toolbar.css" rel="stylesheet" />
<link href="/auth/resources/cywqa/login/keycloak-cern-theme/css/footer.css" rel="stylesheet" />
<script src="/auth/resources/cywqa/login/keycloak-cern-theme/js/polyfill.js" type="text/javascript"></script>
<script src="/auth/resources/cywqa/login/keycloak-cern-theme/js/onload.js" type="text/javascript"></script>
<script type="importmap">
{
"imports": {
"rfc4648": "/auth/resources/cywqa/common/keycloak/vendor/rfc4648/rfc4648.js"
}
}
</script>
<script src="/auth/resources/cywqa/login/keycloak-cern-theme/js/menu-button-links.js" type="module"></script>
<script type="module">
import { startSessionPolling } from "/auth/resources/cywqa/login/keycloak-cern-theme/js/authChecker.js";
startSessionPolling(
"/auth/realms/cern/login-actions/restart?client_id=webframeworks-app-catalogue-isoldeop-wp&tab_id=bfRlI1-oK8g&client_data=eyJydSI6Imh0dHBzOi8vaXNvbGRlb3Aud2ViLmNlcm4uY2gvcmVkaXJlY3RfdXJpIiwicnQiOiJjb2RlIiwic3QiOiI2NDViMzdlODY0YWIwNGIxZWIzYjllMTdmYjA0M2FlYiJ9&skip_logout=true"
);
</script>
<script type="module">
import { checkAuthSession } from "/auth/resources/cywqa/login/keycloak-cern-theme/js/authChecker.js";
checkAuthSession(
"YMoi9iFKMJH3kOMAHmryE6thN+aZv6/yCmwZfB8jjbM"
);
</script>
</head>
<body class="">
<div style="position: fixed; width: 100%; top: 0px; left: 0px; z-index: 70;">
<div id="cern-toolbar">
<h1><a title="CERN" href="https://cern.ch">CERN <span>Accelerating science</span></a></h1>
<ul class="cern-signedin">
<li><a title="Search CERN resources and browse the directory" class="cern-directory" href="https://cern.ch/directory">Directory</a></li>
</ul>
</div>
</div>
<div class="login-pf-page">
<div id="kc-header" class="login-pf-page-header">
<div id="kc-header-wrapper"
class="">CERN Single Sign-On</div>
</div>
<div class="card-pf login-pf-accounts">
<header class="login-pf-header">
<div class="pf-c-dropdown" id="kc-locale">
<div id="kc-locale-wrapper" class="">
<div id="kc-locale-dropdown" class="">
<a href="#" id="kc-current-locale-link">English</a>
<ul class="pf-c-dropdown__menu pf-m-align-right">
<li class="">
<a class="pf-c-dropdown__menu-item" href="/auth/realms/cern/login-actions/authenticate?client_id=webframeworks-app-catalogue-isoldeop-wp&tab_id=bfRlI1-oK8g&client_data=eyJydSI6Imh0dHBzOi8vaXNvbGRlb3Aud2ViLmNlcm4uY2gvcmVkaXJlY3RfdXJpIiwicnQiOiJjb2RlIiwic3QiOiI2NDViMzdlODY0YWIwNGIxZWIzYjllMTdmYjA0M2FlYiJ9&execution=382c6066-748f-442e-9842-fc3d8aff422f&kc_locale=en">English</a>
</li>
<li class="">
<a class="pf-c-dropdown__menu-item" href="/auth/realms/cern/login-actions/authenticate?client_id=webframeworks-app-catalogue-isoldeop-wp&tab_id=bfRlI1-oK8g&client_data=eyJydSI6Imh0dHBzOi8vaXNvbGRlb3Aud2ViLmNlcm4uY2gvcmVkaXJlY3RfdXJpIiwicnQiOiJjb2RlIiwic3QiOiI2NDViMzdlODY0YWIwNGIxZWIzYjllMTdmYjA0M2FlYiJ9&execution=382c6066-748f-442e-9842-fc3d8aff422f&kc_locale=fr">French (Français)</a>
</li>
</ul>
</div>
</div>
</div>
<h1 id="kc-page-title"> Sign in to your account
</h1>
</header>
<div id="kc-content">
<div id="kc-content-wrapper">
<div id="alert-security" class="alert-warning pf-c-alert pf-m-inline pf-m-warning login-alert" style="display: none;">
<div class="pf-c-alert__icon">
<span class="fa fa-fw fa-exclamation-triangle"></span>
</div>
<span class="pf-c-alert__title kc-feedback-text" id="security-motd"></span>
</div>
<div id="kc-form">
<div id="kc-form-wrapper">
<div class="login-form-caption-large"><h2>Sign in with a CERN account</h2></div>
<form id="kc-form-login" onsubmit="login.disabled = true; return true;" action="https://auth.cern.ch/auth/realms/cern/login-actions/authenticate?session_code=7PrzPD7_VjsRKtLH08Rq6uGgfpQ5by5dXabGaFWRdGM&execution=382c6066-748f-442e-9842-fc3d8aff422f&client_id=webframeworks-app-catalogue-isoldeop-wp&tab_id=bfRlI1-oK8g&client_data=eyJydSI6Imh0dHBzOi8vaXNvbGRlb3Aud2ViLmNlcm4uY2gvcmVkaXJlY3RfdXJpIiwicnQiOiJjb2RlIiwic3QiOiI2NDViMzdlODY0YWIwNGIxZWIzYjllMTdmYjA0M2FlYiJ9" method="post">
<div class="form-group">
<label for="username" class="pf-c-form__label pf-c-form__label-text">Username</label>
<input id="username" class="pf-c-form-control" name="username" value="" type="text" autofocus autocomplete="off" autocapitalize="none"
aria-label="Enter your CERN Username"
aria-invalid=""
/>
<span id="username-email-help" class="pf-c-form__helper-text pf-m-error required kc-feedback-text" aria-live="polite" style="display: none">
Enter a CERN username. To use an email address, choose "Home organization - eduGain", "External email - Guest access" or social accounts.
</span>
</div>
<div class="form-group">
<label for="password" class="pf-c-form__label pf-c-form__label-text">Password</label>
<input id="password" class="pf-c-form-control" name="password" type="password" autocomplete="off" aria-label="Enter your CERN password"
aria-invalid=""
/>
</div>
<div id="kc-form-buttons" class="form-group">
<input type="hidden" id="id-hidden-input" name="credentialId" />
<input class="pf-c-button pf-m-primary pf-m-block btn-lg" name="login" id="kc-login" type="submit" value="Sign In"/>
</div>
<div class="form-group login-pf-settings">
<div id="kc-form-options">
<div class="checkbox" aria-hidden="true" style="visibility: hidden;">
<label>
<input id="rememberMe" name="rememberMe" type="checkbox"> Remember me
</label>
</div>
</div>
<div class="">
<span><a href="https://users-portal.web.cern.ch/self-service-reset" id="resetPassUrl">Forgot Password?</a></span>
</div>
</div>
</form>
<div id="cern-providers" class="sub-providers">
<hr class="less-space-below">
<div class="login-form-caption-small"><h2>Or use another login method</h2></div>
<ul class="pf-c-login__main-footer-links kc-social-links ">
<a id="social-kerberos" class="pf-c-button pf-m-control pf-m-block kc-social-item kc-social-gray pf-l-grid__item"
type="button" href="/auth/realms/cern/broker/kerberos/login?client_id=webframeworks-app-catalogue-isoldeop-wp&tab_id=bfRlI1-oK8g&client_data=eyJydSI6Imh0dHBzOi8vaXNvbGRlb3Aud2ViLmNlcm4uY2gvcmVkaXJlY3RfdXJpIiwicnQiOiJjb2RlIiwic3QiOiI2NDViMzdlODY0YWIwNGIxZWIzYjllMTdmYjA0M2FlYiJ9&session_code=7PrzPD7_VjsRKtLH08Rq6uGgfpQ5by5dXabGaFWRdGM">
<i class="kc-social-provider-logo kc-social-gray fa fa-sign-in" aria-hidden="true"></i>
<span class="kc-social-provider-name kc-social-icon-text">Kerberos</span>
</a>
</ul>
</div>
<div class="reminder-oc5">By logging in, you agree to comply with the <a href="https://security.web.cern.ch/rules/en/index.shtml">CERN Computing Rules</a>, in particular OC5. CERN implements the measures necessary to ensure compliance.</div>
</div>
<div id="kc-social-providers" class=" ">
<div class="login-form-caption-large"><h2>Sign in with your email or organisation</h2></div>
<div id="user-providers" class="sub-providers">
<ul class="pf-c-login__main-footer-links kc-social-links ">
<a id="social-eduGAIN" class="pf-c-button pf-m-control pf-m-block kc-social-item kc-social-gray pf-l-grid__item"
type="button" href="/auth/realms/cern/broker/eduGAIN/login?client_id=webframeworks-app-catalogue-isoldeop-wp&tab_id=bfRlI1-oK8g&client_data=eyJydSI6Imh0dHBzOi8vaXNvbGRlb3Aud2ViLmNlcm4uY2gvcmVkaXJlY3RfdXJpIiwicnQiOiJjb2RlIiwic3QiOiI2NDViMzdlODY0YWIwNGIxZWIzYjllMTdmYjA0M2FlYiJ9&session_code=7PrzPD7_VjsRKtLH08Rq6uGgfpQ5by5dXabGaFWRdGM">
<i class="kc-social-provider-logo kc-social-gray fa fa-university" aria-hidden="true"></i>
<span class="kc-social-provider-name kc-social-icon-text">Home Organisation - eduGAIN</span>
</a>
<a id="social-guest" class="pf-c-button pf-m-control pf-m-block kc-social-item kc-social-gray pf-l-grid__item"
type="button" href="/auth/realms/cern/broker/guest/login?client_id=webframeworks-app-catalogue-isoldeop-wp&tab_id=bfRlI1-oK8g&client_data=eyJydSI6Imh0dHBzOi8vaXNvbGRlb3Aud2ViLmNlcm4uY2gvcmVkaXJlY3RfdXJpIiwicnQiOiJjb2RlIiwic3QiOiI2NDViMzdlODY0YWIwNGIxZWIzYjllMTdmYjA0M2FlYiJ9&session_code=7PrzPD7_VjsRKtLH08Rq6uGgfpQ5by5dXabGaFWRdGM">
<i class="kc-social-provider-logo kc-social-gray fa fa-envelope" aria-hidden="true"></i>
<span class="kc-social-provider-name kc-social-icon-text">Email - Guest Access</span>
</a>
</ul>
</div>
<div id="social-providers" class="sub-providers">
<hr class="more-space-below">
<div class="login-form-caption-large"><h2>Sign in with a social account</h2></div>
<div class="social-privacy-notice">By clicking on the buttons below, you consent to CERN's transfer of your login request to the social provider and to receive your account name, name and e-mail for authenticating you. See more details in our <a href="https://auth.docs.cern.ch/privacy-notice/#social-login-providers-privacy-notices" target="_blank">Privacy Notice</a>.</div>
<ul class="pf-c-login__main-footer-links kc-social-links ">
<a id="social-google" class="pf-c-button pf-m-control pf-m-block kc-social-item kc-social-gray pf-l-grid__item"
type="button" href="/auth/realms/cern/broker/google/login?client_id=webframeworks-app-catalogue-isoldeop-wp&tab_id=bfRlI1-oK8g&client_data=eyJydSI6Imh0dHBzOi8vaXNvbGRlb3Aud2ViLmNlcm4uY2gvcmVkaXJlY3RfdXJpIiwicnQiOiJjb2RlIiwic3QiOiI2NDViMzdlODY0YWIwNGIxZWIzYjllMTdmYjA0M2FlYiJ9&session_code=7PrzPD7_VjsRKtLH08Rq6uGgfpQ5by5dXabGaFWRdGM">
<i class="kc-social-provider-logo kc-social-gray fa fa-google" aria-hidden="true"></i>
<span class="kc-social-provider-name kc-social-icon-text">Google</span>
</a>
<a id="social-github" class="pf-c-button pf-m-control pf-m-block kc-social-item kc-social-gray pf-l-grid__item"
type="button" href="/auth/realms/cern/broker/github/login?client_id=webframeworks-app-catalogue-isoldeop-wp&tab_id=bfRlI1-oK8g&client_data=eyJydSI6Imh0dHBzOi8vaXNvbGRlb3Aud2ViLmNlcm4uY2gvcmVkaXJlY3RfdXJpIiwicnQiOiJjb2RlIiwic3QiOiI2NDViMzdlODY0YWIwNGIxZWIzYjllMTdmYjA0M2FlYiJ9&session_code=7PrzPD7_VjsRKtLH08Rq6uGgfpQ5by5dXabGaFWRdGM">
<i class="kc-social-provider-logo kc-social-gray fa fa-github" aria-hidden="true"></i>
<span class="kc-social-provider-name kc-social-icon-text">GitHub</span>
</a>
<a id="social-facebook" class="pf-c-button pf-m-control pf-m-block kc-social-item kc-social-gray pf-l-grid__item"
type="button" href="/auth/realms/cern/broker/facebook/login?client_id=webframeworks-app-catalogue-isoldeop-wp&tab_id=bfRlI1-oK8g&client_data=eyJydSI6Imh0dHBzOi8vaXNvbGRlb3Aud2ViLmNlcm4uY2gvcmVkaXJlY3RfdXJpIiwicnQiOiJjb2RlIiwic3QiOiI2NDViMzdlODY0YWIwNGIxZWIzYjllMTdmYjA0M2FlYiJ9&session_code=7PrzPD7_VjsRKtLH08Rq6uGgfpQ5by5dXabGaFWRdGM">
<i class="kc-social-provider-logo kc-social-gray fa fa-facebook" aria-hidden="true"></i>
<span class="kc-social-provider-name kc-social-icon-text">Facebook</span>
</a>
<a id="social-apple" class="pf-c-button pf-m-control pf-m-block kc-social-item kc-social-gray pf-l-grid__item"
type="button" href="/auth/realms/cern/broker/apple/login?client_id=webframeworks-app-catalogue-isoldeop-wp&tab_id=bfRlI1-oK8g&client_data=eyJydSI6Imh0dHBzOi8vaXNvbGRlb3Aud2ViLmNlcm4uY2gvcmVkaXJlY3RfdXJpIiwicnQiOiJjb2RlIiwic3QiOiI2NDViMzdlODY0YWIwNGIxZWIzYjllMTdmYjA0M2FlYiJ9&session_code=7PrzPD7_VjsRKtLH08Rq6uGgfpQ5by5dXabGaFWRdGM">
<i class="kc-social-provider-logo kc-social-gray fa fa-apple" aria-hidden="true"></i>
<span class="kc-social-provider-name kc-social-icon-text">Apple</span>
</a>
<a id="social-linkedin-openid-connect" class="pf-c-button pf-m-control pf-m-block kc-social-item kc-social-gray pf-l-grid__item"
type="button" href="/auth/realms/cern/broker/linkedin-openid-connect/login?client_id=webframeworks-app-catalogue-isoldeop-wp&tab_id=bfRlI1-oK8g&client_data=eyJydSI6Imh0dHBzOi8vaXNvbGRlb3Aud2ViLmNlcm4uY2gvcmVkaXJlY3RfdXJpIiwicnQiOiJjb2RlIiwic3QiOiI2NDViMzdlODY0YWIwNGIxZWIzYjllMTdmYjA0M2FlYiJ9&session_code=7PrzPD7_VjsRKtLH08Rq6uGgfpQ5by5dXabGaFWRdGM">
<i class="kc-social-provider-logo kc-social-gray fa fa-linkedin" aria-hidden="true"></i>
<span class="kc-social-provider-name kc-social-icon-text">LinkedIn</span>
</a>
</ul>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div id='cernfooter'>
<div id='flex'>
<div class='col debug'>-<br/>k8s-authzsvc-prod-b-v35</div>
<div class='col'>
<h2>Account</h2>
<ul>
<li><a href='https://users-portal.web.cern.ch' target='_blank'>Manage your account</a></li>
</ul>
</div>
<div class='col'>
<h2>Privacy</h2>
<ul>
<li><a href='https://auth.docs.cern.ch/privacy-notice/' target='_blank'>Privacy Notice</a></li>
</ul>
</div>
<div class='col'>
<h2>Support</h2>
<ul>
<li><a href='https://www.cern.ch/service-portal' target='_blank'>Service Desk - </a> <a href='tel:+41227677777'>+41 22 76 77777</a></li>
<li><a href='https://cern.service-now.com/service-portal?id=service_status_board' target='_blank'>Service Status</a></li>
</ul>
</div>
<div class='lastcol'>
<a href='https://home.cern' title='CERN' rel='CERN' target='_blank'><img border='0' src='/auth/resources/cywqa/login/keycloak-cern-theme/img/logo.svg' alt='CERN' class="cernlogo"></a>
</div>
</div>
</div>
</body>
</html>
