Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 6 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://ncda.kdp.io/robots.txt
302 Found
https://ncda.kdp.io/robots.txt
302 Found
https://ncda.kdp.io/app
302 Found
https://ncda.kdp.io/auth
302 Found
https://ncda.org/oauth/authorize?state=6HDGfKQ2Kc3YkTpzeUJ4mhCYqLUJ3eHq&response_type=code&approval_prompt=auto&client_id=a173e5c857ea76239a610aaac7c80c4434d1b9678722eed2f84910b131ee92fb&redirect_uri=https%3A%2F%2Fncda.kdp.io%2Fauth%2Fsso%2Fcallback
302 Found
https://ncda.org/aws/NCDA/login/login?follow_up_url=%2Foauth%2Fauthorize%3Fstate%3D6HDGfKQ2Kc3YkTpzeUJ4mhCYqLUJ3eHq%26response_type%3Dcode%26approval_prompt%3Dauto%26client_id%3Da173e5c857ea76239a610aaac7c80c4434d1b9678722eed2f84910b131ee92fb%26redirect_uri%3Dhttps%253A%252F%252Fncda.kdp.io%252Fauth%252Fsso%252Fcallback
200 OK
Показать содержимое robots.txt
<!DOCTYPE HTML>
<html lang="en">
<head><!-- Begin Bootstrap Header -->
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
<!-- The above 3 meta tags *must* come first in the head; any other head content must come *after* these tags -->
<script src="https://ncda.org/bootstrap4/js/jquery-3.7.1.min.js"></script>
<!-- <link rel="stylesheet" href="/bootstrap4/css/fontawesome-all.min.css">-->
<link rel="stylesheet" href="https://ncda.org/fontawesome-6.4.2/css/all.min.css?ver=002" />
<link href="https://ncda.org/bootstrap4/css/bootstrap.min.css" rel="stylesheet">
<link rel="stylesheet" href="https://ncda.org/bootstrap4/css/mdb.min.css" xmlns="http://www.w3.org/1999/html">
<!-- End Bootstrap Header -->
<script src="/assets/application-4a50bb57e88beee6b5c23e61e744b50c094005be5ef9fcebcc0062d6db326f74.js"></script>
<link rel="stylesheet" media="screen" href="/assets/application-9503260fc8cec2d000c4c32051a873aa71b2f0bb6ef8a8d7cc04cf73a27f7e73.css" />
<title></title>
<meta name="description" content=""/>
<link rel="icon" type="image/x-icon" href="https://ncda.org/aws/NCDA/am/gi/favicon.ico?ver=71" />
<link href="https://fonts.googleapis.com/css?family=Lato:100,300,400,700,900" rel="stylesheet">
<style type='text/css'>.temp {color:#FFF;}</style><link href='https://ncda.org/aws/NCDA/pt/css/css-screen.css?ver=100' media='screen' rel='Stylesheet' type='text/css' />
<style type='text/css'>.temp {color:#FFF;}</style><link href='https://ncda.org/aws/NCDA/pt/css/css-print.css' media='print' rel='Stylesheet' type='text/css' />
<script src="https://assets.adobedtm.com/175f7caa2b90/cd927d082cec/launch-47b913433e34.min.js" async></script>
<script src="/assets/application-4a50bb57e88beee6b5c23e61e744b50c094005be5ef9fcebcc0062d6db326f74.js"></script>
<meta name="csrf-param" content="authenticity_token" />
<meta name="csrf-token" content="Td/qek5R+4dCLQ8Ced5Pco2oJLJwyBndCZC0is6laeIlLnxhfvncErOt3uQKw07qqqrDC6Cx1xr6NFCE063W2g==" />
<link rel="stylesheet" media="screen" href="/assets/application-9503260fc8cec2d000c4c32051a873aa71b2f0bb6ef8a8d7cc04cf73a27f7e73.css" />
</head>
<body class="login-page">
<div class="login-container">
<div id="login-box" class="z-depth-1">
<div id="login-logo">
<a href="https://ncda.org/aws/NCDA/pt/sp/home_page">
<img src="https://ncda.org/aws/NCDA/am/gi/NCDA_logo.png?ver=5" border="0" alt="The National Career Development Association"/></a>
</div>
<div id="login-text">
<div class="tcsnews"><h1><strong>Welcome</strong></h1>
<p>If you don't recall your password, enter your email address and click <strong><em>'Forgot Login/Password'</em></strong> and follow the instructions on the next page. If your email address is not found and you are not an NCDA Member, you will need to click the <strong><em>'Create New Account'</em></strong> button next to the Login area.</p>
<p><strong>Members may need to contact the NCDA office in order for Member Security and Discount Codes to be ACTIVATED. Please contact our office at (918) 663-7060 or<br /><a href="mailto:webeditor@ncda.org">webeditor@ncda.org</a>.<br /></strong></p></div>
</div>
<!-- ==================== Begin TCSRESULTS ==================== -->
<div id="mainPage" class="container">
<div id="mainContent" class="row">
<!-- If already logged in, then just display error message. Don't redisplay login window. -->
<div class="col-md-8 col-md-offset-2">
<!-- Display Login Form -->
<!-- <div class="tcsSubHeadFont tcs-grey text-left" style="border:none;margin:10px 0 0 0">Please log in to continue.</div>-->
<form name="loginform" id="loginform" class="tcs_form_class" onkeypress="javascript:form_keypress(event.keyCode);" action="/aws/NCDA/login/login" accept-charset="UTF-8" method="post"><input name="utf8" type="hidden" value="✓" /><input type="hidden" name="authenticity_token" value="nA+UfuBPZjgc0ycvNsDr0z6D9nXe5cJCt0J0+3tjGUL0/gJl0OdBre1T9slF3epLGYERzA6cDIVE5pD1Zmumeg==" />
<input type="hidden" name="follow_up_url" id="follow_up_url" value="/oauth/authorize?state=6HDGfKQ2Kc3YkTpzeUJ4mhCYqLUJ3eHq&response_type=code&approval_prompt=auto&client_id=a173e5c857ea76239a610aaac7c80c4434d1b9678722eed2f84910b131ee92fb&redirect_uri=https%3A%2F%2Fncda.kdp.io%2Fauth%2Fsso%2Fcallback" />
<input type="hidden" name="subsite" id="subsite" />
<input type="hidden" name="continue_shopping_uri" id="continue_shopping_uri" />
<div id="tcs-login-panel" class="tcsInputForm tcs-box-shadow-4dp">
<div class="row">
<div class="col-md-12">
<div class="tcsFormTitle tcs-grey text-left">Log In</div>
<div class="tcsFormInput">
<label for="userlogin" class="text-left">Login or Email</label>
<input type="text" name="userlogin" id="userlogin" />
</div>
<div class="tcsFormInput" style="margin-top:5px">
<label for="password" class="text-left">Password</label>
<input type="password" name="password" id="password" size="20" maxlength="20" />
</div>
<div class="tcsFormSubmit" style="margin-top:10px">
<button id="login" type="submit" value="Login">
Login
</button>
</div>
<div class="tcsForgotPassword">
<a href="/aws/NCDA/login/forgot_password">Forgot Login/Password?</a>
</div>
</div><!-- col-md-8 -->
</div><!-- row -->
</form> <!-- form -->
</div> <!-- <div class="col-md-8 col-md-offset-2"> -->
<!-- if (session[:current_end_user][:access_level].to_i > 10) -->
</div>
</div>
</div>
<!--
=================================
Styles unique to this page.
=================================
-->
<style>
h3 {
margin-top:15px !important; /* Force spacing for user layout h3 tags because they seem to have 0px for margins. */
}
button { cursor:pointer; }
#login-text { margin-bottom:0px; border-bottom:none !important; }
.tcs-blue
{
color: #337AB7;
}
.tcsSubHeadFont
{
font-size: 20px;
font-weight: 200;
margin-bottom: 10px;
}
.tcsInputForm
{
border:1px solid #F0EFEF;
padding:20px;
border-radius:10px;
background:#fff;
position:relative;
margin-bottom: 30px;
}
.tcsFormTitle
{
font-size: 30px;
font-weight: 200;
line-height: 1em;
margin-bottom: 15px;
padding-bottom: 15px;
border-bottom: 1px solid #F0EFEF;
}
.tcsFormInput label
{
display: block;
margin-bottom: 5px;
color: #878380; /* 20230321 TCS - Make labels darker */
}
.tcsFormInput input
{
padding: 7px;
margin-bottom: 15px;
width: 100%;
border-radius: 5px;
border: 0px;
background: #FFF; /* #F0EFEF; */
border:3px solid #F0EFEF;
color: #837d7d;
box-sizing: border-box;
}
.tcsFormInput input:focus
{
border:3px solid #0093D9;
background:#fff;
}
.tcsFormSubmit
{
text-align: right;
}
.tcsnews p { text-align:left; margin-top:10px } /* 20230321 TCS - Make sure all page paragraphs of text are left-justified. */
#login
{
background: #005288;
padding: 10px 30px;
border: 0px;
border-radius: 5px;
color: #fff;
}
#login:hover
{
background:#f28200;
}
#login-tcs
{
background: #0093D9;
padding: 10px 30px;
border:0px;
border-radius: 5px;
color: #fff;
}
#login-tcs:hover
{
background:#f28200;
}
#new-account-button
{
background: #0093D9;
padding: 10px 30px;
border: 0px;
border-radius: 5px;
color: #fff;
}
#new-account-button:hover
{
background:#f28200;
}
/* If this is an embedded form, use neutral colors for buttons */
#login {
background: #f0f0f0 ;
padding: 10px 30px;
border: 0px;
border-radius: 5px;
color: #222;
border: 1px solid #d4d4d4 ;
}
#login:hover {
background: #f9f9f9 ;
}
#new-account-button {
background: #d4d4d4 ;
padding: 10px 30px;
border: 0px;
border-radius: 5px;
color: #fff;
font-weight:bold;
border: 1px solid #d4d4d4;
width:100% !important;
}
#new-account-button:hover {
background: #f9f9f9;
color: #a7a7a7;
}
.tcsForgotPassword
{
position: absolute;
right: 10px;
top: 20px;
}
#terms
{
padding:20px;
margin-bottom:50px;
}
/* errorExplanation - used by error messages on each page ---- */
#errorMessages.errorExplanation {
color:#000000;
background-color: #d7efff;
padding:10px;
border: 0px;
border-radius:5px;
margin-bottom:10px;
width:100%;
box-sizing: border-box;
}
#errorMessages.errorExplanation ul {
margin:0px !important;
padding:0px !important;
list-style-type: none;
}
#errorMessages.errorWarning {
background-color:#F8E0E0;
padding:3px;
}
#errorMessages.errorWarning h2 {
font-family: Verdana, Georgia, Helvetica, sans-serif;
font-size: 14px;
font-weight: bold;
line-height: 1.2em;
margin-left:5px;
margin-bottom:5px;
}
#errorMessages.errorWarning ul {
margin: 0 0 0 0px;
padding:0px;
}
#errorMessages.errorWarning li {
margin: 0;
}
/* ========================================= */
/* MEDIA QUERIES */
/* MAIN MONITOR ---------------------------- */
@media (min-width:993px) and (max-width:1200px)
{
}
/* MAIN TABLET ----------------------------- */
@media (min-width:768px) and (max-width:992px)
{
#new-user
{
margin-top:20px;
}
#new_account_button
{
padding: 5px 15px !important;
}
}
/* MAIN PHONE ----------------------------- */
@media (max-width:767px)
{
.tcs-header-jumbotron
{
height:100px;
}
#login
{
width:100%;
}
#login-tcs
{
margin-top:10px;
width:100%;
}
#new-account-button
{
width:100%;
}
#new-user
{
padding-top:20px;
padding-left:0px;
}
}
</style>
<script type="text/javascript">
document.loginform.userlogin.focus(); // focus cursor on Login input field.
function form_keypress(key_pressed) {
if (key_pressed != 13) {
return true;
}
else {
document.loginform.submit();
}
}
</script>
<!-- ==================== End TCSRESULTS ==================== -->
</div>
</div>
</div>
<!-- Begin Bootstrap Footer -->
<!-- Placed at the end of the document so the pages load faster -->
<script src="https://ncda.org/bootstrap4/js/popper.min.js"></script>
<script src="https://ncda.org/bootstrap4/js/bootstrap.min.js"></script>
<!--<script>jQuery.noConflict();</script>-->
<!-- If jQuery options present, then load jQuery add-on (UI) javascripts. But don't reload core jQuery libs since they are loaded above. -->
<!-- Other TCS page-specific Bootstrap-related custom javascript -->
<!-- End Bootstrap Footer -->
<!-- Begin Bootstrap-MDB Footer -->
<style>
.btn, .btn.btn-sm { font-family: sans-serif;
font-weight: 300;
line-height: 1.255;
color: #fff;
cursor: pointer;
-webkit-appearance: button;
display:inline-block;
white-space: nowrap;
vertical-align: middle;
border: 1px solid transparent;
padding: 0.375em 0.75em;
font-size: 1.0em;
border-radius: 0.25em;
text-transform: none;
}
.btn-primary,
.btn-primary:hover,
.btn-primary:focus,
.btn-primary:active { background-color:#007bff !important; border-color:#007bff !important; }
.btn-secondary,
.btn-secondary:hover,
.btn-secondary:focus,
.btn-secondary:active { background-color:#6c757d !important; border-color:#6c757d !important; }
.btn-outline-secondary,
.btn-outline-secondary:hover,
.btn-outline-secondary:focus,
.btn-outline-secondary:active { color: #797979 !important; background-color:#fff !important; border-color:#fff !important; }
.btn-danger,
.btn-danger:hover,
.btn-danger:focus,
.btn-danger:active { background-color:#dc3545 !important; border-color:#dc3545 !important; }
.btn-success,
.btn-success:hover,
.btn-success:focus,
.btn-success:active { background-color:#28a745 !important; border-color:#28a745 !important; }
</style>
<!-- Placed at the end of the document so the pages load faster -->
<!-- add following line to work-around bug in mdb.min.js -->
<script>$.fn.pickadate = $.fn.pickadate || {};</script>
<script src="https://ncda.org/bootstrap4/js/mdb.min.js"></script>
<script src="https://ncda.org/bootstrap4/js/wow.min.js"></script>
<script>
new WOW().init();
</script>
<!-- End Bootstrap-MDB Footer -->
</body>
</html>
Phusion Passenger