Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 5 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://wo.spbstu.ru/robots.txt
301 MovedPermanently
https://wo.spbstu.ru/robots.txt
302 Found
https://wo.spbstu.ru/social/login/cas-oauth2/?next=/robots.txt
302 Found
https://cas.spbstu.ru/oauth2.0/authorize?client_id=c9906912-469b-4329-99c3-5f8463d33a3b&redirect_uri=https://wo.spbstu.ru/social/complete/cas-oauth2/&state=ey52AGENvQnBn7PyN95T0iuXWxbCbarv&response_type=code
302 Found
https://cas.spbstu.ru/login?service=https%3A%2F%2Fcas.spbstu.ru%2Foauth2.0%2FcallbackAuthorize%3Fclient_id%3Dc9906912-469b-4329-99c3-5f8463d33a3b%26redirect_uri%3Dhttps%253A%252F%252Fwo.spbstu.ru%252Fsocial%252Fcomplete%252Fcas-oauth2%252F%26response_type%3Dcode%26client_name%3DCasOAuthClient
200 OK
Показать содержимое robots.txt
<!DOCTYPE html><html>
<head>
<title>Login — SPbPU SSO</title>
<meta charset="UTF-8"/><meta http-equiv="X-UA-Compatible" content="IE=edge"/><meta name="viewport" content="width=device-width, initial-scale=1"/><link rel="apple-touch-icon" sizes="180x180" href="/sso/favicons/apple-touch-icon.png"><link rel="icon" type="image/png" sizes="32x32" href="/sso/favicons/favicon-32x32.png"><link rel="icon" type="image/png" sizes="16x16" href="/sso/favicons/favicon-16x16.png"><link rel="manifest" href="/sso/favicons/manifest.json"><link rel="mask-icon" href="/sso/favicons/safari-pinned-tab.svg" color="#5bbad5"><meta name="theme-color" content="#ffffff"><link rel="stylesheet" href="/webjars/font-awesome/5.0.13/web-fonts-with-css/css/fontawesome-all.min.css"/><link type="text/css" rel="stylesheet" href="/webjars/lato/0.3.0/css/lato.min.css"/><link rel="stylesheet" href="/sso/css/loginPage.css"/></head>
<body id="cas" class="login">
<div id="container" class="form_wrap">
<svg xmlns="http://www.w3.org/2000/svg" width="266.1px" height="42.1px" viewBox="0 0 266.1 42.1" xml:space="preserve" class="logo">
<g>
<path class="text" d="M86,21c0-8.4,3.5-15.7,13.7-15.7c10.2,0,13.7,7.2,13.7,15.7c0,8.5-3.5,15.7-13.7,15.7
C89.5,36.7,86,29.5,86,21 M92.4,21c0,5,1,9.7,7.3,9.7c6.3,0,7.3-4.7,7.3-9.7c0-5-1-9.6-7.3-9.6C93.4,11.4,92.4,16.1,92.4,21
M246.6,6.1l5.6,9.3l5.6-9.3h7.5l-9.1,14.3l9.9,15.6h-7.6l-6.3-10.5L245.9,36h-7.6l9.9-15.6l-9.1-14.3H246.6z M219,18h11.8v5.8H219
V30h13.9v6h-20.3v-30h20.3v6H219V18z M192,36V12.1h-8.2v-6h22.8v6h-8.2V36H192z M158.9,36h-6V6.1h6.4v18.4l11.8-18.4h6V36h-6.4
V17.6L158.9,36z M117,30.1c2.7,0.1,4.4-1.1,5.1-3.5c1.7-6.5,1.9-13.8,2.9-20.6h19.3V36h-6.4V12.1h-7.2c-0.4,4.2-1.1,11.4-2.3,16
c-1.4,5.2-5.6,8.3-11.2,8.1V30.1z M55.5,36V6.1h23.4V36h-6.4V12.1H61.9V36H55.5z"/><path class="pi" d="M20.7,0
c-3.6,0-9.5,0.2-12.9,0.6c-4.7,0.6-6.6,3-7.1,7.5C0.3,11.5,0,16.4,0,21s0.1,9.6,0.7,13c0.7,4.4,2.8,6.8,7.1,7.5
c3.4,0.5,9.7,0.6,12.9,0.6c3.2,0,9.5,0,12.9-0.6c4.3-0.7,6.3-3,7.1-7.5c0.6-3.4,0.7-8.6,0.7-13s-0.4-10.3-0.7-13
c-0.5-4.6-2.5-6.9-7.1-7.5C30.2,0.1,24.3,0,20.7,0z M35.2,4.8c0.9,0.4,2.5,2.8,2.2,5.4c-1.8,1.4-3.9,2.5-6,2.8v16.6h6.2
c0,2.6-0.4,4.6-0.8,5.3H25.4V13.2h-7.9v12.9c0,6.5-3.7,9.7-8.4,9.7c-1.3,0-2.9-0.2-4.2-0.6c-0.6-0.9-0.9-3.4-1-6.5
c3.1,1.5,7.3,2.2,7.7-2.7V14c-4.7,0.5-6.5,3.8-8.1,6.1c0-3,0.2-5.7,0.3-7.5c3.2-3.5,6.9-5.1,14-5.1h10.2C30.6,7.5,33,6.5,35.2,4.8z
"/></g>
</svg>
<script id="page-context" type="text/page-context">
{
"text": {
"loginwip": "Wait",
"login": "Login"
}
}
</script>
<form id="enter" method="post" action="login" class="form_enter" style="">
<div id="notices">
<div id="serviceui" class="serviceinfo">
<div>
<table>
<tr>
<td>
<img title="wo"
alt="wo"
src="images/webapp.png"
width="32"
height="32"
style="width: auto; height: auto;max-width: 52px;max-height: 52px"
/></td>
<td id="servicedesc">
Рабочий офис НПР</td>
</tr>
</table>
</div>
</div>
</div>
<div class="form_group">
<label for="user" class="form_label">Username</label>
<input
type="text"
tabindex="1"
class="form_input"
id="user"
autocomplete="off"
accesskey="u" name="username" value=""></div>
<div class="form_group">
<label for="password" class="form_label">Password</label>
<input
type="password"
class="form_input"
id="password"
tabindex="2"
accesskey="p" name="password" value=""></div>
<div class="form_group btns">
<div class="one-half">
<input
type="submit"
accesskey="l"
tabindex="6"
class="btn btn-rounded submit"
id="doLogin"
value="Login"></div>
<div class="one-half text-right">
<input type="button" value="Reset" class="btn btn-rounded cancel" id="doCancel"></div>
</div>
<input type="hidden" name="execution" value="34565640-dba4-49ee-84ab-95b4d6c0201e_ZXlKaGJHY2lPaUpJVXpVeE1pSjkuYWQvdkpOVVcrbGZwMnNHMnY0WlMxTmk1ZkJ4RnpNclBwaXpYdFN0cEJmTHBQa3NkdzlMWnhtczd3T2VqcURjN2hhNjBCU3IyRFMyL1JvMlllVnVGajdNWnZMRmlTRmpraEJYSDVVRE80Wk50ak9QcS9Rb0thL2FnK1krK2RlT0s1RDdKRFByUkNIRVlWeDdPSkhkdC9YY0M0aXROR0NQK1RhV2ZhcXBlRm5zQzRhVjZYR2wwTjZVQis3REt5UHVpSlVONXc3VGx6NUFWSVRTd09sT1ZNU0RHcE5aWjJVTVFRcktad1NzT1hKQ2NrZWJETEpjY2FhOGY1ankxblhaQVJVbE9aU1V2Z1ZuTStaTmdzVnQzamlHc2FYUWZhdExXVGZJV3J3MFduaC81dXluMWh3SHVFL0hEWkQyYkYramxsV09TU3pYdTg0aGlnT0JSaExLT2ZhdjFLWXZZck1ZVVp0U2lDT0tGVEdBZjFRUUxYMEEvcUZSNWNqNityMUhRQzhpUVM0dnZnSUsrd2ZxeDJYbnpqellka2RrM3pxcElOSjh0WmhDMUJDRG5nYW9meVQxMThERnFrYWMwRDZ6OVAydzVyRGdPL3g4Ui9JYzR5amk5R3B5ZVZ0YUk0dFBnc0VHR2V6OFlqeDYxU2VHVTBGc3E4UEh2Y0NxWEFBMkk3U3ZnZzRpdm5UNnlLNTZsbkJsb1ZaZ1J2NFdwUDc5V1gzT1M1QSs0UTB3QXFiNlg1ajNEUHB3Q3B4YmpVdDltdjR2N25rTWRCMGdYdEJONmdWSGZHZ3dOZjJiNjRwT1hwZ3BUWko1ajU4WUpkK2FyNmg4TTljelFqMkh2K0c2aDc2WkhDT05Rb2RpNEhORHdkWGE3OXZGd3BKOEQ5clM2RWQ0UzJtOUM1M1JNbVY2ZTdwRTRoOCttUlhXNXpCcUJ6RlRBRThyMkd1K1VMd0IvNm5iL04xQ3VUaVdRcVExOEw3YXRwZzIwTGJsWDZWU0MzS3B2dHJyOUFBMTdsNDlNWjZkakxyaktUdzViZkptckltb1kzd00wUmpsbnhzNnMwRXc4Rm5tUEp5R1NITERNMTg2ZjJ0VTRxbzN0ekcySEI2YjUrN2RLWmZpaFlJMVB3YlRoSTBiZzZESmlucTRyeXl1b3JwVGlRM1FVNkQvT29palZGU2dVRkFXS2ZodytaVVorQS9HUXFuNXFzQU5QeXZmaWJvSThDci8rTXRhREw0VjB4M0JHcTI5TmVUWUN4MWhwRThaWVp2d2NZZkVvejBZSHBCRHhMY2N4UGVmakJ1dTVxTDZ4Zjlia0hTQTdZKzN0UDE0M0ZOcnltTE9RUE01VysvL2kwY1QwVERTcnkxSXVsc2lLWlVLVGRQOUlNb1dyVTB1TFhmM1k3dXV3MjN0djNlc2o4eFk3SVR1KzRQZjQ5eTF5SGU5QTY3MjBvTkJvY2pEY01pSFh0YndoaFVvZlR2cmw4bHg3OVZJNnZydmQzamRnV3phekt3Z2t5ZWExSWZsalBUUks4NU9mQUdrS0gwZVJvRkRMKzI1L3lMSDliUWZncS9HM1NZeEJBVE93RFhIT3FiNUJ6UFBwRmRLRUZJekJJMkFlK2VMUmJDYVVJMEJaLzFnc2hxWW9LbitMcmVNcEdxNWcrWFRWZkxDMjhNbDMybXVhM0tvN2ZNdm1HYTZRd1VSZWovSnFScnpaalNRSkFHOXU5dGtEUU55N1djZUlaejcvcGt0a2x2bjZUc0lWM3VKamtxYTJOWkJ3d3hvSm4rVHhzRElrNDhGTTIxMk52U3ZRcFJyaUl1bnZINjhudFByZFJhNlExSFdvZnpFUzFveTZwVFU5eEgwQVNQcEdvM2ltZmlxaUp6bEJ3a01DWXZYL2pwK0w5SWFyL1NMNFF4SVdKV2wrNFFkd0UxSlNtWCtVNHpSa1dIams0K0tSUnNQeUdqaXhyMzBwdytkM1R0cGUxWElBdUpEOGY0dHdVbkw2ajR1TjkwQlRRZEpXMTlvMk1SWEtleG9vNzBEcjNhN1FicWFJTWd1L3NoNk9WZHlYZEw3RVYrblgwejZPNnpERUdMcUlaRHFtRmEwQ3p2ODZDNGR6NUxDb05GMCtlRDdqVzZnVmtPKzZFWVh1OUo0Wi9ObTBmNlJ4dHRZK2N1ZnZPalY1L1hkYnBDNFQ4Zjl6Rmd5WXNmQVhpU011RmFPQ1JSMFJPZmFoenNGOTFvSGQ0T0dEMlJ3ZHRnblBXb2h1UUFCdVprYkppREtnUjdkQ01NbTB6YnVyNktRQjM2TjBBRHlwajd2Zm5OSEZTL3dtYmtvemdpb1BtdTQzSHVZRTh2NHJhOWFrRWN1RXNsRjNGdkZkeWVmOGprT3FpSjFsV0ZTOEgwTjl6Q21YZTd6WDZZWm4vTVRJZG83S2cxYVZmTFhXaHhvN3dmNW9Rc3JudUxtMFpXUER2TWVFbkN4UXdydE0yMnJ4YXhBZ1B6ZzdDdUJUUlk0U3I3b3BuOWNpNGl0VjUyOEJFNEpWRlRLNldpczBhbnFIN240YUdVcS9DRFlWN0NpV3gvNDJhczNWUmFoZWwrWkVIRmE2Z0lJdHk2U1dqb2pvckRhRzhYUXlSdGF6T2ZlRllKNDBhcEovZXpXcFlQeGoxRjAzdGpJWGdNWVMrOHNqbHl2UkFtaDIyMkZCQXk0M1dBdjZSNndDK2lXcGRORXhuV0dWYW9QRk42c0VzMFRpNFM3czQ4cEd1NUFOUDRjU080ZU1tZ2RTT0NCSUlubG52UE1rSSt4ekZXYjVaK0ExSUlyZy9YVnlKYW92cjQzZG90bGFOWUlKWDVjTG9TOGE3d0hwMWpGV3k4L1VGT2ZHNlMvUUE4WnFtY3d4aU5GaytCSTdmSXVjL3lyUzYvN2JBYm1hSDNwMWRsMDdncUxNamJkaUFZR2cwUTFTZ2lzVjZBSS9xemk1UUZTTmxSZHdYK0lLREYvWTduMVVuUndFcS9Ga0piUmh2RWtETUM2bHhadnR5SWJqUk92ZmNDU3NHZXAybWVvRGxvSzUrNlpRcW9jS2R5amI2c1ZjdWRhNVBKa2krQWdyTXEvUkIxN2lVaThpb3FseVVSSlJYcS80Y09uZ1B2SDZlbEc0ZWNxTmE5clEySkVMSHlEdlBxempFZlo1bkZ1VVdNSktydnNqcEJkRU5LWWRTdzNxdlptSThwbXpzL29lQ1RvMUlmL3BHMlM0Z3pWN2tITGFHQTF1bzB2ZnhNT1FsbktYOW1mVFI3d3cyeUYyRlMwTU5yQzZBd3lSNU4rcmFjZjJ1cHUrWFJEczlmTWdyNHdidlp6aVgzZVR6ZFdDclRJNjdOVEpRSkZQMnRTa1UwcWFpdW1pbXg5c0J6Qk81eUtoNUZJQndsU2dvRDc5ejBwblVVNXVzcDN0bmt1T2JtTjgxeXhCQmU2c0pXdDlkaDZNOTQ2L0FPWm5rRGh5UHBtL1J5MmJZR0VmMWV3Ulp6elR1WE8vWmllOFdPbVpJdGo3bmROR3F1MWl4N0ErVkxOV1R2c1NlT0N4ODdCS0JBK0JsWEI2djZXekV6Q0pnVkpqY04xVVd5TnJQVFhlK0w2a0JXYmwvOWEzdGRvSnJaMGxqVGFWSkxKMDIzRDRKMXdFemprZzFWVFRPMFgwNElia01pdTd5SytLWWdhSTh6cjQ3ejZjY0VNVWFQVjlBSUw4ZTBib2poWUhBRm1VUS95b3RZZ2ZndFFpZjl4dDd1dTZVK2g0VUxNOEpzVVZNbDg3bFgwbFZ1T2x4VXAxUWRZcDJITFBCQjdPajZsNjVNT3BaUkJZTldKZUVkOS9kUUJac2lSS3dCSHVqNzluZXQraThNR3BDWGhEQWtaVk1OWDlLRnU5T3RoM2NGNDZZeG9kRnJIb3owV1lnVVNHQk9VTkxqamw5b1dTMlltZ0VEMTJlNEJhVndDbDBPMzRvU0pMWURuOGdGZUdFYTBmOEZSZTlPTGJsZGQ4SVZ0azEyRDRud0MrMFFVUVpnMi9xak9QMUpnVm9jdHc2RWFzdzhIQmZLd09wL3dsVFZGWlB6SC9DUmpvTGd0elFOUjRpQXJEQk9rREpUZjRWZGZtN0xpRWRMd2krT3ZPVTZ0ZXBScTBsa1plWmltenV5WUtaWGdRR0hVQkpzVEdsRzUrZzR4Z1c1bGFydDVnMDloNW9mU24xeUNad2pxakwzcmRsK3M3ZVorZTR2TlRwcEVSTXlHbDJQc3VmWWdmcHlCempwRHdDMkFsb2pxbTZJL0RtOVZzNFdwNHhIUGpBcHFBTG16OGI0cktYc1AyVEg0cVJmQ2Z6LzZId1hvcTJ1dmx2ZlhRN1hxUXU5dkdwdVY1RG9ETWthdzI3bG9XTW56bEFTRUVDc2kyaExWek15bzFZZHlnTGJxM0dab0pjdVN1ZzdUNHcvN3NEeWl0RDcycHVaVC9mbGtBbEE9PS4taFRiQy1WUF9pWnQyaHJYamF6Q1lINDBkbG5rVWZobzBWdlJ2dUZvS2ZTdm50NnJ1aXd0RGVEcmdKTVQwcjFJRmtJeExZdlhJRURES3A0MDlMYmtzUQ=="/><input type="hidden" name="_eventId" value="submit"/><input type="hidden" name="geolocation"/></form>
</div>
<script type="text/javascript" src="/sso/js/vendors.bundle.js"></script>
<script type="text/javascript" src="/sso/js/loginPage.bundle.js"></script>
</body>
</html>