Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 3 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://marcomengoni.it/robots.txt
301 MovedPermanently
https://www.marcomengoni.it/robots.txt
302 Found
https://shor.by/MM_
200 OK
Показать содержимое robots.txt
<!DOCTYPE html><html lang="en"><head><meta charSet="utf-8"/><meta name="viewport" content="user-scalable=no,width=device-width,initial-scale=1"/><title>Marco Mengoni </title><link rel="shortcut icon" href="/favicon.ico?1" type="image/x-icon"/><link rel="apple-touch-icon" href="/touch-icons/apple-touch-icon.png"/><link rel="apple-touch-icon" sizes="57x57" href="/touch-icons/apple-touch-icon-57x57.png"/><link rel="apple-touch-icon" sizes="72x72" href="/touch-icons/apple-touch-icon-72x72.png"/><link rel="apple-touch-icon" sizes="76x76" href="/touch-icons/apple-touch-icon-76x76.png"/><link rel="apple-touch-icon" sizes="114x114" href="/touch-icons/apple-touch-icon-114x114.png"/><link rel="apple-touch-icon" sizes="120x120" href="/touch-icons/apple-touch-icon-120x120.png"/><link rel="apple-touch-icon" sizes="144x144" href="/touch-icons/apple-touch-icon-144x144.png"/><link rel="apple-touch-icon" sizes="152x152" href="/touch-icons/apple-touch-icon-152x152.png"/><link rel="apple-touch-icon" sizes="180x180" href="/touch-icons/apple-touch-icon-180x180.png"/><link href="/css/main.css" rel="stylesheet"/><link href="/css/shorby-page.css?dc02a642" rel="stylesheet"/><meta property="og:type" content="article"/><meta property="og:image" content="https://cdn.filestackcontent.com/PG2xTGppSGO3hAWW8V6n"/><meta property="og:title" content="Marco Mengoni "/><script>(function(w,d,s,l,i){w[l]=w[l]||[];w[l].push({'gtm.start':
new Date().getTime(),event:'gtm.js'});var f=d.getElementsByTagName(s)[0],
j=d.createElement(s),dl=l!='dataLayer'?'&l='+l:'';j.async=true;j.src=
'https://www.googletagmanager.com/gtm.js?id='+i+dl;f.parentNode.insertBefore(j,f);
})(window,document,'script','dataLayer','GTM-WCJDT87');</script><script async="" src="https://www.googletagmanager.com/gtag/js?id=UA-118079587-2"></script><script>
window.dataLayer = window.dataLayer || [];
function gtag(){dataLayer.push(arguments);}
gtag('js', new Date());
gtag('config', 'UA-118091080-2');
gtag('set', {'user_id': '89246'});
gtag('config', 'ga_id', {
'page_path': 'https://shor.by/MM_',
'page_location': 'https://shor.by'
});</script></head><body class="theme-custom custom-theme"><noscript><iframe src="https://www.googletagmanager.com/ns.html?id=GTM-WCJDT87" height="0" width="0" style="display:none;visibility:hidden"></iframe></noscript><style type="text/css">
.theme-custom{
background: url(https://cdn.filestackcontent.com/pjpg=q:80/no_metadata/cache=expiry:max/compress=m:true/XUo74cqtTqKlVtRqkFGq) #000000;
background-size: cover;
background-position: center 50%;
}
.theme-custom::before{
content: "";
background-color: #000000;
opacity: 0.5;
position: fixed;
top: 0;
bottom: 0;
right: 0;
left: 0;
z-index: -1;
}
.theme-custom .smartpage-container,
.theme-custom .smartpage-container .bio-title,
.theme-custom .smartpage-container h1,
.theme-custom .smartpage-container h2,
.theme-custom .smartpage-container h3,
.theme-custom .smartpage-container h4{
color: #FFFFFF;
}
.theme-custom .smartpage-container .powered-by-shorby .shorby-logo:before {
border-color: #FFFFFF;
}
.theme-custom .smartpage-container .block-item.layout-button {
background: #A7BEE1;
color: #FFFFFF;
}
.theme-custom .smartpage-container .add-block-button,
.theme-custom .smartpage-container .avatar.empty,
.theme-custom .smartpage-container .avatar-editor .avatar-upload {
color: rgba(255,255,255,0.5);
border-color: rgba(255,255,255,0.5);
}
.theme-custom .smartpage-container .bio-title h1.empty span{
border-color: #FFFFFF;
}
.theme-custom .smartpage-container .service-button{
background: rgba(255,255,255,0.5);
color: #000000;
}</style><script src="/smartpage.js?ec02a642"></script><div class="container smartpage-container"><header><img src="https://cdn.filestackcontent.com/PG2xTGppSGO3hAWW8V6n" class="avatar" alt="" title="Marco Mengoni "/><div class="bio-title"><h1 align="center">Marco Mengoni </h1><div class="bio-description"><p><br /></p></div></div></header><ul class="messengers blocks-num-0"></ul><ul class="rich-links"><li id="block0" class="links-block"><a href="/20xC" title="Canto d'amore / ASCOLTA ORA" class="block-item layout-card" style="background-image:"><div class="button-image"><img src="https://cdn.filestackcontent.com/compress=m:true/quality=v:80/cache=expiry:max/no_metadata/wUijs6ZeROyMsxdsxDSD" alt=""/></div><div class="block-content"><div>Canto d'amore / ASCOLTA ORA</div></div></a></li><li id="block1" class="links-block loading"></li><li id="block2" class="links-block"><a href="/Yzec" title="MATERIA (PRISMA)" class="block-item layout-card" style="background-image:"><div class="button-image"><img src="https://cdn.filestackcontent.com/compress=m:true/quality=v:80/cache=expiry:max/no_metadata/ELPTumfxSeqRq0v4ipOT" alt=""/></div><div class="block-content"><div>MATERIA (PRISMA)</div></div></a></li><li id="block3" class="links-block"><a href="/t8Kd" title="MATERIA (PRISMA) / CD, VINYL & EXCLUSIVE AND SIGNED PACK " class="block-item layout-card" style="background-image:"><div class="button-image"><img src="https://cdn.filestackcontent.com/compress=m:true/quality=v:80/cache=expiry:max/no_metadata/gbxsxD1MT2aVkQeEVd8d" alt=""/></div><div class="block-content"><div>MATERIA (PRISMA) / CD, VINYL & EXCLUSIVE AND SIGNED PACK </div></div></a></li><li id="block4" class="links-block"><a href="/zpt7" title="MATERIA (PELLE)" class="block-item layout-card" style="background-image:"><div class="button-image"><img src="https://cdn.filestackcontent.com/compress=m:true/quality=v:80/cache=expiry:max/no_metadata/dVItYhwUTIq3vVHELrjk" alt=""/></div><div class="block-content"><div>MATERIA (PELLE)</div></div></a></li><li id="block5" class="links-block"><a href="/DC7J" title="MATERIA (TERRA)" class="block-item layout-card" style="background-image:"><div class="button-image"><img src="https://cdn.filestackcontent.com/compress=m:true/quality=v:80/cache=expiry:max/no_metadata/J5WUkpQQZKxsRejDjTMY" alt=""/></div><div class="block-content"><div>MATERIA (TERRA)</div></div></a></li><li id="block6" class="links-block"><a href="/4eVj" title="MATERIA, LE PAROLE " class="block-item layout-card" style="background-image:"><div class="button-image"><img src="https://cdn.filestackcontent.com/compress=m:true/quality=v:80/cache=expiry:max/no_metadata/DVqsoMVcTP6p1SPw8z3O" alt=""/></div><div class="block-content"><div>MATERIA, LE PAROLE </div></div></a></li><li id="block7" class="links-block"><a href="/syC0" title="UNISCITI AL CANALE " class="block-item layout-card" style="background-image:"><div class="button-image"><img src="https://cdn.filestackcontent.com/compress=m:true/quality=v:80/cache=expiry:max/no_metadata/c59m9FHRhajg7iq7X9Pa" alt=""/></div><div class="block-content"><div>UNISCITI AL CANALE </div></div></a></li></ul><ul class="social-links blocks-num-5"><li class="social-item"><a href="/vkUG" title="Facebook"><svg aria-labelledby="svg-inline--fa-title-geDSJQs3dvA3" data-prefix="fab" data-icon="facebook" class="svg-inline--fa fa-facebook fa-w-16 fa-network" role="img" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 512 512"><title id="svg-inline--fa-title-geDSJQs3dvA3">facebook</title><path fill="currentColor" d="M504 256C504 119 393 8 256 8S8 119 8 256c0 123.78 90.69 226.38 209.25 245V327.69h-63V256h63v-54.64c0-62.15 37-96.48 93.67-96.48 27.14 0 55.52 4.84 55.52 4.84v61h-31.28c-30.8 0-40.41 19.12-40.41 38.73V256h68.78l-11 71.69h-57.78V501C413.31 482.38 504 379.78 504 256z"></path></svg></a></li><li class="social-item"><a href="/IWhh" title="Instagram"><svg aria-labelledby="svg-inline--fa-title-aMi72rinWoPp" data-prefix="fab" data-icon="instagram" class="svg-inline--fa fa-instagram fa-w-14 fa-network" role="img" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 448 512"><title id="svg-inline--fa-title-aMi72rinWoPp">instagram</title><path fill="currentColor" d="M224.1 141c-63.6 0-114.9 51.3-114.9 114.9s51.3 114.9 114.9 114.9S339 319.5 339 255.9 287.7 141 224.1 141zm0 189.6c-41.1 0-74.7-33.5-74.7-74.7s33.5-74.7 74.7-74.7 74.7 33.5 74.7 74.7-33.6 74.7-74.7 74.7zm146.4-194.3c0 14.9-12 26.8-26.8 26.8-14.9 0-26.8-12-26.8-26.8s12-26.8 26.8-26.8 26.8 12 26.8 26.8zm76.1 27.2c-1.7-35.9-9.9-67.7-36.2-93.9-26.2-26.2-58-34.4-93.9-36.2-37-2.1-147.9-2.1-184.9 0-35.8 1.7-67.6 9.9-93.9 36.1s-34.4 58-36.2 93.9c-2.1 37-2.1 147.9 0 184.9 1.7 35.9 9.9 67.7 36.2 93.9s58 34.4 93.9 36.2c37 2.1 147.9 2.1 184.9 0 35.9-1.7 67.7-9.9 93.9-36.2 26.2-26.2 34.4-58 36.2-93.9 2.1-37 2.1-147.8 0-184.8zM398.8 388c-7.8 19.6-22.9 34.7-42.6 42.6-29.5 11.7-99.5 9-132.1 9s-102.7 2.6-132.1-9c-19.6-7.8-34.7-22.9-42.6-42.6-11.7-29.5-9-99.5-9-132.1s-2.6-102.7 9-132.1c7.8-19.6 22.9-34.7 42.6-42.6 29.5-11.7 99.5-9 132.1-9s102.7-2.6 132.1 9c19.6 7.8 34.7 22.9 42.6 42.6 11.7 29.5 9 99.5 9 132.1s2.7 102.7-9 132.1z"></path></svg></a></li><li class="social-item"><a href="/rsyn" title="Twitter"><svg aria-labelledby="svg-inline--fa-title-KhyeNfLVmxMB" data-prefix="fab" data-icon="twitter" class="svg-inline--fa fa-twitter fa-w-16 fa-network" role="img" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 512 512"><title id="svg-inline--fa-title-KhyeNfLVmxMB">twitter</title><path fill="currentColor" d="M459.37 151.716c.325 4.548.325 9.097.325 13.645 0 138.72-105.583 298.558-298.558 298.558-59.452 0-114.68-17.219-161.137-47.106 8.447.974 16.568 1.299 25.34 1.299 49.055 0 94.213-16.568 130.274-44.832-46.132-.975-84.792-31.188-98.112-72.772 6.498.974 12.995 1.624 19.818 1.624 9.421 0 18.843-1.3 27.614-3.573-48.081-9.747-84.143-51.98-84.143-102.985v-1.299c13.969 7.797 30.214 12.67 47.431 13.319-28.264-18.843-46.781-51.005-46.781-87.391 0-19.492 5.197-37.36 14.294-52.954 51.655 63.675 129.3 105.258 216.365 109.807-1.624-7.797-2.599-15.918-2.599-24.04 0-57.828 46.782-104.934 104.934-104.934 30.213 0 57.502 12.67 76.67 33.137 23.715-4.548 46.456-13.32 66.599-25.34-7.798 24.366-24.366 44.833-46.132 57.827 21.117-2.273 41.584-8.122 60.426-16.243-14.292 20.791-32.161 39.308-52.628 54.253z"></path></svg></a></li><li class="social-item"><a href="/jxko" title="Youtube"><svg aria-labelledby="svg-inline--fa-title-88mCJRCykxnw" data-prefix="fab" data-icon="youtube" class="svg-inline--fa fa-youtube fa-w-18 fa-network" role="img" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 576 512"><title id="svg-inline--fa-title-88mCJRCykxnw">youtube</title><path fill="currentColor" d="M549.655 124.083c-6.281-23.65-24.787-42.276-48.284-48.597C458.781 64 288 64 288 64S117.22 64 74.629 75.486c-23.497 6.322-42.003 24.947-48.284 48.597-11.412 42.867-11.412 132.305-11.412 132.305s0 89.438 11.412 132.305c6.281 23.65 24.787 41.5 48.284 47.821C117.22 448 288 448 288 448s170.78 0 213.371-11.486c23.497-6.321 42.003-24.171 48.284-47.821 11.412-42.867 11.412-132.305 11.412-132.305s0-89.438-11.412-132.305zm-317.51 213.508V175.185l142.739 81.205-142.739 81.201z"></path></svg></a></li><li class="social-item"><a href="/jMcn" title="TikTok"><svg aria-labelledby="svg-inline--fa-title-veQd4Z1YgN8s" data-prefix="fab" data-icon="tiktok" class="svg-inline--fa fa-tiktok fa-w-14 fa-network" role="img" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 448 512"><title id="svg-inline--fa-title-veQd4Z1YgN8s">tiktok</title><path fill="currentColor" d="M448,209.91a210.06,210.06,0,0,1-122.77-39.25V349.38A162.55,162.55,0,1,1,185,188.31V278.2a74.62,74.62,0,1,0,52.23,71.18V0l88,0a121.18,121.18,0,0,0,1.86,22.17h0A122.18,122.18,0,0,0,381,102.39a121.43,121.43,0,0,0,67,20.14Z"></path></svg></a></li></ul><div class="powered-by-shorby"><a href="https://shorby.com/?utm_source=shorby&utm_medium=logo">made on <strong class="domain-logo">shor</strong></a></div></div></body></html>
Node.js