Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 8753 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://tech-blogs.dev/robots.txt
301 MovedPermanently
https://tech-blogs.dev/robots.txt
200 OK
Показать содержимое robots.txt
<!DOCTYPE html><html lang="en" prefix="og: http://ogp.me/ns#"><head><meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>Awesome Tech Blogs</title>
<link rel="stylesheet" href="https://fonts.googleapis.com/css2?family=Inter&display=swap">
<style>html{line-height:1.15;-webkit-text-size-adjust:100%}body{margin:0}main{display:block}h1{font-size:2em;margin:.67em 0}hr{box-sizing:content-box;height:0;overflow:visible}pre{font-family:monospace,monospace;font-size:1em}a{background-color:transparent}abbr[title]{border-bottom:none;text-decoration:underline;-webkit-text-decoration:underline dotted;text-decoration:underline dotted}b,strong{font-weight:bolder}code,kbd,samp{font-family:monospace,monospace;font-size:1em}small{font-size:80%}sub,sup{font-size:75%;line-height:0;position:relative;vertical-align:baseline}sub{bottom:-.25em}sup{top:-.5em}img{border-style:none}button,input,optgroup,select,textarea{font-family:inherit;font-size:100%;line-height:1.15;margin:0}button,input{overflow:visible}button,select{text-transform:none}[type=button],[type=reset],[type=submit],button{-webkit-appearance:button}[type=button]::-moz-focus-inner,[type=reset]::-moz-focus-inner,[type=submit]::-moz-focus-inner,button::-moz-focus-inner{border-style:none;padding:0}[type=button]:-moz-focusring,[type=reset]:-moz-focusring,[type=submit]:-moz-focusring,button:-moz-focusring{outline:1px dotted ButtonText}fieldset{padding:.35em .75em .625em}legend{box-sizing:border-box;color:inherit;display:table;max-width:100%;padding:0;white-space:normal}progress{vertical-align:baseline}textarea{overflow:auto}[type=checkbox],[type=radio]{box-sizing:border-box;padding:0}[type=number]::-webkit-inner-spin-button,[type=number]::-webkit-outer-spin-button{height:auto}[type=search]{-webkit-appearance:textfield;outline-offset:-2px}[type=search]::-webkit-search-decoration{-webkit-appearance:none}::-webkit-file-upload-button{-webkit-appearance:button;font:inherit}details{display:block}summary{display:list-item}[hidden],template{display:none}</style>
<style>.text-center{text-align:center}.text-2xl{font-size:1.5rem}.pb-6{padding-bottom:2rem}.mb-6{margin-bottom:2rem}.ml-3{margin-left:1rem}.underlined{text-decoration:underline}html{--black:#0e141b;--orange:#ff8a00;--green:#4fc08d;--pink:#a84fc0;--rose:#ff0a78;--purple:#7928ca;--blue:#6ac;--grey:#2a4555;--dark-grey:#1e262f;background-color:var(--black);color:#fff;font-family:Inter,sans-serif;scroll-behavior:smooth}html ::-moz-selection{background:var(--purple);color:#fff}html ::selection{background:var(--purple);color:#fff}html #__layout{align-items:stretch;display:flex;min-height:100vh}html .wrapper{display:flex;flex-direction:column;min-height:calc(100vh - 2rem);padding:2rem 2rem 0}html h1{background-clip:text;-webkit-background-clip:text;background-image:linear-gradient(45deg,#ff0a78,#43f);font-size:3rem;-webkit-text-fill-color:transparent}html header p{font-size:1.4rem}html main{flex:1}html .cta,html main{align-items:center;display:flex;justify-content:center}html .cta{flex-direction:column;font-size:2rem;height:100%;text-align:center}html footer a{text-decoration:underline}html a{color:#fff;text-decoration:none}html a:hover{color:var(--purple);transition:all .4s}html .tag{background-color:var(--grey);border:0;border-radius:5px;color:#fff;cursor:pointer;display:inline-block;font-size:1.1rem;margin-bottom:8px;margin-right:8px;opacity:.8;outline:none;padding:5px;transform-origin:center center;transition:all .4s}html .tag:hover{opacity:1;transform:scale(1.05)}html .tag--active{background:var(--green)}html .tag--small{cursor:default;font-size:1rem}html .tag--small:hover{opacity:.8;transform:none}html .tag .number{background-color:var(--black);border-radius:2px;font-size:1rem;padding:1px 3px}html .blogs{display:grid;gap:2rem;grid-template-columns:repeat(auto-fit,minmax(350px,1fr))}@media(max-width:600px){html .blogs{grid-template-columns:repeat(auto-fit,minmax(300px,1fr))}}html .blog{background-color:var(--dark-grey);border-radius:5px;box-shadow:inset 0 1px #ffffff1a;display:flex;flex-direction:column}html .blog-header{align-items:center;display:flex;padding:15px}html .blog-content{display:flex;flex:1;flex-direction:column;padding:15px}html .blog-description{flex:1;font-size:1.2rem;line-height:1.8rem}html .blog-tags{list-style-type:none;padding:0}html .blog-tags li{display:inline-block}html .blog-footer{border-top:1px solid var(--grey);display:flex}html .blog-footer .blog-link{flex:1;overflow:hidden;padding:15px;text-align:center;text-overflow:ellipsis;white-space:nowrap}html .blog-social{align-items:center;border-left:1px solid var(--grey);display:flex;justify-content:center;width:50px}html .blog-social a{display:flex;opacity:.7}html .blog-social a:hover{opacity:1}.page-enter-active,.page-leave-active{transition:opacity .2s}.page-enter,.page-leave-to{opacity:0}</style>
<style>.error-page{padding:4rem;text-align:center}</style>
<link rel="stylesheet" href="/_nuxt/entry.ILObWENu.css" crossorigin>
<link rel="preload" as="fetch" crossorigin="anonymous" href="/_payload.json?d452406b-577f-4ff0-8ead-2f6ea06ead3e">
<link rel="modulepreload" as="script" crossorigin href="/_nuxt/CQ_-ocVd.js">
<link rel="modulepreload" as="script" crossorigin href="/_nuxt/CuPyGYKu.js">
<link rel="modulepreload" as="script" crossorigin href="/_nuxt/FLaQ_vGv.js">
<link rel="modulepreload" as="script" crossorigin href="/_nuxt/CM3FAkWk.js">
<link rel="preload" as="fetch" fetchpriority="low" crossorigin="anonymous" href="/_nuxt/builds/meta/d452406b-577f-4ff0-8ead-2f6ea06ead3e.json">
<script type="module" src="/_nuxt/CQ_-ocVd.js" crossorigin></script>
<meta name="saashub-verification" content="bi3elh9bv2hz">
<meta name="description" content="This is a list of Awesome Tech Blogs. Add yourself.">
<meta property="og:title" content="Awesome Tech Blogs">
<meta property="og:description" content="This is a list of Awesome Tech Blogs. Add yourself.">
<meta property="og:type" content="website">
<meta name="msapplication-TileColor" content="#2b5797">
<meta name="theme-color" content="#ffffff">
<meta property="image" content="/social-media-card-atb.jpg">
<meta property="og:image" content="https://tech-blogs.dev/social-media-card-atb.jpg">
<meta name="twitter:card" content="summary_large_image">
<link rel="icon" type="image/x-icon" href="/favicon.ico">
<link rel="icon" sizes="32x32" type="image/png" href="/favicon-32x32.png">
<link rel="icon" sizes="16x16" type="image/png" href="/favicon-16x16.png">
<link rel="apple-touch-icon" sizes="180x180" href="/icon.png">
<link rel="mask-icon" color="#a3e635" href="/safari-pinned-tab.svg">
<script id="unhead:payload" type="application/json">{"title":"Awesome Tech Blogs"}</script><script async defer data-domain="tech-blogs.dev" src="https://plausible.io/js/plausible.js"></script><meta name="google-site-verification" content="zLeLL_B2CZiDN6Cb8WjTiiDaPgK4egkD7nuFlEKXr4I" /></head><body><div id="__nuxt"><div class="wrapper"><header id="top" class="text-center pb-6"><h1>Tech blogs</h1><p>Find amazing tech-related articles by the Tech community!</p></header><main><!--[--><div></div><div class="cta"><div class="mb-6"> Currently 283 blogs listed! </div><a href="/list" class="underlined mb-6"> Take me to the list! </a></div><!--]--></main><footer class="text-center"><a aria-current="page" href="/" class="router-link-active router-link-exact-active">Tech Blogs</a><p> Made by <a href="https://markodenic.com" target="_blank" rel="noopener">Marko Denic</a> with Nuxt.js. Icons from Freepik. </p><p><a href="https://markodenic.tech/html-ebook/" target="_blank" rel="noopener">Free HTML eBook</a> | <a href="https://javascriptquiz.com" target="_blank" rel="noopener">JavaScript Quiz</a> | <a href="https://freecodetools.org" target="_blank" rel="noopener">Free Code Tools</a> | <a href="https://web-dev-resources.com" target="_blank" rel="noopener">Web Development Resources</a></p><p>Hosted on Netlify.</p><p>Inspired by Wes Bos's /uses.tech page.</p><p> Similar amazing projects: <a href="https://publicapis.dev" target="_blank" rel="noopener">Public APIs</a> | <a href="https://devresourc.es" target="_blank" rel="noopener">Dev Resources</a></p></footer></div></div><div id="teleports"></div><script>window.__NUXT__={};window.__NUXT__.config={public:{},app:{baseURL:"/",buildId:"d452406b-577f-4ff0-8ead-2f6ea06ead3e",buildAssetsDir:"/_nuxt/",cdnURL:""}}</script>
<script type="application/json" data-nuxt-data="nuxt-app" data-ssr="true" id="__NUXT_DATA__" data-src="/_payload.json?d452406b-577f-4ff0-8ead-2f6ea06ead3e">[{"state":1,"once":3,"_errors":4,"serverRendered":6,"path":7,"prerenderedAt":8},["Reactive",2],{},["Set"],["ShallowReactive",5],{},true,"/",1782033444406]</script></body></html>
