Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 11766 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://accessmars.withgoogle.com/robots.txt
302 Found
https://experiments.withgoogle.com/access-mars
200 OK
Показать содержимое robots.txt
<!DOCTYPE html><html><head><title>Access Mars by Google Creative Lab + NASA JPL - Experiments with Google</title><meta name="description" content="Since 2009, coders have created thousands of amazing experiments using Chrome, Android, AI, WebVR, AR and more. We're showcasing projects here, along with helpful tools and resources, to inspire others to create new experiments."><meta charset="utf-8"><meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"><meta name="viewport" content="width=device-width,initial-scale=1,maximum-scale=1"><link rel="icon" type="image/png" href="/static/img/favicon.png"><meta name="apple-mobile-web-app-capable" content="yes"><meta name="mobile-web-app-capable" content="yes"><meta name="twitter:card" content="summary_large_image"><meta name="twitter:title" content="Access Mars by Google Creative Lab + NASA JPL - Experiments with Google"><meta name="twitter:site" content="@google"><meta name="twitter:description" content="Since 2009, coders have created thousands of amazing experiments using Chrome, Android, AI, WebVR, AR and more. We're showcasing projects here, along with helpful tools and resources, to inspire others to create new experiments."><meta name="twitter:image" content="https://lh3.googleusercontent.com/adA3OLb1LGGLcOQVYAntDLVuVHPzFn-_psnPmYnZPv_1s0Jn43wHaQWPIBmmT9N-TsJlRhPLDFNnUz6NR4dbqu5HSDv7PHU"><meta property="og:title" content="Access Mars by Google Creative Lab + NASA JPL - Experiments with Google"><meta property="og:type" content="website"><meta property="og:url" content="https://experiments.withgoogle.com/access-mars"><meta property="og:image" content="https://lh3.googleusercontent.com/adA3OLb1LGGLcOQVYAntDLVuVHPzFn-_psnPmYnZPv_1s0Jn43wHaQWPIBmmT9N-TsJlRhPLDFNnUz6NR4dbqu5HSDv7PHU"><meta property="og:image:type" content="image/jpeg"><meta property="og:image:width" content="1200"><meta property="og:image:height" content="630"><meta property="og:description" content="Since 2009, coders have created thousands of amazing experiments using Chrome, Android, AI, WebVR, AR and more. We're showcasing projects here, along with helpful tools and resources, to inspire others to create new experiments."><meta itemscope itemtype="http://schema.org/Article"><meta itemprop="title" content="Access Mars by Google Creative Lab + NASA JPL - Experiments with Google"><meta itemprop="name" content="Experiments with Google"><meta itemprop="description" content="Since 2009, coders have created thousands of amazing experiments using Chrome, Android, AI, WebVR, AR and more. We're showcasing projects here, along with helpful tools and resources, to inspire others to create new experiments."><meta itemprop="image" content="https://lh3.googleusercontent.com/adA3OLb1LGGLcOQVYAntDLVuVHPzFn-_psnPmYnZPv_1s0Jn43wHaQWPIBmmT9N-TsJlRhPLDFNnUz6NR4dbqu5HSDv7PHU"><link href="https://www.gstatic.com/glue/cookienotificationbar/cookienotificationbar.min.css" rel="stylesheet"><link rel="stylesheet" href="//fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400,600,700|Source+Code+Pro:300,400,500,600,700" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE"><link rel="stylesheet" href="//fonts.googleapis.com/css2?family=Google+Sans:wght@400;500;700&Google+Sans+Mono" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE"><link rel="stylesheet" href="/static/css/vendors.css" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE"><link rel="stylesheet" href="/static/css/style.css" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE"><script nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE">((e,t,n,a)=>{e[a]=e[a]||[],e[a].push({"gtm.start":(new Date).getTime(),event:"gtm.js"}),e=t.getElementsByTagName(n)[0],(a=t.createElement(n)).async=!0,a.src="https://www.googletagmanager.com/gtm.js?id=GTM-WSXK4F2",(n=t.querySelector("[nonce]"))&&a.setAttribute("nonce",n.nonce||n.getAttribute("nonce")),e.parentNode.insertBefore(a,e)})(window,document,"script","dataLayer")</script></head><body class="experiment hide-butterbar" data-coll-name=""><header> <div class="wrapper"><div id="logo-holder"><a href="/"><nav id="logo" role="navigation" aria-label="Homepage">Experiments with Google</nav></a></div><div id="menuoverlay"><nav id="mainmenu" role="navigation" aria-label="main navigation"><ul id="collection-menu" style="padding:0"><li style="padding:0" class="menuitem coll-options"><a href="/collections" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE">Collections</a><div class="triangle-down">▾</div></li><ul id="home-menu"> <li class="home-menuitem" data-coll-name="tfliteformicrocontrollers"><a href="/collection/tfliteformicrocontrollers" title="TensorFlow Lite for Microcontrollers" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE">TensorFlow Lite for Microcontrollers</a></li> <li class="home-menuitem" data-coll-name="startwithone"><a href="/collection/startwithone" title="Start With One" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE">Start With One</a></li> <li class="home-menuitem" data-coll-name="creatability"><a href="/collection/creatability" title="Creatability" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE">Creatability</a></li> <li class="home-menuitem" data-coll-name="digitalwellbeing"><a href="/collection/digitalwellbeing" title="Digital Wellbeing Experiments" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE">Digital Wellbeing Experiments</a></li> <li class="home-menuitem" data-coll-name="webxr"><a href="/collection/webxr" title="WebXR Experiments" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE">WebXR Experiments</a></li> <li class="home-menuitem" data-coll-name="arts-culture"><a href="/collection/arts-culture" title="Arts & Culture Experiments" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE">Arts & Culture Experiments</a></li> <li class="home-menuitem" data-coll-name="ar"><a href="/collection/ar" title="AR Experiments" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE">AR Experiments</a></li> <li class="home-menuitem" data-coll-name="ai"><a href="/collection/ai" title="AI Experiments" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE">AI Experiments</a></li> <li class="home-menuitem" data-coll-name="android"><a href="/collection/android" title="Android Experiments" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE">Android Experiments</a></li> <li class="home-menuitem" data-coll-name="chrome"><a href="/collection/chrome" title="Chrome Experiments" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE">Chrome Experiments</a></li> <li class="home-menuitem" data-coll-name="All Collections"><a href="/collections" title="View all <built-in method count of list object at 0x7ff7c4fb8240> collections" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE">VIEW ALL 17 COLLECTIONS</a></li></ul></ul><a class="menuitem" href="/experiments" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE">Experiments</a><div id="searchwrap"><div class="menuitem" id="search"></div><input type="text" name="search" id="searchbox" value="" aria-label="Search experiments" spellcheck="false" autocomplete="off" autocorrect="off" autocapitalize="off" placeholder="Search" onfocus='this.placeholder=""' onblur='this.placeholder="Search"'></div></nav><div class="google-logo"></div></div></div></header><div id="main" class=""><div class="wrapper"><div id="exp-intro"><div class="cont-left displaytext"><h1 class="title">Access Mars</h1><p class="gray">October 2017 | By Google Creative Lab + NASA JPL </p><p style="margin-top:10px;width:90%">The real surface of Mars. Photographed by the Curiosity Rover. Used by NASA JPL scientists. Now in your browser.</p> <div id="sunsetted-msg">This experiment is no longer active, but you can still learn about it on this page.</div><div class="action-button-holder" style="margin-top:25px"> <a class="button hollow caps disabled" href="http://accessmars.withgoogle.com" target="_blank" onclick='ga("send","event","Experiment Launch Button","Click","Access Mars")' aria-label="Launch Access Mars Experiment" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE"> Launch experiment </a> <a class="button hollow caps" href="http://github.com/googlecreativelab/access-mars" target="_blank" onclick="ga('send', 'event', 'Experiment Get Code Button', 'Click', 'Access Mars);" aria-label="View Access Mars Experiment Source Code" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE"> Get the code </a> </div></div><div class="cont-right"><h3 class="caps small">Collection:</h3><div id="collections-holder" style="display:block"> <a class="collection" href="/collection/webvr">Web VR Experiments</a> </div></div></div><div class="video-holder" data-videoid="AQPHo0cgHPo" data-exp-name="Access Mars"> <img class="video-cover-image" src="https://lh3.googleusercontent.com/OVE1n7JSogL0tGothT1NUGOc-VvwI3UmRmfLKn5bTDLxYhYatHKWGMc-CiLEg_BC8CoaljPIDR45UeJF8j1IUvlC5ijs0A" alt="" data-img-alt=""> <div class="video-embed" id="video-AQPHo0cgHPo" data-loop=""></div><img src="/static/img/video-play-btn.png" class="video-play-btn" alt="Video Play Button"></div><div id="featured-holder"><div class="featured-img-holder"><img class="featured-img" src="https://lh3.googleusercontent.com/fIBMf5EoYeapGNpHTu2kHFFlzAx9PSw3uuPaXCZc4Ufx-Afsq9O4SrIiYY8qJkvx9G9Z89fmrkrwzbNXr6uQ9_eSOB574AE" alt="" data-img-alt=""></div> <div class="featured-img-holder"><img class="featured-img" src="https://lh3.googleusercontent.com/dcKJHxvxCKkDUfItPi6YSbff90tzldb523EDFwhPcemUXHDETGOBhaClqh4-RFDivRFufKGf5cz_qLdSTvM8CuWCAKsnTA" alt="" data-img-alt=""></div> <div class="featured-img-holder"><img class="featured-img" src="https://lh3.googleusercontent.com/i8X9BiLmC_NtZ-UyzOrXWHvDrt1YAL5nNMC6H-9Xe633HF2Vmjz_tcNQ7Hk07CiAnK5QrfK-JrabDGZaxvpjpKM7L6yZdhM" alt="" data-img-alt=""></div> <div class="featured-img-holder"><img class="featured-img" src="https://lh3.googleusercontent.com/nJQdfCXu9OTjxsNbc1kOmDrFdJuEqKO-VzFU_VzyHU6p_OZibUd4Dei5ipK1TDeM227AtzVVFDLS52CuhRVpK0B7CIFX6Q" alt="" data-img-alt=""></div> </div><div class="content-wrap single"><div class="content-twothird"><div class="content-block displaytext">The Curiosity rover landed on Mars on August 5, 2012. Since then, it’s sent over 200,000 photographs back to Earth. JPL engineers transform these photos into a 3D model that scientists use to study the surface of Mars. They wanted to share this tool with everyone so they partnered with Google Creative Lab to create an immersive web experience called Access Mars. Access Mars features some of the most important locations from the mission, key points of interest, and narration from JPL Mission Scientist Katie Stack. Start exploring Mars today.</div> </div><div class="content-onethird"></div></div></div></div><footer><div class="wrapper"><div class="google-logo"></div><div id="social-holder"><a href="https://www.google.com/policies/" target="_blank" class="social-icon">Privacy & Terms</a><div id="social-icons"><a class="social-icon" href="https://www.facebook.com/ExpWithGoogle/" target="_blank" aria-label="Link to our Facebook page"><img src="/static/img/social-fb.png" alt="facebook icon"></a></div></div></div></footer><div id="page-loader"><div id="txt-submitting">Submitting...</div><div id="txt-saving">Saving...</div></div><div id="sitemenu-icon"><span class="line1"></span> <span class="line2"></span> <span class="line3"></span></div><div id="overlay"><div id="overlay-closebtn"></div><div id="overlay-content-wrap"><div class="wrapper"><div id="overlay-content"></div></div></div></div><script src="//ajax.googleapis.com/ajax/libs/jquery/3.2.1/jquery.min.js" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE"></script><script src="/static/js/vendors.js" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE"></script><script src="/static/js/script.min.js" nonce="6ZDgkfVp1q7nZwaUqlHh4aCk37t1WEGE"></script><script src="https://www.gstatic.com/glue/cookienotificationbar/cookienotificationbar.min.js" data-glue-cookie-notification-bar-category="2B"></script></body></html>