Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 10777 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://exquisiteforest.com/robots.txt
301 MovedPermanently
https://experiments.withgoogle.com/this-exquisite-forest
200 OK
Показать содержимое robots.txt
<!DOCTYPE html><html><head><title>This Exquisite Forest by Google Data Arts Team - Experiments with Google</title><meta name="description" content="Since 2009, coders have created thousands of amazing experiments using Chrome, Android, AI, WebVR, AR and more. We're showcasing projects here, along with helpful tools and resources, to inspire others to create new experiments."><meta charset="utf-8"><meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"><meta name="viewport" content="width=device-width,initial-scale=1,maximum-scale=1"><link rel="icon" type="image/png" href="/static/img/favicon.png"><meta name="apple-mobile-web-app-capable" content="yes"><meta name="mobile-web-app-capable" content="yes"><meta name="twitter:card" content="summary_large_image"><meta name="twitter:title" content="This Exquisite Forest by Google Data Arts Team - Experiments with Google"><meta name="twitter:site" content="@google"><meta name="twitter:description" content="Since 2009, coders have created thousands of amazing experiments using Chrome, Android, AI, WebVR, AR and more. We're showcasing projects here, along with helpful tools and resources, to inspire others to create new experiments."><meta name="twitter:image" content="https://lh6.ggpht.com/X112DG-LJHGOrUz-RJQxMr1jvwcZin32KKYmrmWcaDNPsfTW13H7DHpj0JD2Vu00KsSu667tktYhvaMSnecIAmx3LkYQexUttJ78"><meta property="og:title" content="This Exquisite Forest by Google Data Arts Team - Experiments with Google"><meta property="og:type" content="website"><meta property="og:url" content="https://experiments.withgoogle.com/this-exquisite-forest"><meta property="og:image" content="https://lh6.ggpht.com/X112DG-LJHGOrUz-RJQxMr1jvwcZin32KKYmrmWcaDNPsfTW13H7DHpj0JD2Vu00KsSu667tktYhvaMSnecIAmx3LkYQexUttJ78"><meta property="og:image:type" content="image/jpeg"><meta property="og:image:width" content="1200"><meta property="og:image:height" content="630"><meta property="og:description" content="Since 2009, coders have created thousands of amazing experiments using Chrome, Android, AI, WebVR, AR and more. We're showcasing projects here, along with helpful tools and resources, to inspire others to create new experiments."><meta itemscope itemtype="http://schema.org/Article"><meta itemprop="title" content="This Exquisite Forest by Google Data Arts Team - Experiments with Google"><meta itemprop="name" content="Experiments with Google"><meta itemprop="description" content="Since 2009, coders have created thousands of amazing experiments using Chrome, Android, AI, WebVR, AR and more. We're showcasing projects here, along with helpful tools and resources, to inspire others to create new experiments."><meta itemprop="image" content="https://lh6.ggpht.com/X112DG-LJHGOrUz-RJQxMr1jvwcZin32KKYmrmWcaDNPsfTW13H7DHpj0JD2Vu00KsSu667tktYhvaMSnecIAmx3LkYQexUttJ78"><link href="https://www.gstatic.com/glue/cookienotificationbar/cookienotificationbar.min.css" rel="stylesheet"><link rel="stylesheet" href="//fonts.googleapis.com/css?family=Source+Sans+Pro:200,300,400,600,700|Source+Code+Pro:300,400,500,600,700" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ"><link rel="stylesheet" href="//fonts.googleapis.com/css2?family=Google+Sans:wght@400;500;700&Google+Sans+Mono" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ"><link rel="stylesheet" href="/static/css/vendors.css" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ"><link rel="stylesheet" href="/static/css/style.css" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ"><script nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ">((e,t,n,a)=>{e[a]=e[a]||[],e[a].push({"gtm.start":(new Date).getTime(),event:"gtm.js"}),e=t.getElementsByTagName(n)[0],(a=t.createElement(n)).async=!0,a.src="https://www.googletagmanager.com/gtm.js?id=GTM-WSXK4F2",(n=t.querySelector("[nonce]"))&&a.setAttribute("nonce",n.nonce||n.getAttribute("nonce")),e.parentNode.insertBefore(a,e)})(window,document,"script","dataLayer")</script></head><body class="experiment hide-butterbar" data-coll-name=""><header> <div class="wrapper"><div id="logo-holder"><a href="/"><nav id="logo" role="navigation" aria-label="Homepage">Experiments with Google</nav></a></div><div id="menuoverlay"><nav id="mainmenu" role="navigation" aria-label="main navigation"><ul id="collection-menu" style="padding:0"><li style="padding:0" class="menuitem coll-options"><a href="/collections" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ">Collections</a><div class="triangle-down">▾</div></li><ul id="home-menu"> <li class="home-menuitem" data-coll-name="tfliteformicrocontrollers"><a href="/collection/tfliteformicrocontrollers" title="TensorFlow Lite for Microcontrollers" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ">TensorFlow Lite for Microcontrollers</a></li> <li class="home-menuitem" data-coll-name="startwithone"><a href="/collection/startwithone" title="Start With One" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ">Start With One</a></li> <li class="home-menuitem" data-coll-name="creatability"><a href="/collection/creatability" title="Creatability" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ">Creatability</a></li> <li class="home-menuitem" data-coll-name="digitalwellbeing"><a href="/collection/digitalwellbeing" title="Digital Wellbeing Experiments" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ">Digital Wellbeing Experiments</a></li> <li class="home-menuitem" data-coll-name="webxr"><a href="/collection/webxr" title="WebXR Experiments" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ">WebXR Experiments</a></li> <li class="home-menuitem" data-coll-name="arts-culture"><a href="/collection/arts-culture" title="Arts & Culture Experiments" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ">Arts & Culture Experiments</a></li> <li class="home-menuitem" data-coll-name="ar"><a href="/collection/ar" title="AR Experiments" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ">AR Experiments</a></li> <li class="home-menuitem" data-coll-name="ai"><a href="/collection/ai" title="AI Experiments" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ">AI Experiments</a></li> <li class="home-menuitem" data-coll-name="android"><a href="/collection/android" title="Android Experiments" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ">Android Experiments</a></li> <li class="home-menuitem" data-coll-name="chrome"><a href="/collection/chrome" title="Chrome Experiments" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ">Chrome Experiments</a></li> <li class="home-menuitem" data-coll-name="All Collections"><a href="/collections" title="View all <built-in method count of list object at 0x7f1a98644dc0> collections" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ">VIEW ALL 17 COLLECTIONS</a></li></ul></ul><a class="menuitem" href="/experiments" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ">Experiments</a><div id="searchwrap"><div class="menuitem" id="search"></div><input type="text" name="search" id="searchbox" value="" aria-label="Search experiments" spellcheck="false" autocomplete="off" autocorrect="off" autocapitalize="off" placeholder="Search" onfocus='this.placeholder=""' onblur='this.placeholder="Search"'></div></nav><div class="google-logo"></div></div></div></header><div id="main" class=""><div class="wrapper"><div id="exp-intro"><div class="cont-left displaytext"><h1 class="title">This Exquisite Forest</h1><p class="gray">July 2012 | By <a href="http://workshop.chromeexperiments.com/" target="_blank">Google Data Arts Team</a> </p> <div id="sunsetted-msg">This experiment is no longer active, but you can still learn about it on this page.</div><div class="action-button-holder" style="margin-top:25px"> <a class="button hollow caps disabled" href="http://www.exquisiteforest.com/" target="_blank" onclick='ga("send","event","Experiment Launch Button","Click","This Exquisite Forest")' aria-label="Launch This Exquisite Forest Experiment" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ"> Launch experiment </a> </div></div><div class="cont-right"><h3 class="caps small">Collection:</h3><div id="collections-holder" style="display:block"> <a class="collection" href="/collection/chrome">Chrome Experiments</a> </div></div></div><div class="video-holder" data-videoid="nnhJ1841K-8" data-exp-name="This Exquisite Forest"><div class="video-embed" id="video-nnhJ1841K-8" data-loop=""></div><img src="/static/img/video-play-btn.png" class="video-play-btn" alt="Video Play Button"></div><div id="featured-holder"><div class="featured-img-holder"><img class="featured-img" src="https://lh6.ggpht.com/X112DG-LJHGOrUz-RJQxMr1jvwcZin32KKYmrmWcaDNPsfTW13H7DHpj0JD2Vu00KsSu667tktYhvaMSnecIAmx3LkYQexUttJ78" alt="" data-img-alt=""></div> <div class="featured-img-holder"><img class="featured-img" src="https://lh3.ggpht.com/XmRPL8WDiXAO65m0UOZ97LYh7CbJmhOVVAbduLkjJazP1mbKZcH2EbWNeB9jABTL3BAU26E2bDpr39x5YB9vzxeWptLWvvokSPUs" alt="" data-img-alt=""></div> <div class="featured-img-holder"><img class="featured-img" src="https://lh4.ggpht.com/b8g5WDHc344P7Tu1HZr9EkMTN_hQ-ZvvYrp2Jqya0auSG3f_9XJHgv-Ss_uUImFqpDRA4EUkQOLO2dbyMNACyUY5PBZUI-xZ7Vc" alt="" data-img-alt=""></div> </div><div class="content-wrap single"><div class="content-twothird"><div class="content-block displaytext">"This Exquisite Forest" is an online collaborative art experiment presented by Google and Tate Modern. The project lets users create short animations that build off one another as they explore a specific theme. It can be accessed via the website exquisiteforest.com and through a physical installation at Tate Modern (http://www.tate.org.uk/) from July 23, 2012.</div> </div><div class="content-onethird"></div></div></div></div><footer><div class="wrapper"><div class="google-logo"></div><div id="social-holder"><a href="https://www.google.com/policies/" target="_blank" class="social-icon">Privacy & Terms</a><div id="social-icons"><a class="social-icon" href="https://www.facebook.com/ExpWithGoogle/" target="_blank" aria-label="Link to our Facebook page"><img src="/static/img/social-fb.png" alt="facebook icon"></a></div></div></div></footer><div id="page-loader"><div id="txt-submitting">Submitting...</div><div id="txt-saving">Saving...</div></div><div id="sitemenu-icon"><span class="line1"></span> <span class="line2"></span> <span class="line3"></span></div><div id="overlay"><div id="overlay-closebtn"></div><div id="overlay-content-wrap"><div class="wrapper"><div id="overlay-content"></div></div></div></div><script src="//ajax.googleapis.com/ajax/libs/jquery/3.2.1/jquery.min.js" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ"></script><script src="/static/js/vendors.js" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ"></script><script src="/static/js/script.min.js" nonce="ZsYX_-iA07tObaYxVDmlQv6HWI6ktZxJ"></script><script src="https://www.gstatic.com/glue/cookienotificationbar/cookienotificationbar.min.js" data-glue-cookie-notification-bar-category="2B"></script></body></html>