Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 14054 байт. Загружен за: 0сек.
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://agoogleaday.com/robots.txt
301 MovedPermanently
http://www.agoogleaday.com/
200 OK
Показать содержимое robots.txt
<!doctype html>
<html lang="en">
<head>
<meta charset="UTF-8">
<title>A Google a Day</title>
<link href="images/favicon.png" rel="shortcut icon">
<!-- META:OG -->
<meta content="A Google a Day" property="og:title">
<meta content="website" property="og:type">
<meta content="http://www.agoogleaday.com" property="og:url">
<meta content="/img/preview.png" property="og:image">
<meta content="A Google a Day" property="og:site_name">
<meta
content="Welcome to the new daily puzzle from Google. There is no right way to solve it, but there's only one right answer. Find the answer with your creativity and clever search skills."
property="og:description">
<!-- JAVSCRIPT and CSS -->
<link rel="stylesheet" href="build/css/screen.css">
<!--[if lte IE 8]>
<script type="text/javascript" src="js/lib/jquery-1.11.1.min.js"></script>
<link rel="stylesheet" href="build/css/lteIE8.css">
<![endif]-->
<script type="text/javascript" src="js/lib/jquery-2.0.3.min.js"></script>
<script type="text/javascript" src="js/lib/handlebars-v2.0.0.min.js"></script>
<script type="text/javascript" src="js/lib/Modernizr-2.8.3.min.js"></script>
<script src="build/js/bundle.min.js"></script>
<!-- FONTS -->
<link href="https://fonts.googleapis.com/css?family=Roboto:300,400,500" rel="stylesheet" type="text/css">
<!-- META -->
<meta name="viewport" content="width=device-width, user-scalable=0" />
</head>
<body>
<!--[if lte IE 8]>
<div class="unsupported-wrapper">
<div class="intro-content">
<div class="logo">
a <img src="images/googlelogo_color_520x172dp.png"> a day
</div>
<div class="unsupported-error-msg">
<h1>Uh-oh!</h1>
<p>
Your browser isn't supported by <em>A Google a Day</em>
</p>
</div>
<div class="unsupported-modal">
<p class="unsupported-upgrade">
<img src="images/chrome-48.png"/>
<a href="http://www.google.com/chrome/index.html" target="_blank">Consider upgrading to Google Chrome for a faster browsing experience.</a>
</p>
</div>
</div>
<![endif]-->
<div class="frame-wrapper">
<iframe frameborder="0" class="frame" src="//www.google.com/webhp?esrch=Agad::Public&nord=1&igu=1"></iframe>
<div id="intro">
<div class="intro-content">
<div class="logo">
a <img src="images/googlelogo_color_520x172dp.png"> a day
</div>
<div class="tagline">
There's no right way to solve it, but there's only one right answer.
</div>
<div class="button button-raised start-button">
Start Playing
</div>
<div class="description">
<div class="desc-item desc-item-1">
<div class="desc-image"></div>
<div class="desc-content">
<h1>We ask a question</h2>
<p>
"An 11-foot bird lives less than two miles from 30.891383,-102.885032. What's his name?"
</p>
</div>
</div>
<div class="desc-item desc-item-2">
<div class="desc-image"></div>
<div class="desc-content">
<h1>You find the answer</h2>
<p>
Put your search skills and Google's tools to use. For instance, you can enter 30.891383, -102.885032 right inside the search bar, and learn that it's directly in the center of Ft. Stockton, TX. A quick Search for [Giant bird ft stockton TX] (or perhaps you're the adventurous type who'll "walk" there in Street View) and you'll have your bird: <span>Paisano Pete</span>.
</p>
</div>
</div>
</div>
</div>
</div>
</div>
<div class="agad-wrapper">
<div class="agad-top-bar-wrapper">
<div class="agad-top-bar">
<ul class="panel-links">
<li><a class="panel-link-1" href="#1"></a></li>
<li><a class="panel-link-2" href="#2"></a></li>
<li><a class="panel-link-3" href="#3"></a></li>
<li><a class="panel-link-4" href="#4"></a></li>
</ul>
<a class="tips-and-tricks-link">Tips & Tricks</a>
<div class="icon icon-slide"></div>
</div>
</div>
<div class="agad-panels-wrapper">
<div class="agad-panels">
<div class="panels-container">
<div class="panel" id="panel1">
<div class="panel-content">
<!-- question to be rendered here -->
</div>
</div>
<div class="panel" id="panel2">
<div class="panel-content">
<!-- question to be rendered here -->
</div>
</div>
<div class="panel" id="panel3">
<div class="panel-content">
<!-- question to be rendered here -->
</div>
</div>
<div class="panel" id="summary">
<div class="panel-content">
<div class="summary-sections">
<div class="summary-section" id="panel1-summary">
<!-- summary section to be rendered here -->
</div>
<div class="summary-section" id="panel2-summary">
<!-- summary section to be rendered here -->
</div>
<div class="summary-section" id="panel3-summary">
<!-- summary section to be rendered here -->
</div>
</div>
<div class="answer-box">
<div class="total-points"><span>0</span> total points!</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div class="tips-wrapper">
<div class="opacity-mask"></div>
<div class="material-card">
<h2 class="material-dialog-header">
<img src="images/googlelogo_color_520x172dp.png"> Tips & Tricks
<div class="icon icon-close"></div>
</h2>
<div class="material-tabs">
<div class="material-tab-links-wrapper">
<ul class="material-tab-links">
<li><a class="active" href="#tab-advanced">Advanced</a></li>
<li><a href="#tab-calculator">Calculator</a></li>
<li><a href="#tab-information">Information</a></li>
</ul>
</div>
<div class="material-tab-content">
<div id="tab-advanced" class="material-tab active">
<ul class="tips-list">
<li>
<span class="term">site:</span> <span class="definition">search only within a
specific site</span> <span class="example">site:www.stanford.edu</span>
</li>
<li>
<span class="term">filetype:</span> <span class="definition">find a type of
file: PDF, DOC, TXT</span> <span class="example">filetype:PDF</span>
</li>
<li>
<span class="term">define:</span> <span class="definition">find definitions for
a word</span> <span class="example">define audacity</span>
</li>
<li>
<span class="term">intitle:</span> <span class="definition">find words in the
title of the webpage</span> <span class="example">intitle:inspirational</span>
</li>
<li>
<span class="term">..</span> <span class="definition">get ranges of numbers,
dates, or prices</span> <span class="example">presidents 1800..1900</span>
</li>
<li>
<span class="term">word * word</span> <span class="definition">find other
combinations of words between words</span> <span class="example">creative *
writing</span>
</li>
<li>
<span class="term">- word</span> <span class="definition">search for homer, but
NOT simpsons</span> <span class="example">homer - simpsons</span>
</li>
<li>
<span class="term">"word"</span> <span class="definition">find exact words - no
synonyms or plurals</span> <span class="example">"peace" "freedom"</span>
</li>
<li>
<span class="term">"set of words"</span> <span class="definition">search for
exact set of words, quotes or phrases</span> <span class="example">"I have a
dream"</span>
</li>
</ul>
</div>
<div id="tab-calculator" class="material-tab">
<ul class="tips-list">
<li>
<span class="term">+-*/</span> <span class="definition">add, subtract,
multiply, divide</span> <span class="example">12+68</span>
</li>
<li>
<span class="term">% of</span> <span class="definition">percentage of a
number</span> <span class="example">12% of 68</span>
</li>
<li>
<span class="term">cos() sin()</span> <span class="definition">trigonometry:
cos, sin, tan, arcsin…</span> <span class="example">cos(68)</span>
</li>
<li>
<span class="term">km to miles</span> <span class="definition">convert units:
temp (C to F), weight (kg to lbs)</span> <span class="example">100 km to
miles</span>
</li>
</ul>
</div>
<div id="tab-information" class="material-tab">
<ul class="tips-list">
<li>
<span class="term">weather</span> <span class="definition">get weather for a
region</span> <span class="example">weather honolulu</span>
</li>
<li>
<span class="term">movies</span> <span class="definition">find movies &
theaters nearby (zip or city)</span> <span class="example">movies 94043</span>
</li>
<li>
<span class="term">flight status</span> <span class="definition">get flight
status with the airline & flight number</span> <span class="example">HA
124</span>
</li>
</ul>
</div>
</div>
</div>
<div class="material-dialog-footer">
<ul class="material-dialog-footer-buttons">
<li>
<a target="_blank" href="http://www.google.com/insidesearch/tipstricks/all.html">
Learn More
</a>
</li>
<li>
<a target="_blank" href="http://static.googleusercontent.com/external_content/untrusted_dlcp/agoogleaday.com/en/us/pdf/aGoogleaday_TipsAndTricks.pdf">
Print Tips & Tricks
</a>
</li>
</ul>
</div>
</div>
</div>
<!-- HANDLEBARS TEMPLATES -->
<script id="panel-template" type="text/x-handlebars-template">
<div class="category-{{get_category_class cat}}">
<div class="question">
<h2 class="question-category">{{ cat }}</h2>
<p class="question-text">
{{ question }}
</p>
</div>
<div class="clock">
<svg class="clock-svg" viewBox="0 0 300 300" version="1.1" xmlns="http://www.w3.org/2000/svg">
<circle cx="150" cy="150" r="150" fill="#dddddd" />
<path class="clock-color" />
<circle cx="150" cy="150" r="120" fill="white" />
<text x="150" y="160" class="clock-numbers" font-family="Roboto" text-anchor="middle" font-size="78"></text>
<text x="150" y="205" class="points-text" font-family="Roboto" text-anchor="middle" font-size="36">points</text>
</svg>
</div>
<div class="answer-box">
<div class="answer-box-section answer-input-wrapper">
<div class="icon icon-submit"></div>
<div class="icon icon-check"></div>
<div class="answer-input-wrapper-2">
<input tabindex="-1" value="Enter your answer..."/>
</div>
</div>
<div class="answer-box-section answer-box-option option-hint">
<span class="icon icon-small icon-hint"></span>
<span class="hint-prompt">Give me a hint</span>
<span class="hint-value">{{ hint }}</span>
</div>
<div class="answer-box-section answer-box-option option-hangman">
<span class="icon icon-small icon-hangman"></span>
<span class="hangman-prompt">Show first letters</span>
<span class="hangman-value">{{ hangmanHint }}</span>
</div>
</div>
</div>
</script>
<script id="summary-template" type="text/x-handlebars-template">
<div class="category-{{get_category_class cat}}-summary">
<div class="summary-clock">
<svg class="clock-svg" viewBox="0 0 300 300" version="1.1" xmlns="http://www.w3.org/2000/svg">
<circle cx="150" cy="150" r="150" fill="#dddddd" />
<path class="clock-color" />
<circle cx="150" cy="150" r="120" fill="white" />
<text x="150" y="160" class="clock-numbers" font-family="Roboto" text-anchor="middle" font-size="78"></text>
<text x="150" y="205" class="points-text" font-family="Roboto" text-anchor="middle" font-size="36">points</text>
</svg>
</div>
<div class="summary-info">
<h1>{{ cat }}</h1>
<span class="summary-status">Get started</span>
</div>
</div>
</script>
<script type="text/javascript">
var _gaq = _gaq || [];
_gaq.push(['_setAccount', 'UA-22137604-1']);
_gaq.push(['_trackPageview']);
(function() {
var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
})();
</script>
</body>
</html>
