Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 8234 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Показать содержимое robots.txt
<html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"><head><meta http-equiv="Content-Type" content="text/html; charset=windows-1252">
<script type="text/javascript"></script>
</script>
<title>Jonathan Strahan</title>
<!-- Meta Information -->
<meta name="DC.Identifier" scheme="URI" content="mailto:jstrahan@iinet.net.au">
<meta name="DC.Creator" content="personalName: Jonathan Strahan">
<meta name="DC.Publisher" content="corporateName: Coode Street Productions">
<meta name="DC.Rights" content="Copyright 2006 Jonathan Strahan">
<meta name="DC.Title" content="Notes from Coode Street">
<meta name="DC.Subject" content="">
<meta name="DC.Description" content="This site provides visitors with information on science fiction, editing, and the activities of Jonathan Strahan, editor, reviewer and anthologist.">
<meta name="DC.Language" scheme="RFC1766" content="en">
<meta name="DC.Coverage.spatial" content="">
<meta name="AGLS.Function" content="This site provides visitors with information on science fiction, editing, and the activities of Jonathan Strahan, editor, reviewer and anthologist.">
<meta name="DC.Date.created" scheme="ISO8601" content="2006-01-16">
<meta name="DC.Date.valid" scheme="ISO8601" content="2006-01-16">
<meta name="DC.Date.issued" scheme="ISO8601" content="2006-01-161">
<meta name="DC.Date.modified" scheme="ISO8601" content="2006-01-16">
<meta name="AGLS.Availability" content="This site provides visitors with information on science fiction, editing, and the activities of Jonathan Strahan, editor, reviewer and anthologist">
<meta name="AGLS.Audience" content="science fiction, editing, anthologies, locus, year's best">
<!-- End Meta Information -->
<link rel="stylesheet" href="http://www.blogger.com/css/blog_controls.css" type="text/css"/><link rel="stylesheet" href="http://www.blogger.com/dyn-css/authorization.css?blogID=8602859" type="text/css"/>
<style type="text/css">body{background:#fff;margin:0;padding:40px 20px;font:x-small Georgia,serif;text-align:center;color:#333;font-size:small;font-size:small}a:link{color:#58a;text-decoration:none}a:visited{color:#969;text-decoration:none}a:hover{color:#c60;text-decoration:underline}a img{border-width:0}#header{width:660px;margin:0 auto 10px;border:1px solid #ccc}#blog-title{margin:5px 5px 0;padding:20px 20px .25em;border:1px solid #eee;border-width:1px 1px 0;font-size:200%;line-height:1.2em;font-weight:normal;color:#666;text-transform:uppercase;letter-spacing:.2em}#blog-title a{color:#666;text-decoration:none}#blog-title a:hover{color:#c60}#description{margin:0 5px 5px;padding:0 20px 20px;border:1px solid #eee;border-width:0 1px 1px;max-width:700px;font:78%/1.4em "Trebuchet MS",Trebuchet,Arial,Verdana,sans-serif;letter-spacing:.2em;color:#999}#content{width:660px;margin:0 auto;padding:0;text-align:left}#main{width:480px;float:right}#sidebar{width:140px;float:left}h2{margin:1.5em 0 .75em;font:78%/1.4em "Trebuchet MS",Trebuchet,Arial,Verdana,sans-serif;letter-spacing:.2em;color:#999}.date-header{margin:1.5em 0 .5em}.post{margin:.5em 0 1.5em;line-height:1.6em;border-bottom:1px dotted #ccc;padding-bottom:1.5em}.post-title{margin:.25em 0 0;padding:0 0 4px;font-size:140%;font-weight:normal;line-height:1.4em;color:#232323}.post-title a,.post-title a:visited,.post-title strong{display:block;text-decoration:none;color:#c60;font-weight:normal}.post-title strong,.post-title a:hover{color:#333}.post div{margin:0 0 .75em;line-height:1.6em}p.post-footer{margin:-.25em 0 0;color:#ccc}.post-footer em,.comment-link{font:78%/1.4em "Trebuchet MS",Trebuchet,Arial,Verdana,sans-serif;letter-spacing:.1em}.post-footer em{font-style:normal;color:#999;margin-right:.6em}.comment-link{margin-left:.6em}.post img{padding:4px;border:1px solid #ddd}.post blockquote{margin:1em 20px}.post blockquote p{margin:.75em 0}#comments h4{margin:1em 0;font:bold 78%/1.6em "Trebuchet MS",Trebuchet,Arial,Verdana,sans-serif;letter-spacing:.2em;color:#999}#comments h4 strong{font-size:130%}#comments-block{margin:1em 0 1.5em;line-height:1.6em}#comments-block dt{margin:.5em 0}#comments-block dd{margin:.25em 0 0}#comments-block dd.comment-timestamp{margin:-.25em 0 2em;font:78%/1.4em "Trebuchet MS",Trebuchet,Arial,Verdana,sans-serif;letter-spacing:.1em}#comments-block dd p{margin:0 0 .75em}.deleted-comment{font-style:italic;color:gray}#sidebar ul{margin:0 1.5em 1.5em;padding:0 1.5em 1.5em;border-bottom:1px dotted #ccc;list-style:square}#sidebar li{margin:0;padding:0 0 .25em 15px;text-indent:-15px;line-height:2.5em;font-size:.8em}#sidebar p{color:#666;line-height:1.5em;font-size:.8em}#profile-container{margin:0 0 1.5em;border-bottom:1px dotted #ccc;padding-bottom:1.5em}.profile-datablock{margin:.5em 0 .5em}.profile-img{display:inline}.profile-img img{float:left;padding:4px;border:1px solid #ddd;margin:0 8px 3px 0}.profile-data{margin:0;font:bold 78%/1.6em "Trebuchet MS",Trebuchet,Arial,Verdana,sans-serif;text-transform:uppercase;letter-spacing:.1em}.profile-data strong{display:none}.profile-textblock{margin:0 0 .5em}.profile-link{margin:0;font:78%/1.4em "Trebuchet MS",Trebuchet,Arial,Verdana,sans-serif;text-transform:uppercase;letter-spacing:.1em}#footer{width:660px;clear:both;margin:0 auto}#footer hr{display:none}#footer p{margin:0;padding-top:15px;font:78%/1.6em "Trebuchet MS",Trebuchet,Verdana,sans-serif;text-transform:uppercase;letter-spacing:.1em}</style>
<!-- --><link rel="stylesheet" href="http://www.blogger.com/css/navbar/main.css" type="text/css"/><link rel="stylesheet" href="http://www.blogger.com/css/navbar/4.css" type="text/css"/>
</head>
<body data-gr-c-s-loaded="true"><!-- BEGIN WAYBACK TOOLBAR INSERT -->
<style type="text/css">body{margin-top:0!important;padding-top:0!important}</style>
<script>__wm.rw(0);</script>
</div><script type="text/javascript">__wm.bt(625,27,25,2,"web","http://www.jonathanstrahan.com.au/","20200718090916",1996,"/_static/",["/_static/css/banner-styles.css?v=_99BHQfY","/_static/css/iconochive.css?v=qtvMKcIJ"]);__wm.rw(1);</script>
<!-- END WAYBACK TOOLBAR INSERT -->
<div id="header">
<h1 id="blog-title">
Coode Street
</h1>
<p id="description">information on jonathan strahan and coode street productions</p>
</div>
<!-- Begin #content -->
<div id="content">
<!-- Begin #main -->
<div id="main">
<!-- Begin .post -->
<div class="post">
<div class="post-body">
<div>
Welcome to the website for Jonathan Strahan and Coode Street Productions.<br><br>I am an award-winning editor, anthologist and book reviewer. I edit anthologies on a freelance basis, acquire and edit fiction for Tor.com and Tor.com Publishing, and am the Reviews Editor for <a href="http://www.locusmag.com/"><em>Locus</em></a>.<br><br>
I co-host the multiple-award nominated <a href="http://jonathanstrahan.podbean.com/">Coode Street Podcast</a>, a happy successor to my now oft-ignored but also excessively rambling and digressive personal journal, <a href="http://www.jonathanstrahan.com.au/wp">notes from coode street</a>.<br><br>Coode Street Productions was established in 1999 to publish a critical 'zine, <em>The Coode Street Review of Science Fiction</em>, a one-shot critical magazine. Named after the not very bohemian street where I used to live, Coode Street has become the umbrella name for all of the science fiction work I do, which I also keep against the possibility that I might publish books again.
</div>
</div>
</div>
<!-- End .post -->
</div>
<!-- End #main -->
<!-- Begin #sidebar -->
<div id="sidebar">
<ul class="sidebar">
<li><a href="http://www.jonathanstrahan.com.au/" class="sidebar-title">Home</a></li>
<li><a href="http://www.jonathanstrahan.com.au/wp">Journal</a></li>
<li><a href="http://www.jonathanstrahan.com.au/wp/about/">Biography</a></li>
<li><a href="http://www.jonathanstrahan.com.au/wp/bibliography/">Bibliography</a></li>
<li><a href="http://www.jonathanstrahan.com.au/wp/contact-information/">Contact</a></li>
</ul>
</div>
<!-- End #sidebar -->
</div>
<!-- End #content -->
<!-- Begin #footer -->
<div id="footer"><hr>
<p class="post-footer">copyright 2017 Coode Street Productions</p>
</div>
<!-- End #footer -->
</body></html>
Apache