Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 14091 байт. Загружен за: 2сек.
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://rubenvidal.com/robots.txt
302 Found
https://cargocollective.com/rubenvidal
200 OK
Показать содержимое robots.txt
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
<meta name="verify-v1" content="STDtWvgGjOy77mPN8tNAAfDaBqDkqWU7AHfu7opE3NQ=" />
<meta name="description" content="ruben vidal, painting, pintura, dibujo, escultura, sculpture, oleo, oil, clay, barro, escultura, portfolio, carboncillo, charcoal, tinta, ink, graphite, grafito" />
<meta name="keywords" content="painting, sculpture, drawing" />
<meta name="cargo_title" content="Rubén Vidal" />
<meta name="ROBOTS" content="INDEX,FOLLOW">
<base href="//cargocollective.com" />
<link rel="shortcut icon" href="https://favicon.cargocollective.com/favicon.ico">
<title>Rubén Vidal</title>
<link href="/stylesheet/rubenvidal" id="user_stylesheet" rel="stylesheet" type="text/css" />
<script type='text/javascript' src='/_js/cargo.jquery.package.js?26.11.18.1'></script>
<script type='text/javascript' src='/_js/cargo.site.package.js?26.11.18.1'></script>
<script type='text/javascript' src='/_js/cargo.tools.package.js?26.11.18.1'></script>
<script type="text/javascript" src="/designs/escher/mondrian/template.js?26.11.18.1" charset="utf-8"></script> <script type="text/javascript">var _sf_startpt=(new Date()).getTime()</script>
<script type="text/javascript">var _use_google_analytics=1</script>
<link href="_css/globalstyle.css?26.11.18.1" rel="stylesheet" type="text/css" charset="utf-8" />
<link href="/rss/rubenvidal" rel="alternate" type="application/rss+xml" title="Cargo feed" />
</head>
<body >
<customhtml><div class="cargo_link">Running on <a href="http://cargocollective.com">Cargo</a></div></customhtml><div class="header_img" ><a href="https://cargocollective.com/rubenvidal" onfocus="this.blur()"><img src="https://media.cargocollective.com/1/1/44877/headerimg/rubenvidal_6.gif" height="70" width="452"></a></div><img src="/_gfx/loadingAnim.gif" id="nav_loadspin"><div class="nav_container"><div class="page_link" id="menu_539010"><a href="/rubenvidal/About-Ruben-Vidal" id="p539010" rel="history" name="rubenvidal" id="p539010">About Rubén Vidal</a></div><div class="page_link" id="menu_540812"><a href="/rubenvidal/CV" id="p540812" rel="history" name="rubenvidal" id="p540812">CV</a></div><div class="page_link" id="menu_540645"><a href="/rubenvidal/Contact" id="p540645" rel="history" name="rubenvidal" id="p540645">Contact</a></div><div id="nav_page_1"><div class="project_link" id="menu_540554"><a href="/rubenvidal/Figures" id="p540554" rel="history" name="rubenvidal" >Figures</a></div><div class="project_link" id="menu_540639"><a href="/rubenvidal/Landscapes" id="p540639" rel="history" name="rubenvidal" >Landscapes</a></div><div class="project_link" id="menu_539258"><a href="/rubenvidal/Sculptures" id="p539258" rel="history" name="rubenvidal" >Sculptures</a></div><div class="project_link" id="menu_539213"><a href="/rubenvidal/Portraits" id="p539213" rel="history" name="rubenvidal" >Portraits</a></div><div class="project_link" id="menu_539206"><a href="/rubenvidal/Musicians" id="p539206" rel="history" name="rubenvidal" >Musicians</a></div><div class="project_link" id="menu_539009"><a href="/rubenvidal/News" id="p539009" rel="history" name="rubenvidal" >News</a></div></div></div><div id="content_container"><div id="maincontainer" class="bodycopy"></div><div class="pagecontainer" id="item_539010" name="539010" page="0" spot="0"></div><div class="pagecontainer" id="item_540812" name="540812" page="0" spot="0"></div><div id="page_1"><div class="project_thumb" id="item_540554" name="540554" page="1" spot="-1"><div id="pr_contain_item_540554"><a href="/rubenvidal/Figures" onmouseover="this.className='hover';" onmouseout="this.className='nohover';" class="nohover" id="p540554" rel="history" name="rubenvidal" onfocus="this.blur()"><div class="loader_holder " id="load_540554"><img src="/_gfx/loadingAnim.gif"></div><div class="cardimgcrop " id="cardthumb_540554" name=""><img src="https://payload.cargocollective.com/1/1/44877/540554/prt_1442921197.JPG" border="0" rel="testprt_1442921197.JPG" data-hi-res="https://payload.cargocollective.com/1/1/44877/540554/prt_1442921197_2x.JPG" data-4x="https://payload.cargocollective.com/1/1/44877/540554/prt_1442921197_4x.JPG" width="200" height="134"></div><div class="thumb_title "><span class="text">Figures</span> </div></a><div class="thumb_tag "><span class="text"><a href="https://cargocollective.com/rubenvidal/filter/Oil">Oil</a> </span></div></div></div><div class="project_thumb" id="item_540639" name="540639" page="1" spot="-1"><div id="pr_contain_item_540639"><a href="/rubenvidal/Landscapes" onmouseover="this.className='hover';" onmouseout="this.className='nohover';" class="nohover" id="p540639" rel="history" name="rubenvidal" onfocus="this.blur()"><div class="loader_holder " id="load_540639"><img src="/_gfx/loadingAnim.gif"></div><div class="cardimgcrop " id="cardthumb_540639" name=""><img src="https://payload.cargocollective.com/1/1/44877/540639/prt_1353514025.JPG" border="0" rel="testprt_1353514025.JPG"></div><div class="thumb_title "><span class="text">Landscapes</span> </div></a><div class="thumb_tag "><span class="text"><a href="https://cargocollective.com/rubenvidal/filter/Oil">Oil</a> </span></div></div></div><div class="project_thumb" id="item_539258" name="539258" page="1" spot="-1"><div id="pr_contain_item_539258"><a href="/rubenvidal/Sculptures" onmouseover="this.className='hover';" onmouseout="this.className='nohover';" class="nohover" id="p539258" rel="history" name="rubenvidal" onfocus="this.blur()"><div class="loader_holder " id="load_539258"><img src="/_gfx/loadingAnim.gif"></div><div class="cardimgcrop " id="cardthumb_539258" name=""><img src="https://payload.cargocollective.com/1/1/44877/539258/prt_1353518834.JPG" border="0" rel="testprt_1353518834.JPG"></div><div class="thumb_title "><span class="text">Sculptures</span> </div></a><div class="thumb_tag "><span class="text"><a href="https://cargocollective.com/rubenvidal/filter/Clay-_-Bronze">Clay / Bronze</a> </span></div></div></div><div class="project_thumb" id="item_539213" name="539213" page="1" spot="-1"><div id="pr_contain_item_539213"><a href="/rubenvidal/Portraits" onmouseover="this.className='hover';" onmouseout="this.className='nohover';" class="nohover" id="p539213" rel="history" name="rubenvidal" onfocus="this.blur()"><div class="loader_holder " id="load_539213"><img src="/_gfx/loadingAnim.gif"></div><div class="cardimgcrop " id="cardthumb_539213" name=""><img src="https://payload.cargocollective.com/1/1/44877/539213/prt_1353516938.JPG" border="0" rel="testprt_1353516938.JPG"></div><div class="thumb_title "><span class="text">Portraits</span> </div></a><div class="thumb_tag "><span class="text"><a href="https://cargocollective.com/rubenvidal/filter/Oil-_-Charcoal">Oil / Charcoal</a> </span></div></div></div><div class="project_thumb" id="item_539206" name="539206" page="1" spot="-1"><div id="pr_contain_item_539206"><a href="/rubenvidal/Musicians" onmouseover="this.className='hover';" onmouseout="this.className='nohover';" class="nohover" id="p539206" rel="history" name="rubenvidal" onfocus="this.blur()"><div class="loader_holder " id="load_539206"><img src="/_gfx/loadingAnim.gif"></div><div class="cardimgcrop " id="cardthumb_539206" name=""><img src="https://payload.cargocollective.com/1/1/44877/539206/prt_1378982242.jpg" border="0" rel="testprt_1378982242.jpg" data-hi-res="https://payload.cargocollective.com/1/1/44877/539206/prt_1378982242_2x.jpg" width="200" height="134"></div><div class="thumb_title "><span class="text">Musicians</span> </div></a><div class="thumb_tag "><span class="text"><a href="https://cargocollective.com/rubenvidal/filter/Ink-_-Graphite-_-Charcoal">Ink / Graphite / Charcoal</a> </span></div></div></div><div class="project_thumb" id="item_539009" name="539009" page="1" spot="-1"><div id="pr_contain_item_539009"><a href="/rubenvidal/News" onmouseover="this.className='hover';" onmouseout="this.className='nohover';" class="nohover" id="p539009" rel="history" name="rubenvidal" onfocus="this.blur()"><div class="loader_holder " id="load_539009"><img src="/_gfx/loadingAnim.gif"></div><div class="cardimgcrop " id="cardthumb_539009" name=""><img src="https://payload.cargocollective.com/1/1/44877/539009/prt_1442920777.jpg" border="0" rel="testprt_1442920777.jpg" data-hi-res="https://payload.cargocollective.com/1/1/44877/539009/prt_1442920777_2x.jpg" width="200" height="134"></div><div class="thumb_title "><span class="text">News</span> </div></a><div class="thumb_tag "><span class="text"><a href="https://cargocollective.com/rubenvidal/filter/Exhibitions-_-Events">Exhibitions / Events</a> </span></div></div></div><div class="pagecontainer" id="item_540645" name="540645" page="0" spot="6"></div></div></div><div id="foot_container"><input type="hidden" id="current_open" value="none"><input type="hidden" id="prev_open" value="none"><input type="hidden" id="prev_type" value="project_link"><input type="hidden" id="this_spot" value="-1"><input type="hidden" id="is_domain" value="false"><input type="hidden" id="url" value="rubenvidal"><input type="hidden" id="uid" value="44877"><input type="hidden" id="current_page" value="1"><input type="hidden" id="total_pages" value="1"><input type="hidden" id="limit" value="24"><input type="hidden" id="viewtype" value="list"><input type="hidden" id="previewtemplate" value="false"><input type="hidden" id="template" value="escher"><input type="hidden" id="design" value="mondrian"><input type="hidden" id="templatepath" value="designs/escher"><input type="hidden" id="designpath" value="designs/escher/mondrian"><input type="hidden" id="sticky_page" value="top"><input type="hidden" id="o_thumb_nav" value="yes"><input type="hidden" id="is_solo" value="false"><input type="hidden" id="is_direct" value="false"><fullscreen_option data="fill"></fullscreen_option><script type="text/html"id="fullscreen_src"><div class="freshbox_navigation"><div class="freshbox_navigation_group"><a href="#"id="fullscreen_prev"class="freshbox_nav_button"><svg viewBox="0 0 30 30"height="100%"width="100%"version="1.1"><g transform="translate(11, 11)"><path class="nav_svg"d="M 0 4 L 8 8 L 8 8 L 8 0"/></g></svg></a><a href="#"id="fullscreen_close"class="freshbox_nav_button"><svg viewBox="0 0 30 30"height="100%"width="100%"version="1.1"><g class="nav_svg"transform="translate(10, 10)"><rect x="1"width="1"height="1"/><rect x="1"y="1"width="1"height="1"/><rect x="2"y="1"width="1"height="1"/><rect x="1"y="2"width="1"height="1"/><rect x="2"y="2"width="1"height="1"/><rect x="3"y="2"width="1"height="1"/><rect x="4"y="3"width="1"height="1"/><rect x="3"y="4"width="1"height="1"/><rect x="4"y="4"width="1"height="1"/><rect x="5"y="3"width="1"height="1"/><rect x="6"y="2"width="1"height="1"/><rect x="7"y="1"width="1"height="1"/><rect x="8"width="1"height="1"/><rect x="9"y="1"width="1"height="1"/><rect x="8"y="1"width="1"height="1"/><rect x="7"y="2"width="1"height="1"/><rect x="8"y="2"width="1"height="1"/><rect x="7"y="3"width="1"height="1"/><rect x="6"y="3"width="1"height="1"/><rect x="5"y="4"width="1"height="1"/><rect x="6"y="4"width="1"height="1"/><rect x="5"y="5"width="1"height="1"/><rect x="6"y="5"width="1"height="1"/><rect x="7"y="6"width="1"height="1"/><rect x="8"y="7"width="1"height="1"/><rect x="9"y="8"width="1"height="1"/><rect x="8"y="9"width="1"height="1"/><rect x="7"y="8"width="1"height="1"/><rect x="7"y="7"width="1"height="1"/><rect x="6"y="7"width="1"height="1"/><rect x="6"y="6"width="1"height="1"/><rect x="5"y="6"width="1"height="1"/><rect x="4"y="6"width="1"height="1"/><rect x="3"y="7"width="1"height="1"/><rect x="3"y="6"width="1"height="1"/><rect x="2"y="6"width="1"height="1"/><rect x="2"y="7"width="1"height="1"/><rect x="1"y="7"width="1"height="1"/><rect y="8"width="1"height="1"/><rect x="1"y="8"width="1"height="1"/><rect x="3"y="5"width="1"height="1"/><rect x="2"y="8"width="1"height="1"/><rect x="1"y="9"width="1"height="1"/><rect x="8"y="8"width="1"height="1"/><rect x="4"y="5"width="1"height="1"/><rect x="2"y="3"width="1"height="1"/><rect x="3"y="3"width="1"height="1"/><rect y="1"width="1"height="1"/></g></svg></a><a href="#"id="fullscreen_next"class="freshbox_nav_button"><svg viewBox="0 0 30 30"height="100%"width="100%"version="1.1"><g transform="translate(20, 11) scale(-1, 1)"><path class="nav_svg"d="M 0 4 L 8 8 L 8 8 L 8 0"/></g></svg></a><a href="#"id="fullscreen_zoom" class="freshbox_nav_button"><svg version="1.1" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" x="0px" y="0px" width="60px" height="30px" viewBox="0 0 60 30" xml:space="preserve"><g class="nav_svg"><polygon points="22,8 16.111,8 18.296,10.186 15.914,12.564 17.438,14.088 19.818,11.707 22,13.891 "/><polygon points="12.564,15.914 10.184,18.295 8,16.109 8,22 13.891,22 11.707,19.816 14.087,17.436 "/></g><g class="nav_svg"><polygon points="46.914,13.087 52.803,13.087 50.618,10.902 53,8.523 51.477,7 49.096,9.38 46.914,7.197 "/><polygon points="38.522,23 40.903,20.619 43.087,22.805 43.087,16.914 37.196,16.914 39.38,19.098 37,21.479 "/></g></svg></a></div></div><div id="fullscreen_imgs"></div></script><script language="javascript"> var pid_list = new Array("539010","540812","540554","540639","539258","539213","539206","539009","540645",""); var pr_list = new Array("540554","540639","539258","539213","539206","539009"); var prt_list = new Array("Figures","Landscapes","Sculptures","Portraits","Musicians","News"); </script> <div class="bottompad"> </div></div><!-- following rail -->
<script type="text/javascript" src="/_jsapps/_libs/cargo.rail.package.js"></script>
<script type="text/javascript" src="/_jsapps/rail/rail.app.js"></script>
<script type="text/javascript" src="/_jsapps/rail/rail.jquery.js"></script>
<link href="/_jsapps/rail/rail.css" rel="stylesheet" type="text/css" /></body>
</html>
Apache