Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Кол-во редиректов для файла robots.txt 3 слишком большое! Это может вызывать затруднение при индексации поисковыми роботами!
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://giglio.com/robots.txt
301 MovedPermanently
https://giglio.com/robots.txt
302 Found
https://www.giglio.com/robots.txt
200 OK
Показать содержимое robots.txt
Sitemap: https://www.giglio.com/sitemap_index_it-it.xml
Sitemap: https://www.giglio.com/sitemap_index_en-us.xml
Sitemap: https://www.giglio.com/sitemap_index_ru-ru.xml
Sitemap: https://www.giglio.com/sitemap_index_es-es.xml
Sitemap: https://www.giglio.com/sitemap_index_de-de.xml
Sitemap: https://www.giglio.com/sitemap_index_fr-fr.xml
Sitemap: https://www.giglio.com/sitemap_index_en-gb.xml
Sitemap: https://www.giglio.com/sitemap_index_zh-cn.xml
Sitemap: https://www.giglio.com/sitemap_index_ja-jp.xml
Sitemap: https://www.giglio.com/sitemap_index_ko-kr.xml
# Regole per AdsBot-Google
User-agent: AdsBot-Google
Disallow: /*?*category
Disallow: /*?*brandId=
Disallow: /*?*priceRange=
Disallow: /*?*colorId=
Disallow: /*?*size=
Disallow: /*?*woman-shoes=
Disallow: /*?*man-shoes=
Disallow: /*?*woman-clothing=
Disallow: /*?*man-clothing=
Disallow: /*?*673f
Disallow: /*?*6740
Disallow: /*?*655
Disallow: /*?*653
Disallow: /link?*
Disallow: /logo/
Disallow: /api/
Disallow: /js/
Disallow: /widgetInvestors/
Disallow: /*?*srsltid
Disallow: /*?k=*
Disallow: /*&pag=*
Disallow: /*?pag=*
Disallow: /*?sortBy=*
Disallow: /*?designer=*
Disallow: /*?category=*
Disallow: /*?color=*
Disallow: /*?woman-clothing=*
Disallow: /*?man-clothing=*
Disallow: /*?man-shoes=*
Disallow: /*?woman-shoes=*
Disallow: /*?size=*
Disallow: /*,*
Disallow: /*philocaly/*
Disallow: /*_*&cur=*
Disallow: /it-*/
Allow: /it-it/
Allow: /it-ch/
Disallow: /en-*/
Allow: /en-us/
Allow: /en-gb/
Allow: /en-gr/
Allow: /en-be/
Allow: /en-ca/
Allow: /en-hk/
Allow: /en-nl/
Allow: /en-tw/
Allow: /en-pt/
Allow: /en-pl/
Allow: /en-tr/
Allow: /en-ro/
Allow: /en-in/
Allow: /en-bg/
Allow: /en-dk/
Allow: /en-cz/
Allow: /en-sg/
Allow: /en-se/
Allow: /en-kw/
Allow: /en-au/
Allow: /en-sa/
Allow: /en-ie/
Allow: /en-ae/
Allow: /en-lt/
Allow: /en-hu/
Allow: /en-fi/
Allow: /en-no/
Allow: /en-sk/
Allow: /en-qa/
Allow: /en-bh/
Allow: /en-jp/
Allow: /en-rs/
Allow: /en-hr/
Disallow: /ru-*/
Allow: /ru-ru/
Disallow: /es-*/
Allow: /es-mx/
Allow: /es-es/
Disallow: /de-*/
Allow: /de-ch/
Allow: /de-de/
Allow: /de-at/
Disallow: /fr-*/
Allow: /fr-fr/
Allow: /fr-be/
Allow: /fr-ca/
Allow: /fr-ch/
Disallow: /zh-*/
Allow: /zh-cn/
Allow: /zh-hk/
Disallow: /ja-*/
Allow: /ja-jp/
Disallow: /ko-*/
Allow: /ko-kr/
# Regole per AdsBot-Google-Mobile
User-agent: AdsBot-Google-Mobile
Disallow: /*?*category
Disallow: /*?*brandId=
Disallow: /*?*priceRange=
Disallow: /*?*colorId=
Disallow: /*?*size=
Disallow: /*?*woman-shoes=
Disallow: /*?*man-shoes=
Disallow: /*?*woman-clothing=
Disallow: /*?*man-clothing=
Disallow: /*?*673f
Disallow: /*?*6740
Disallow: /*?*655
Disallow: /*?*653
Disallow: /link?*
Disallow: /logo/
Disallow: /api/
Disallow: /js/
Disallow: /widgetInvestors/
Disallow: /*?*srsltid
Disallow: /*?k=*
Disallow: /*&pag=*
Disallow: /*?pag=*
Disallow: /*?sortBy=*
Disallow: /*?designer=*
Disallow: /*?category=*
Disallow: /*?color=*
Disallow: /*?woman-clothing=*
Disallow: /*?man-clothing=*
Disallow: /*?man-shoes=*
Disallow: /*?woman-shoes=*
Disallow: /*?size=*
Disallow: /*,*
Disallow: /*philocaly/*
Disallow: /*_*&cur=*
Disallow: /it-*/
Allow: /it-it/
Allow: /it-ch/
Disallow: /en-*/
Allow: /en-us/
Allow: /en-gb/
Allow: /en-gr/
Allow: /en-be/
Allow: /en-ca/
Allow: /en-hk/
Allow: /en-nl/
Allow: /en-tw/
Allow: /en-pt/
Allow: /en-pl/
Allow: /en-tr/
Allow: /en-ro/
Allow: /en-in/
Allow: /en-bg/
Allow: /en-dk/
Allow: /en-cz/
Allow: /en-sg/
Allow: /en-se/
Allow: /en-kw/
Allow: /en-au/
Allow: /en-sa/
Allow: /en-ie/
Allow: /en-ae/
Allow: /en-lt/
Allow: /en-hu/
Allow: /en-fi/
Allow: /en-no/
Allow: /en-sk/
Allow: /en-qa/
Allow: /en-bh/
Allow: /en-jp/
Allow: /en-rs/
Allow: /en-hr/
Disallow: /ru-*/
Allow: /ru-ru/
Disallow: /es-*/
Allow: /es-mx/
Allow: /es-es/
Disallow: /de-*/
Allow: /de-ch/
Allow: /de-de/
Allow: /de-at/
Disallow: /fr-*/
Allow: /fr-fr/
Allow: /fr-be/
Allow: /fr-ca/
Allow: /fr-ch/
Disallow: /zh-*/
Allow: /zh-cn/
Allow: /zh-hk/
Disallow: /ja-*/
Allow: /ja-jp/
Disallow: /ko-*/
Allow: /ko-kr/
# Regole per Google-Read-Aloud
User-agent: Google-Read-Aloud
Disallow: /*?*category
Disallow: /*?*brandId=
Disallow: /*?*priceRange=
Disallow: /*?*colorId=
Disallow: /*?*size=
Disallow: /*?*woman-shoes=
Disallow: /*?*man-shoes=
Disallow: /*?*woman-clothing=
Disallow: /*?*man-clothing=
Disallow: /*?*673f
Disallow: /*?*6740
Disallow: /*?*655
Disallow: /*?*653
Disallow: /link?*
Disallow: /logo/
Disallow: /api/
Disallow: /js/
Disallow: /widgetInvestors/
Disallow: /*?*srsltid
Disallow: /*?k=*
Disallow: /*&pag=*
Disallow: /*?pag=*
Disallow: /*?sortBy=*
Disallow: /*?designer=*
Disallow: /*?category=*
Disallow: /*?color=*
Disallow: /*?woman-clothing=*
Disallow: /*?man-clothing=*
Disallow: /*?man-shoes=*
Disallow: /*?woman-shoes=*
Disallow: /*?size=*
Disallow: /*,*
Disallow: /*philocaly/*
Disallow: /*_*&cur=*
Disallow: /it-*/
Allow: /it-it/
Allow: /it-ch/
Disallow: /en-*/
Allow: /en-us/
Allow: /en-gb/
Allow: /en-gr/
Allow: /en-be/
Allow: /en-ca/
Allow: /en-hk/
Allow: /en-nl/
Allow: /en-tw/
Allow: /en-pt/
Allow: /en-pl/
Allow: /en-tr/
Allow: /en-ro/
Allow: /en-in/
Allow: /en-bg/
Allow: /en-dk/
Allow: /en-cz/
Allow: /en-sg/
Allow: /en-se/
Allow: /en-kw/
Allow: /en-au/
Allow: /en-sa/
Allow: /en-ie/
Allow: /en-ae/
Allow: /en-lt/
Allow: /en-hu/
Allow: /en-fi/
Allow: /en-no/
Allow: /en-sk/
Allow: /en-qa/
Allow: /en-bh/
Allow: /en-jp/
Allow: /en-rs/
Allow: /en-hr/
Disallow: /ru-*/
Allow: /ru-ru/
Disallow: /es-*/
Allow: /es-mx/
Allow: /es-es/
Disallow: /de-*/
Allow: /de-ch/
Allow: /de-de/
Allow: /de-at/
Disallow: /fr-*/
Allow: /fr-fr/
Allow: /fr-be/
Allow: /fr-ca/
Allow: /fr-ch/
Disallow: /zh-*/
Allow: /zh-cn/
Allow: /zh-hk/
Disallow: /ja-*/
Allow: /ja-jp/
Disallow: /ko-*/
Allow: /ko-kr/
User-agent: *
Disallow: /*?*category
Disallow: /*?*brandId=
Disallow: /*?*priceRange=
Disallow: /*?*colorId=
Disallow: /*?*size=
Disallow: /*?*woman-shoes=
Disallow: /*?*man-shoes=
Disallow: /*?*woman-clothing=
Disallow: /*?*man-clothing=
Disallow: /*?*673f
Disallow: /*?*6740
Disallow: /*?*655
Disallow: /*?*653
Disallow: /link?*
Disallow: /logo/
Disallow: /api/
Disallow: /js/
Disallow: /widgetInvestors/
Disallow: /*?*srsltid
Disallow: /*?k=*
Disallow: /*&pag=*
Disallow: /*?pag=*
Disallow: /*?sortBy=*
Disallow: /*?designer=*
Disallow: /*?category=*
Disallow: /*?color=*
Disallow: /*?woman-clothing=*
Disallow: /*?man-clothing=*
Disallow: /*?man-shoes=*
Disallow: /*?woman-shoes=*
Disallow: /*?size=*
Disallow: /*,*
Disallow: /*philocaly/*
Disallow: /*_*&cur=*
Disallow: /it-*/
Allow: /it-it/
Allow: /it-ch/
Disallow: /en-*/
Allow: /en-us/
Allow: /en-gb/
Allow: /en-gr/
Allow: /en-be/
Allow: /en-ca/
Allow: /en-hk/
Allow: /en-nl/
Allow: /en-tw/
Allow: /en-pt/
Allow: /en-pl/
Allow: /en-tr/
Allow: /en-ro/
Allow: /en-in/
Allow: /en-bg/
Allow: /en-dk/
Allow: /en-cz/
Allow: /en-sg/
Allow: /en-se/
Allow: /en-kw/
Allow: /en-au/
Allow: /en-sa/
Allow: /en-ie/
Allow: /en-ae/
Allow: /en-lt/
Allow: /en-hu/
Allow: /en-fi/
Allow: /en-no/
Allow: /en-sk/
Allow: /en-qa/
Allow: /en-bh/
Allow: /en-jp/
Allow: /en-rs/
Allow: /en-hr/
Disallow: /ru-*/
Allow: /ru-ru/
Disallow: /es-*/
Allow: /es-mx/
Allow: /es-es/
Disallow: /de-*/
Allow: /de-ch/
Allow: /de-de/
Allow: /de-at/
Disallow: /fr-*/
Allow: /fr-fr/
Allow: /fr-be/
Allow: /fr-ca/
Allow: /fr-ch/
Disallow: /zh-*/
Allow: /zh-cn/
Allow: /zh-hk/
Disallow: /ja-*/
Allow: /ja-jp/
Disallow: /ko-*/
Allow: /ko-kr/
User-agent: EtaoSpider
Disallow: /
User-agent: psbot
Disallow: /
User-agent: NPBot-1/2.0
Disallow: /
User-agent: NPBot
Disallow: /
User-agent: AhrefsBot
Disallow: /
User-agent: BLEXBot
Disallow: /
User-agent: Pinterest
Disallow: /*?*category
Disallow: /*?*brandId=
Disallow: /*?*priceRange=
Disallow: /*?*colorId=
Disallow: /*?*size=
Disallow: /*?*woman-shoes=
Disallow: /*?*man-shoes=
Disallow: /*?*woman-clothing=
Disallow: /*?*man-clothing=
Disallow: /*?*673f
Disallow: /*?*6740
Disallow: /*?*655
Disallow: /*?*653
Disallow: /link?*
Disallow: /logo/
Disallow: /api/
Disallow: /js/
Disallow: /widgetInvestors/
Disallow: /*?*srsltid
Disallow: /*?k=*
Disallow: /*&pag=*
Disallow: /*?pag=*
Disallow: /*?sortBy=*
Disallow: /*?designer=*
Disallow: /*?category=*
Disallow: /*?color=*
Disallow: /*?woman-clothing=*
Disallow: /*?man-clothing=*
Disallow: /*?man-shoes=*
Disallow: /*?woman-shoes=*
Disallow: /*?size=*
Disallow: /*,*
Disallow: /*philocaly/*
Disallow: /*_*&cur=*
Disallow: /it-*/
Allow: /it-it/
Allow: /it-ch/
Disallow: /en-*/
Allow: /en-us/
Allow: /en-gb/
Allow: /en-gr/
Allow: /en-be/
Allow: /en-ca/
Allow: /en-hk/
Allow: /en-nl/
Allow: /en-tw/
Allow: /en-pt/
Allow: /en-pl/
Allow: /en-tr/
Allow: /en-ro/
Allow: /en-in/
Allow: /en-bg/
Allow: /en-dk/
Allow: /en-cz/
Allow: /en-sg/
Allow: /en-se/
Allow: /en-kw/
Allow: /en-au/
Allow: /en-sa/
Allow: /en-ie/
Allow: /en-ae/
Allow: /en-lt/
Allow: /en-hu/
Allow: /en-fi/
Allow: /en-no/
Allow: /en-sk/
Allow: /en-qa/
Allow: /en-bh/
Allow: /en-jp/
Allow: /en-rs/
Allow: /en-hr/
Disallow: /ru-*/
Allow: /ru-ru/
Disallow: /es-*/
Allow: /es-mx/
Allow: /es-es/
Disallow: /de-*/
Allow: /de-ch/
Allow: /de-de/
Allow: /de-at/
Disallow: /fr-*/
Allow: /fr-fr/
Allow: /fr-be/
Allow: /fr-ca/
Allow: /fr-ch/
Disallow: /zh-*/
Allow: /zh-cn/
Allow: /zh-hk/
Disallow: /ja-*/
Allow: /ja-jp/
Disallow: /ko-*/
Allow: /ko-kr/
Crawl-delay: 1
