Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 11398 байт. Загружен за: 0сек.
Проверяемая страница не запрещена в robots.txt.
Показать содержимое robots.txt
# As a condition of accessing this website, you agree to abide by the following
# content signals:
# (a) If a Content-Signal = yes, you may collect content for the corresponding
# use.
# (b) If a Content-Signal = no, you may not collect content for the
# corresponding use.
# (c) If the website operator does not include a Content-Signal for a
# corresponding use, the website operator neither grants nor restricts
# permission via Content-Signal with respect to the corresponding use.
# The content signals and their meanings are:
# search: building a search index and providing search results (e.g., returning
# hyperlinks and short excerpts from your website's contents). Search does not
# include providing AI-generated search summaries.
# ai-input: inputting content into one or more AI models (e.g., retrieval
# augmented generation, grounding, or other real-time taking of content for
# generative AI search answers).
# ai-train: training or fine-tuning AI models.
# use: how AI systems may consume the content (immediate, reference, or full).
# ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF
# RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT
# AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET.
# BEGIN Cloudflare Managed content
User-agent: *
Content-Signal: search=yes,ai-train=no,use=reference
Allow: /
User-agent: Amazonbot
Disallow: /
User-agent: Applebot-Extended
Disallow: /
User-agent: Bytespider
Disallow: /
User-agent: CCBot
Disallow: /
User-agent: ClaudeBot
Disallow: /
User-agent: CloudflareBrowserRenderingCrawler
Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: GPTBot
Disallow: /
User-agent: meta-externalagent
Disallow: /
# END Cloudflare Managed Content
<!DOCTYPE html><html><head><meta charset="utf-8"><title>Francesca Bria</title><meta name="description" content="Innovation economist and digital policy expert, working at the intersection of technology, geopolitics, economics and society."><meta name="keywords" content="Innovation,economy,digital policy,DECODE,D-CENT,DSI4EU,Top Women in Tech"><meta name="author" content="Jose Nuñez"><meta property="og:image" content="/img/francesca_bria_site.jpg"><meta property="og:image:type" content="image/jpeg"><meta property="og:image:width" content="1200"><meta property="og:image:height" content="630"><meta name="viewport" content="width=device-width, minimum-scale=1, maximum-scale=1, initial-scale=1, shrink-to-fit=no"><link href="/index.7a96647a.css" rel="stylesheet"><link rel="stylesheet" media="screen and (max-width: 768px)" href="/index.e3293463.css"><script src="/index.a040b5c0.js"></script></head><body id="home"> <nav class="scroll"> <div class="navbar"> <input class="side-menu" type="checkbox" id="side-menu"> <label class="hamb" for="side-menu"><span class="hamb-line"></span></label> <div class="nav_menu"> <div class="hide_menu social_menu"> <a href="https://twitter.com/francesca_bria"> <svg viewBox="0 0 24 25"><path d="M24 4.557a9.8 9.8 0 0 1-2.828.775 4.93 4.93 0 0 0 2.165-2.724 9.9 9.9 0 0 1-3.127 1.195 4.92 4.92 0 0 0-3.594-1.555c-3.179 0-5.515 2.966-4.797 6.045A13.98 13.98 0 0 1 1.671 3.149a4.93 4.93 0 0 0 1.523 6.574 4.9 4.9 0 0 1-2.229-.616c-.054 2.281 1.581 4.415 3.949 4.89a4.9 4.9 0 0 1-2.224.084 4.93 4.93 0 0 0 4.6 3.419A9.9 9.9 0 0 1 0 19.54a13.94 13.94 0 0 0 7.548 2.212c9.142 0 14.307-7.721 13.995-14.646A10 10 0 0 0 24 4.557"/></svg> </a> <a href="https://www.linkedin.com/in/francescabria"> <svg viewBox="0 0 24 27"><path d="M4.98 3.5C4.98 4.881 3.87 6 2.5 6S.02 4.881.02 3.5C.02 2.12 1.13 1 2.5 1s2.48 1.12 2.48 2.5M5 8H0v16h5zm7.982 0H8.014v16h4.969v-8.399c0-4.67 6.029-5.052 6.029 0V24H24V13.869c0-7.88-8.922-7.593-11.018-3.714z"/></svg> </a> <a href="mailto:contact@francescabria.com"> <svg viewBox="0 0 24 24"><path d="M12 12.713.015 3h23.971zm-5.425-1.822L0 5.562v12.501zm10.85 0L24 18.063V5.562zm-1.557 1.261L12 15.287l-3.868-3.135L.022 21h23.956z"/></svg> </a> </div> <ul class="hide_menu main_menu"> <li class="nav-item"> <a class="nav-link" href="." ahref-index="#home">Home</a> </li> <li class="nav-item"> <a class="nav-link" href="/about.html" ahref-index="#about">About me</a> </li> <li class="nav-item"> <a class="nav-link" href="/works.html" ahref-index="#works">My work</a> </li> <li class="nav-item"> <a class="nav-link" href="/talks.html" ahref-index="#talks">Featured talks</a> </li> <li class="nav-item"> <a class="nav-link" href="/media.html" ahref-index="#media">In the media</a> </li> <li class="nav-item"> <a class="nav-link" target="_new" href="https://medium.com/@francescabria">Blogpost</a> </li> </ul> </div> <div class="nav_brand"> <a class="nav-link navbar_brand" href=".">Francesca Bria</a> </div> <a href="/index_v2.html" class="hide">v2</a> </div> </nav> <section id="main_header" class="header header_dark_gradient" aria-background="img/francesca_bria_header.jpg" aria-current="0"> <div class="header_row"> <div class="header_title"> <h1 class="header_text">Francesca Bria</h1> <h2 class="header_subtext slogan"> There is no digital revolution without a <b>democratic revolution</b> </h2> </div> </div> </section> <div id="about"></div> <div class="about_text"> <div aria-data="home_bio"></div> <a class="link link_more link_under" href="/about.html">Read more about me</a> </div> <section id="home_works" class="work_section"> <div class="header_section"> <h2 class="title_open title_section">My work and Projects</h2> </div> <div id="projects_grid" aria-load="projects" aria-highfield="highlight" aria-item="project_item" class="projects_home_grid"></div> <div class="section_foot section_header text-center"> <h2 class="section_title"> <a href="/works.html" id="btn_go_projects" class="link_go_projects"><span>Check out more</span> <svg viewBox="0 0 24 24"><path d="M0 3.795 2.995.815 14.127 12 2.995 23.186 0 20.205 8.167 12zM18.04 12l-8.167 8.205 2.995 2.98L24 12 12.868.814l-2.995 2.98z"/></svg> </a> </h2> </div> </section> <section id="talks" class="talks_section"> <div class="header_section"> <h2 class="title_section">Featured talks</h2> <div class="video_row"> <div class="video_list_wrapper"> <div class="video_list" aria-load="talks" aria-highfield="highlight" aria-item="video_item"></div> <h2 class="section_title"> <a href="/talks.html" id="btn_go_talks" class="link_go_projects"><span>Check out more</span> <svg viewBox="0 0 24 24"><path d="M0 3.795 2.995.815 14.127 12 2.995 23.186 0 20.205 8.167 12zM18.04 12l-8.167 8.205 2.995 2.98L24 12 12.868.814l-2.995 2.98z"/></svg> </a> </h2> </div> <div id="video_player" class="video_wrapper"> <iframe id="video_iframe" width="560" height="315" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope;" allowfullscreen></iframe> </div> </div> </div> </section> <section id="media" class="media_section"> <div class="amedia_section header_section"> <div class="media_head"> <h2 class="title_section">In the media</h2> </div> <div id="media_grid" aria-load="media" aria-highfield="highlight" aria-item="media_item"> </div> </div> <div class="section_foot section_header text-center"> <h2 class="section_title"> <a href="/media.html" id="btn_go_media" class="link_go_projects"><span>Check out more</span> <svg viewBox="0 0 24 24"><path d="M0 3.795 2.995.815 14.127 12 2.995 23.186 0 20.205 8.167 12zM18.04 12l-8.167 8.205 2.995 2.98L24 12 12.868.814l-2.995 2.98z"/></svg> </a> </h2> </div> </section> <div class="cookies_msg hide"> <p> This website uses cookies for statistics puroposes.<br> If you agree press Accept.<br> <a target="_new" href="https://support.mozilla.org/es/kb/cookies-informacion-que-los-sitios-web-guardan-en-"> Get information about cookies.</a><br> <a class="cookies_accept" href="#">Accept</a> </p> </div> <footer> <div class="menu_footer"> <a href=".">Home</a> <a href="/about.html">About me</a> <a href="/works.html">My work and Projects</a> <a href="/talks.html">Featured talks</a> <a href="/media.html">In the media</a> </div> <div class="social_footer"> <a href="https://twitter.com/francesca_bria"> <svg viewBox="0 0 24 25"><path d="M24 4.557a9.8 9.8 0 0 1-2.828.775 4.93 4.93 0 0 0 2.165-2.724 9.9 9.9 0 0 1-3.127 1.195 4.92 4.92 0 0 0-3.594-1.555c-3.179 0-5.515 2.966-4.797 6.045A13.98 13.98 0 0 1 1.671 3.149a4.93 4.93 0 0 0 1.523 6.574 4.9 4.9 0 0 1-2.229-.616c-.054 2.281 1.581 4.415 3.949 4.89a4.9 4.9 0 0 1-2.224.084 4.93 4.93 0 0 0 4.6 3.419A9.9 9.9 0 0 1 0 19.54a13.94 13.94 0 0 0 7.548 2.212c9.142 0 14.307-7.721 13.995-14.646A10 10 0 0 0 24 4.557"/></svg> </a> <a href="https://www.linkedin.com/in/francescabria"> <svg viewBox="0 0 24 27"><path d="M4.98 3.5C4.98 4.881 3.87 6 2.5 6S.02 4.881.02 3.5C.02 2.12 1.13 1 2.5 1s2.48 1.12 2.48 2.5M5 8H0v16h5zm7.982 0H8.014v16h4.969v-8.399c0-4.67 6.029-5.052 6.029 0V24H24V13.869c0-7.88-8.922-7.593-11.018-3.714z"/></svg> </a> <a href="mailto:contact@francescabria.com"> <svg viewBox="0 0 24 24"><path d="M12 12.713.015 3h23.971zm-5.425-1.822L0 5.562v12.501zm10.85 0L24 18.063V5.562zm-1.557 1.261L12 15.287l-3.868-3.135L.022 21h23.956z"/></svg> </a> </div> </footer> <div id="elements" class="hidden"> <a class="video_item" href="video"> <div aria-field="url" aria-url class="hide"></div> <h5 aria-field="date" class="talk_date"></h5> <h4 aria-field="title" class="talk_title"></h4> <h6 aria-field="info" class="talk_text"></h6> </a> <div class="talk_item"> <div class="talk_wrapper"> <audio controls class="hide talk_type_audio"> <source type="audio/mpeg"> </audio> <div class="talk_type_video video_wrapper"> <iframe class="talk_video" width="560" height="315" aria-field href="url" frameborder="0" allow="accelerometer; autoplay; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe> </div> <div class="talk_info"> <h5 aria-field="date" class="talk_date"></h5> <h4 aria-field="title" class="talk_title"></h4> <h6 aria-field="info" class="talk_text"></h6> </div> </div> </div> <div class="media_item"> <div class="media_wrapper"> <img class="media_image" aria-field="image"> <div class="media_info"> <h4 class="media_media" aria-field="media"></h4> <h4 class="media_title" aria-field="title"></h4> <h5 class="media_date" aria-field="date"></h5> </div> <div class="media_details"> <h6 class="media_text" aria-field="info"></h6> <a class="link media_link" target="_new" aria-field href="url">Read more</a> </div> </div> </div> <div class="media_line"> <div class="media_wrapper"> <div class="media_info"> <h4 class="media_media" aria-field="media"></h4> <h5 class="media_date" aria-field="date"></h5> <a class="media_title" aria-field="title" href="url" target="_new"></a> </div> </div> </div> <a class="project_item" href="url" target="_blank"> <div class="project_image"> <img aria-field="image"> </div> <div class="project_info"> <div> <h5 class="project_date" aria-field="date">01/10/2019</h5> <div class="project_title" aria-field="title"></div> <div class="project_desc project_short" aria-field="short"></div> <div class="project_desc project_long" aria-field="info"></div> <div class="project_types" aria-field="type" aria-select> <div class="hide project_type type_writings">Writings</div> <div class="hide project_type type_rai">Research & Innovation</div> <div class="hide project_type type_policy">Policy</div> </div> </div> </div> </a> </div> <a class="hide" href="/player.html"> </a></body></html>
Cloudflare