Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 7957 байт. Загружен за: 0сек.
Проверяемая страница не запрещена в robots.txt.
Показать содержимое robots.txt
# As a condition of accessing this website, you agree to abide by the following
# content signals:
# (a) If a Content-Signal = yes, you may collect content for the corresponding
# use.
# (b) If a Content-Signal = no, you may not collect content for the
# corresponding use.
# (c) If the website operator does not include a Content-Signal for a
# corresponding use, the website operator neither grants nor restricts
# permission via Content-Signal with respect to the corresponding use.
# The content signals and their meanings are:
# search: building a search index and providing search results (e.g., returning
# hyperlinks and short excerpts from your website's contents). Search does not
# include providing AI-generated search summaries.
# ai-input: inputting content into one or more AI models (e.g., retrieval
# augmented generation, grounding, or other real-time taking of content for
# generative AI search answers).
# ai-train: training or fine-tuning AI models.
# use: how AI systems may consume the content (immediate, reference, or full).
# ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF
# RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT
# AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET.
# BEGIN Cloudflare Managed content
User-agent: *
Content-Signal: search=yes,ai-train=no,use=reference
Allow: /
User-agent: Amazonbot
Disallow: /
User-agent: Applebot-Extended
Disallow: /
User-agent: Bytespider
Disallow: /
User-agent: CCBot
Disallow: /
User-agent: ClaudeBot
Disallow: /
User-agent: CloudflareBrowserRenderingCrawler
Disallow: /
User-agent: Google-Extended
Disallow: /
User-agent: GPTBot
Disallow: /
User-agent: meta-externalagent
Disallow: /
# END Cloudflare Managed Content
<!DOCTYPE html><html lang="en"> <head><meta charset="utf-8"><meta name="viewport" content="width=device-width, initial-scale=1.0"><title>NebraskaJS - Home</title><link rel="icon" type="image/x-icon" href="/favicon.ico"><!--<link href="/atom.xml" rel="alternate" title="NebraskaJS" type="application/atom+xml" />--><!--<link href="{{ site.distFolder }}all.min.css" rel="stylesheet" />--><link href="https://fonts.googleapis.com/css?family=Raleway:600,400" rel="stylesheet"><!--<meta name="dist" content="{{ site.distFolder }}" />--><meta name="astro-view-transitions-enabled" content="true"><meta name="astro-view-transitions-fallback" content="animate"><script type="module" src="/_astro/ClientRouter.astro_astro_type_script_index_0_lang.DZnDNxNb.js"></script><link rel="stylesheet" href="/_astro/about.9A7hgeRC.css"></head> <body class="text-js-dark bg-white font-sans leading-relaxed"> <header class="bg-js-dark sticky top-0 z-50 text-white shadow-lg"> <div class="mx-auto flex max-w-6xl flex-wrap items-center justify-between px-6 py-4"> <a href="/" class="flex items-center gap-1 text-white no-underline"> <div class="relative h-[50px] w-[100px]"> <object data="/img/nebraska-outline-with-text-transparent.svg" type="image/svg+xml" class="h-full w-full"> <img src="/img/nebraska-outline.png" alt="NebraskaJS Logo"> </object> <img src="/img/cornfield-640.jpg" class="absolute inset-0 h-full w-full opacity-[0.01] transition-opacity duration-1000 hover:opacity-100" style="mask: url(/img/nebraska-outline-with-text-transparent.svg); mask-size: 100% 100%; mask-repeat: no-repeat;"> </div> <div class="text-2xl font-semibold">NebraskaJS</div> </a> <nav class="flex gap-6"> <a href="/about" class="hover:border-js-yellow border-b-2 border-transparent py-2 text-white no-underline transition-colors">
About
</a> <a href="/conduct" class="hover:border-js-yellow border-b-2 border-transparent py-2 text-white no-underline transition-colors">
Code of Conduct
</a> <a href="https://discord.gg/JJaFMgscWf" target="_blank" class="hover:border-js-yellow border-b-2 border-transparent py-2 text-white no-underline transition-colors">
Discord
</a> </nav> </div> </header> <!-- Hero Section --> <div class="from-js-dark to-js-darker bg-gradient-to-br px-6 py-16 text-center text-white"> <div class="mx-auto max-w-6xl"> <h1 class="mb-4 text-5xl font-bold">Welcome to NebraskaJS</h1> <p class="text-js-yellow text-xl">Omaha's JavaScript Community Since 2009</p> </div> </div> <div class="flex px-6"><div class="bg-js-yellow text-js-dark relative z-10 mx-auto my-12 -mt-8 max-w-4xl rounded-xl px-6 py-12 shadow-2xl"><div class="mb-4 text-sm font-semibold tracking-wider uppercase">Next Meetup</div><h2 class="mb-4 text-3xl font-bold">Demand-Driven Development - Omaha</h2><div class="mb-6 flex flex-wrap gap-6"><div class="flex items-center gap-2"><span>📅</span><span>Wednesday, August 19, 2026</span></div><div class="flex items-center gap-2"><span>🕒</span><span>5:30 PM - 7:30 PM CST</span></div><div class="flex items-center gap-2"><span>📍</span><span>Omaha, NE</span></div></div><div class="flex flex-wrap gap-4"><a href="https://luma.com/nebras-7la3" target="_blank" class="bg-js-dark inline-block rounded-lg px-8 py-3 font-semibold text-white transition-all hover:-translate-y-0.5 hover:shadow-lg">
Register on Luma
</a><a href="https://lu.ma/nebraskajs" target="_blank" class="text-js-dark inline-block rounded-lg bg-white px-8 py-3 font-semibold transition-all hover:-translate-y-0.5 hover:shadow-lg">
View All Events
</a></div></div></div> <div class="grid gap-8 px-6 py-8 md:grid-cols-3"> <div class="border border-gray-200 rounded-xl bg-white p-8 shadow-md transition-all hover:-translate-y-1 hover:shadow-xl"> <div class="bg-js-yellow mx-auto mb-4 flex h-16 w-16 items-center justify-center rounded-full text-2xl">💬</div> <h3 class="mb-4 text-2xl font-semibold">Discord Community</h3> <p class="mb-6 text-gray-600">
Chat with local developers, share projects, and get help with your code.
</p> <a href="https://discord.gg/JJaFMgscWf" target="_blank" class="bg-js-dark inline-block rounded-lg px-6 py-3 font-semibold text-white transition-all hover:-translate-y-0.5 hover:shadow-lg"> Join Discord </a> </div> <div class="border border-gray-200 rounded-xl bg-white p-8 shadow-md transition-all hover:-translate-y-1 hover:shadow-xl"> <div class="bg-js-yellow mx-auto mb-4 flex h-16 w-16 items-center justify-center rounded-full text-2xl">🎯</div> <h3 class="mb-4 text-2xl font-semibold">Monthly Meetups</h3> <p class="mb-6 text-gray-600">
Join us for talks, workshops, and networking with the local tech community.
</p> <a href="https://lu.ma/nebraskajs" target="_blank" class="bg-js-dark inline-block rounded-lg px-6 py-3 font-semibold text-white transition-all hover:-translate-y-0.5 hover:shadow-lg"> See Events </a> </div> <div class="border border-gray-200 rounded-xl bg-white p-8 shadow-md transition-all hover:-translate-y-1 hover:shadow-xl"> <div class="bg-js-yellow mx-auto mb-4 flex h-16 w-16 items-center justify-center rounded-full text-2xl">🤝</div> <h3 class="mb-4 text-2xl font-semibold">Code of Conduct</h3> <p class="mb-6 text-gray-600">
We're committed to providing a welcoming and inclusive environment for all.
</p> <a href="/conduct" class="bg-js-dark inline-block rounded-lg px-6 py-3 font-semibold text-white transition-all hover:-translate-y-0.5 hover:shadow-lg"> Read More </a> </div> </div> <footer class="bg-js-dark px-6 py-8 text-center text-white"> <div class="mx-auto max-w-6xl"> <div class="mb-4 flex justify-center gap-6"> <a href="/about" class="hover:text-js-yellow text-white transition-colors">About</a> <a href="/conduct" class="hover:text-js-yellow text-white transition-colors">Code of Conduct</a> <a href="https://discord.gg/JJaFMgscWf" target="_blank" class="hover:text-js-yellow text-white transition-colors">Discord</a> <a href="https://lu.ma/nebraskajs" target="_blank" class="hover:text-js-yellow text-white transition-colors">Events</a> </div> <p class="text-gray-400">© 2025 NebraskaJS. Building the Omaha JavaScript community since 2009.</p> </div> </footer> </body></html>
Cloudflare