Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 10245 байт. Загружен за: 0сек.
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://files.indowebster.com/robots.txt
301 MovedPermanently
https://indowebster.com/
200 OK
Показать содержимое robots.txt
<!doctype html><html lang=id><head><meta name=generator content="Hugo 0.123.7"><meta charset=utf-8><meta name=viewport content="width=device-width,initial-scale=1"><title>Indowebster (IDWS) — Legenda Internet Indonesia</title>
<meta name=description content="Indowebster (IDWS) — portal warisan resmi legenda internet Indonesia sejak 2007. Sejarah, kisah komunitas, budaya internet, dan cerita di balik IDWS oleh pendirinya."><link rel=canonical href=https://indowebster.com/><meta name=theme-color content="#12386e"><meta name=robots content="index, follow, max-image-preview:large, max-snippet:-1"><meta property="og:type" content="website"><meta property="og:site_name" content="Indowebster"><meta property="og:title" content="Indowebster (IDWS) — Legenda Internet Indonesia"><meta property="og:description" content="Indowebster (IDWS) — portal warisan resmi legenda internet Indonesia sejak 2007. Sejarah, kisah komunitas, budaya internet, dan cerita di balik IDWS oleh pendirinya."><meta property="og:url" content="https://indowebster.com/"><meta property="og:image" content="https://indowebster.com/img/og-default.png"><meta name=twitter:card content="summary_large_image"><link rel=preconnect href=https://fonts.googleapis.com><link rel=preconnect href=https://fonts.gstatic.com crossorigin><link rel=stylesheet href="https://fonts.googleapis.com/css2?family=Space+Grotesk:wght@500;600;700&family=Source+Serif+4:ital,opsz,wght@0,8..60,400;0,8..60,600;1,8..60,400&family=JetBrains+Mono:wght@500&display=swap"><link rel=stylesheet href=https://indowebster.com/css/site.min.21cd38f6395083626e04b412cd8f7bdf2d331e95906262c2ecb4407bdb734d39.css><link rel=icon href=https://indowebster.com/img/favicon.svg type=image/svg+xml><link rel=alternate type=application/rss+xml href=https://indowebster.com/index.xml title="Indowebster (IDWS) — Legenda Internet Indonesia"><script type=application/ld+json>{"@context":"https://schema.org","@graph":[{"@type":"Organization","@id":"https:\/\/indowebster.com\/#organization","name":"Indowebster","alternateName":"IDWS","url":"https:\/\/indowebster.com\/","foundingDate":"2007-04-15","logo":{"@type":"ImageObject","url":"https:\/\/indowebster.com\/img\/og-default.png"},"description":"Indowebster (IDWS) — portal warisan resmi legenda internet Indonesia sejak 2007. Sejarah, kisah komunitas, budaya internet, dan cerita di balik IDWS oleh pendirinya."},{"@type":"WebSite","@id":"https:\/\/indowebster.com\/#website","url":"https:\/\/indowebster.com\/","name":"Indowebster (IDWS) — Legenda Internet Indonesia","publisher":{"@id":"https:\/\/indowebster.com\/#organization"},"inLanguage":"id-ID","potentialAction":{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/indowebster.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}}]}</script></head><body><header class=site-header><div class="wrap header-inner"><a class=brand href=https://indowebster.com/><span class=brand-logo>IDWS</span>
<span class=brand-text><span class=brand-name>Indowebster</span>
<span class=brand-since>est. 2007 — legenda kembali</span>
</span></a><button class=nav-toggle aria-label=Menu onclick='document.body.classList.toggle("nav-open")'>☰</button><nav class=site-nav><a href=https://indowebster.com/>Beranda</a><a href=https://indowebster.com/sejarah/>Sejarah</a><a href=https://indowebster.com/tokoh/>Tokoh</a><a href=https://indowebster.com/komunitas/>Komunitas</a><a href=https://indowebster.com/teknologi/>Teknologi</a><a href=https://indowebster.com/warisan/>Warisan</a><a href=https://tv.indowebster.com/ rel=noopener>IDWS TV</a><a href=https://forum.idws.id/ rel=noopener>Forum</a></nav></div></header><main class=site-main><section class=hero><div class="wrap hero-inner"><div class=hero-badge>EST. 2007 · IDWS</div><h1>Indowebster kembali.</h1><p class=hero-tag>Sejarah, komunitas, dan warisan sang legenda file sharing Indonesia — hidup kembali.</p><p class=hero-sub>Dulu rumah berbagi file terbesar Indonesia. Kini, portal warisan resmi yang merawat sejarah, tokoh, dan komunitas di baliknya — diceritakan langsung dari sumbernya.</p><div class=hero-cta><a class="btn btn-primary" href=https://indowebster.com/sejarah/sejarah-indowebster-idws-2007/>Baca kisah IDWS</a>
<a class="btn btn-ghost" href=https://forum.idws.id/ rel=noopener>Kunjungi forum</a></div></div></section><section class="wrap home-latest"><div class=section-head><h2>Artikel terbaru</h2><span class=rule></span></div><div class=card-grid><article class=card><a href=https://indowebster.com/tokoh/tim-di-balik-layar-indowebster/><div class=card-img style=background-image:url(/img/cover-tokoh.png)></div><div class=card-body><span class=card-kicker>tokoh</span><h3>Tim di Balik Layar Indowebster</h3><time>23 Aug 2026</time></div></a></article><article class=card><a href=https://indowebster.com/tokoh/antihackerlink-komunitas-awal-acong/><div class=card-img style=background-image:url(/img/cover-tokoh.png)></div><div class=card-body><span class=card-kicker>tokoh</span><h3>AntiHackerlink: Komunitas Tempat Ko Acong Bertumbuh</h3><time>22 Aug 2026</time></div></a></article><article class=card><a href=https://indowebster.com/sejarah/ulang-tahun-ke-11-indowebster-2018/><div class=card-img style=background-image:url(/img/cover-sejarah.png)></div><div class=card-body><span class=card-kicker>sejarah</span><h3>Ulang Tahun ke-11 Indowebster pada April 2018</h3><time>21 Aug 2026</time></div></a></article><article class=card><a href=https://indowebster.com/warisan/pelajaran-hak-cipta-dari-era-berbagi-berkas/><div class=card-img style=background-image:url(/img/cover-warisan.png)></div><div class=card-body><span class=card-kicker>warisan</span><h3>Pelajaran Hak Cipta dari Era Berbagi Berkas</h3><time>20 Aug 2026</time></div></a></article><article class=card><a href=https://indowebster.com/warisan/kenapa-startup-lokal-sulit-lawan-raksasa-global/><div class=card-img style=background-image:url(/img/cover-warisan.png)></div><div class=card-body><span class=card-kicker>warisan</span><h3>Kenapa Startup Lokal Sulit Bertahan Melawan Raksasa Global</h3><time>19 Aug 2026</time></div></a></article><article class=card><a href=https://indowebster.com/teknologi/peta-belajar-idws-tekno-urutan-baca/><div class=card-img style=background-image:url(/img/og-default.png)></div><div class=card-body><span class=card-kicker>teknologi</span><h3>Peta Belajar di IDWS Tekno: Urutan Baca dari Nol sampai Punya Lab Sendiri</h3><time>18 Aug 2026</time></div></a></article><article class=card><a href=https://indowebster.com/teknologi/transparansi-kerja-sama-konten-dewaasia-ragam-maumere/><div class=card-img style=background-image:url(/img/og-default.png)></div><div class=card-body><span class=card-kicker>teknologi</span><h3>Menandai Kerja Sama Secara Terbuka: Pelajaran Lama IDWS dan Contoh Halaman Dewaasia x Ragam Maumere</h3><time>18 Aug 2026</time></div></a></article><article class=card><a href=https://indowebster.com/warisan/apakah-indowebster-masih-ada/><div class=card-img style=background-image:url(/img/cover-warisan.png)></div><div class=card-body><span class=card-kicker>warisan</span><h3>Apakah Indowebster masih ada?</h3><time>18 Aug 2026</time></div></a></article><article class=card><a href=https://indowebster.com/tokoh/siapa-pendiri-indowebster/><div class=card-img style=background-image:url(/img/cover-tokoh.png)></div><div class=card-body><span class=card-kicker>tokoh</span><h3>Siapa pendiri Indowebster?</h3><time>17 Aug 2026</time></div></a></article></div></section><section class="wrap home-pillars"><div class=section-head><h2>Jelajahi warisan IDWS</h2><span class=rule></span></div><div class=pillar-grid><a class=pillar href=https://indowebster.com/tokoh/><span>01</span><h3>Tokoh di Balik IDWS</h3><p>Juny “Ko Acong” Maimun dan orang-orang yang membangun Indowebster.</p></a><a class=pillar href=https://indowebster.com/sejarah/><span>02</span><h3>Sejarah Indowebster</h3><p>Perjalanan IDWS dari cikal-bakal Indofile 2007, masa jaya, hingga babak baru hari ini.</p></a><a class=pillar href=https://indowebster.com/warisan/><span>03</span><h3>Warisan IDWS</h3><p>Jejak, pelajaran, dan masa depan sang legenda file sharing Indonesia.</p></a><a class=pillar href=https://indowebster.com/teknologi/><span>04</span><h3>Teknologi IDWS</h3><p>File hosting, tv.indowebster, dan evolusi penyimpanan online Indonesia.</p></a><a class=pillar href=https://indowebster.com/komunitas/><span>05</span><h3>Komunitas IDWS</h3><p>Forum legendaris dan budaya berbagi yang menghidupkan Indowebster.</p></a></div></section></main><footer class=site-footer><div class="wrap footer-grid"><div class=foot-brand><span class=brand-logo>IDWS</span><p>Indowebster (IDWS) — portal warisan resmi legenda internet Indonesia sejak 2007. Sejarah, kisah komunitas, budaya internet, dan cerita di balik IDWS oleh pendirinya.</p></div><div class=foot-col><h4>Jelajahi</h4><a href=https://indowebster.com/tokoh/>Tokoh di Balik IDWS</a><a href=https://indowebster.com/sejarah/>Sejarah Indowebster</a><a href=https://indowebster.com/warisan/>Warisan IDWS</a><a href=https://indowebster.com/teknologi/>Teknologi IDWS</a><a href=https://indowebster.com/komunitas/>Komunitas IDWS</a></div><div class=foot-col><h4>Indowebster</h4><a href=https://indowebster.com/tentang/>Tentang</a>
<a href=https://indowebster.com/kontak/>Kontak</a>
<a href=https://indowebster.com/dmca/>DMCA</a>
<a href=https://indowebster.com/kebijakan-privasi/>Kebijakan Privasi</a></div><div class=foot-col><h4>Media & Komunitas</h4><a href=https://tv.indowebster.com/ rel=noopener>IDWS TV</a>
<a href=https://forum.idws.id/ rel=noopener>Forum IDWS</a><p class=foot-note>Forum komunitas dikelola pihak terpisah di forum.idws.id.</p></div></div><div class="wrap foot-bottom"><small>© 2026 Indowebster (IDWS) · Sejak 2007 · Portal warisan resmi.</small></div></footer><script type="module" src="https://static.cloudflareinsights.com/beacon.min.js/v4513226cdae34746b4dedf0b4dfa099e1781791509496" integrity="sha512-ZE9pZaUXND66v380QUtch/5sE9tPFh2zg45pR2PB0CVkCtOREv2AJKkSidISWkysEuQ0EH8faUU5du78bx87UQ==" data-cf-beacon='{"version":"2024.11.0","token":"77de816f20ef4e468cc86458d262456c","r":1}' crossorigin="anonymous"></script>
</body></html>
Cloudflare