Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 11686 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://dev.frdl.de/robots.txt
301 MovedPermanently
https://dev.frdl.de/robots.txt
200 OK
Показать содержимое robots.txt
<!DOCTYPE html>
<html>
<head>
<meta charset="utf-8"/>
<meta name="viewport" content="width=device-width, initial-scale=1, viewport-fit=cover"/>
<meta http-equiv="X-UA-Compatible" content="ie=edge"/>
<meta http-equiv="Content-Language" content="en"/>
<meta name="msapplication-TileColor" content="#206bc4"/>
<meta name="theme-color" content="#206bc4"/>
<meta name="apple-mobile-web-app-status-bar-style" content="black-translucent"/>
<meta name="apple-mobile-web-app-capable" content="yes"/>
<meta name="mobile-web-app-capable" content="yes"/>
<meta name="HandheldFriendly" content="True"/>
<meta name="MobileOptimized" content="320"/>
<link rel="icon" href="https://pkg.frdl.de/favicon.ico?v1" type="image/x-icon"/>
<link rel="shortcut icon" href="https://pkg.frdl.de/favicon.ico?v1" type="image/x-icon"/>
<title>Frdlweb Packages</title>
<link rel="stylesheet" href="https://frdlweb.de/style.css">
<style>
[ng-cloak], [data-ng-cloak], [x-ng-cloak], .ng-cloak, .x-ng-cloak{
display:none;
}
</style>
<script>
((q, w,d)=>{
var s=d.createElement('script');
s.setAttribute('src', 'https://cdn.frdl.de/webfan.js?cdn=https://cdn.frdl.de&?' + q);
s.async='false';
s.onload=()=>{
frdlweb.ready(()=>{
/* if('/' === location.pathname){
document.querySelectorAll('a[href="/"]')[1].parentNode.style.display='none';
document.querySelectorAll('a[href="/"]')[2].parentNode.style.display='none';
} */
});
};
d.head.prepend(s);
})('angularjs.html5mode.rewriteLinks=false&angularjs.html5mode.enabled=false&website.consent.ads=true', window, document);
</script>
</head>
<body class="antialiased border-top-wide border-primary">
<header class="topnav" id="header" role="nav">
<div class="container" id="menu">
<div class="navbar navbar-expand-lg navbar-light">
<div id="menu_btn">
<label for="drop">
<svg width="48" height="48" viewBox="0 0 13 10">
<path d="M0,1 13,1" stroke="#fff" stroke-width="2"></path>
<path d="M0,5 13,5" stroke="#fff" stroke-width="2"></path>
<path d="M0,9 13,9" stroke="#fff" stroke-width="2"></path>
</svg>
</label>
</div>
<input id="drop" type="checkbox">
<nav id="mainnav">
<ul>
<li>
<a href="https://frdlweb.de/">Frdlweb</a>
</li>
<li><a href="javascript:;">Packages</a>
<ul>
<li>
<a href="https://pkg.dev.frdl.de/organization/frdl/overview" title="Frdlweb Composer Packages">Frdlweb Composer Packages</a>
</li>
<li>
<a href="https://pkg.dev.frdl.de/organization/weid/overview" title="WEID Composer Packages">WEID Composer Packages</a>
</li>
<li>
<a href="https://pkg.dev.frdl.de/organization/webfat/package" title="Webfan Webfat Packages">Webfan Webfat Packages</a>
</li>
</ul>
</li>
<li>
<a href="https://frdl.de">🌐 Netzwerk</a>
<ul>
<li>
<a href="https://frdl.de/pages" title="Seiten">Seiten</a>
</li>
<li>
<a href="https://frdl.de/blog" title="Blogs">Blogs</a>
</li>
<li>
<a href="https://frdl.de/groups" title="Gruppen">Gruppen</a>
</li>
<li>
<a href="https://startforum.de/spaces" title="Startforum Spaces">☕ Startforum Spaces</a>
</li>
<li>
<a href="https://startforum.de/p/network" title="Foren & Communites">Foren & Communites</a>
</li>
</ul>
</li>
<li>
<a href="https://frdl.de/activity" title="Timeline">Timeline</a>
</li>
<li>
<a href="https://domainundhomepagespeicher.de/" title="Domain & Webhosting">Domain</a>
<ul>
<li>
<a href="https://frdlweb.de/dns/domain-check">Domain-Check</a>
</li>
<li>
<a href="https://frdlweb.de/api/rdap/whois" title="Whois/RDAP">Whois/RDAP</a>
</li>
<li>
<a href="https://domainundhomepagespeicher.de/" title="Domain & Webhosting">Webhosting</a>
</li>
</ul>
</li>
<li>
<a href="https://frdl.de">⚙️ Account</a>
<ul>
<li>
<a href="https://frdl.de/dashboard" title="SignIn Entity">Login</a>
</li>
<li>
<a href="https://frdl.de/register" title="Register Entity">Registrieren</a>
</li>
<li>
<a href="https://registry.frdl.de/?goto=oidplus%3Alogin" title="Registration Authority Account">RA-Account</a>
</li>
<li>
<a href="https://api.webfan.de/apps/developer/#!/login" title="Webfan API Developer Portal">Developer-Account</a>
</li>
<li>
<a href="https://webfan.de/login" title="Webfan Login">Webfan-Account</a>
</li>
</ul>
</li>
<li>
<a href="https://frdlweb.de/cdn/index">CDN</a>
</li>
<li>
<a href="https://frdlweb.de/about/">Über</a>
<ul>
<li>
<a href="https://frdl.de/privacy">Datenschutzerklärung</a>
</li>
<li>
<a href="https://registry.frdl.de/?goto=oidplus%3Aresources%24About%2FLegal.html#frdlweb">AGB und Nutzungsbedingungen</a>
</li>
<li>
<a href="https://frdlweb.de/imprint.html">Imprint</a>
</li>
</ul>
</li>
</ul>
</nav>
</div>
</div>
</header>
<div class="d-flex h-auto min-h-full justify-content-center">
<div class="d-flex align-items-center justify-content-center flex-fill">
<div class="container">
<div class="text-center mb-4">
<img src="https://cdn.startdir.de/logos/webfan-software.webp" style="width:auto;max-width:100%;height:auto;border:none;" alt="Webfan Software" />
</div>
<div class="text-center">
<ul style="list-style:none;">
<li>
<a href="https://frdl.de/groups/profile/97/frdlweb-software" title="Webfan Software">Webfan Software Blogs & Community Page</a>
</li>
<li>
<a href="https://pkg.dev.frdl.de/organization/webfat/package" title="Webfan Webfat Packages">Webfan Webfat Packages</a>
</li>
<li>
<a href="https://pkg.dev.frdl.de/organization/frdl/overview" title="Frdlweb Composer Packages">Frdlweb Composer Packages</a>
</li>
<li>
<a href="https://pkg.dev.frdl.de/organization/weid/overview" title="WEID Composer Packages">WEID Composer Packages</a>
</li>
<li>
<a href="https://pkg.dev.frdl.de/organization/oidplus-plugins/overview" title="OIDplus Plugins and Packages">OIDplus Plugins and Packages</a>
</li>
<li>
<a aria-label="Homepage" title="GitHub" class="footer-octicon mr-2" href="https://github.com/frdl">
<svg aria-hidden="true" height="24" viewBox="0 0 16 16" version="1.1" width="24" data-view-component="true" class="octicon octicon-mark-github">
<path d="M8 0c4.42 0 8 3.58 8 8a8.013 8.013 0 0 1-5.45 7.59c-.4.08-.55-.17-.55-.38 0-.27.01-1.13.01-2.2 0-.75-.25-1.23-.54-1.48 1.78-.2 3.65-.88 3.65-3.95 0-.88-.31-1.59-.82-2.15.08-.2.36-1.02-.08-2.12 0 0-.67-.22-2.2.82-.64-.18-1.32-.27-2-.27-.68 0-1.36.09-2 .27-1.53-1.03-2.2-.82-2.2-.82-.44 1.1-.16 1.92-.08 2.12-.51.56-.82 1.28-.82 2.15 0 3.06 1.86 3.75 3.64 3.95-.23.2-.44.55-.51 1.07-.46.21-1.61.55-2.33-.66-.15-.24-.6-.83-1.23-.82-.67.01-.27.38.01.53.34.19.73.9.82 1.13.16.45.68 1.31 2.69.94 0 .67.01 1.3.01 1.49 0 .21-.15.45-.55.38A7.995 7.995 0 0 1 0 8c0-4.42 3.58-8 8-8Z"></path>
</svg>
Source Code
</a>
</li>
<li>
<a href="https://www.npmjs.com/~webfan" title="NPM Packages">NPM Packages</a>
</li>
</ul>
</div>
<div class="text-center">
<h1>Webfan Website</h1>
<button class="btn btn-light" disabled>Start Website</button>
<a class="btn btn-primary" href="https://webfan.website">Your @Web Presence</a>
<a class="btn btn-primary" href="https://webfan.de/apps/registry/">Register OID-Hosting</a>
<a class="btn btn-primary" href="https://api.webfan.de/apps/">Webfan API</a>
<a class="btn btn-primary" href="https://packages.frdl.de/raw/webfan/website/installer.php" target="_blank">Installer PHP Script</a>
<a class="btn btn-primary" href="https://packages.frdl.de/webfan/website/archive/main.zip" target="_blank">
Download .zip-Archive
</a>
<br />
<br />
</div>
<div>
To read some information about the software we use, you can
visit the <a href="https://webfan.de/install/">Webfan Software Page</a>
or <button class="btn-sm btn-info" onclick="this.setAttribute('disabled', true);this.parentNode.innerHTML+=atob('PGZyZGx3ZWItc29mdHdhcmUtbGljZW5zZXM+PC9mcmRsd2ViLXNvZnR3YXJlLWxpY2Vuc2VzPg==');">click this button</button>.
<br />
<br />
</div>
</div>
</div>
</div>
<div class="modal fade" id="confirmation-modal" tabindex="-1" role="dialog" aria-hidden="true">
<div class="modal-dialog modal-dialog-centered" role="document">
<div class="modal-content">
<div class="modal-header">
<h3 class="modal-title">Title</h3>
<button type="button" class="close" data-dismiss="modal" aria-label="Close">
<span aria-hidden="true">×</span>
</button>
</div>
<div class="modal-body">
Are you sure you want to perform this action?
</div>
<div class="modal-footer">
<button type="button" class="btn btn-secondary" data-dismiss="modal">Close</button>
<form id="modal-action-form" class="d-inline" action="action" method="POST">
<input type="hidden" name="_method" value="method">
<button type="submit" class="btn btn-primary" id="confirmation-btn">Ok</button>
</form>
</div>
</div>
</div>
</div>
<!--
<script src="https://code.jquery.com/jquery-3.5.1.min.js" integrity="sha256-9/aliU8dGd2tb6OSsuzixeV4y/faTqgFtohetphbbj0=" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/popper.js/1.12.9/umd/popper.min.js" integrity="sha384-ApNbgh9B+Y1QKtv3Rn7W3mgPxhU9K/ScQsAP7hUibX39j7fakFPskvXusvfa0b4Q" crossorigin="anonymous"></script>
<script src="https://stackpath.bootstrapcdn.com/bootstrap/4.4.1/js/bootstrap.min.js" integrity="sha384-wfSDF2E50Y2D1uUdj0O3uMBJnjuUD4Ih7YwaYd1iqfktj0Uod8GCExl3Og8ifwB6" crossorigin="anonymous"></script>
<script src="https://cdnjs.cloudflare.com/ajax/libs/bootstrap-select/1.13.18/js/bootstrap-select.min.js" integrity="sha512-yDlE7vpGDP7o2eftkCiPZ+yuUyEcaBwoJoIhdXv71KZWugFqEphIS3PU60lEkFaz8RxaVsMpSvQxMBaKVwA5xg==" crossorigin="anonymous"></script>
<script>(function() {
$('[data-target="confirmation"]').on('click', function() {
const confirmationModalId = '#confirmation-modal';
const $source = $(this);
const $modal = $(`${confirmationModalId}`);
const $modalForm = $(`${confirmationModalId} form`);
const $modalTitle = $(`${confirmationModalId} .modal-title`);
$modalForm.prop('action', $source.data('action'));
$modalForm.children('[name=_method]').val($source.data('method'));
$modalTitle.html($source.data('title') || 'Confirm action');
$modal.modal('show');
});
$('.copy-to-clipboard').click(function() {
$($(this).data('clipboard-target')).select();
document.execCommand('copy');
});
$('.show-token').click(function() {
$(this).parent().find('[data-type="token"]').removeClass('d-none');
$(this).remove();
});
$('[data-toggle="popover"]').popover({
trigger: 'hover'
});
$('[data-toggle="tooltip"]').tooltip();
$('.number-format').each(function() {
$(this).text(parseInt($(this).text()).toLocaleString());
});
})();
</script>
-->
</body>
</html>