Найден корректный robots.txt
Файл управления сканированием сайта роботами
?
Robots.txt указывает поисковым роботам, какие страницы сканировать, а какие — нет. Ошибки в файле могут случайно закрыть важные разделы от индексации.
Robots.txt настроен корректно. Размер файла: 14148 байт. Загружен за: 1сек.
Проверяемая страница не запрещена в robots.txt.
Цепочка редиректов для файла robots.txt:
http://techbeat.net/robots.txt
302 Found
https://techbeat.net/robots.txt
200 OK
Показать содержимое robots.txt
<!DOCTYPE html><html lang=zh><head><meta charset=utf-8><meta http-equiv=X-UA-Compatible content="IE=edge"><meta content="width=device-width,initial-scale=1,maximum-scale=1,user-scalable=0;" name=viewport><meta name=keywords content=TechBeat——荟聚全球华人AI精英><meta name=description content=TechBeat是荟聚全球华人AI精英的成长社区,每周上新来自顶尖大厂、明星创业公司、国际顶级高校相关专业在读博士的最新研究工作。我们希望为AI人才打造更专业的服务和体验,加速并陪伴其成长。><meta name=baidu-site-verification content=code-8Bv3lfHbGS><meta http-equiv=pragram content=no-cache><meta http-equiv=cache-control content="no-cache, no-store, must-revalidate"><meta name=viewport content="width=device-width,initial-scale=1"><link rel=icon href=https://file.techbeat.net/techbeatStatic/v14/favicon.ico><title>TechBeat</title><title>tech</title><meta http-equiv=X-UA-Compatible content="IE=edge,chrome=1"><meta name=apple-mobile-web-app-capable content=yes><meta name=viewport content="width=device-width,initial-scale=1,minimum-scale=1,maximum-scale=1,user-scalable=no"><link rel=stylesheet href=https://g.alicdn.com/de/prismplayer/2.8.8/skins/default/aliplayer-min.css><script>!function (e, t, n, g, i) {
e[i] = e[i] || function () {
(e[i].q = e[i].q || []).push(arguments)
}, n = t.createElement("script"), tag = t.getElementsByTagName("script")[0], n.async = 1, n.src = ('https:' == document.location.protocol ? 'https://' : 'http://') + g, tag.parentNode.insertBefore(n, tag)
}(window, document, "script", "assets.giocdn.com/2.1/gio.js", "gio");
gio('init', 'a3aadb49a9879c0e', {});
gio('send');</script><script charset=utf-8 src=https://g.alicdn.com/de/prismplayer/2.8.8/aliplayer-min.js></script><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-06ae6cf1.8f4be98a.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-09fdbf33.3cbbe9da.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-0ce30992.6b4a0d68.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-187a860b.ff49d0b5.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-19f8ce22.f43bee83.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-1f99b962.c76eaebc.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-2310fb21.b72bc497.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-2377f867.e14f5dbc.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-23ea3ad5.460afe69.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-23fa13f9.02329390.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-2638c1df.400a8897.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-2bddffc3.68102f57.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-2e55063c.d462c9cb.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-2f2e0803.94bd7cdb.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-2f958184.948d5a21.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-323568a5.a1657079.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-32507de8.15b71261.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-3b0cd271.31708bcc.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-42202914.b6465f34.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-4240abba.00cd2eba.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-425030ff.c6a6aff2.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-48b60362.31f41c6f.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-4bf2ee77.b0b04cf4.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-507a3032.72ce2d77.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-515083c8.bd84d1c1.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-51bbd284.7ac2d523.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-53e6db7a.847d68d0.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-5530b1a6.2a9608e5.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-55bee5a7.dcd72da9.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-5c60eda7.6b8e5fc8.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-641b0569.08ee75d4.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-6440f6d0.77d10ac0.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-6a686728.014e0892.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-6b642eb1.4cecc7c0.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-705a3b21.a040f10e.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-70ba7bde.f6941e2e.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-713aea00.b8f6bb44.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-74772cb3.522d5f43.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-74903f3f.a569f77c.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-74dde852.d74d05a5.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-7d79b3e5.b7c71e9f.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-8d711a1e.6ba6a75d.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-8ebef1b0.c6e111eb.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-9908722e.7432e649.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-a7d18692.bf8e4716.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-a8d059f0.85e76382.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-d864c3c6.68d52813.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-db508536.9efb7537.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-ea4bf070.82eca2fd.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-ee57e094.ebf715b8.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-f5023b4e.a19bdf2b.css rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-06ae6cf1.1b617151.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-09fdbf33.434f588f.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-0ce30992.aaf9a709.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-187a860b.0a9d5c14.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-19f8ce22.3f418db1.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-1f99b962.d756d3d7.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-2310fb21.e3bf5d5e.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-2377f867.ebc1fec0.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-23ea3ad5.ff28bf9b.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-23fa13f9.7d84fcef.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-2638c1df.0a0858d8.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-2bddffc3.fdeb3d2c.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-2d0d712f.d42a8f48.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-2d21af29.6c7f0fad.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-2e55063c.5803a746.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-2f2e0803.2d3b1a38.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-2f958184.975b72ce.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-323568a5.a80a4266.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-32507de8.2258802e.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-3b0cd271.9436b205.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-42202914.6fa94709.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-4240abba.dc81ce3e.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-425030ff.d36096dc.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-48b60362.cc985b44.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-4bf2ee77.9e439766.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-507a3032.8599a93d.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-515083c8.6a53e357.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-51bbd284.7bd0c719.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-53e6db7a.b5cdbcfe.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-5530b1a6.6122caf4.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-55bee5a7.9b3ab742.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-5c60eda7.f357bce5.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-5cccf5f8.1a870871.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-641b0569.ed1808b3.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-6440f6d0.a967a153.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-6a686728.7f764231.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-6b642eb1.95560a5d.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-705a3b21.c9a0b3a2.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-70ba7bde.ce2cee74.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-713aea00.b8cf4db1.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-74772cb3.b83fd7b4.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-74903f3f.13b5a19e.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-74dde852.94e5d69f.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-7d79b3e5.6e460e77.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-8d711a1e.d5d7a344.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-8ebef1b0.a8d7c133.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-9908722e.c0b2f1b3.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-a7d18692.26fbd89c.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-a8d059f0.fd2e5d0e.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-d864c3c6.89035207.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-db508536.10828678.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-ea4bf070.e6eb94ca.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-ee57e094.9e8703b9.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-f5023b4e.d74ce06f.js rel=prefetch><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-vendors.b6588c2c.css rel=preload as=style><link href=https://file.techbeat.net/techbeatStatic/v14/css/index.73b3b25c.css rel=preload as=style><link href=https://file.techbeat.net/techbeatStatic/v14/js/chunk-vendors.d2f73e65.js rel=preload as=script><link href=https://file.techbeat.net/techbeatStatic/v14/js/index.f1a57600.js rel=preload as=script><link href=https://file.techbeat.net/techbeatStatic/v14/css/chunk-vendors.b6588c2c.css rel=stylesheet><link href=https://file.techbeat.net/techbeatStatic/v14/css/index.73b3b25c.css rel=stylesheet></head><body><noscript><strong>We're sorry but tech doesn't work properly without JavaScript enabled. Please enable it to continue.</strong></noscript><div id=app></div><script src=https://file.techbeat.net/techbeatStatic/v14/js/chunk-vendors.d2f73e65.js></script><script src=https://file.techbeat.net/techbeatStatic/v14/js/index.f1a57600.js></script></body><script async src="https://www.googletagmanager.com/gtag/js?id=UA-175676697-1"></script><script charset=utf-8 src=./playComponent.js></script><script>var _hmt = _hmt || [];
(function () {
var hm = document.createElement("script");
hm.src = "https://hm.baidu.com/hm.js?09e2de6133e0187da061f9d600bd32e9";
var s = document.getElementsByTagName("script")[0];
s.parentNode.insertBefore(hm, s);
})();</script><script>var userAgent = navigator.userAgent; //取得浏览器的userAgent字符串
var isIE = userAgent.indexOf("compatible") > -1 && userAgent.indexOf("MSIE") > -1; //判断是否IE<11浏览器
var isIE11 = userAgent.indexOf('Trident') > -1 && userAgent.indexOf("rv:11.0") > -1;
if (isIE || isIE11) {
alert("您的ie浏览器版本过低,请升级为Microsoft Edge浏览器或使用Chrome,Firefox以及其它支持ES6的浏览器,以获得更好的浏览体验!")
}
window.dataLayer = window.dataLayer || [];
function gtag() {
dataLayer.push(arguments);
}
gtag('js', new Date());
gtag('config', 'UA-175676697-1');</script></html>