{"id":"ai-crawlers-2026-11","title":"AI crawler rules in the robots.txt files of the Tranco top 500 domains","publisher":"Autoranko (https://autoranko.com/blog/ai-crawler-rules-top-500-sites)","collected":{"started":"2026-11-08T02:10:22.210Z","finished":"2026-11-08T02:12:30.886Z"},"source":{"list":"Tranco","list_id":"94P72","url":"https://tranco-list.eu/list/94P72/1000000","created_on":"2026-11-07","window":["2026-10-09","2026-11-07"],"providers":["CrUX","Farsight","Majestic","Cloudflare Radar","Cisco Umbrella"],"combination":"Dowdall rule, pay-level domains only","top":500,"citation":"Victor Le Pochat, Tom Van Goethem, Samaneh Tajalizadehkhoob, Maciej Korczyński, and Wouter Joosen. 2019. Tranco: A Research-Oriented Top Sites Ranking Hardened Against Manipulation. In Proceedings of the 26th Annual Network and Distributed System Security Symposium (NDSS 2019). https://doi.org/10.14722/ndss.2019.23386"},"crawler":{"user_agent":"AutorankoResearch/1.0 (+https://autoranko.com/blog)","concurrency":8,"timeout_ms":8000,"max_redirects":5,"runtime":"Node.js v24.0.2"},"method":["Took the first 500 domains of Tranco list 94P72 (generated 2026-11-07).","Requested https://<domain>/robots.txt once, following up to 5 redirects (also across hosts), with an 8-second timeout per request and at most 8 domains in parallel. When the domain itself did not answer at the network level (DNS, TLS, refused, timeout), requested https://www.<domain>/robots.txt once instead.","Classified the answer with RFC 9309 status rules as implemented in Autoranko's tools (lib/tools/net.ts): ok = 2xx and not an HTML page; html = 2xx but an HTML page; missing = 4xx other than 429, or a redirect chain longer than 5 hops; unreachable = 5xx, 429 or a network failure.","Parsed every 'ok' file with Autoranko's RFC 9309 parser (lib/tools/robots.ts: longest match wins, allow wins ties, groups for the same token merge, the * group applies when a token has no group of its own, only the first 500 KiB count) and evaluated the site root '/' for 12 AI product tokens, plus the * group.","Recorded Content-Signal lines (contentsignals.org) outside comments."],"definitions":{"blocked":"The rules that apply to the token disallow the site root '/', usually with 'Disallow: /'.","partial":"The root is allowed, but at least one Disallow rule applies to the token (for example /search or /admin).","allowed":"No Disallow rule applies to the token.","named":"The file has a User-agent group for the token itself, rather than leaving it to the * group."},"limits":["Tranco ranks registrable domains by popularity signals, including DNS traffic, so the top 500 includes CDN, API and telemetry domains without a website. They are counted in the totals and fall out of the robots.txt analysis.","Each robots.txt was fetched once, from one machine in Europe, with our own user agent. Sites that serve different rules to different crawlers or regions may show the real crawlers other rules. A 403 or challenge page shown to us is recorded as such and excluded.","Only the root path is evaluated. 'Partial' covers everything from one disallowed /search path to large private areas.","robots.txt states a request, not access control: it does not prove a crawler obeys it, and some vendors say user-triggered fetchers may ignore it."],"bots":[{"token":"GPTBot","owner":"OpenAI","purpose":"training","docs":"https://developers.openai.com/api/docs/bots"},{"token":"OAI-SearchBot","owner":"OpenAI","purpose":"answer-engine","docs":"https://developers.openai.com/api/docs/bots"},{"token":"ChatGPT-User","owner":"OpenAI","purpose":"user-fetch","docs":"https://developers.openai.com/api/docs/bots"},{"token":"ClaudeBot","owner":"Anthropic","purpose":"training","docs":"https://support.claude.com/en/articles/8896518"},{"token":"Claude-SearchBot","owner":"Anthropic","purpose":"answer-engine","docs":"https://support.claude.com/en/articles/8896518"},{"token":"Claude-User","owner":"Anthropic","purpose":"user-fetch","docs":"https://support.claude.com/en/articles/8896518"},{"token":"PerplexityBot","owner":"Perplexity","purpose":"answer-engine","docs":"https://docs.perplexity.ai/guides/bots"},{"token":"Google-Extended","owner":"Google","purpose":"control-token","docs":"https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers"},{"token":"Applebot-Extended","owner":"Apple","purpose":"control-token","docs":"https://support.apple.com/en-us/119829"},{"token":"CCBot","owner":"Common Crawl","purpose":"training","docs":"https://commoncrawl.org/ccbot"},{"token":"Bytespider","owner":"ByteDance","purpose":"training","docs":null},{"token":"meta-externalagent","owner":"Meta","purpose":"training","docs":"https://developers.facebook.com/docs/sharing/webmasters/web-crawlers/"}],"domains":[{"rank":1,"domain":"google.com","host":"google.com","state":"ok","detail":"200","status":200,"final_host":"www.google.com","bytes":6654,"groups":4,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":2,"domain":"cloudflare.com","host":"cloudflare.com","state":"ok","detail":"200","status":200,"final_host":"www.cloudflare.com","bytes":1099,"groups":9,"sitemaps":1,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":["GPTBot","ChatGPT-User","PerplexityBot","Google-Extended","CCBot"],"content_signal":[{"ai-train":"yes","search":"yes","ai-input":"yes"}]},{"rank":3,"domain":"ezviz7.com","host":"ezviz7.com","state":"unreachable","detail":"dns","status":null,"final_host":"ezviz7.com","bytes":0},{"rank":4,"domain":"amazonaws.com","host":"amazonaws.com","state":"ok","detail":"200","status":200,"final_host":"aws.amazon.com","bytes":13879,"groups":2,"sitemaps":3,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":5,"domain":"facebook.com","host":"facebook.com","state":"ok","detail":"200","status":200,"final_host":"facebook.com","bytes":26917,"groups":37,"sitemaps":0,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","ClaudeBot","PerplexityBot","Google-Extended","Applebot-Extended"]},{"rank":6,"domain":"fbcdn.net","host":"fbcdn.net","state":"ok","detail":"200","status":200,"final_host":"fbcdn.net","bytes":3400,"groups":37,"sitemaps":0,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","ClaudeBot","PerplexityBot","Google-Extended","Applebot-Extended"]},{"rank":7,"domain":"gstatic.com","host":"gstatic.com","state":"ok","detail":"200","status":200,"final_host":"www.gstatic.com","bytes":5326,"groups":1,"sitemaps":0,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":[]},{"rank":8,"domain":"googleapis.com","host":"googleapis.com","state":"missing","detail":"404","status":404,"final_host":"googleapis.com","bytes":1571},{"rank":9,"domain":"hicloudcam.com","host":"www.hicloudcam.com","state":"ok","detail":"200","status":200,"final_host":"www.hicloudcam.com","bytes":0,"groups":0,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":10,"domain":"youtube.com","host":"youtube.com","state":"ok","detail":"200","status":200,"final_host":"www.youtube.com","bytes":792,"groups":2,"sitemaps":2,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":11,"domain":"microsoft.com","host":"microsoft.com","state":"ok","detail":"200","status":200,"final_host":"www.microsoft.com","bytes":9126,"groups":1,"sitemaps":22,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":12,"domain":"apple.com","host":"apple.com","state":"ok","detail":"200","status":200,"final_host":"www.apple.com","bytes":1018,"groups":6,"sitemaps":5,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":13,"domain":"akamai.net","host":"akamai.net","state":"unreachable","detail":"dns","status":null,"final_host":"akamai.net","bytes":0},{"rank":14,"domain":"instagram.com","host":"instagram.com","state":"ok","detail":"200","status":200,"final_host":"www.instagram.com","bytes":6394,"groups":37,"sitemaps":6,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","ClaudeBot","PerplexityBot","Google-Extended","Applebot-Extended"]},{"rank":15,"domain":"akamaiedge.net","host":"akamaiedge.net","state":"unreachable","detail":"dns","status":null,"final_host":"akamaiedge.net","bytes":0},{"rank":16,"domain":"twitter.com","host":"twitter.com","state":"ok","detail":"200","status":200,"final_host":"twitter.com","bytes":3039,"groups":11,"sitemaps":2,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["Google-Extended","meta-externalagent"]},{"rank":17,"domain":"linkedin.com","host":"linkedin.com","state":"html","detail":"200","status":200,"final_host":"linkedin.com","bytes":21357},{"rank":18,"domain":"azure.com","host":"azure.com","state":"html","detail":"200","status":200,"final_host":"azure.microsoft.com","bytes":463015},{"rank":19,"domain":"triplinkintl.com","host":"triplinkintl.com","state":"html","detail":"200","status":200,"final_host":"www.triplinkintl.com","bytes":306356},{"rank":20,"domain":"gwfb.net","host":"gwfb.net","state":"unreachable","detail":"dns","status":null,"final_host":"gwfb.net","bytes":0},{"rank":21,"domain":"akadns.net","host":"akadns.net","state":"unreachable","detail":"dns","status":null,"final_host":"akadns.net","bytes":0},{"rank":22,"domain":"domaincontrol.com","host":"domaincontrol.com","state":"unreachable","detail":"refused","status":null,"final_host":"domaincontrol.com","bytes":0},{"rank":23,"domain":"googlevideo.com","host":"www.googlevideo.com","state":"ok","detail":"200","status":200,"final_host":"www.googlevideo.com","bytes":26,"groups":1,"sitemaps":0,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":[]},{"rank":24,"domain":"googletagmanager.com","host":"googletagmanager.com","state":"missing","detail":"404","status":404,"final_host":"googletagmanager.com","bytes":1571},{"rank":25,"domain":"mail.ru","host":"mail.ru","state":"ok","detail":"200","status":200,"final_host":"mail.ru","bytes":433,"groups":4,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":26,"domain":"appsflyersdk.com","host":"appsflyersdk.com","state":"missing","detail":"403","status":403,"final_host":"appsflyersdk.com","bytes":146},{"rank":27,"domain":"gtld-servers.net","host":"gtld-servers.net","state":"unreachable","detail":"dns","status":null,"final_host":"gtld-servers.net","bytes":0},{"rank":28,"domain":"cloudfront.net","host":"cloudfront.net","state":"unreachable","detail":"dns","status":null,"final_host":"cloudfront.net","bytes":0},{"rank":29,"domain":"amazon.com","host":"amazon.com","state":"ok","detail":"200","status":200,"final_host":"www.amazon.com","bytes":7947,"groups":101,"sitemaps":0,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":30,"domain":"shiabank.com","host":"shiabank.com","state":"unreachable","detail":"timeout","status":null,"final_host":"shiabank.com","bytes":0},{"rank":31,"domain":"office.com","host":"office.com","state":"ok","detail":"200","status":200,"final_host":"login.microsoftonline.com","bytes":60267,"groups":0,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":32,"domain":"sharepoint.com","host":"sharepoint.com","state":"missing","detail":"redirect-limit","status":302,"final_host":"www.microsoft.com","bytes":0},{"rank":33,"domain":"dzen.ru","host":"dzen.ru","state":"ok","detail":"200","status":200,"final_host":"dzen.ru","bytes":9794,"groups":3,"sitemaps":26,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":34,"domain":"github.com","host":"github.com","state":"ok","detail":"200","status":200,"final_host":"github.com","bytes":15093,"groups":6,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"blocked","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Bytespider"]},{"rank":35,"domain":"live.com","host":"live.com","state":"html","detail":"200","status":200,"final_host":"outlook.live.com","bytes":14287},{"rank":36,"domain":"aaplimg.com","host":"aaplimg.com","state":"unreachable","detail":"dns","status":null,"final_host":"aaplimg.com","bytes":0},{"rank":37,"domain":"trafficmanager.net","host":"trafficmanager.net","state":"unreachable","detail":"dns","status":null,"final_host":"trafficmanager.net","bytes":0},{"rank":38,"domain":"lsrelayaccess.com","host":"lsrelayaccess.com","state":"unreachable","detail":"timeout","status":null,"final_host":"lsrelayaccess.com","bytes":0},{"rank":39,"domain":"wikipedia.org","host":"wikipedia.org","state":"ok","detail":"200","status":200,"final_host":"en.wikipedia.org","bytes":28275,"groups":34,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":40,"domain":"cloud.microsoft","host":"cloud.microsoft","state":"html","detail":"200","status":200,"final_host":"m365.cloud.microsoft","bytes":317386},{"rank":41,"domain":"fastly.net","host":"fastly.net","state":"ok","detail":"200","status":200,"final_host":"www.fastly.com","bytes":398,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":42,"domain":"apple-dns.net","host":"apple-dns.net","state":"unreachable","detail":"dns","status":null,"final_host":"apple-dns.net","bytes":0},{"rank":43,"domain":"netflix.com","host":"netflix.com","state":"ok","detail":"200","status":200,"final_host":"www.netflix.com","bytes":3790,"groups":4,"sitemaps":1,"star":"blocked","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended"]},{"rank":44,"domain":"office.net","host":"office.net","state":"unreachable","detail":"dns","status":null,"final_host":"office.net","bytes":0},{"rank":45,"domain":"w2rt6byl5nf1opmc-a.com","host":"w2rt6byl5nf1opmc-a.com","state":"unreachable","detail":"dns","status":null,"final_host":"w2rt6byl5nf1opmc-a.com","bytes":0},{"rank":46,"domain":"whatsapp.net","host":"whatsapp.net","state":"ok","detail":"200","status":200,"final_host":"www.whatsapp.com","bytes":1225,"groups":18,"sitemaps":1,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","ClaudeBot","PerplexityBot","Google-Extended","Applebot-Extended"]},{"rank":47,"domain":"bing.com","host":"bing.com","state":"ok","detail":"200","status":200,"final_host":"www.bing.com","bytes":2676,"groups":3,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":48,"domain":"x.com","host":"x.com","state":"ok","detail":"200","status":200,"final_host":"x.com","bytes":3039,"groups":11,"sitemaps":2,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["Google-Extended","meta-externalagent"]},{"rank":49,"domain":"googleusercontent.com","host":"googleusercontent.com","state":"missing","detail":"404","status":404,"final_host":"googleusercontent.com","bytes":1571},{"rank":50,"domain":"pv-cdn.net","host":"pv-cdn.net","state":"unreachable","detail":"dns","status":null,"final_host":"pv-cdn.net","bytes":0},{"rank":51,"domain":"doubleclick.net","host":"doubleclick.net","state":"ok","detail":"200","status":200,"final_host":"doubleclick.net","bytes":6654,"groups":4,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":52,"domain":"youtu.be","host":"youtu.be","state":"ok","detail":"200","status":200,"final_host":"youtu.be","bytes":511,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":53,"domain":"googlesyndication.com","host":"googlesyndication.com","state":"missing","detail":"404","status":404,"final_host":"googlesyndication.com","bytes":1571},{"rank":54,"domain":"pinterest.com","host":"pinterest.com","state":"ok","detail":"200","status":200,"final_host":"www.pinterest.com","bytes":44019,"groups":8,"sitemaps":155,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":[]},{"rank":55,"domain":"windows.net","host":"windows.net","state":"unreachable","detail":"tls","status":null,"final_host":"windows.net","bytes":0},{"rank":56,"domain":"icloud.com","host":"icloud.com","state":"ok","detail":"200","status":200,"final_host":"www.icloud.com","bytes":1289,"groups":3,"sitemaps":2,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":57,"domain":"cloudflare.net","host":"cloudflare.net","state":"ok","detail":"200","status":200,"final_host":"cloudflare.net","bytes":207,"groups":4,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":58,"domain":"myfritz.net","host":"myfritz.net","state":"ok","detail":"200","status":200,"final_host":"myfritz.net","bytes":355,"groups":4,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"blocked"},"named":["meta-externalagent"]},{"rank":59,"domain":"goo.gl","host":"goo.gl","state":"missing","detail":"400","status":400,"final_host":"goo.gl","bytes":9258},{"rank":60,"domain":"adobe.com","host":"adobe.com","state":"ok","detail":"200","status":200,"final_host":"www.adobe.com","bytes":10199,"groups":7,"sitemaps":9,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":61,"domain":"gandi.net","host":"gandi.net","state":"ok","detail":"200","status":200,"final_host":"www.gandi.net","bytes":9023,"groups":212,"sitemaps":2,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":62,"domain":"zoom.us","host":"zoom.us","state":"ok","detail":"200","status":200,"final_host":"zoom.us","bytes":2005,"groups":13,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":63,"domain":"tiktok.com","host":"tiktok.com","state":"ok","detail":"200","status":200,"final_host":"www.tiktok.com","bytes":1567,"groups":3,"sitemaps":0,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":64,"domain":"microsoftonline.com","host":"microsoftonline.com","state":"unreachable","detail":"dns","status":null,"final_host":"microsoftonline.com","bytes":0},{"rank":65,"domain":"h264.io","host":"h264.io","state":"unreachable","detail":"dns","status":null,"final_host":"h264.io","bytes":0},{"rank":66,"domain":"whatsapp.com","host":"whatsapp.com","state":"ok","detail":"200","status":200,"final_host":"www.whatsapp.com","bytes":1225,"groups":18,"sitemaps":1,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","ClaudeBot","PerplexityBot","Google-Extended","Applebot-Extended"]},{"rank":67,"domain":"wordpress.org","host":"wordpress.org","state":"ok","detail":"200","status":200,"final_host":"wordpress.org","bytes":976,"groups":12,"sitemaps":9,"star":"partial","bots":{"GPTBot":"allowed","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"allowed","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"partial"},"named":["GPTBot","ClaudeBot","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider"]},{"rank":68,"domain":"windowsupdate.com","host":"windowsupdate.com","state":"unreachable","detail":"dns","status":null,"final_host":"windowsupdate.com","bytes":0},{"rank":69,"domain":"googledomains.com","host":"googledomains.com","state":"html","detail":"200","status":200,"final_host":"domains.google","bytes":5354},{"rank":70,"domain":"yahoo.com","host":"yahoo.com","state":"ok","detail":"200","status":200,"final_host":"www.yahoo.com","bytes":1464,"groups":3,"sitemaps":0,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","PerplexityBot","Google-Extended","CCBot","Bytespider"]},{"rank":71,"domain":"gvt1.com","host":"gvt1.com","state":"unreachable","detail":"dns","status":null,"final_host":"gvt1.com","bytes":0},{"rank":72,"domain":"wa.me","host":"wa.me","state":"ok","detail":"200","status":200,"final_host":"wa.me","bytes":1525,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":73,"domain":"skype.com","host":"skype.com","state":"html","detail":"200","status":200,"final_host":"teams.live.com","bytes":61987},{"rank":74,"domain":"edgekey.net","host":"edgekey.net","state":"unreachable","detail":"dns","status":null,"final_host":"edgekey.net","bytes":0},{"rank":75,"domain":"digicert.com","host":"digicert.com","state":"ok","detail":"200","status":200,"final_host":"www.digicert.com","bytes":2605,"groups":23,"sitemaps":14,"star":"partial","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended"]},{"rank":76,"domain":"tiktokcdn.com","host":"tiktokcdn.com","state":"unreachable","detail":"dns","status":null,"final_host":"tiktokcdn.com","bytes":0},{"rank":77,"domain":"spotify.com","host":"spotify.com","state":"ok","detail":"200","status":200,"final_host":"www.spotify.com","bytes":635,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":78,"domain":"opera.com","host":"opera.com","state":"ok","detail":"200","status":200,"final_host":"www.opera.com","bytes":994,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":79,"domain":"a2z.com","host":"a2z.com","state":"unreachable","detail":"dns","status":null,"final_host":"a2z.com","bytes":0},{"rank":80,"domain":"roblox.com","host":"roblox.com","state":"ok","detail":"200","status":200,"final_host":"www.roblox.com","bytes":2281,"groups":1,"sitemaps":32,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":81,"domain":"b-cdn.net","host":"b-cdn.net","state":"html","detail":"200","status":200,"final_host":"bunny.net","bytes":79102},{"rank":82,"domain":"amazonvideo.com","host":"amazonvideo.com","state":"ok","detail":"200","status":200,"final_host":"www.primevideo.com","bytes":4348,"groups":94,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"blocked","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["ChatGPT-User","Claude-User","PerplexityBot","CCBot","Bytespider","meta-externalagent"]},{"rank":83,"domain":"epicgames.com","host":"epicgames.com","state":"missing","detail":"403","status":403,"final_host":"www.epicgames.com","bytes":25397},{"rank":84,"domain":"tiktokv.com","host":"tiktokv.com","state":"missing","detail":"404","status":404,"final_host":"tiktokv.com","bytes":144},{"rank":85,"domain":"workers.dev","host":"workers.dev","state":"html","detail":"200","status":200,"final_host":"www.cloudflare.com","bytes":512000},{"rank":86,"domain":"vimeo.com","host":"vimeo.com","state":"ok","detail":"200","status":200,"final_host":"vimeo.com","bytes":30242,"groups":21,"sitemaps":2,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"partial"},"named":["GPTBot","ClaudeBot","Google-Extended","CCBot","Bytespider"]},{"rank":87,"domain":"ntp.org","host":"ntp.org","state":"ok","detail":"200","status":200,"final_host":"www.ntp.org","bytes":16,"groups":1,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":88,"domain":"3gppnetwork.org","host":"3gppnetwork.org","state":"unreachable","detail":"dns","status":null,"final_host":"3gppnetwork.org","bytes":0},{"rank":89,"domain":"blogspot.com","host":"blogspot.com","state":"ok","detail":"200","status":200,"final_host":"www.blogger.com","bytes":572,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":90,"domain":"baidu.com","host":"baidu.com","state":"ok","detail":"200","status":200,"final_host":"www.baidu.com","bytes":2814,"groups":16,"sitemaps":0,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":[]},{"rank":91,"domain":"qq.com","host":"qq.com","state":"ok","detail":"200","status":200,"final_host":"www.qq.com","bytes":71,"groups":1,"sitemaps":1,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":92,"domain":"aws.dev","host":"aws.dev","state":"unreachable","detail":"dns","status":null,"final_host":"aws.dev","bytes":0},{"rank":93,"domain":"mozilla.org","host":"mozilla.org","state":"ok","detail":"200","status":200,"final_host":"www.mozilla.org","bytes":66,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":94,"domain":"nginx.org","host":"nginx.org","state":"ok","detail":"200","status":200,"final_host":"nginx.org","bytes":72,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":95,"domain":"msn.com","host":"msn.com","state":"ok","detail":"200","status":200,"final_host":"www.msn.com","bytes":5245,"groups":11,"sitemaps":6,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":96,"domain":"akam.net","host":"akam.net","state":"unreachable","detail":"dns","status":null,"final_host":"akam.net","bytes":0},{"rank":97,"domain":"f5.com","host":"f5.com","state":"ok","detail":"200","status":200,"final_host":"www.f5.com","bytes":156,"groups":1,"sitemaps":2,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":98,"domain":"cdn77.org","host":"cdn77.org","state":"unreachable","detail":"dns","status":null,"final_host":"cdn77.org","bytes":0},{"rank":99,"domain":"yandex.net","host":"yandex.net","state":"missing","detail":"404","status":404,"final_host":"yandex.net","bytes":9},{"rank":100,"domain":"wordpress.com","host":"wordpress.com","state":"ok","detail":"200","status":200,"final_host":"wordpress.com","bytes":1387,"groups":1,"sitemaps":5,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":101,"domain":"dotaplabs.net","host":"dotaplabs.net","state":"unreachable","detail":"dns","status":null,"final_host":"dotaplabs.net","bytes":0},{"rank":102,"domain":"t.me","host":"t.me","state":"missing","detail":"404","status":404,"final_host":"t.me","bytes":153},{"rank":103,"domain":"sentry.io","host":"sentry.io","state":"ok","detail":"200","status":200,"final_host":"sentry.io","bytes":140,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[],"content_signal":[{"search":"yes","ai-input":"yes","ai-train":"yes"}]},{"rank":104,"domain":"virginm.net","host":"virginm.net","state":"unreachable","detail":"dns","status":null,"final_host":"virginm.net","bytes":0},{"rank":105,"domain":"lencr.org","host":"lencr.org","state":"html","detail":"200","status":200,"final_host":"letsencrypt.org","bytes":28840},{"rank":106,"domain":"nginx.com","host":"nginx.com","state":"html","detail":"200","status":200,"final_host":"www.f5.com","bytes":434519},{"rank":107,"domain":"reddit.com","host":"reddit.com","state":"ok","detail":"200","status":200,"final_host":"www.reddit.com","bytes":538,"groups":1,"sitemaps":0,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":[]},{"rank":108,"domain":"intuit.com","host":"intuit.com","state":"ok","detail":"200","status":200,"final_host":"www.intuit.com","bytes":3086,"groups":16,"sitemaps":5,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":109,"domain":"t-online.de","host":"t-online.de","state":"ok","detail":"200","status":200,"final_host":"www.t-online.de","bytes":2206,"groups":6,"sitemaps":0,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"blocked","Google-Extended":"partial","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","ClaudeBot","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":110,"domain":"edgesuite.net","host":"edgesuite.net","state":"unreachable","detail":"dns","status":null,"final_host":"edgesuite.net","bytes":0},{"rank":111,"domain":"2mdn.net","host":"2mdn.net","state":"unreachable","detail":"dns","status":null,"final_host":"2mdn.net","bytes":0},{"rank":112,"domain":"cdninstagram.com","host":"cdninstagram.com","state":"unreachable","detail":"dns","status":null,"final_host":"cdninstagram.com","bytes":0},{"rank":113,"domain":"ui.com","host":"ui.com","state":"ok","detail":"200","status":200,"final_host":"ui.com","bytes":367,"groups":10,"sitemaps":1,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","PerplexityBot","Google-Extended","Applebot-Extended","CCBot"]},{"rank":114,"domain":"europa.eu","host":"europa.eu","state":"ok","detail":"200","status":200,"final_host":"europa.eu","bytes":4930,"groups":2,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":115,"domain":"chatgpt.com","host":"chatgpt.com","state":"ok","detail":"200","status":200,"final_host":"chatgpt.com","bytes":4601,"groups":14,"sitemaps":4,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"partial"},"named":["PerplexityBot","Google-Extended","CCBot","Bytespider"]},{"rank":116,"domain":"yandex.ru","host":"yandex.ru","state":"ok","detail":"200","status":200,"final_host":"yandex.ru","bytes":40657,"groups":5,"sitemaps":31,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["OAI-SearchBot"]},{"rank":117,"domain":"gvt2.com","host":"gvt2.com","state":"unreachable","detail":"dns","status":null,"final_host":"gvt2.com","bytes":0},{"rank":118,"domain":"bit.ly","host":"bit.ly","state":"ok","detail":"200","status":200,"final_host":"bit.ly","bytes":123,"groups":1,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":119,"domain":"aliyuncs.com","host":"aliyuncs.com","state":"missing","detail":"404","status":404,"final_host":"aliyuncs.com","bytes":611},{"rank":120,"domain":"samsung.com","host":"samsung.com","state":"ok","detail":"200","status":200,"final_host":"www.samsung.com","bytes":10075,"groups":4,"sitemaps":94,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","PerplexityBot","Google-Extended"]},{"rank":121,"domain":"fastly-edge.com","host":"fastly-edge.com","state":"unreachable","detail":"dns","status":null,"final_host":"fastly-edge.com","bytes":0},{"rank":122,"domain":"azurefd.net","host":"www.azurefd.net","state":"missing","detail":"404","status":404,"final_host":"www.azurefd.net","bytes":266389},{"rank":123,"domain":"amazon.dev","host":"amazon.dev","state":"unreachable","detail":"dns","status":null,"final_host":"amazon.dev","bytes":0},{"rank":124,"domain":"ipify.org","host":"ipify.org","state":"ok","detail":"200","status":200,"final_host":"www.ipify.org","bytes":24,"groups":1,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":125,"domain":"root-servers.net","host":"root-servers.net","state":"unreachable","detail":"dns","status":null,"final_host":"root-servers.net","bytes":0},{"rank":126,"domain":"openai.com","host":"openai.com","state":"ok","detail":"200","status":200,"final_host":"openai.com","bytes":98,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":127,"domain":"registrar-servers.com","host":"registrar-servers.com","state":"ok","detail":"200","status":200,"final_host":"registrar-servers.com","bytes":26,"groups":1,"sitemaps":0,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":[]},{"rank":128,"domain":"office365.com","host":"office365.com","state":"missing","detail":"403","status":403,"final_host":"office365.com","bytes":1892},{"rank":129,"domain":"adobe.io","host":"adobe.io","state":"ok","detail":"200","status":200,"final_host":"developer.adobe.com","bytes":92,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":130,"domain":"webex.com","host":"webex.com","state":"missing","detail":"403","status":403,"final_host":"www.webex.com","bytes":381},{"rank":131,"domain":"yccdn.ru","host":"yccdn.ru","state":"unreachable","detail":"dns","status":null,"final_host":"yccdn.ru","bytes":0},{"rank":132,"domain":"android.com","host":"android.com","state":"ok","detail":"200","status":200,"final_host":"www.android.com","bytes":1890,"groups":15,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ClaudeBot","Claude-SearchBot","PerplexityBot","Google-Extended","Applebot-Extended","CCBot"]},{"rank":133,"domain":"dropbox.com","host":"dropbox.com","state":"ok","detail":"200","status":200,"final_host":"www.dropbox.com","bytes":816,"groups":3,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":134,"domain":"github.io","host":"github.io","state":"html","detail":"200","status":200,"final_host":"pages.github.com","bytes":14446},{"rank":135,"domain":"nih.gov","host":"nih.gov","state":"missing","detail":"403","status":403,"final_host":"www.nih.gov","bytes":5634},{"rank":136,"domain":"outlook.com","host":"outlook.com","state":"html","detail":"200","status":200,"final_host":"outlook.cloud.microsoft","bytes":14255},{"rank":137,"domain":"ytimg.com","host":"ytimg.com","state":"unreachable","detail":"dns","status":null,"final_host":"ytimg.com","bytes":0},{"rank":138,"domain":"okcdn.ru","host":"okcdn.ru","state":"missing","detail":"404","status":404,"final_host":"st.okcdn.ru","bytes":147},{"rank":139,"domain":"cloudflare-dns.com","host":"cloudflare-dns.com","state":"ok","detail":"200","status":200,"final_host":"one.one.one.one","bytes":1248,"groups":0,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":140,"domain":"akamaized.net","host":"akamaized.net","state":"unreachable","detail":"dns","status":null,"final_host":"akamaized.net","bytes":0},{"rank":141,"domain":"nflxso.net","host":"nflxso.net","state":"unreachable","detail":"dns","status":null,"final_host":"nflxso.net","bytes":0},{"rank":142,"domain":"windows.com","host":"windows.com","state":"html","detail":"200","status":200,"final_host":"www.microsoft.com","bytes":512000},{"rank":143,"domain":"skybridge.click","host":"skybridge.click","state":"ok","detail":"200","status":200,"final_host":"skybridge.click","bytes":26,"groups":1,"sitemaps":0,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":[]},{"rank":144,"domain":"static.microsoft","host":"static.microsoft","state":"unreachable","detail":"dns","status":null,"final_host":"static.microsoft","bytes":0},{"rank":145,"domain":"apache.org","host":"apache.org","state":"ok","detail":"200","status":200,"final_host":"apache.org","bytes":47,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":146,"domain":"supertms.com","host":"supertms.com","state":"unreachable","detail":"dns","status":null,"final_host":"supertms.com","bytes":0},{"rank":147,"domain":"duckdns.org","host":"www.duckdns.org","state":"missing","detail":"404","status":404,"final_host":"www.duckdns.org","bytes":7834},{"rank":148,"domain":"dns-parking.com","host":"dns-parking.com","state":"unreachable","detail":"dns","status":null,"final_host":"dns-parking.com","bytes":0},{"rank":149,"domain":"tm-azurefd.net","host":"tm-azurefd.net","state":"unreachable","detail":"dns","status":null,"final_host":"tm-azurefd.net","bytes":0},{"rank":150,"domain":"discord.gg","host":"discord.gg","state":"ok","detail":"200","status":200,"final_host":"discord.gg","bytes":23,"groups":1,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":151,"domain":"nic.ru","host":"nic.ru","state":"html","detail":"200","status":200,"final_host":"nic.ru","bytes":13602},{"rank":152,"domain":"archive.org","host":"archive.org","state":"ok","detail":"200","status":200,"final_host":"archive.org","bytes":238,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":153,"domain":"vk.ru","host":"vk.ru","state":"ok","detail":"200","status":200,"final_host":"vk.ru","bytes":6175,"groups":3,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":154,"domain":"forms.gle","host":"forms.gle","state":"missing","detail":"400","status":400,"final_host":"forms.gle","bytes":9258},{"rank":155,"domain":"azurewebsites.net","host":"azurewebsites.net","state":"unreachable","detail":"dns","status":null,"final_host":"azurewebsites.net","bytes":0},{"rank":156,"domain":"tumblr.com","host":"tumblr.com","state":"ok","detail":"200","status":200,"final_host":"www.tumblr.com","bytes":3452,"groups":19,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"partial","meta-externalagent":"blocked"},"named":["ClaudeBot","Google-Extended","Applebot-Extended","CCBot","meta-externalagent"]},{"rank":157,"domain":"crashlytics.com","host":"crashlytics.com","state":"html","detail":"200","status":200,"final_host":"firebase.google.com","bytes":512000},{"rank":158,"domain":"snapchat.com","host":"snapchat.com","state":"ok","detail":"200","status":200,"final_host":"www.snapchat.com","bytes":4072,"groups":51,"sitemaps":13,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":159,"domain":"vk.com","host":"vk.com","state":"ok","detail":"200","status":200,"final_host":"vk.com","bytes":6175,"groups":3,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":160,"domain":"nytimes.com","host":"nytimes.com","state":"ok","detail":"200","status":200,"final_host":"www.nytimes.com","bytes":8547,"groups":63,"sitemaps":25,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":161,"domain":"jomodns.com","host":"jomodns.com","state":"unreachable","detail":"dns","status":null,"final_host":"jomodns.com","bytes":0},{"rank":162,"domain":"godaddy.com","host":"godaddy.com","state":"missing","detail":"403","status":403,"final_host":"www.godaddy.com","bytes":383},{"rank":163,"domain":"dnsowl.com","host":"dnsowl.com","state":"unreachable","detail":"dns","status":null,"final_host":"dnsowl.com","bytes":0},{"rank":164,"domain":"spo-msedge.net","host":"spo-msedge.net","state":"unreachable","detail":"dns","status":null,"final_host":"spo-msedge.net","bytes":0},{"rank":165,"domain":"telegram.org","host":"telegram.org","state":"missing","detail":"404","status":404,"final_host":"telegram.org","bytes":153},{"rank":166,"domain":"telekom.net","host":"telekom.net","state":"html","detail":"200","status":200,"final_host":"www.telekom.com","bytes":231749},{"rank":167,"domain":"ubuntu.com","host":"ubuntu.com","state":"ok","detail":"200","status":200,"final_host":"ubuntu.com","bytes":5561,"groups":2,"sitemaps":11,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","PerplexityBot","Google-Extended","Applebot-Extended","Bytespider","meta-externalagent"]},{"rank":168,"domain":"gravatar.com","host":"gravatar.com","state":"ok","detail":"200","status":200,"final_host":"gravatar.com","bytes":1022,"groups":11,"sitemaps":0,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"blocked","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"partial"},"named":["GPTBot","Google-Extended","CCBot","Bytespider"]},{"rank":169,"domain":"samsungcloud.com","host":"samsungcloud.com","state":"ok","detail":"200","status":200,"final_host":"www.samsungcloud.com","bytes":125,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":170,"domain":"shopify.com","host":"shopify.com","state":"ok","detail":"200","status":200,"final_host":"shopify.com","bytes":62,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":171,"domain":"amazon-adsystem.com","host":"amazon-adsystem.com","state":"unreachable","detail":"timeout","status":null,"final_host":"amazon-adsystem.com","bytes":0},{"rank":172,"domain":"ax-msedge.net","host":"ax-msedge.net","state":"unreachable","detail":"dns","status":null,"final_host":"ax-msedge.net","bytes":0},{"rank":173,"domain":"paypal.com","host":"paypal.com","state":"ok","detail":"200","status":200,"final_host":"www.paypal.com","bytes":2628,"groups":2,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":174,"domain":"reg.ru","host":"reg.ru","state":"html","detail":"200","status":200,"final_host":"reg.ru","bytes":13602},{"rank":175,"domain":"pages.dev","host":"pages.dev","state":"html","detail":"200","status":200,"final_host":"www.cloudflare.com","bytes":512000},{"rank":176,"domain":"meraki.com","host":"meraki.com","state":"missing","detail":"401","status":401,"final_host":"meraki.cisco.com","bytes":172},{"rank":177,"domain":"google-analytics.com","host":"google-analytics.com","state":"ok","detail":"200","status":200,"final_host":"google-analytics.com","bytes":78,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":178,"domain":"astrumu.io","host":"astrumu.io","state":"ok","detail":"200","status":200,"final_host":"astrumu.io","bytes":136,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":179,"domain":"example.com","host":"example.com","state":"missing","detail":"404","status":404,"final_host":"example.com","bytes":577},{"rank":180,"domain":"tbcache.com","host":"tbcache.com","state":"unreachable","detail":"timeout","status":null,"final_host":"tbcache.com","bytes":0},{"rank":181,"domain":"trbcdn.net","host":"trbcdn.net","state":"unreachable","detail":"tls","status":null,"final_host":"trbcdn.net","bytes":0},{"rank":182,"domain":"ksyuncdn.com","host":"ksyuncdn.com","state":"unreachable","detail":"dns","status":null,"final_host":"ksyuncdn.com","bytes":0},{"rank":183,"domain":"flickr.com","host":"flickr.com","state":"ok","detail":"200","status":200,"final_host":"flickr.com","bytes":2210,"groups":3,"sitemaps":6,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["OAI-SearchBot","ChatGPT-User","Claude-SearchBot","Claude-User","PerplexityBot"]},{"rank":184,"domain":"scorecardresearch.com","host":"scorecardresearch.com","state":"missing","detail":"404","status":404,"final_host":"scorecardresearch.com","bytes":1245},{"rank":185,"domain":"comcast.net","host":"comcast.net","state":"missing","detail":"403","status":403,"final_host":"www.xfinity.com","bytes":369},{"rank":186,"domain":"kaspersky.com","host":"kaspersky.com","state":"ok","detail":"200","status":200,"final_host":"www.kaspersky.com","bytes":1929,"groups":18,"sitemaps":2,"star":"partial","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"partial","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-User","PerplexityBot","Google-Extended","Applebot-Extended","CCBot"]},{"rank":187,"domain":"creativecommons.org","host":"creativecommons.org","state":"ok","detail":"200","status":200,"final_host":"creativecommons.org","bytes":177,"groups":1,"sitemaps":1,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":188,"domain":"nflximg.com","host":"nflximg.com","state":"unreachable","detail":"timeout","status":null,"final_host":"nflximg.com","bytes":0},{"rank":189,"domain":"discord.com","host":"discord.com","state":"ok","detail":"200","status":200,"final_host":"discord.com","bytes":1774,"groups":3,"sitemaps":7,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":190,"domain":"w3.org","host":"w3.org","state":"ok","detail":"200","status":200,"final_host":"www.w3.org","bytes":3844,"groups":2,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":191,"domain":"awswaf.com","host":"awswaf.com","state":"unreachable","detail":"dns","status":null,"final_host":"awswaf.com","bytes":0},{"rank":192,"domain":"cnn.com","host":"cnn.com","state":"ok","detail":"200","status":200,"final_host":"www.cnn.com","bytes":3704,"groups":3,"sitemaps":13,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"partial","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Applebot-Extended","CCBot","Bytespider"]},{"rank":193,"domain":"forter.com","host":"forter.com","state":"ok","detail":"200","status":200,"final_host":"forter.com","bytes":1253,"groups":4,"sitemaps":1,"star":"partial","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"],"content_signal":[{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes"},{"search":"no","ai-input":"no","ai-train":"no"},{"search":"yes","ai-input":"yes","ai-train":"no"}]},{"rank":194,"domain":"quickconnect.to","host":"quickconnect.to","state":"ok","detail":"200","status":200,"final_host":"quickconnect.to","bytes":1,"groups":0,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":195,"domain":"afternic.com","host":"afternic.com","state":"ok","detail":"200","status":200,"final_host":"www.afternic.com","bytes":85,"groups":1,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":196,"domain":"ebay.com","host":"ebay.com","state":"ok","detail":"200","status":200,"final_host":"www.ebay.com","bytes":24164,"groups":9,"sitemaps":7,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"blocked","Google-Extended":"partial","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":197,"domain":"firefox-portal-detection.com","host":"firefox-portal-detection.com","state":"missing","detail":"404","status":404,"final_host":"firefox-portal-detection.com","bytes":10},{"rank":198,"domain":"soundcloud.com","host":"soundcloud.com","state":"ok","detail":"200","status":200,"final_host":"soundcloud.com","bytes":1557,"groups":2,"sitemaps":2,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":199,"domain":"macromedia.com","host":"www.macromedia.com","state":"ok","detail":"200","status":200,"final_host":"www.adobe.com","bytes":10199,"groups":7,"sitemaps":9,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":200,"domain":"pki.goog","host":"pki.goog","state":"ok","detail":"200","status":200,"final_host":"pki.goog","bytes":69,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":201,"domain":"hichina.com","host":"www.hichina.com","state":"html","detail":"200","status":200,"final_host":"www.hichina.com","bytes":43725},{"rank":202,"domain":"theguardian.com","host":"theguardian.com","state":"ok","detail":"200","status":200,"final_host":"www.theguardian.com","bytes":2873,"groups":3,"sitemaps":2,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"partial","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":203,"domain":"unity3d.com","host":"unity3d.com","state":"ok","detail":"200","status":200,"final_host":"unity.com","bytes":264,"groups":5,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"blocked","meta-externalagent":"partial"},"named":["Bytespider"]},{"rank":204,"domain":"youtube-nocookie.com","host":"www.youtube-nocookie.com","state":"ok","detail":"200","status":200,"final_host":"www.youtube-nocookie.com","bytes":548,"groups":2,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":205,"domain":"skyhigh.cloud","host":"skyhigh.cloud","state":"html","detail":"200","status":200,"final_host":"www.skyhighsecurity.com","bytes":195618},{"rank":206,"domain":"medium.com","host":"medium.com","state":"ok","detail":"200","status":200,"final_host":"medium.com","bytes":884,"groups":2,"sitemaps":1,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"blocked","CCBot":"partial","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","ClaudeBot","Applebot-Extended","Bytespider","meta-externalagent"]},{"rank":207,"domain":"omtrdc.net","host":"omtrdc.net","state":"unreachable","detail":"dns","status":null,"final_host":"omtrdc.net","bytes":0},{"rank":208,"domain":"stripe.com","host":"stripe.com","state":"ok","detail":"200","status":200,"final_host":"stripe.com","bytes":643,"groups":3,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":209,"domain":"doi.org","host":"doi.org","state":"missing","detail":"404","status":404,"final_host":"www.doi.org","bytes":7625},{"rank":210,"domain":"msedge.net","host":"msedge.net","state":"unreachable","detail":"timeout","status":null,"final_host":"msedge.net","bytes":0},{"rank":211,"domain":"azureedge.net","host":"www.azureedge.net","state":"missing","detail":"404","status":404,"final_host":"www.azureedge.net","bytes":266389},{"rank":212,"domain":"hcaptcha.com","host":"hcaptcha.com","state":"ok","detail":"200","status":200,"final_host":"www.hcaptcha.com","bytes":109,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":213,"domain":"mtgglobals.com","host":"www.mtgglobals.com","state":"missing","detail":"404","status":404,"final_host":"www.mtgglobals.com","bytes":365},{"rank":214,"domain":"oracle.com","host":"oracle.com","state":"missing","detail":"403","status":403,"final_host":"www.oracle.com","bytes":3988},{"rank":215,"domain":"mts.ru","host":"mts.ru","state":"ok","detail":"200","status":200,"final_host":"moskva.mts.ru","bytes":6839,"groups":2,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":216,"domain":"ttdns2.com","host":"ttdns2.com","state":"unreachable","detail":"dns","status":null,"final_host":"ttdns2.com","bytes":0},{"rank":217,"domain":"publicnode.com","host":"publicnode.com","state":"ok","detail":"200","status":200,"final_host":"publicnode.com","bytes":117,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":218,"domain":"app-measurement.com","host":"app-measurement.com","state":"missing","detail":"404","status":404,"final_host":"app-measurement.com","bytes":1571},{"rank":219,"domain":"bbc.com","host":"bbc.com","state":"ok","detail":"200","status":200,"final_host":"www.bbc.com","bytes":6250,"groups":42,"sitemaps":39,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"partial","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":220,"domain":"vkuserphoto.ru","host":"vkuserphoto.ru","state":"missing","detail":"418","status":418,"final_host":"ps.userapi.com","bytes":0},{"rank":221,"domain":"iiko.it","host":"iiko.it","state":"unreachable","detail":"dns","status":null,"final_host":"iiko.it","bytes":0},{"rank":222,"domain":"wikimedia.org","host":"wikimedia.org","state":"missing","detail":"404","status":404,"final_host":"www.wikimedia.org","bytes":2864},{"rank":223,"domain":"cdngslb.com","host":"cdngslb.com","state":"unreachable","detail":"timeout","status":null,"final_host":"cdngslb.com","bytes":0},{"rank":224,"domain":"licdn.com","host":"licdn.com","state":"unreachable","detail":"dns","status":null,"final_host":"licdn.com","bytes":0},{"rank":225,"domain":"bybanking.com","host":"bybanking.com","state":"unreachable","detail":"timeout","status":null,"final_host":"bybanking.com","bytes":0},{"rank":226,"domain":"roku.com","host":"roku.com","state":"ok","detail":"200","status":200,"final_host":"www.roku.com","bytes":303,"groups":1,"sitemaps":5,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":227,"domain":"criteo.com","host":"criteo.com","state":"ok","detail":"200","status":200,"final_host":"criteo.com","bytes":2056,"groups":2,"sitemaps":10,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":228,"domain":"forbes.com","host":"forbes.com","state":"ok","detail":"200","status":200,"final_host":"www.forbes.com","bytes":33649,"groups":23,"sitemaps":8,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"allowed","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"blocked","Google-Extended":"partial","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":229,"domain":"xiaomi.com","host":"xiaomi.com","state":"missing","detail":"403","status":403,"final_host":"www.mi.com","bytes":378},{"rank":230,"domain":"weather.com","host":"weather.com","state":"ok","detail":"200","status":200,"final_host":"weather.com","bytes":3532,"groups":26,"sitemaps":7,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"allowed","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"partial"},"named":["ChatGPT-User","CCBot","Bytespider"]},{"rank":231,"domain":"twitch.tv","host":"twitch.tv","state":"ok","detail":"200","status":200,"final_host":"www.twitch.tv","bytes":1674,"groups":5,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":232,"domain":"researchgate.net","host":"researchgate.net","state":"ok","detail":"200","status":200,"final_host":"www.researchgate.net","bytes":433,"groups":3,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"blocked","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["Applebot-Extended"]},{"rank":233,"domain":"sciencedirect.com","host":"sciencedirect.com","state":"ok","detail":"200","status":200,"final_host":"www.sciencedirect.com","bytes":17401,"groups":49,"sitemaps":32,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"allowed","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"allowed","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":234,"domain":"googletagservices.com","host":"www.googletagservices.com","state":"missing","detail":"404","status":404,"final_host":"www.googletagservices.com","bytes":1571},{"rank":235,"domain":"amplitude.com","host":"amplitude.com","state":"ok","detail":"200","status":200,"final_host":"amplitude.com","bytes":2385,"groups":16,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"blocked","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"],"content_signal":[{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"no","ai-input":"no","ai-train":"no"}]},{"rank":236,"domain":"ailawandorder.com","host":"ailawandorder.com","state":"unreachable","detail":"tls","status":null,"final_host":"ailawandorder.com","bytes":0},{"rank":237,"domain":"mit.edu","host":"mit.edu","state":"ok","detail":"200","status":200,"final_host":"web.mit.edu","bytes":199,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":238,"domain":"brave.com","host":"brave.com","state":"ok","detail":"200","status":200,"final_host":"brave.com","bytes":53,"groups":1,"sitemaps":1,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":239,"domain":"namecheap.com","host":"namecheap.com","state":"ok","detail":"200","status":200,"final_host":"www.namecheap.com","bytes":1359,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":240,"domain":"nist.gov","host":"nist.gov","state":"ok","detail":"200","status":200,"final_host":"www.nist.gov","bytes":2425,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":241,"domain":"rbxcdn.com","host":"rbxcdn.com","state":"unreachable","detail":"dns","status":null,"final_host":"rbxcdn.com","bytes":0},{"rank":242,"domain":"applovin.com","host":"applovin.com","state":"ok","detail":"200","status":200,"final_host":"applovin.com","bytes":218,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":243,"domain":"bbc.co.uk","host":"bbc.co.uk","state":"ok","detail":"200","status":200,"final_host":"www.bbc.co.uk","bytes":4988,"groups":42,"sitemaps":13,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"partial","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":244,"domain":"cpanel.net","host":"cpanel.net","state":"ok","detail":"200","status":200,"final_host":"www.cpanel.net","bytes":297,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":245,"domain":"cisco.com","host":"cisco.com","state":"ok","detail":"200","status":200,"final_host":"www.cisco.com","bytes":15619,"groups":3,"sitemaps":99,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":246,"domain":"playstation.net","host":"playstation.net","state":"unreachable","detail":"dns","status":null,"final_host":"playstation.net","bytes":0},{"rank":247,"domain":"shifen.com","host":"shifen.com","state":"unreachable","detail":"timeout","status":null,"final_host":"shifen.com","bytes":0},{"rank":248,"domain":"t.co","host":"t.co","state":"ok","detail":"200","status":200,"final_host":"t.co","bytes":150,"groups":3,"sitemaps":0,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":[]},{"rank":249,"domain":"wsdvs.com","host":"wsdvs.com","state":"unreachable","detail":"dns","status":null,"final_host":"wsdvs.com","bytes":0},{"rank":250,"domain":"msftconnecttest.com","host":"msftconnecttest.com","state":"unreachable","detail":"dns","status":null,"final_host":"msftconnecttest.com","bytes":0},{"rank":251,"domain":"dnsmadeeasy.com","host":"dnsmadeeasy.com","state":"missing","detail":"404","status":404,"final_host":"dnsmadeeasy.com","bytes":102365},{"rank":252,"domain":"sourceforge.net","host":"sourceforge.net","state":"ok","detail":"200","status":200,"final_host":"sourceforge.net","bytes":5870,"groups":3,"sitemaps":7,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":253,"domain":"adtrafficquality.google","host":"adtrafficquality.google","state":"missing","detail":"404","status":404,"final_host":"adtrafficquality.google","bytes":1571},{"rank":254,"domain":"avcdn.net","host":"avcdn.net","state":"unreachable","detail":"dns","status":null,"final_host":"avcdn.net","bytes":0},{"rank":255,"domain":"icanhazip.com","host":"icanhazip.com","state":"ok","detail":"200","status":200,"final_host":"icanhazip.com","bytes":26,"groups":0,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":256,"domain":"bytefcdn-oversea.com","host":"bytefcdn-oversea.com","state":"unreachable","detail":"dns","status":null,"final_host":"bytefcdn-oversea.com","bytes":0},{"rank":257,"domain":"alibabadns.com","host":"alibabadns.com","state":"unreachable","detail":"dns","status":null,"final_host":"alibabadns.com","bytes":0},{"rank":258,"domain":"aliyuncsslbintl.com","host":"aliyuncsslbintl.com","state":"unreachable","detail":"dns","status":null,"final_host":"aliyuncsslbintl.com","bytes":0},{"rank":259,"domain":"salesforce.com","host":"salesforce.com","state":"ok","detail":"200","status":200,"final_host":"www.salesforce.com","bytes":14256,"groups":9,"sitemaps":52,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":260,"domain":"name-services.com","host":"name-services.com","state":"unreachable","detail":"dns","status":null,"final_host":"name-services.com","bytes":0},{"rank":261,"domain":"sfx.ms","host":"sfx.ms","state":"unreachable","detail":"dns","status":null,"final_host":"sfx.ms","bytes":0},{"rank":262,"domain":"hubspot.com","host":"hubspot.com","state":"ok","detail":"200","status":200,"final_host":"www.hubspot.com","bytes":12606,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":263,"domain":"imdb.com","host":"imdb.com","state":"ok","detail":"200","status":200,"final_host":"www.imdb.com","bytes":1992,"groups":4,"sitemaps":0,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":[]},{"rank":264,"domain":"linktr.ee","host":"linktr.ee","state":"ok","detail":"200","status":200,"final_host":"linktr.ee","bytes":11124,"groups":60,"sitemaps":5,"star":"blocked","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"partial","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","Applebot-Extended","CCBot"],"content_signal":[{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"},{"ai-train":"no","search":"yes"}]},{"rank":265,"domain":"namebrightdns.com","host":"namebrightdns.com","state":"unreachable","detail":"dns","status":null,"final_host":"namebrightdns.com","bytes":0},{"rank":266,"domain":"cdn-apple.com","host":"cdn-apple.com","state":"unreachable","detail":"dns","status":null,"final_host":"cdn-apple.com","bytes":0},{"rank":267,"domain":"akamaihd.net","host":"akamaihd.net","state":"unreachable","detail":"dns","status":null,"final_host":"akamaihd.net","bytes":0},{"rank":268,"domain":"yandexcloud.net","host":"yandexcloud.net","state":"unreachable","detail":"dns","status":null,"final_host":"yandexcloud.net","bytes":0},{"rank":269,"domain":"mybluehost.me","host":"mybluehost.me","state":"unreachable","detail":"tls","status":null,"final_host":"mybluehost.me","bytes":0},{"rank":270,"domain":"alidns.com","host":"alidns.com","state":"ok","detail":"200","status":200,"final_host":"alidns.com","bytes":64,"groups":0,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":271,"domain":"who.int","host":"who.int","state":"ok","detail":"200","status":200,"final_host":"www.who.int","bytes":18983,"groups":527,"sitemaps":1,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"blocked","Bytespider":"allowed","meta-externalagent":"allowed"},"named":["CCBot"]},{"rank":272,"domain":"googleblog.com","host":"googleblog.com","state":"html","detail":"200","status":200,"final_host":"blog.google","bytes":403120},{"rank":273,"domain":"xcal.tv","host":"xcal.tv","state":"unreachable","detail":"dns","status":null,"final_host":"xcal.tv","bytes":0},{"rank":274,"domain":"wixsite.com","host":"www.wixsite.com","state":"ok","detail":"200","status":200,"final_host":"www.wixsite.com","bytes":443,"groups":5,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":275,"domain":"ttvnw.net","host":"ttvnw.net","state":"unreachable","detail":"dns","status":null,"final_host":"ttvnw.net","bytes":0},{"rank":276,"domain":"geobasket.ru","host":"geobasket.ru","state":"unreachable","detail":"dns","status":null,"final_host":"geobasket.ru","bytes":0},{"rank":277,"domain":"googleadservices.com","host":"googleadservices.com","state":"missing","detail":"404","status":404,"final_host":"googleadservices.com","bytes":1571},{"rank":278,"domain":"vedcdnlb.com","host":"vedcdnlb.com","state":"unreachable","detail":"dns","status":null,"final_host":"vedcdnlb.com","bytes":0},{"rank":279,"domain":"ibm.com","host":"ibm.com","state":"ok","detail":"200","status":200,"final_host":"www.ibm.com","bytes":4616,"groups":10,"sitemaps":5,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":280,"domain":"datadoghq.com","host":"datadoghq.com","state":"ok","detail":"200","status":200,"final_host":"www.datadoghq.com","bytes":525,"groups":1,"sitemaps":9,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":281,"domain":"ozon.ru","host":"ozon.ru","state":"missing","detail":"redirect-limit","status":307,"final_host":"ozon.ru","bytes":0},{"rank":282,"domain":"demdex.net","host":"www.demdex.net","state":"ok","detail":"200","status":200,"final_host":"www.demdex.net","bytes":26,"groups":1,"sitemaps":0,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":[]},{"rank":283,"domain":"hp.com","host":"hp.com","state":"ok","detail":"200","status":200,"final_host":"www.hp.com","bytes":17151,"groups":15,"sitemaps":89,"star":"partial","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended"]},{"rank":284,"domain":"reuters.com","host":"reuters.com","state":"ok","detail":"200","status":200,"final_host":"www.reuters.com","bytes":4605,"groups":3,"sitemaps":14,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["OAI-SearchBot","ChatGPT-User","Applebot-Extended"]},{"rank":285,"domain":"centinel-analytica.com","host":"centinel-analytica.com","state":"ok","detail":"200","status":200,"final_host":"www.centinelanalytica.com","bytes":1426,"groups":11,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","Applebot-Extended"],"content_signal":[{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"},{"search":"yes","ai-input":"yes","ai-train":"yes"}]},{"rank":286,"domain":"slack.com","host":"slack.com","state":"ok","detail":"200","status":200,"final_host":"slack.com","bytes":484,"groups":1,"sitemaps":3,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":287,"domain":"launchdarkly.com","host":"launchdarkly.com","state":"ok","detail":"200","status":200,"final_host":"launchdarkly.com","bytes":251,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":288,"domain":"launchpad.net","host":"launchpad.net","state":"ok","detail":"200","status":200,"final_host":"launchpad.net","bytes":1881,"groups":2,"sitemaps":0,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"],"content_signal":[{"ai-train":"no","search":"yes","ai-input":"no"}]},{"rank":289,"domain":"booking.com","host":"booking.com","state":"ok","detail":"200","status":200,"final_host":"booking.com","bytes":39602,"groups":13,"sitemaps":434,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":290,"domain":"telegram.me","host":"telegram.me","state":"html","detail":"200","status":200,"final_host":"telegram.org","bytes":19928},{"rank":291,"domain":"archive.ph","host":"archive.ph","state":"unreachable","detail":"timeout","status":null,"final_host":"archive.ph","bytes":0},{"rank":292,"domain":"app-analytics-services.com","host":"app-analytics-services.com","state":"missing","detail":"404","status":404,"final_host":"app-analytics-services.com","bytes":1571},{"rank":293,"domain":"myshopify.com","host":"myshopify.com","state":"missing","detail":"404","status":404,"final_host":"myshopify.com","bytes":22},{"rank":294,"domain":"nature.com","host":"nature.com","state":"ok","detail":"200","status":200,"final_host":"www.nature.com","bytes":2780,"groups":23,"sitemaps":5,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","ChatGPT-User","ClaudeBot","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":295,"domain":"www.gov.uk","host":"www.gov.uk","state":"ok","detail":"200","status":200,"final_host":"www.gov.uk","bytes":1097,"groups":5,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["meta-externalagent"]},{"rank":296,"domain":"tinyurl.com","host":"tinyurl.com","state":"ok","detail":"200","status":200,"final_host":"tinyurl.com","bytes":154,"groups":1,"sitemaps":3,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":297,"domain":"steampowered.com","host":"steampowered.com","state":"ok","detail":"200","status":200,"final_host":"store.steampowered.com","bytes":303,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":298,"domain":"canva.com","host":"canva.com","state":"ok","detail":"200","status":200,"final_host":"www.canva.com","bytes":6527,"groups":5,"sitemaps":2,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"allowed","Google-Extended":"partial","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","ClaudeBot","PerplexityBot","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":299,"domain":"ggpht.com","host":"ggpht.com","state":"unreachable","detail":"dns","status":null,"final_host":"ggpht.com","bytes":0},{"rank":300,"domain":"charter.net","host":"charter.net","state":"ok","detail":"200","status":200,"final_host":"www.spectrum.net","bytes":486,"groups":1,"sitemaps":2,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":301,"domain":"media-amazon.com","host":"media-amazon.com","state":"unreachable","detail":"dns","status":null,"final_host":"media-amazon.com","bytes":0},{"rank":302,"domain":"online-metrix.net","host":"online-metrix.net","state":"unreachable","detail":"dns","status":null,"final_host":"online-metrix.net","bytes":0},{"rank":303,"domain":"tiktokcdn-us.com","host":"tiktokcdn-us.com","state":"unreachable","detail":"dns","status":null,"final_host":"tiktokcdn-us.com","bytes":0},{"rank":304,"domain":"gamepass.com","host":"gamepass.com","state":"unreachable","detail":"tls","status":null,"final_host":"gamepass.com","bytes":0},{"rank":305,"domain":"wac-msedge.net","host":"wac-msedge.net","state":"unreachable","detail":"dns","status":null,"final_host":"wac-msedge.net","bytes":0},{"rank":306,"domain":"alibaba.com","host":"alibaba.com","state":"ok","detail":"200","status":200,"final_host":"www.alibaba.com","bytes":5406,"groups":6,"sitemaps":0,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"blocked","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","Google-Extended"]},{"rank":307,"domain":"manulife-sinochem.com","host":"manulife-sinochem.com","state":"unreachable","detail":"timeout","status":null,"final_host":"manulife-sinochem.com","bytes":0},{"rank":308,"domain":"grammarly.com","host":"grammarly.com","state":"ok","detail":"200","status":200,"final_host":"www.grammarly.com","bytes":289,"groups":1,"sitemaps":2,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":309,"domain":"springer.com","host":"springer.com","state":"ok","detail":"200","status":200,"final_host":"www.springer.com","bytes":286,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":310,"domain":"jsdelivr.net","host":"jsdelivr.net","state":"unreachable","detail":"timeout","status":null,"final_host":"jsdelivr.net","bytes":0},{"rank":311,"domain":"byteoversea.net","host":"byteoversea.net","state":"unreachable","detail":"dns","status":null,"final_host":"byteoversea.net","bytes":0},{"rank":312,"domain":"arubanetworks.com","host":"www.arubanetworks.com","state":"missing","detail":"403","status":403,"final_host":"www.arubanetworks.com","bytes":387},{"rank":313,"domain":"userapi.com","host":"userapi.com","state":"ok","detail":"200","status":200,"final_host":"vk.com","bytes":6175,"groups":3,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":314,"domain":"msftncsi.com","host":"msftncsi.com","state":"unreachable","detail":"dns","status":null,"final_host":"msftncsi.com","bytes":0},{"rank":315,"domain":"onelink.me","host":"onelink.me","state":"html","detail":"200","status":200,"final_host":"www.appsflyer.com","bytes":441434},{"rank":316,"domain":"miui.com","host":"miui.com","state":"missing","detail":"404","status":404,"final_host":"miui.com","bytes":169},{"rank":317,"domain":"crcdn.pro","host":"crcdn.pro","state":"unreachable","detail":"dns","status":null,"final_host":"crcdn.pro","bytes":0},{"rank":318,"domain":"cloudflareinsights.com","host":"cloudflareinsights.com","state":"html","detail":"200","status":200,"final_host":"cloudflareinsights.com","bytes":498},{"rank":319,"domain":"ip-api.com","host":"ip-api.com","state":"ok","detail":"200","status":200,"final_host":"ip-api.com","bytes":213,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":320,"domain":"avast.com","host":"avast.com","state":"missing","detail":"403","status":403,"final_host":"www.avast.com","bytes":381},{"rank":321,"domain":"wiley.com","host":"wiley.com","state":"html","detail":"200","status":200,"final_host":"www.wiley-vch.de","bytes":59979},{"rank":322,"domain":"douyincdn.com","host":"douyincdn.com","state":"unreachable","detail":"dns","status":null,"final_host":"douyincdn.com","bytes":0},{"rank":323,"domain":"anthropic.com","host":"anthropic.com","state":"ok","detail":"200","status":200,"final_host":"www.anthropic.com","bytes":71,"groups":1,"sitemaps":1,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":324,"domain":"debian.org","host":"debian.org","state":"missing","detail":"404","status":404,"final_host":"www.debian.org","bytes":7467},{"rank":325,"domain":"vungle.com","host":"vungle.com","state":"ok","detail":"200","status":200,"final_host":"vungle.com","bytes":82,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":326,"domain":"weibo.com","host":"weibo.com","state":"ok","detail":"200","status":200,"final_host":"weibo.com","bytes":968,"groups":4,"sitemaps":1,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["OAI-SearchBot","ChatGPT-User","Bytespider","meta-externalagent"],"content_signal":[{"search":"yes","ai-input":"yes","ai-train":"no"},{"search":"yes","ai-input":"yes","ai-train":"no"},{"search":"yes","ai-input":"yes","ai-train":"no"},{"search":"yes","ai-input":"yes","ai-train":"no"}]},{"rank":327,"domain":"heytapmobile.com","host":"heytapmobile.com","state":"unreachable","detail":"dns","status":null,"final_host":"heytapmobile.com","bytes":0},{"rank":328,"domain":"harvard.edu","host":"harvard.edu","state":"ok","detail":"200","status":200,"final_host":"www.harvard.edu","bytes":748,"groups":1,"sitemaps":10,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":329,"domain":"steamserver.net","host":"steamserver.net","state":"unreachable","detail":"dns","status":null,"final_host":"steamserver.net","bytes":0},{"rank":330,"domain":"amazon.co.uk","host":"amazon.co.uk","state":"ok","detail":"200","status":200,"final_host":"www.amazon.co.uk","bytes":7258,"groups":101,"sitemaps":0,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":331,"domain":"autodesk.com","host":"autodesk.com","state":"missing","detail":"403","status":403,"final_host":"www.autodesk.com","bytes":382},{"rank":332,"domain":"vercel-dns-016.com","host":"www.vercel-dns-016.com","state":"missing","detail":"404","status":404,"final_host":"www.vercel-dns-016.com","bytes":107},{"rank":333,"domain":"rubiconproject.com","host":"rubiconproject.com","state":"ok","detail":"200","status":200,"final_host":"www.rubiconproject.com","bytes":189,"groups":1,"sitemaps":1,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":334,"domain":"casalemedia.com","host":"casalemedia.com","state":"html","detail":"200","status":200,"final_host":"www.indexexchange.com","bytes":111385},{"rank":335,"domain":"archive.is","host":"archive.is","state":"unreachable","detail":"timeout","status":null,"final_host":"archive.is","bytes":0},{"rank":336,"domain":"zendesk.com","host":"zendesk.com","state":"ok","detail":"200","status":200,"final_host":"www.zendesk.com","bytes":1028,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":337,"domain":"telecid.ru","host":"www.telecid.ru","state":"missing","detail":"403","status":403,"final_host":"www.telecid.ru","bytes":146},{"rank":338,"domain":"volcfcdndvs.com","host":"volcfcdndvs.com","state":"unreachable","detail":"dns","status":null,"final_host":"volcfcdndvs.com","bytes":0},{"rank":339,"domain":"etsy.com","host":"etsy.com","state":"ok","detail":"200","status":200,"final_host":"www.etsy.com","bytes":52811,"groups":3,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":340,"domain":"ok.ru","host":"ok.ru","state":"ok","detail":"200","status":200,"final_host":"ok.ru","bytes":6051,"groups":1,"sitemaps":17,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":341,"domain":"gmail.com","host":"gmail.com","state":"ok","detail":"200","status":200,"final_host":"gmail.com","bytes":129,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":342,"domain":"unisys.com","host":"unisys.com","state":"ok","detail":"200","status":200,"final_host":"www.unisys.com","bytes":473,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":343,"domain":"espn.com","host":"espn.com","state":"ok","detail":"200","status":200,"final_host":"www.espn.com","bytes":3223,"groups":11,"sitemaps":1,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"blocked","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"blocked","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"partial"},"named":["GPTBot","ChatGPT-User","Google-Extended","CCBot","Bytespider"]},{"rank":344,"domain":"php.net","host":"php.net","state":"ok","detail":"200","status":200,"final_host":"www.php.net","bytes":292,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":345,"domain":"clarity.ms","host":"www.clarity.ms","state":"missing","detail":"404","status":404,"final_host":"www.clarity.ms","bytes":0},{"rank":346,"domain":"nflxvideo.net","host":"nflxvideo.net","state":"unreachable","detail":"tls","status":null,"final_host":"nflxvideo.net","bytes":0},{"rank":347,"domain":"mi.com","host":"mi.com","state":"missing","detail":"403","status":403,"final_host":"www.mi.com","bytes":378},{"rank":348,"domain":"smartadserver.com","host":"smartadserver.com","state":"html","detail":"200","status":200,"final_host":"www.equativ.com","bytes":142465},{"rank":349,"domain":"naver.com","host":"naver.com","state":"ok","detail":"200","status":200,"final_host":"www.naver.com","bytes":91,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":350,"domain":"imcmdb.net","host":"imcmdb.net","state":"unreachable","detail":"timeout","status":null,"final_host":"imcmdb.net","bytes":0},{"rank":351,"domain":"plex.direct","host":"plex.direct","state":"unreachable","detail":"refused","status":null,"final_host":"plex.direct","bytes":0},{"rank":352,"domain":"bilibili.com","host":"bilibili.com","state":"ok","detail":"200","status":200,"final_host":"www.bilibili.com","bytes":430,"groups":2,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":353,"domain":"trustpilot.com","host":"trustpilot.com","state":"ok","detail":"200","status":200,"final_host":"www.trustpilot.com","bytes":25101,"groups":46,"sitemaps":3,"star":"blocked","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"blocked","CCBot":"partial","Bytespider":"blocked","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":354,"domain":"ea.com","host":"ea.com","state":"ok","detail":"200","status":200,"final_host":"www.ea.com","bytes":1904,"groups":8,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["Bytespider","meta-externalagent"]},{"rank":355,"domain":"pubmatic.com","host":"pubmatic.com","state":"missing","detail":"403","status":403,"final_host":"pubmatic.com","bytes":919},{"rank":356,"domain":"paloaltonetworks.com","host":"paloaltonetworks.com","state":"ok","detail":"200","status":200,"final_host":"www.paloaltonetworks.com","bytes":7701,"groups":3,"sitemaps":5,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["OAI-SearchBot","ChatGPT-User","Claude-SearchBot","Claude-User","PerplexityBot"]},{"rank":357,"domain":"gnu.org","host":"gnu.org","state":"ok","detail":"200","status":200,"final_host":"www.gnu.org","bytes":2862,"groups":27,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":358,"domain":"branch.io","host":"branch.io","state":"ok","detail":"200","status":200,"final_host":"www.branch.io","bytes":1783,"groups":8,"sitemaps":1,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"partial","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":["GPTBot","ClaudeBot","PerplexityBot","Google-Extended","Applebot-Extended","CCBot"]},{"rank":359,"domain":"tp-link.com","host":"tp-link.com","state":"ok","detail":"200","status":200,"final_host":"www.tp-link.com","bytes":544,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":360,"domain":"tradingview.com","host":"tradingview.com","state":"ok","detail":"200","status":200,"final_host":"www.tradingview.com","bytes":1153,"groups":4,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["OAI-SearchBot","ChatGPT-User","ClaudeBot","PerplexityBot","Google-Extended","Applebot-Extended","Bytespider","meta-externalagent"]},{"rank":361,"domain":"nvidia.com","host":"nvidia.com","state":"ok","detail":"200","status":200,"final_host":"www.nvidia.com","bytes":3725,"groups":2,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[],"content_signal":[{"ai-train":"yes","search":"yes","ai-input":"yes"}]},{"rank":362,"domain":"weebly.com","host":"weebly.com","state":"ok","detail":"200","status":200,"final_host":"www.weebly.com","bytes":777,"groups":2,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":363,"domain":"checkpoint.com","host":"checkpoint.com","state":"ok","detail":"200","status":200,"final_host":"www.checkpoint.com","bytes":1918,"groups":14,"sitemaps":1,"star":"partial","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"partial","CCBot":"allowed","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","PerplexityBot","Google-Extended","CCBot"]},{"rank":364,"domain":"dell.com","host":"dell.com","state":"ok","detail":"200","status":200,"final_host":"www.dell.com","bytes":28897,"groups":9,"sitemaps":9,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["Bytespider"]},{"rank":365,"domain":"cdc.gov","host":"cdc.gov","state":"ok","detail":"200","status":200,"final_host":"www.cdc.gov","bytes":1699,"groups":4,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":366,"domain":"okta.com","host":"okta.com","state":"ok","detail":"200","status":200,"final_host":"www.okta.com","bytes":2518,"groups":1,"sitemaps":24,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":367,"domain":"aliyun.com","host":"aliyun.com","state":"ok","detail":"200","status":200,"final_host":"www.aliyun.com","bytes":626,"groups":2,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","ClaudeBot","CCBot"]},{"rank":368,"domain":"grammarly.io","host":"grammarly.io","state":"unreachable","detail":"dns","status":null,"final_host":"grammarly.io","bytes":0},{"rank":369,"domain":"dotomi.com","host":"dotomi.com","state":"html","detail":"200","status":200,"final_host":"www.epsilon.com","bytes":303555},{"rank":370,"domain":"un.org","host":"un.org","state":"ok","detail":"200","status":200,"final_host":"www.un.org","bytes":2226,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":371,"domain":"browser-intake-datadoghq.com","host":"browser-intake-datadoghq.com","state":"missing","detail":"403","status":403,"final_host":"browser-intake-datadoghq.com","bytes":56},{"rank":372,"domain":"worldnic.com","host":"worldnic.com","state":"unreachable","detail":"timeout","status":null,"final_host":"worldnic.com","bytes":0},{"rank":373,"domain":"cm.com","host":"cm.com","state":"ok","detail":"200","status":200,"final_host":"www.cm.com","bytes":63,"groups":1,"sitemaps":1,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":374,"domain":"wsj.com","host":"wsj.com","state":"ok","detail":"200","status":200,"final_host":"www.wsj.com","bytes":4320,"groups":2,"sitemaps":12,"star":"blocked","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User"]},{"rank":375,"domain":"cdnbuild.net","host":"cdnbuild.net","state":"unreachable","detail":"dns","status":null,"final_host":"cdnbuild.net","bytes":0},{"rank":376,"domain":"google.cn","host":"google.cn","state":"missing","detail":"404","status":404,"final_host":"google.cn","bytes":1571},{"rank":377,"domain":"on.aws","host":"on.aws","state":"unreachable","detail":"dns","status":null,"final_host":"on.aws","bytes":0},{"rank":378,"domain":"bsky.app","host":"bsky.app","state":"ok","detail":"200","status":200,"final_host":"bsky.app","bytes":441,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":379,"domain":"dynatrace.com","host":"dynatrace.com","state":"ok","detail":"200","status":200,"final_host":"www.dynatrace.com","bytes":319,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":380,"domain":"amazon.de","host":"amazon.de","state":"ok","detail":"200","status":200,"final_host":"www.amazon.de","bytes":7508,"groups":102,"sitemaps":0,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":381,"domain":"gitlab.com","host":"gitlab.com","state":"ok","detail":"200","status":200,"final_host":"gitlab.com","bytes":3230,"groups":4,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":382,"domain":"elasticbeanstalk.com","host":"elasticbeanstalk.com","state":"unreachable","detail":"timeout","status":null,"final_host":"elasticbeanstalk.com","bytes":0},{"rank":383,"domain":"chatgpt.site","host":"chatgpt.site","state":"html","detail":"200","status":200,"final_host":"chatgpt.com","bytes":512000},{"rank":384,"domain":"netease.com","host":"www.netease.com","state":"missing","detail":"404","status":404,"final_host":"www.netease.com","bytes":2426},{"rank":385,"domain":"atlassian.net","host":"atlassian.net","state":"ok","detail":"200","status":200,"final_host":"atlassian.net","bytes":347,"groups":2,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":386,"domain":"stanford.edu","host":"stanford.edu","state":"ok","detail":"200","status":200,"final_host":"www.stanford.edu","bytes":219,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":387,"domain":"shopifysvc.com","host":"shopifysvc.com","state":"unreachable","detail":"dns","status":null,"final_host":"shopifysvc.com","bytes":0},{"rank":388,"domain":"dns.google","host":"dns.google","state":"missing","detail":"404","status":404,"final_host":"dns.google","bytes":1571},{"rank":389,"domain":"name.com","host":"name.com","state":"ok","detail":"200","status":200,"final_host":"www.name.com","bytes":1986,"groups":3,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"blocked"},"named":["meta-externalagent"]},{"rank":390,"domain":"allawnos.com","host":"allawnos.com","state":"unreachable","detail":"dns","status":null,"final_host":"allawnos.com","bytes":0},{"rank":391,"domain":"globo.com","host":"globo.com","state":"ok","detail":"200","status":200,"final_host":"www.globo.com","bytes":408,"groups":4,"sitemaps":1,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"blocked","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","Google-Extended","CCBot"]},{"rank":392,"domain":"wps.com","host":"wps.com","state":"ok","detail":"200","status":200,"final_host":"www.wps.com","bytes":666,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":393,"domain":"issuu.com","host":"issuu.com","state":"ok","detail":"200","status":200,"final_host":"issuu.com","bytes":4280,"groups":47,"sitemaps":11,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":394,"domain":"myhuaweicloud.com","host":"myhuaweicloud.com","state":"unreachable","detail":"dns","status":null,"final_host":"myhuaweicloud.com","bytes":0},{"rank":395,"domain":"nasa.gov","host":"nasa.gov","state":"ok","detail":"200","status":200,"final_host":"www.nasa.gov","bytes":69,"groups":2,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":396,"domain":"opendns.com","host":"opendns.com","state":"ok","detail":"200","status":200,"final_host":"www.opendns.com","bytes":24,"groups":1,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":397,"domain":"go.com","host":"go.com","state":"ok","detail":"200","status":200,"final_host":"www.go.com","bytes":212,"groups":3,"sitemaps":1,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"blocked","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","Google-Extended"]},{"rank":398,"domain":"xboxlive.com","host":"xboxlive.com","state":"unreachable","detail":"tls","status":null,"final_host":"xboxlive.com","bytes":0},{"rank":399,"domain":"bloomberg.com","host":"bloomberg.com","state":"ok","detail":"200","status":200,"final_host":"www.bloomberg.com","bytes":8033,"groups":22,"sitemaps":10,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":400,"domain":"adnxs.com","host":"adnxs.com","state":"missing","detail":"404","status":404,"final_host":"adnxs.com","bytes":153},{"rank":401,"domain":"tiktokv.us","host":"tiktokv.us","state":"unreachable","detail":"dns","status":null,"final_host":"tiktokv.us","bytes":0},{"rank":402,"domain":"live-video.net","host":"live-video.net","state":"missing","detail":"403","status":403,"final_host":"live-video.net","bytes":111},{"rank":403,"domain":"cookiedatabase.org","host":"cookiedatabase.org","state":"ok","detail":"200","status":200,"final_host":"cookiedatabase.org","bytes":177,"groups":1,"sitemaps":2,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":[]},{"rank":404,"domain":"awsglobalaccelerator.com","host":"awsglobalaccelerator.com","state":"unreachable","detail":"dns","status":null,"final_host":"awsglobalaccelerator.com","bytes":0},{"rank":405,"domain":"plesk.com","host":"plesk.com","state":"ok","detail":"200","status":200,"final_host":"www.plesk.com","bytes":101,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":406,"domain":"samsungcloudsolution.com","host":"samsungcloudsolution.com","state":"unreachable","detail":"dns","status":null,"final_host":"samsungcloudsolution.com","bytes":0},{"rank":407,"domain":"washingtonpost.com","host":"washingtonpost.com","state":"ok","detail":"200","status":200,"final_host":"www.washingtonpost.com","bytes":5804,"groups":35,"sitemaps":7,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"blocked","Google-Extended":"partial","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["ClaudeBot","PerplexityBot","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":408,"domain":"githubusercontent.com","host":"www.githubusercontent.com","state":"unreachable","detail":"500","status":500,"final_host":"www.githubusercontent.com","bytes":296},{"rank":409,"domain":"amazontrust.com","host":"amazontrust.com","state":"missing","detail":"404","status":404,"final_host":"www.amazontrust.com","bytes":13315},{"rank":410,"domain":"impervadns.net","host":"impervadns.net","state":"unreachable","detail":"dns","status":null,"final_host":"impervadns.net","bytes":0},{"rank":411,"domain":"withgoogle.com","host":"withgoogle.com","state":"html","detail":"200","status":200,"final_host":"www.google.com","bytes":86890},{"rank":412,"domain":"spov-msedge.net","host":"spov-msedge.net","state":"unreachable","detail":"dns","status":null,"final_host":"spov-msedge.net","bytes":0},{"rank":413,"domain":"claude.ai","host":"claude.ai","state":"ok","detail":"200","status":200,"final_host":"claude.ai","bytes":281,"groups":3,"sitemaps":1,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"blocked","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","Google-Extended"]},{"rank":414,"domain":"ibyteimg.com","host":"ibyteimg.com","state":"unreachable","detail":"dns","status":null,"final_host":"ibyteimg.com","bytes":0},{"rank":415,"domain":"spotifycdn.com","host":"www.spotifycdn.com","state":"missing","detail":"404","status":404,"final_host":"www.spotifycdn.com","bytes":0},{"rank":416,"domain":"yandex.com","host":"yandex.com","state":"ok","detail":"200","status":200,"final_host":"yandex.com","bytes":21167,"groups":4,"sitemaps":12,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":417,"domain":"scdn.co","host":"www.scdn.co","state":"missing","detail":"404","status":404,"final_host":"www.scdn.co","bytes":0},{"rank":418,"domain":"capcutapi.com","host":"capcutapi.com","state":"unreachable","detail":"dns","status":null,"final_host":"capcutapi.com","bytes":0},{"rank":419,"domain":"firetvcaptiveportal.com","host":"firetvcaptiveportal.com","state":"unreachable","detail":"timeout","status":null,"final_host":"firetvcaptiveportal.com","bytes":0},{"rank":420,"domain":"calendly.com","host":"calendly.com","state":"ok","detail":"200","status":200,"final_host":"calendly.com","bytes":335,"groups":3,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"partial","meta-externalagent":"partial"},"named":["CCBot"]},{"rank":421,"domain":"adobe.net","host":"adobe.net","state":"unreachable","detail":"tls","status":null,"final_host":"adobe.net","bytes":0},{"rank":422,"domain":"gcdn.co","host":"gcdn.co","state":"unreachable","detail":"tls","status":null,"final_host":"gcdn.co","bytes":0},{"rank":423,"domain":"substack.com","host":"substack.com","state":"ok","detail":"200","status":200,"final_host":"substack.com","bytes":585,"groups":4,"sitemaps":2,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":424,"domain":"duckduckgo.com","host":"duckduckgo.com","state":"ok","detail":"200","status":200,"final_host":"duckduckgo.com","bytes":757,"groups":2,"sitemaps":2,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":425,"domain":"163.com","host":"163.com","state":"ok","detail":"200","status":200,"final_host":"www.163.com","bytes":225,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":426,"domain":"aol.com","host":"aol.com","state":"ok","detail":"200","status":200,"final_host":"www.aol.com","bytes":2827,"groups":44,"sitemaps":4,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"blocked","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"partial"},"named":["GPTBot","ChatGPT-User","ClaudeBot","PerplexityBot","Google-Extended","CCBot","Bytespider"]},{"rank":427,"domain":"line.me","host":"line.me","state":"ok","detail":"200","status":200,"final_host":"line.me","bytes":454,"groups":3,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":428,"domain":"indeed.com","host":"indeed.com","state":"ok","detail":"200","status":200,"final_host":"www.indeed.com","bytes":13731,"groups":9,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","Applebot-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":429,"domain":"temu.com","host":"temu.com","state":"ok","detail":"200","status":200,"final_host":"www.temu.com","bytes":8239,"groups":5,"sitemaps":1,"star":"allowed","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"blocked","meta-externalagent":"allowed"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","Bytespider"]},{"rank":430,"domain":"steamcommunity.com","host":"steamcommunity.com","state":"ok","detail":"200","status":200,"final_host":"steamcommunity.com","bytes":141,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":431,"domain":"unsplash.com","host":"unsplash.com","state":"ok","detail":"200","status":200,"final_host":"unsplash.com","bytes":8472,"groups":12,"sitemaps":31,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"blocked","meta-externalagent":"partial"},"named":["ClaudeBot","Claude-SearchBot","Bytespider"]},{"rank":432,"domain":"ripn.net","host":"ripn.net","state":"unreachable","detail":"dns","status":null,"final_host":"ripn.net","bytes":0},{"rank":433,"domain":"expireddomains.com","host":"expireddomains.com","state":"ok","detail":"200","status":200,"final_host":"expireddomains.com","bytes":172,"groups":3,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":434,"domain":"spaceweb.pro","host":"spaceweb.pro","state":"unreachable","detail":"refused","status":null,"final_host":"spaceweb.pro","bytes":0},{"rank":435,"domain":"kwai-pro.com","host":"www.kwai-pro.com","state":"missing","detail":"404","status":404,"final_host":"www.kwai-pro.com","bytes":578},{"rank":436,"domain":"tiktokcdn-eu.com","host":"tiktokcdn-eu.com","state":"unreachable","detail":"dns","status":null,"final_host":"tiktokcdn-eu.com","bytes":0},{"rank":437,"domain":"telekom.de","host":"telekom.de","state":"ok","detail":"200","status":200,"final_host":"www.telekom.de","bytes":151,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":438,"domain":"tencent-cloud.net","host":"tencent-cloud.net","state":"unreachable","detail":"EHOSTUNREACH","status":null,"final_host":"tencent-cloud.net","bytes":0},{"rank":439,"domain":"sberbank.ru","host":"sberbank.ru","state":"unreachable","detail":"tls","status":null,"final_host":"sberbank.ru","bytes":0},{"rank":440,"domain":"netcraze.io","host":"netcraze.io","state":"ok","detail":"200","status":200,"final_host":"netcraze.io","bytes":25,"groups":1,"sitemaps":0,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":[]},{"rank":441,"domain":"tiktokv.eu","host":"tiktokv.eu","state":"unreachable","detail":"dns","status":null,"final_host":"tiktokv.eu","bytes":0},{"rank":442,"domain":"dailymotion.com","host":"dailymotion.com","state":"ok","detail":"200","status":200,"final_host":"www.dailymotion.com","bytes":18276,"groups":7,"sitemaps":9,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":443,"domain":"beian.gov.cn","host":"beian.gov.cn","state":"unreachable","detail":"dns","status":null,"final_host":"beian.gov.cn","bytes":0},{"rank":444,"domain":"heytapdl.com","host":"heytapdl.com","state":"unreachable","detail":"dns","status":null,"final_host":"heytapdl.com","bytes":0},{"rank":445,"domain":"twimg.com","host":"twimg.com","state":"unreachable","detail":"dns","status":null,"final_host":"twimg.com","bytes":0},{"rank":446,"domain":"adobedc.net","host":"adobedc.net","state":"unreachable","detail":"dns","status":null,"final_host":"adobedc.net","bytes":0},{"rank":447,"domain":"vkuser.net","host":"vkuser.net","state":"unreachable","detail":"timeout","status":null,"final_host":"vkuser.net","bytes":0},{"rank":448,"domain":"bluehost.com","host":"bluehost.com","state":"missing","detail":"403","status":403,"final_host":"www.bluehost.com","bytes":447220},{"rank":449,"domain":"nr-data.net","host":"nr-data.net","state":"unreachable","detail":"dns","status":null,"final_host":"nr-data.net","bytes":0},{"rank":450,"domain":"tiktokpangle.us","host":"tiktokpangle.us","state":"unreachable","detail":"dns","status":null,"final_host":"tiktokpangle.us","bytes":0},{"rank":451,"domain":"statsigapi.net","host":"statsigapi.net","state":"missing","detail":"403","status":403,"final_host":"statsigapi.net","bytes":19},{"rank":452,"domain":"myqcloud.com","host":"myqcloud.com","state":"unreachable","detail":"EHOSTUNREACH","status":null,"final_host":"myqcloud.com","bytes":0},{"rank":453,"domain":"vercel-dns-017.com","host":"www.vercel-dns-017.com","state":"missing","detail":"404","status":404,"final_host":"www.vercel-dns-017.com","bytes":107},{"rank":454,"domain":"intel.com","host":"intel.com","state":"ok","detail":"200","status":200,"final_host":"www.intel.com","bytes":4211,"groups":31,"sitemaps":1,"star":"partial","bots":{"GPTBot":"allowed","OAI-SearchBot":"partial","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","ChatGPT-User","ClaudeBot","PerplexityBot","Google-Extended"]},{"rank":455,"domain":"arxiv.org","host":"arxiv.org","state":"ok","detail":"200","status":200,"final_host":"arxiv.org","bytes":5854,"groups":10,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":456,"domain":"alicdn.com","host":"alicdn.com","state":"unreachable","detail":"timeout","status":null,"final_host":"alicdn.com","bytes":0},{"rank":457,"domain":"aliexpress.com","host":"aliexpress.com","state":"ok","detail":"200","status":200,"final_host":"www.aliexpress.com","bytes":3025,"groups":9,"sitemaps":8,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"blocked","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"partial"},"named":["GPTBot","ClaudeBot","Google-Extended","CCBot","Bytespider"]},{"rank":458,"domain":"nexthink.cloud","host":"nexthink.cloud","state":"unreachable","detail":"dns","status":null,"final_host":"nexthink.cloud","bytes":0},{"rank":459,"domain":"drom.ru","host":"drom.ru","state":"ok","detail":"200","status":200,"final_host":"www.drom.ru","bytes":10797,"groups":6,"sitemaps":24,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":460,"domain":"hostgator.com","host":"hostgator.com","state":"missing","detail":"403","status":403,"final_host":"www.hostgator.com","bytes":387783},{"rank":461,"domain":"eye4.cn","host":"eye4.cn","state":"unreachable","detail":"500","status":500,"final_host":"eye4.cn","bytes":592},{"rank":462,"domain":"run.app","host":"run.app","state":"missing","detail":"404","status":404,"final_host":"run.app","bytes":1571},{"rank":463,"domain":"taobao.com","host":"taobao.com","state":"ok","detail":"200","status":200,"final_host":"www.taobao.com","bytes":71,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":464,"domain":"mangosip.ru","host":"mangosip.ru","state":"unreachable","detail":"timeout","status":null,"final_host":"mangosip.ru","bytes":0},{"rank":465,"domain":"netangels.ru","host":"netangels.ru","state":"ok","detail":"200","status":200,"final_host":"www.netangels.ru","bytes":1992,"groups":2,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":466,"domain":"lijit.com","host":"lijit.com","state":"missing","detail":"403","status":403,"final_host":"lijit.com","bytes":111},{"rank":467,"domain":"g.page","host":"g.page","state":"html","detail":"200","status":200,"final_host":"www.google.com","bytes":93062},{"rank":468,"domain":"yahoo.co.jp","host":"yahoo.co.jp","state":"missing","detail":"403","status":403,"final_host":"www.yahoo.co.jp","bytes":10051},{"rank":469,"domain":"gandi-ns.fr","host":"gandi-ns.fr","state":"unreachable","detail":"dns","status":null,"final_host":"gandi-ns.fr","bytes":0},{"rank":470,"domain":"pixabay.com","host":"pixabay.com","state":"ok","detail":"200","status":200,"final_host":"pixabay.com","bytes":3248,"groups":2,"sitemaps":1,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"partial"},"named":["GPTBot","ClaudeBot","Google-Extended","Applebot-Extended","CCBot","Bytespider"]},{"rank":471,"domain":"dropcatch.com","host":"dropcatch.com","state":"html","detail":"200","status":200,"final_host":"www.dropcatch.com","bytes":104198},{"rank":472,"domain":"mcafee.com","host":"mcafee.com","state":"unreachable","detail":"timeout","status":null,"final_host":"www.mcafee.com","bytes":0},{"rank":473,"domain":"featureassets.org","host":"featureassets.org","state":"missing","detail":"403","status":403,"final_host":"featureassets.org","bytes":19},{"rank":474,"domain":"nmrodam.com","host":"nmrodam.com","state":"unreachable","detail":"dns","status":null,"final_host":"nmrodam.com","bytes":0},{"rank":475,"domain":"mzstatic.com","host":"mzstatic.com","state":"html","detail":"200","status":200,"final_host":"www.apple.com","bytes":254917},{"rank":476,"domain":"prodregistryv2.org","host":"prodregistryv2.org","state":"missing","detail":"404","status":404,"final_host":"prodregistryv2.org","bytes":18},{"rank":477,"domain":"pushy.io","host":"pushy.io","state":"missing","detail":"404","status":404,"final_host":"pushy.me","bytes":11964},{"rank":478,"domain":"duolingo.com","host":"duolingo.com","state":"ok","detail":"200","status":200,"final_host":"www.duolingo.com","bytes":826,"groups":3,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":479,"domain":"speedtest.net","host":"speedtest.net","state":"ok","detail":"200","status":200,"final_host":"www.speedtest.net","bytes":247,"groups":2,"sitemaps":0,"star":"allowed","bots":{"GPTBot":"allowed","OAI-SearchBot":"allowed","ChatGPT-User":"allowed","ClaudeBot":"allowed","Claude-SearchBot":"allowed","Claude-User":"allowed","PerplexityBot":"allowed","Google-Extended":"allowed","Applebot-Extended":"allowed","CCBot":"allowed","Bytespider":"allowed","meta-externalagent":"allowed"},"named":[]},{"rank":480,"domain":"azure-dns.com","host":"azure-dns.com","state":"unreachable","detail":"dns","status":null,"final_host":"azure-dns.com","bytes":0},{"rank":481,"domain":"huawei.com","host":"huawei.com","state":"missing","detail":"403","status":403,"final_host":"www.huawei.com","bytes":380},{"rank":482,"domain":"shein.com","host":"shein.com","state":"ok","detail":"200","status":200,"final_host":"www.shein.com","bytes":279,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":483,"domain":"trendmicro.com","host":"trendmicro.com","state":"ok","detail":"200","status":200,"final_host":"www.trendmicro.com","bytes":2211,"groups":4,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":["OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","CCBot","Bytespider","meta-externalagent"],"content_signal":[{"search":"yes","ai-input":"yes","ai-train":"no"},{"search":"yes","ai-input":"yes","ai-train":"no"}]},{"rank":484,"domain":"walmart.com","host":"walmart.com","state":"ok","detail":"200","status":200,"final_host":"www.walmart.com","bytes":3479,"groups":2,"sitemaps":32,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":485,"domain":"dyndns.org","host":"dyndns.org","state":"html","detail":"200","status":200,"final_host":"account.dyn.com","bytes":34160},{"rank":486,"domain":"cnbc.com","host":"cnbc.com","state":"missing","detail":"404","status":404,"final_host":"cnbc.com","bytes":19},{"rank":487,"domain":"kwai.net","host":"www.kwai.net","state":"ok","detail":"200","status":200,"final_host":"www.kwai.net","bytes":305,"groups":9,"sitemaps":0,"star":"blocked","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"blocked","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":[]},{"rank":488,"domain":"dual-s-msedge.net","host":"dual-s-msedge.net","state":"unreachable","detail":"dns","status":null,"final_host":"dual-s-msedge.net","bytes":0},{"rank":489,"domain":"businessinsider.com","host":"businessinsider.com","state":"ok","detail":"200","status":200,"final_host":"www.businessinsider.com","bytes":2231,"groups":13,"sitemaps":7,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"partial"},"named":["ClaudeBot","CCBot","Bytespider"]},{"rank":490,"domain":"goodreads.com","host":"goodreads.com","state":"ok","detail":"200","status":200,"final_host":"www.goodreads.com","bytes":2647,"groups":8,"sitemaps":16,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"partial","meta-externalagent":"partial"},"named":["GPTBot","CCBot"]},{"rank":491,"domain":"bx-msedge.net","host":"bx-msedge.net","state":"unreachable","detail":"dns","status":null,"final_host":"bx-msedge.net","bytes":0},{"rank":492,"domain":"visualstudio.com","host":"visualstudio.com","state":"ok","detail":"200","status":200,"final_host":"visualstudio.microsoft.com","bytes":234,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":493,"domain":"wp.com","host":"wp.com","state":"ok","detail":"200","status":200,"final_host":"wordpress.com","bytes":1387,"groups":1,"sitemaps":5,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":494,"domain":"ietf.org","host":"ietf.org","state":"ok","detail":"200","status":200,"final_host":"www.ietf.org","bytes":51,"groups":1,"sitemaps":0,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":495,"domain":"facebook.net","host":"facebook.net","state":"unreachable","detail":"dns","status":null,"final_host":"facebook.net","bytes":0},{"rank":496,"domain":"braze.com","host":"braze.com","state":"ok","detail":"200","status":200,"final_host":"braze.com","bytes":129,"groups":1,"sitemaps":1,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"partial","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"partial","Bytespider":"partial","meta-externalagent":"partial"},"named":[]},{"rank":497,"domain":"kaspersky-labs.com","host":"kaspersky-labs.com","state":"unreachable","detail":"refused","status":null,"final_host":"kaspersky-labs.com","bytes":0},{"rank":498,"domain":"scribd.com","host":"scribd.com","state":"ok","detail":"200","status":200,"final_host":"www.scribd.com","bytes":3518,"groups":9,"sitemaps":10,"star":"partial","bots":{"GPTBot":"partial","OAI-SearchBot":"partial","ChatGPT-User":"partial","ClaudeBot":"blocked","Claude-SearchBot":"partial","Claude-User":"partial","PerplexityBot":"partial","Google-Extended":"partial","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"partial"},"named":["ClaudeBot","CCBot","Bytespider"]},{"rank":499,"domain":"amazon.co.jp","host":"amazon.co.jp","state":"ok","detail":"200","status":200,"final_host":"www.amazon.co.jp","bytes":10234,"groups":101,"sitemaps":0,"star":"partial","bots":{"GPTBot":"blocked","OAI-SearchBot":"blocked","ChatGPT-User":"blocked","ClaudeBot":"blocked","Claude-SearchBot":"blocked","Claude-User":"blocked","PerplexityBot":"blocked","Google-Extended":"blocked","Applebot-Extended":"partial","CCBot":"blocked","Bytespider":"blocked","meta-externalagent":"blocked"},"named":["GPTBot","OAI-SearchBot","ChatGPT-User","ClaudeBot","Claude-SearchBot","Claude-User","PerplexityBot","Google-Extended","CCBot","Bytespider","meta-externalagent"]},{"rank":500,"domain":"bunnyinfra.net","host":"bunnyinfra.net","state":"unreachable","detail":"dns","status":null,"final_host":"bunnyinfra.net","bytes":0}]}
