{"id":"llms-txt-2026-11","title":"llms.txt and llms-full.txt on the Tranco top 500 domains","publisher":"Autoranko (https://autoranko.com/blog/llms-txt-adoption-top-500-sites)","collected":{"started":"2026-11-08T02:10:22.210Z","finished":"2026-11-08T02:12:30.886Z"},"source":{"list":"Tranco","list_id":"94P72","url":"https://tranco-list.eu/list/94P72/1000000","created_on":"2026-11-07","window":["2026-10-09","2026-11-07"],"providers":["CrUX","Farsight","Majestic","Cloudflare Radar","Cisco Umbrella"],"combination":"Dowdall rule, pay-level domains only","top":500,"citation":"Victor Le Pochat, Tom Van Goethem, Samaneh Tajalizadehkhoob, Maciej Korczyński, and Wouter Joosen. 2019. Tranco: A Research-Oriented Top Sites Ranking Hardened Against Manipulation. In Proceedings of the 26th Annual Network and Distributed System Security Symposium (NDSS 2019). https://doi.org/10.14722/ndss.2019.23386"},"crawler":{"user_agent":"AutorankoResearch/1.0 (+https://autoranko.com/blog)","concurrency":8,"timeout_ms":8000,"max_redirects":5,"runtime":"Node.js v24.0.2"},"method":["Same 500 domains and the same run as the AI crawler dataset (robots.txt first).","Requested /llms.txt and /llms-full.txt on the host that answered robots.txt, only when that robots.txt allowed our user agent (which no file names, so the * group applied) to fetch them. Domains whose robots.txt was unreachable were not requested, as RFC 9309 asks.","Accept: text/plain, text/markdown, */*;q=0.5. Up to 5 redirects, 8-second timeout, at most 2 MiB read for llms.txt and 5 MiB for llms-full.txt.","Classified each answer: file = 2xx, not HTML, non-empty, at a path that still ends in /llms.txt (or /llms-full.txt) after redirects; html = an HTML page (soft 404, login or home page); elsewhere = redirected to another path; missing = 4xx; error = 5xx, 429 or a network failure.","Validated every llms.txt file with Autoranko's llms.txt validator (lib/tools/llms-txt.ts, following llmstxt.org): an H1 title first (the only required part), a > summary, H2 sections listing [name](url) links, absolute URLs, no duplicates, an optional 'Optional' section, under 100 KB."],"limits":["llms.txt is a proposal (llmstxt.org), not a standard. Finding a file says nothing about whether any AI system reads it.","One request per file, one location (Europe), one user agent; files behind bot protection or served only to some agents are missed.","Only the root location is checked. Files published elsewhere (for example docs.example.com/llms.txt) are not counted unless the root redirects to them.","Sizes above the read limit are recorded as the limit (truncated: true)."],"domains":[{"rank":1,"domain":"google.com","host":"google.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://google.com/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://google.com/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":2,"domain":"cloudflare.com","host":"cloudflare.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.cloudflare.com/llms.txt","bytes":17173,"truncated":false,"content_type":"text/plain","h1":true,"title":"Cloudflare","summary":true,"sections":13,"links":90,"malformed_items":16,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":true,"md_links":82,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://www.cloudflare.com/llms-full.txt","bytes":169547,"truncated":false,"content_type":"text/plain","starts_with_heading":true}},{"rank":3,"domain":"ezviz7.com","host":"ezviz7.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":4,"domain":"amazonaws.com","host":"amazonaws.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://aws.amazon.com/llms.txt","bytes":300543,"truncated":false,"content_type":"text/html;charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://aws.amazon.com/llms-full.txt","bytes":300543,"truncated":false,"content_type":"text/html;charset=UTF-8","starts_with_heading":null}},{"rank":5,"domain":"facebook.com","host":"facebook.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":6,"domain":"fbcdn.net","host":"fbcdn.net","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":7,"domain":"gstatic.com","host":"gstatic.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":8,"domain":"googleapis.com","host":"googleapis.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://googleapis.com/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://googleapis.com/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":9,"domain":"hicloudcam.com","host":"www.hicloudcam.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.hicloudcam.com/llms.txt","bytes":321,"truncated":false,"content_type":"text/html;charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.hicloudcam.com/llms-full.txt","bytes":321,"truncated":false,"content_type":"text/html;charset=UTF-8","starts_with_heading":null}},{"rank":10,"domain":"youtube.com","host":"youtube.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.youtube.com/llms.txt?cbrd=1&ucbcb=1","bytes":755,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.youtube.com/llms-full.txt?cbrd=1&ucbcb=1","bytes":755,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":11,"domain":"microsoft.com","host":"microsoft.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.microsoft.com/llms.txt","bytes":76859,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.microsoft.com/llms-full.txt","bytes":76859,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":12,"domain":"apple.com","host":"apple.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.apple.com/llms.txt","bytes":109401,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.apple.com/llms-full.txt","bytes":109401,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":13,"domain":"akamai.net","host":"akamai.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":14,"domain":"instagram.com","host":"instagram.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":15,"domain":"akamaiedge.net","host":"akamaiedge.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":16,"domain":"twitter.com","host":"twitter.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":17,"domain":"linkedin.com","host":"linkedin.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://linkedin.com/llms.txt","bytes":21349,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://linkedin.com/llms-full.txt","bytes":21366,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":18,"domain":"azure.com","host":"azure.com","robots_state":"html","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://azure.microsoft.com/llms.txt","bytes":94537,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://azure.microsoft.com/en-us","bytes":463015,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":19,"domain":"triplinkintl.com","host":"triplinkintl.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.triplinkintl.com/en/home/","bytes":306356,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.triplinkintl.com/en/home/","bytes":306356,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":20,"domain":"gwfb.net","host":"gwfb.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":21,"domain":"akadns.net","host":"akadns.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":22,"domain":"domaincontrol.com","host":"domaincontrol.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":23,"domain":"googlevideo.com","host":"www.googlevideo.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":24,"domain":"googletagmanager.com","host":"googletagmanager.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://googletagmanager.com/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://googletagmanager.com/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":25,"domain":"mail.ru","host":"mail.ru","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":26,"domain":"appsflyersdk.com","host":"appsflyersdk.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://appsflyersdk.com/llms.txt","bytes":146,"truncated":false,"content_type":"text/xml"},"llms_full":{"kind":"missing","status":403,"final_url":"https://appsflyersdk.com/llms-full.txt","bytes":146,"truncated":false,"content_type":"text/xml","starts_with_heading":null}},{"rank":27,"domain":"gtld-servers.net","host":"gtld-servers.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":28,"domain":"cloudfront.net","host":"cloudfront.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":29,"domain":"amazon.com","host":"amazon.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.amazon.com/llms.txt","bytes":2296,"truncated":false,"content_type":"text/html;charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.amazon.com/llms-full.txt","bytes":2296,"truncated":false,"content_type":"text/html;charset=UTF-8","starts_with_heading":null}},{"rank":30,"domain":"shiabank.com","host":"shiabank.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":31,"domain":"office.com","host":"office.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://login.microsoftonline.com/common/oauth2/v2.0/authorize?client_id=4765445b-32c6-49b0-83e6-1d93765276ca&redirect_uri=https%3A%2F%2Fwww.office.com%2Flandingv2&response_type=code%20id_token&scope=","bytes":60283,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://login.microsoftonline.com/common/oauth2/v2.0/authorize?client_id=4765445b-32c6-49b0-83e6-1d93765276ca&redirect_uri=https%3A%2F%2Fwww.office.com%2Flandingv2&response_type=code%20id_token&scope=","bytes":60354,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":32,"domain":"sharepoint.com","host":"sharepoint.com","robots_state":"missing","skipped":null,"llms":{"kind":"error","status":302,"final_url":"https://www.microsoft.com/microsoft-365/sharepoint/collaboration?ms.officeurl=sharepoint","bytes":0,"truncated":false,"content_type":""},"llms_full":{"kind":"error","status":302,"final_url":"https://www.microsoft.com/microsoft-365/sharepoint/collaboration?ms.officeurl=sharepoint","bytes":0,"truncated":false,"content_type":"","starts_with_heading":null}},{"rank":33,"domain":"dzen.ru","host":"dzen.ru","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://sso.passport.yandex.ru/showcaptcha?cc=1&form-fb-hint=2.188.87e27097544e59129dc3bb33cb652210387477ef0e91ecf6a45947e16fd4dca6e2b7a053f520eb1d1881245e773e0ccc3c262409ea710ad8481e44&mt=9D8BC88D874","bytes":14002,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"html","status":200,"final_url":"https://sso.passport.yandex.ru/push?uuid=69a0227a-3644-4d08-8276-cb75c3295d9b&retpath=https%3A%2F%2Fdzen.ru%2Fllms-full.txt%3Fis_autologin_ya%3Dtrue","bytes":2896,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":34,"domain":"github.com","host":"github.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://github.com/llms.txt","bytes":28658,"truncated":false,"content_type":"text/plain","h1":true,"title":"GitHub","summary":true,"sections":12,"links":117,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://github.com/llms-full.txt","bytes":28658,"truncated":false,"content_type":"text/plain","starts_with_heading":true}},{"rank":35,"domain":"live.com","host":"live.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://outlook.live.com/mail/","bytes":14287,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"html","status":200,"final_url":"https://outlook.live.com/mail/","bytes":14287,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":36,"domain":"aaplimg.com","host":"aaplimg.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":37,"domain":"trafficmanager.net","host":"trafficmanager.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":38,"domain":"lsrelayaccess.com","host":"lsrelayaccess.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":39,"domain":"wikipedia.org","host":"wikipedia.org","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://en.wikipedia.org/llms.txt","bytes":2692,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://en.wikipedia.org/llms-full.txt","bytes":2707,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":40,"domain":"cloud.microsoft","host":"cloud.microsoft","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://m365.cloud.microsoft/","bytes":317386,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://m365.cloud.microsoft/","bytes":317386,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":41,"domain":"fastly.net","host":"fastly.net","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.fastly.com/llms.txt","bytes":16618,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Fastly","summary":true,"sections":15,"links":87,"malformed_items":13,"relative_links":0,"duplicates":true,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.fastly.com/llms-full.txt","bytes":108841,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":42,"domain":"apple-dns.net","host":"apple-dns.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":43,"domain":"netflix.com","host":"netflix.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":44,"domain":"office.net","host":"office.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":45,"domain":"w2rt6byl5nf1opmc-a.com","host":"w2rt6byl5nf1opmc-a.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":46,"domain":"whatsapp.net","host":"whatsapp.net","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.whatsapp.com/llms.txt","bytes":257540,"truncated":false,"content_type":"text/html; charset=\"utf-8\""},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.whatsapp.com/llms-full.txt","bytes":258463,"truncated":false,"content_type":"text/html; charset=\"utf-8\"","starts_with_heading":null}},{"rank":47,"domain":"bing.com","host":"bing.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.bing.com/llms.txt?toWww=1&redig=392A41AFD9FF425D8A3B2DBCA6BC383E","bytes":0,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.bing.com/llms-full.txt?toWww=1&redig=447EA7CDD1614D66803181615BC8D493","bytes":0,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":48,"domain":"x.com","host":"x.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":49,"domain":"googleusercontent.com","host":"googleusercontent.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://googleusercontent.com/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://googleusercontent.com/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":50,"domain":"pv-cdn.net","host":"pv-cdn.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":51,"domain":"doubleclick.net","host":"doubleclick.net","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://doubleclick.net/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://doubleclick.net/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":52,"domain":"youtu.be","host":"youtu.be","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.youtube.com/watch?v=llms.txt&feature=youtu.be","bytes":901083,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.youtube.com/watch?v=llms-full.txt&feature=youtu.be","bytes":906054,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":53,"domain":"googlesyndication.com","host":"googlesyndication.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://googlesyndication.com/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://googlesyndication.com/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":54,"domain":"pinterest.com","host":"pinterest.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":55,"domain":"windows.net","host":"windows.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":56,"domain":"icloud.com","host":"icloud.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.icloud.com/llms.txt","bytes":3250,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.icloud.com/llms-full.txt","bytes":3250,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":57,"domain":"cloudflare.net","host":"cloudflare.net","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://cloudflare.net/llms.txt","bytes":1286,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://cloudflare.net/llms-full.txt","bytes":1286,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":58,"domain":"myfritz.net","host":"myfritz.net","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":59,"domain":"goo.gl","host":"goo.gl","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":400,"final_url":"https://goo.gl/llms.txt","bytes":9258,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":400,"final_url":"https://goo.gl/llms-full.txt","bytes":9258,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":60,"domain":"adobe.com","host":"adobe.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.adobe.com/llms.txt","bytes":10499,"truncated":false,"content_type":"text/plain; charset=UTF-8","h1":true,"title":"Adobe Tools","summary":true,"sections":7,"links":46,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.adobe.com/llms-full.txt","bytes":1323,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":61,"domain":"gandi.net","host":"gandi.net","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.gandi.net/llms.txt","bytes":118145,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.gandi.net/llms-full.txt","bytes":118150,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":62,"domain":"zoom.us","host":"zoom.us","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://zoom.us/llms.txt","bytes":526089,"truncated":false,"content_type":"text/html;charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://zoom.us/llms-full.txt","bytes":526089,"truncated":false,"content_type":"text/html;charset=utf-8","starts_with_heading":null}},{"rank":63,"domain":"tiktok.com","host":"tiktok.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.tiktok.com/404?fromUrl=/llms.txt","bytes":33633,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.tiktok.com/404?fromUrl=/llms-full.txt","bytes":33608,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":64,"domain":"microsoftonline.com","host":"microsoftonline.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":65,"domain":"h264.io","host":"h264.io","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":66,"domain":"whatsapp.com","host":"whatsapp.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.whatsapp.com/llms.txt","bytes":257534,"truncated":false,"content_type":"text/html; charset=\"utf-8\""},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.whatsapp.com/llms-full.txt","bytes":258456,"truncated":false,"content_type":"text/html; charset=\"utf-8\"","starts_with_heading":null}},{"rank":67,"domain":"wordpress.org","host":"wordpress.org","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://wordpress.org/llms.txt","bytes":5765,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"WordPress","summary":true,"sections":9,"links":36,"malformed_items":7,"relative_links":0,"duplicates":true,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://wordpress.org/llms-full.txt","bytes":125025,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":68,"domain":"windowsupdate.com","host":"windowsupdate.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":69,"domain":"googledomains.com","host":"googledomains.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://domains.google/","bytes":5354,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"html","status":200,"final_url":"https://domains.google/","bytes":5354,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":70,"domain":"yahoo.com","host":"yahoo.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.yahoo.com/llms.txt","bytes":4589,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.yahoo.com/llms-full.txt","bytes":4594,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":71,"domain":"gvt1.com","host":"gvt1.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":72,"domain":"wa.me","host":"wa.me","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://api.whatsapp.com/resolve/?deeplink=%2Fllms.txt&not_found=1","bytes":262217,"truncated":false,"content_type":"text/html; charset=\"utf-8\""},"llms_full":{"kind":"missing","status":404,"final_url":"https://api.whatsapp.com/resolve/?deeplink=%2Fllms-full.txt&not_found=1","bytes":262561,"truncated":false,"content_type":"text/html; charset=\"utf-8\"","starts_with_heading":null}},{"rank":73,"domain":"skype.com","host":"skype.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://teams.live.com/free?source=skype","bytes":61987,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://teams.live.com/free?source=skype","bytes":61987,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":74,"domain":"edgekey.net","host":"edgekey.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":75,"domain":"digicert.com","host":"digicert.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.digicert.com/llms.txt","bytes":8395,"truncated":false,"content_type":"text/plain; charset=ISO-8859-1","h1":true,"title":"DigiCert","summary":true,"sections":21,"links":48,"malformed_items":23,"relative_links":0,"duplicates":true,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.digicert.com/llms-full.txt","bytes":102377,"truncated":false,"content_type":"text/html;charset=utf-8","starts_with_heading":null}},{"rank":76,"domain":"tiktokcdn.com","host":"tiktokcdn.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":77,"domain":"spotify.com","host":"spotify.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.spotify.com/lu-fr/llms.txt","bytes":48578,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.spotify.com/lu-fr/llms-full.txt","bytes":48578,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":78,"domain":"opera.com","host":"opera.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.opera.com/llms.txt","bytes":11613,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"The Opera browser overview","summary":true,"sections":32,"links":29,"malformed_items":20,"relative_links":0,"duplicates":false,"deep_headings":true,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.opera.com/llms-full.txt","bytes":120281,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":79,"domain":"a2z.com","host":"a2z.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":80,"domain":"roblox.com","host":"roblox.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.roblox.com/llms.txt","bytes":66397,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.roblox.com/llms-full.txt","bytes":66397,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":81,"domain":"b-cdn.net","host":"b-cdn.net","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://bunny.net/","bytes":79102,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"html","status":200,"final_url":"https://bunny.net/","bytes":79102,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":82,"domain":"amazonvideo.com","host":"amazonvideo.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.primevideo.com/llms.txt","bytes":6626,"truncated":false,"content_type":"text/html;charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.primevideo.com/llms-full.txt","bytes":6626,"truncated":false,"content_type":"text/html;charset=UTF-8","starts_with_heading":null}},{"rank":83,"domain":"epicgames.com","host":"epicgames.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.epicgames.com/site/llms.txt","bytes":25412,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":403,"final_url":"https://store.epicgames.com/llms-full.txt","bytes":25414,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":84,"domain":"tiktokv.com","host":"tiktokv.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://tiktokv.com/llms.txt","bytes":144,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://tiktokv.com/llms-full.txt","bytes":144,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":85,"domain":"workers.dev","host":"workers.dev","robots_state":"html","skipped":null,"llms":{"kind":"elsewhere","status":200,"final_url":"https://www.cloudflare.com/products/workers/","bytes":3314,"truncated":false,"content_type":"text/markdown; charset=utf-8"},"llms_full":{"kind":"elsewhere","status":200,"final_url":"https://www.cloudflare.com/products/workers/","bytes":3314,"truncated":false,"content_type":"text/markdown; charset=utf-8","starts_with_heading":null}},{"rank":86,"domain":"vimeo.com","host":"vimeo.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://vimeo.com/llms.txt","bytes":161041,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://vimeo.com/llms-full.txt","bytes":161041,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":87,"domain":"ntp.org","host":"ntp.org","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.ntp.org/llms.txt","bytes":6601,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.ntp.org/llms-full.txt","bytes":6601,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":88,"domain":"3gppnetwork.org","host":"3gppnetwork.org","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":89,"domain":"blogspot.com","host":"blogspot.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.blogger.com/llms.txt","bytes":168,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.blogger.com/llms-full.txt","bytes":168,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":90,"domain":"baidu.com","host":"baidu.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":91,"domain":"qq.com","host":"qq.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://h5.news.qq.com/static/babyhome.htm","bytes":4183,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"html","status":200,"final_url":"https://h5.news.qq.com/static/babyhome.htm","bytes":4183,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":92,"domain":"aws.dev","host":"aws.dev","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":93,"domain":"mozilla.org","host":"mozilla.org","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.mozilla.org/en-US/llms.txt","bytes":9033,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.mozilla.org/en-US/llms-full.txt","bytes":9038,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":94,"domain":"nginx.org","host":"nginx.org","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://nginx.org/llms.txt","bytes":2078,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://nginx.org/llms-full.txt","bytes":2078,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":95,"domain":"msn.com","host":"msn.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.msn.com/llms.txt","bytes":19143,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.msn.com/llms-full.txt","bytes":19143,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":96,"domain":"akam.net","host":"akam.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":97,"domain":"f5.com","host":"f5.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.f5.com/llms.txt","bytes":166230,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.f5.com/llms-full.txt","bytes":166288,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":98,"domain":"cdn77.org","host":"cdn77.org","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":99,"domain":"yandex.net","host":"yandex.net","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://ya.ru/llms.txt","bytes":9,"truncated":false,"content_type":"text/plain; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://ya.ru/llms-full.txt","bytes":9,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":null}},{"rank":100,"domain":"wordpress.com","host":"wordpress.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://wordpress.com/llms.txt","bytes":7355,"truncated":false,"content_type":"text/plain","h1":true,"title":"WordPress.com","summary":true,"sections":8,"links":20,"malformed_items":36,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://wordpress.com/llms-full.txt","bytes":141943,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":101,"domain":"dotaplabs.net","host":"dotaplabs.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":102,"domain":"t.me","host":"t.me","robots_state":"missing","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://telegram.org/","bytes":19928,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://telegram.org/","bytes":19928,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":103,"domain":"sentry.io","host":"sentry.io","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://sentry.io/llms.txt","bytes":93292,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Sentry","summary":true,"sections":31,"links":498,"malformed_items":9,"relative_links":0,"duplicates":true,"deep_headings":false,"optional_section":false,"md_links":29,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://sentry.io/llms-full.txt","bytes":976,"truncated":false,"content_type":"text/markdown","starts_with_heading":true}},{"rank":104,"domain":"virginm.net","host":"virginm.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":105,"domain":"lencr.org","host":"lencr.org","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://letsencrypt.org/docs/lencr.org/","bytes":28840,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://letsencrypt.org/docs/lencr.org/","bytes":28840,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":106,"domain":"nginx.com","host":"nginx.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.f5.com/products/nginx","bytes":434519,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.f5.com/products/nginx","bytes":434519,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":107,"domain":"reddit.com","host":"reddit.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":108,"domain":"intuit.com","host":"intuit.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.intuit.com/llms.txt","bytes":5786,"truncated":false,"content_type":"text/plain","h1":true,"title":"Intuit","summary":true,"sections":8,"links":47,"malformed_items":2,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":true,"md_links":0,"over_100kb":false},"llms_full":{"kind":"error","status":null,"final_url":"https://www.intuit.com/llms-full.txt","bytes":0,"truncated":false,"content_type":"","starts_with_heading":null}},{"rank":109,"domain":"t-online.de","host":"t-online.de","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.t-online.de/llms.txt","bytes":13425,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.t-online.de/llms-full.txt","bytes":13425,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":110,"domain":"edgesuite.net","host":"edgesuite.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":111,"domain":"2mdn.net","host":"2mdn.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":112,"domain":"cdninstagram.com","host":"cdninstagram.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":113,"domain":"ui.com","host":"ui.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://ui.com/llms.txt","bytes":274493,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://ui.com/llms-full.txt","bytes":274493,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":114,"domain":"europa.eu","host":"europa.eu","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://european-union.europa.eu/not-found_en","bytes":54399,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://european-union.europa.eu/not-found_en","bytes":54399,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":115,"domain":"chatgpt.com","host":"chatgpt.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":116,"domain":"yandex.ru","host":"yandex.ru","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://yandex.ru/llms.txt","bytes":9,"truncated":false,"content_type":"text/plain; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://yandex.ru/llms-full.txt","bytes":9,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":null}},{"rank":117,"domain":"gvt2.com","host":"gvt2.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":118,"domain":"bit.ly","host":"bit.ly","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://zulk.link/not-found","bytes":158611,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://zulk.link/not-found","bytes":158611,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":119,"domain":"aliyuncs.com","host":"aliyuncs.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://aliyuncs.com/llms.txt","bytes":609,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://aliyuncs.com/llms-full.txt","bytes":614,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":120,"domain":"samsung.com","host":"samsung.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.samsung.com/llms.txt","bytes":4597,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Samsung Electronics","summary":true,"sections":5,"links":31,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":true,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.samsung.com/llms-full.txt","bytes":92098,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":121,"domain":"fastly-edge.com","host":"fastly-edge.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":122,"domain":"azurefd.net","host":"www.azurefd.net","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.azurefd.net/llms.txt","bytes":266389,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.azurefd.net/llms-full.txt","bytes":266389,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":123,"domain":"amazon.dev","host":"amazon.dev","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":124,"domain":"ipify.org","host":"ipify.org","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.ipify.org/llms.txt","bytes":494,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.ipify.org/llms-full.txt","bytes":519,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":125,"domain":"root-servers.net","host":"root-servers.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":126,"domain":"openai.com","host":"openai.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://openai.com/llms.txt","bytes":148487,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":403,"final_url":"https://openai.com/llms-full.txt","bytes":9857,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":127,"domain":"registrar-servers.com","host":"registrar-servers.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":128,"domain":"office365.com","host":"office365.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://office365.com/llms.txt","bytes":1892,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":403,"final_url":"https://office365.com/llms-full.txt","bytes":1892,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":129,"domain":"adobe.io","host":"adobe.io","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://developer.adobe.com/llms.txt","bytes":2586,"truncated":false,"content_type":""},"llms_full":{"kind":"missing","status":404,"final_url":"https://developer.adobe.com/llms-full.txt","bytes":2586,"truncated":false,"content_type":"","starts_with_heading":null}},{"rank":130,"domain":"webex.com","host":"webex.com","robots_state":"missing","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.webex.com/llms.txt","bytes":36071,"truncated":false,"content_type":"text/plain; charset=ISO-8859-1","h1":true,"title":"Webex by Cisco","summary":true,"sections":12,"links":122,"malformed_items":1,"relative_links":0,"duplicates":true,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.webex.com/llms-full.txt","bytes":388,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":131,"domain":"yccdn.ru","host":"yccdn.ru","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":132,"domain":"android.com","host":"android.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.android.com/llms.txt","bytes":233244,"truncated":false,"content_type":"text/html; charset=ISO-8859-1"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.android.com/llms-full.txt","bytes":233244,"truncated":false,"content_type":"text/html; charset=ISO-8859-1","starts_with_heading":null}},{"rank":133,"domain":"dropbox.com","host":"dropbox.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.dropbox.com/llms.txt","bytes":208887,"truncated":false,"content_type":"text/plain","h1":true,"title":"Dropbox","summary":true,"sections":17,"links":780,"malformed_items":0,"relative_links":0,"duplicates":true,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":true},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.dropbox.com/llms-full.txt","bytes":1233,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":134,"domain":"github.io","host":"github.io","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://pages.github.com/","bytes":14446,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://pages.github.com/","bytes":14446,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":135,"domain":"nih.gov","host":"nih.gov","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.nih.gov/llms.txt","bytes":5628,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.nih.gov/llms-full.txt","bytes":5664,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":136,"domain":"outlook.com","host":"outlook.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://outlook.cloud.microsoft/mail/?realm=llms.txt","bytes":14255,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"html","status":200,"final_url":"https://outlook.cloud.microsoft/mail/?realm=llms-full.txt","bytes":14255,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":137,"domain":"ytimg.com","host":"ytimg.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":138,"domain":"okcdn.ru","host":"okcdn.ru","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://st.okcdn.ru/llms.txt","bytes":147,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://st.okcdn.ru/llms-full.txt","bytes":147,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":139,"domain":"cloudflare-dns.com","host":"cloudflare-dns.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://one.one.one.one/llms.txt","bytes":1285,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://one.one.one.one/llms-full.txt","bytes":1285,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":140,"domain":"akamaized.net","host":"akamaized.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":141,"domain":"nflxso.net","host":"nflxso.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":142,"domain":"windows.com","host":"windows.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.microsoft.com/en-us/windows/","bytes":523414,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.microsoft.com/en-us/windows/","bytes":523414,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":143,"domain":"skybridge.click","host":"skybridge.click","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":144,"domain":"static.microsoft","host":"static.microsoft","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":145,"domain":"apache.org","host":"apache.org","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://apache.org/llms.txt","bytes":24879,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://apache.org/llms-full.txt","bytes":24879,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":146,"domain":"supertms.com","host":"supertms.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":147,"domain":"duckdns.org","host":"www.duckdns.org","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.duckdns.org/llms.txt","bytes":7834,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.duckdns.org/llms-full.txt","bytes":7834,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":148,"domain":"dns-parking.com","host":"dns-parking.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":149,"domain":"tm-azurefd.net","host":"tm-azurefd.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":150,"domain":"discord.gg","host":"discord.gg","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://discord.com/","bytes":170430,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://discord.com/","bytes":170418,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":151,"domain":"nic.ru","host":"nic.ru","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://nic.ru/llms.txt","bytes":13602,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://nic.ru/llms-full.txt","bytes":13602,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":152,"domain":"archive.org","host":"archive.org","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://archive.org/llms.txt","bytes":4963,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://archive.org/llms-full.txt","bytes":4963,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":153,"domain":"vk.ru","host":"vk.ru","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://vk.ru/llms.txt","bytes":13067,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://vk.ru/llms-full.txt","bytes":13067,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":154,"domain":"forms.gle","host":"forms.gle","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":400,"final_url":"https://forms.gle/llms.txt","bytes":9258,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":400,"final_url":"https://forms.gle/llms-full.txt","bytes":9258,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":155,"domain":"azurewebsites.net","host":"azurewebsites.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":156,"domain":"tumblr.com","host":"tumblr.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.tumblr.com/llms.txt","bytes":4972,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.tumblr.com/llms-full.txt","bytes":4972,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":157,"domain":"crashlytics.com","host":"crashlytics.com","robots_state":"html","skipped":null,"llms":{"kind":"elsewhere","status":200,"final_url":"https://firebase.google.com/products/crashlytics/","bytes":6809,"truncated":false,"content_type":"text/markdown; charset=utf-8"},"llms_full":{"kind":"elsewhere","status":200,"final_url":"https://firebase.google.com/products/crashlytics/","bytes":6809,"truncated":false,"content_type":"text/markdown; charset=utf-8","starts_with_heading":null}},{"rank":158,"domain":"snapchat.com","host":"snapchat.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.snapchat.com/llms.txt","bytes":66289,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.snapchat.com/llms-full.txt","bytes":66294,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":159,"domain":"vk.com","host":"vk.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://vk.com/llms.txt","bytes":13067,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://vk.com/llms-full.txt","bytes":13067,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":160,"domain":"nytimes.com","host":"nytimes.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.nytimes.com/llms.txt","bytes":68678,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.nytimes.com/llms-full.txt","bytes":68678,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":161,"domain":"jomodns.com","host":"jomodns.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":162,"domain":"godaddy.com","host":"godaddy.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.godaddy.com/llms.txt","bytes":381,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.godaddy.com/llms-full.txt","bytes":390,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":163,"domain":"dnsowl.com","host":"dnsowl.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":164,"domain":"spo-msedge.net","host":"spo-msedge.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":165,"domain":"telegram.org","host":"telegram.org","robots_state":"missing","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://telegram.org/llms.txt","bytes":19922,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://telegram.org/llms-full.txt","bytes":19922,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":166,"domain":"telekom.net","host":"telekom.net","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.telekom.com/","bytes":231749,"truncated":false,"content_type":"text/html;charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.telekom.com/","bytes":231749,"truncated":false,"content_type":"text/html;charset=utf-8","starts_with_heading":null}},{"rank":167,"domain":"ubuntu.com","host":"ubuntu.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://ubuntu.com/llms.txt","bytes":12879,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Ubuntu","summary":true,"sections":12,"links":65,"malformed_items":0,"relative_links":0,"duplicates":true,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://ubuntu.com/llms-full.txt","bytes":23017,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":true}},{"rank":168,"domain":"gravatar.com","host":"gravatar.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://gravatar.com/llms.txt","bytes":21927,"truncated":false,"content_type":"text/plain","h1":true,"title":"Gravatar API Documentation v3.0.0 – LLMS.TXT","summary":false,"sections":15,"links":4,"malformed_items":117,"relative_links":0,"duplicates":false,"deep_headings":true,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://gravatar.com/llms-full.txt","bytes":50605,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":169,"domain":"samsungcloud.com","host":"samsungcloud.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.samsungcloud.com/llms.txt","bytes":30864,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.samsungcloud.com/llms-full.txt","bytes":30864,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":170,"domain":"shopify.com","host":"shopify.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.shopify.com/llms.txt","bytes":12801,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Shopify","summary":true,"sections":12,"links":72,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":2,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://www.shopify.com/llms-full.txt","bytes":19144,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":true}},{"rank":171,"domain":"amazon-adsystem.com","host":"amazon-adsystem.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":172,"domain":"ax-msedge.net","host":"ax-msedge.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":173,"domain":"paypal.com","host":"paypal.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.paypal.com/llms.txt","bytes":40103,"truncated":false,"content_type":"text/plain","h1":true,"title":"PayPal","summary":false,"sections":7,"links":0,"malformed_items":152,"relative_links":0,"duplicates":false,"deep_headings":true,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.paypalobjects.com/llms-full.txt","bytes":1108,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":174,"domain":"reg.ru","host":"reg.ru","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://reg.ru/llms.txt","bytes":13602,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://reg.ru/llms-full.txt","bytes":13602,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":175,"domain":"pages.dev","host":"pages.dev","robots_state":"html","skipped":null,"llms":{"kind":"elsewhere","status":200,"final_url":"https://www.cloudflare.com/products/pages/","bytes":1010,"truncated":false,"content_type":"text/markdown; charset=utf-8"},"llms_full":{"kind":"elsewhere","status":200,"final_url":"https://www.cloudflare.com/products/pages/","bytes":1010,"truncated":false,"content_type":"text/markdown; charset=utf-8","starts_with_heading":null}},{"rank":176,"domain":"meraki.com","host":"meraki.com","robots_state":"missing","skipped":null,"llms":{"kind":"error","status":null,"final_url":"https://meraki.cisco.com/llms.txt","bytes":0,"truncated":false,"content_type":""},"llms_full":{"kind":"error","status":null,"final_url":"https://meraki.cisco.com/llms-full.txt","bytes":0,"truncated":false,"content_type":"","starts_with_heading":null}},{"rank":177,"domain":"google-analytics.com","host":"google-analytics.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://google-analytics.com/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://google-analytics.com/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":178,"domain":"astrumu.io","host":"astrumu.io","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://astrumu.io/llms.txt","bytes":985,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://astrumu.io/llms-full.txt","bytes":985,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":179,"domain":"example.com","host":"example.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://example.com/llms.txt","bytes":577,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://example.com/llms-full.txt","bytes":577,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":180,"domain":"tbcache.com","host":"tbcache.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":181,"domain":"trbcdn.net","host":"trbcdn.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":182,"domain":"ksyuncdn.com","host":"ksyuncdn.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":183,"domain":"flickr.com","host":"flickr.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":184,"domain":"scorecardresearch.com","host":"scorecardresearch.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://scorecardresearch.com/llms.txt","bytes":1245,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://scorecardresearch.com/llms-full.txt","bytes":1245,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":185,"domain":"comcast.net","host":"comcast.net","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.xfinity.com/","bytes":369,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.xfinity.com/","bytes":369,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":186,"domain":"kaspersky.com","host":"kaspersky.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.kaspersky.com/llms.txt","bytes":44633,"truncated":false,"content_type":"text/plain; charset=UTF-8","h1":true,"title":"Kaspersky | Global Cybersecurity & Digital Privacy Solutions","summary":true,"sections":26,"links":101,"malformed_items":35,"relative_links":0,"duplicates":true,"deep_headings":true,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.kaspersky.com/llms-full.txt","bytes":338842,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":187,"domain":"creativecommons.org","host":"creativecommons.org","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://creativecommons.org/llms.txt","bytes":32416,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://creativecommons.org/llms-full.txt","bytes":32421,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":188,"domain":"nflximg.com","host":"nflximg.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":189,"domain":"discord.com","host":"discord.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://discord.com/llms.txt","bytes":44839,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://discord.com/llms-full.txt","bytes":44860,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":190,"domain":"w3.org","host":"w3.org","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.w3.org/llms.txt","bytes":21483,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.w3.org/llms-full.txt","bytes":21483,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":191,"domain":"awswaf.com","host":"awswaf.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":192,"domain":"cnn.com","host":"cnn.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.cnn.com/llms.txt","bytes":1093875,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.cnn.com/llms-full.txt","bytes":1093875,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":193,"domain":"forter.com","host":"forter.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://forter.com/llms.txt","bytes":20831,"truncated":false,"content_type":"text/plain","h1":true,"title":"Forter — Identity Intelligence for Digital Commerce","summary":true,"sections":18,"links":8,"malformed_items":60,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":8,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://forter.com/llms-full.txt","bytes":26099,"truncated":false,"content_type":"text/plain","starts_with_heading":true}},{"rank":194,"domain":"quickconnect.to","host":"quickconnect.to","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"http://llms.txt.quickconnect.to/https_first","bytes":82086,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"html","status":200,"final_url":"http://llms-full.txt.quickconnect.to/https_first","bytes":82086,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":195,"domain":"afternic.com","host":"afternic.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.afternic.com/llms.txt","bytes":337098,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.afternic.com/llms-full.txt","bytes":337103,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":196,"domain":"ebay.com","host":"ebay.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://pages.ebay.com/llms.txt","bytes":73783,"truncated":false,"content_type":"text/html;charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://pages.ebay.com/llms-full.txt","bytes":73902,"truncated":false,"content_type":"text/html;charset=UTF-8","starts_with_heading":null}},{"rank":197,"domain":"firefox-portal-detection.com","host":"firefox-portal-detection.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://firefox-portal-detection.com/llms.txt","bytes":10,"truncated":false,"content_type":"text/plain"},"llms_full":{"kind":"missing","status":404,"final_url":"https://firefox-portal-detection.com/llms-full.txt","bytes":10,"truncated":false,"content_type":"text/plain","starts_with_heading":null}},{"rank":198,"domain":"soundcloud.com","host":"soundcloud.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://soundcloud.com/llms.txt","bytes":0,"truncated":false,"content_type":""},"llms_full":{"kind":"missing","status":404,"final_url":"https://soundcloud.com/llms-full.txt","bytes":0,"truncated":false,"content_type":"","starts_with_heading":null}},{"rank":199,"domain":"macromedia.com","host":"www.macromedia.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.adobe.com/llms.txt","bytes":10499,"truncated":false,"content_type":"text/plain; charset=UTF-8","h1":true,"title":"Adobe Tools","summary":true,"sections":7,"links":46,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.adobe.com/llms-full.txt","bytes":1323,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":200,"domain":"pki.goog","host":"pki.goog","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://pki.goog/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://pki.goog/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":201,"domain":"hichina.com","host":"www.hichina.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.hichina.com/llms.txt","bytes":43725,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.hichina.com/llms-full.txt","bytes":43725,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":202,"domain":"theguardian.com","host":"theguardian.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.theguardian.com/llms.txt","bytes":24345,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.theguardian.com/llms-full.txt","bytes":24345,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":203,"domain":"unity3d.com","host":"unity3d.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://unity.com/llms.txt","bytes":950277,"truncated":false,"content_type":"text/markdown; charset=utf-8","h1":true,"title":"Unity","summary":true,"sections":10,"links":2474,"malformed_items":3,"relative_links":0,"duplicates":false,"deep_headings":true,"optional_section":true,"md_links":0,"over_100kb":true},"llms_full":{"kind":"missing","status":404,"final_url":"https://unity.com/llms-full.txt","bytes":187793,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":204,"domain":"youtube-nocookie.com","host":"www.youtube-nocookie.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.youtube-nocookie.com/llms.txt","bytes":7084,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.youtube-nocookie.com/llms-full.txt","bytes":7084,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":205,"domain":"skyhigh.cloud","host":"skyhigh.cloud","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.skyhighsecurity.com/","bytes":195618,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.skyhighsecurity.com/","bytes":195618,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":206,"domain":"medium.com","host":"medium.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://medium.com/llms.txt","bytes":5563,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":403,"final_url":"https://medium.com/llms-full.txt","bytes":5599,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":207,"domain":"omtrdc.net","host":"omtrdc.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":208,"domain":"stripe.com","host":"stripe.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://stripe.com/llms.txt","bytes":69923,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Stripe","summary":true,"sections":31,"links":305,"malformed_items":1,"relative_links":0,"duplicates":true,"deep_headings":false,"optional_section":true,"md_links":24,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://stripe.com/llms-full.txt","bytes":370282,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":209,"domain":"doi.org","host":"doi.org","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.doi.org/llms.txt","bytes":7625,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.doi.org/llms-full.txt","bytes":7625,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":210,"domain":"msedge.net","host":"msedge.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":211,"domain":"azureedge.net","host":"www.azureedge.net","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.azureedge.net/llms.txt","bytes":266389,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.azureedge.net/llms-full.txt","bytes":266389,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":212,"domain":"hcaptcha.com","host":"hcaptcha.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.hcaptcha.com/llms.txt","bytes":13865,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"hCaptcha","summary":true,"sections":13,"links":62,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.hcaptcha.com/llms-full.txt","bytes":3273,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":213,"domain":"mtgglobals.com","host":"www.mtgglobals.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.mtgglobals.com/llms.txt","bytes":363,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.mtgglobals.com/llms-full.txt","bytes":368,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":214,"domain":"oracle.com","host":"oracle.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.oracle.com/llms.txt","bytes":3988,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.oracle.com/llms-full.txt","bytes":3988,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":215,"domain":"mts.ru","host":"mts.ru","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://moskva.mts.ru/llmstxt","bytes":215979,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://moskva.mts.ru/llms-fulltxt","bytes":215984,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":216,"domain":"ttdns2.com","host":"ttdns2.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":217,"domain":"publicnode.com","host":"publicnode.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://publicnode.com/llms.txt","bytes":139450,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://publicnode.com/llms-full.txt","bytes":139450,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":218,"domain":"app-measurement.com","host":"app-measurement.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://app-measurement.com/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://app-measurement.com/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":219,"domain":"bbc.com","host":"bbc.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.bbc.com/llms.txt","bytes":32428,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.bbc.com/llms-full.txt","bytes":32428,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":220,"domain":"vkuserphoto.ru","host":"vkuserphoto.ru","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":418,"final_url":"https://ps.userapi.com/llms.txt","bytes":0,"truncated":false,"content_type":""},"llms_full":{"kind":"missing","status":418,"final_url":"https://ps.userapi.com/llms-full.txt","bytes":0,"truncated":false,"content_type":"","starts_with_heading":null}},{"rank":221,"domain":"iiko.it","host":"iiko.it","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":222,"domain":"wikimedia.org","host":"wikimedia.org","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.wikimedia.org//llms.txt","bytes":2858,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.wikimedia.org//llms-full.txt","bytes":2873,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":223,"domain":"cdngslb.com","host":"cdngslb.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":224,"domain":"licdn.com","host":"licdn.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":225,"domain":"bybanking.com","host":"bybanking.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":226,"domain":"roku.com","host":"roku.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.roku.com/llms.txt","bytes":15683,"truncated":false,"content_type":"text/plain; charset=UTF-8","h1":true,"title":"Roku","summary":true,"sections":9,"links":70,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"html","status":200,"final_url":"https://www.roku.com/intl?next=/llms-full.txt&source=www.roku.com","bytes":59452,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":227,"domain":"criteo.com","host":"criteo.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.criteo.com/llms.txt","bytes":325795,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.criteo.com/llms-full.txt","bytes":325444,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":228,"domain":"forbes.com","host":"forbes.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.forbes.com/consent/ketch/?toURL=https://www.forbes.com/llms.txt","bytes":4945,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.forbes.com/consent/ketch/?toURL=https://www.forbes.com/llms-full.txt","bytes":4945,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":229,"domain":"xiaomi.com","host":"xiaomi.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.mi.com/llms.txt","bytes":376,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.mi.com/llms-full.txt","bytes":385,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":230,"domain":"weather.com","host":"weather.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://weather.com/llms.txt","bytes":9101,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Weather.com","summary":true,"sections":12,"links":78,"malformed_items":0,"relative_links":73,"duplicates":false,"deep_headings":false,"optional_section":true,"md_links":5,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://weather.com/llms-full.txt","bytes":99753,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":231,"domain":"twitch.tv","host":"twitch.tv","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.twitch.tv/llms.txt","bytes":223650,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.twitch.tv/llms-full.txt","bytes":223810,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":232,"domain":"researchgate.net","host":"researchgate.net","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.researchgate.net/llms.txt","bytes":23111,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.researchgate.net/llms-full.txt","bytes":20189,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":233,"domain":"sciencedirect.com","host":"sciencedirect.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":234,"domain":"googletagservices.com","host":"www.googletagservices.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.googletagservices.com/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.googletagservices.com/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":235,"domain":"amplitude.com","host":"amplitude.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://amplitude.com/llms.txt","bytes":16699,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Amplitude","summary":false,"sections":6,"links":16,"malformed_items":74,"relative_links":0,"duplicates":false,"deep_headings":true,"optional_section":false,"md_links":16,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://amplitude.com/llms-full.txt","bytes":8726,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":true}},{"rank":236,"domain":"ailawandorder.com","host":"ailawandorder.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":237,"domain":"mit.edu","host":"mit.edu","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://web.mit.edu/llms.txt","bytes":25731,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://web.mit.edu/llms-full.txt","bytes":25731,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":238,"domain":"brave.com","host":"brave.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://brave.com/llms.txt/","bytes":54560,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://brave.com/llms-full.txt/","bytes":54560,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":239,"domain":"namecheap.com","host":"namecheap.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.namecheap.com/llms.txt","bytes":5634,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.namecheap.com/llms-full.txt","bytes":5670,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":240,"domain":"nist.gov","host":"nist.gov","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.nist.gov/llms.txt","bytes":186,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.nist.gov/llms-full.txt","bytes":191,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":241,"domain":"rbxcdn.com","host":"rbxcdn.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":242,"domain":"applovin.com","host":"applovin.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://applovin.com/en","bytes":401906,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://applovin.com/en","bytes":401907,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":243,"domain":"bbc.co.uk","host":"bbc.co.uk","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.bbc.co.uk/llms.txt","bytes":32428,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.bbc.co.uk/llms-full.txt","bytes":32428,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":244,"domain":"cpanel.net","host":"cpanel.net","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.cpanel.net/llms.txt","bytes":101618,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.cpanel.net/llms-full.txt","bytes":101618,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":245,"domain":"cisco.com","host":"cisco.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.cisco.com/llms.txt","bytes":1196,"truncated":false,"content_type":"text/plain","h1":false,"title":null,"summary":false,"sections":1,"links":5,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":true,"optional_section":false,"md_links":5,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.cisco.com/llms-full.txt","bytes":32278,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":246,"domain":"playstation.net","host":"playstation.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":247,"domain":"shifen.com","host":"shifen.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":248,"domain":"t.co","host":"t.co","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":249,"domain":"wsdvs.com","host":"wsdvs.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":250,"domain":"msftconnecttest.com","host":"msftconnecttest.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":251,"domain":"dnsmadeeasy.com","host":"dnsmadeeasy.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://dnsmadeeasy.com/llms.txt","bytes":102377,"truncated":false,"content_type":"text/html;charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://dnsmadeeasy.com/llms-full.txt","bytes":102365,"truncated":false,"content_type":"text/html;charset=utf-8","starts_with_heading":null}},{"rank":252,"domain":"sourceforge.net","host":"sourceforge.net","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://sourceforge.net/llms.txt","bytes":2097152,"truncated":true,"content_type":"text/plain; charset=UTF-8","h1":true,"title":"SourceForge","summary":true,"sections":2,"links":2112,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":true},"llms_full":{"kind":"missing","status":404,"final_url":"https://sourceforge.net/llms-full.txt","bytes":14,"truncated":false,"content_type":"application/json; charset=utf-8","starts_with_heading":null}},{"rank":253,"domain":"adtrafficquality.google","host":"adtrafficquality.google","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://adtrafficquality.google/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://adtrafficquality.google/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":254,"domain":"avcdn.net","host":"avcdn.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":255,"domain":"icanhazip.com","host":"icanhazip.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://icanhazip.com/llms.txt","bytes":26,"truncated":false,"content_type":"text/plain","h1":false,"title":null,"summary":false,"sections":0,"links":0,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://icanhazip.com/llms-full.txt","bytes":26,"truncated":false,"content_type":"text/plain","starts_with_heading":false}},{"rank":256,"domain":"bytefcdn-oversea.com","host":"bytefcdn-oversea.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":257,"domain":"alibabadns.com","host":"alibabadns.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":258,"domain":"aliyuncsslbintl.com","host":"aliyuncsslbintl.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":259,"domain":"salesforce.com","host":"salesforce.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.salesforce.com/llms.txt?bc=DB","bytes":1021703,"truncated":false,"content_type":"text/plain; charset=UTF-8","h1":false,"title":null,"summary":false,"sections":0,"links":0,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":true},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.salesforce.com/llms-full.txt?bc=DB","bytes":39,"truncated":false,"content_type":"application/json; charset=utf-8","starts_with_heading":null}},{"rank":260,"domain":"name-services.com","host":"name-services.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":261,"domain":"sfx.ms","host":"sfx.ms","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":262,"domain":"hubspot.com","host":"hubspot.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.hubspot.com/llms.txt","bytes":35564,"truncated":false,"content_type":"text/plain; charset=x-macroman","h1":true,"title":"HubSpot","summary":true,"sections":29,"links":225,"malformed_items":6,"relative_links":0,"duplicates":true,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.hubspot.com/llms-full.txt","bytes":500613,"truncated":false,"content_type":"text/html;charset=utf-8","starts_with_heading":null}},{"rank":263,"domain":"imdb.com","host":"imdb.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":264,"domain":"linktr.ee","host":"linktr.ee","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":265,"domain":"namebrightdns.com","host":"namebrightdns.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":266,"domain":"cdn-apple.com","host":"cdn-apple.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":267,"domain":"akamaihd.net","host":"akamaihd.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":268,"domain":"yandexcloud.net","host":"yandexcloud.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":269,"domain":"mybluehost.me","host":"mybluehost.me","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":270,"domain":"alidns.com","host":"alidns.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://alidns.com/llms.txt","bytes":64,"truncated":false,"content_type":"application/json; charset=utf-8","h1":false,"title":null,"summary":false,"sections":0,"links":0,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://alidns.com/llms-full.txt","bytes":64,"truncated":false,"content_type":"application/json; charset=utf-8","starts_with_heading":false}},{"rank":271,"domain":"who.int","host":"who.int","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.who.int/llms.txt","bytes":72505,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.who.int/llms-full.txt","bytes":72505,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":272,"domain":"googleblog.com","host":"googleblog.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://blog.google/","bytes":403120,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://blog.google/","bytes":403120,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":273,"domain":"xcal.tv","host":"xcal.tv","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":274,"domain":"wixsite.com","host":"www.wixsite.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.wixsite.com/llms.txt","bytes":2243,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.wix.com/llms-full.txt","bytes":2345,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":275,"domain":"ttvnw.net","host":"ttvnw.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":276,"domain":"geobasket.ru","host":"geobasket.ru","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":277,"domain":"googleadservices.com","host":"googleadservices.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://googleadservices.com/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://googleadservices.com/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":278,"domain":"vedcdnlb.com","host":"vedcdnlb.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":279,"domain":"ibm.com","host":"ibm.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.ibm.com/llms.txt","bytes":79283,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.ibm.com/llms-full.txt","bytes":79283,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":280,"domain":"datadoghq.com","host":"datadoghq.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.datadoghq.com/llms.txt","bytes":599072,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Datadog","summary":true,"sections":16,"links":2436,"malformed_items":1,"relative_links":0,"duplicates":true,"deep_headings":false,"optional_section":false,"md_links":2177,"over_100kb":true},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.datadoghq.com/llms-full.txt","bytes":152653,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":281,"domain":"ozon.ru","host":"ozon.ru","robots_state":"missing","skipped":null,"llms":{"kind":"error","status":307,"final_url":"https://ozon.ru/llms.txt?__rr=5","bytes":0,"truncated":false,"content_type":""},"llms_full":{"kind":"error","status":307,"final_url":"https://ozon.ru/llms-full.txt?__rr=5","bytes":0,"truncated":false,"content_type":"","starts_with_heading":null}},{"rank":282,"domain":"demdex.net","host":"www.demdex.net","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":283,"domain":"hp.com","host":"hp.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.hp.com/llms.txt","bytes":317803,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.hp.com/llms-full.txt","bytes":317803,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":284,"domain":"reuters.com","host":"reuters.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":285,"domain":"centinel-analytica.com","host":"centinel-analytica.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.centinelanalytica.com/llms.txt","bytes":47460,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Centinel Analytica","summary":true,"sections":12,"links":214,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":true,"md_links":0,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://www.centinelanalytica.com/llms-full.txt","bytes":1256037,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":true}},{"rank":286,"domain":"slack.com","host":"slack.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://slack.com/llms.txt","bytes":40672,"truncated":false,"content_type":"text/plain;charset=utf-8","h1":true,"title":"Slack","summary":true,"sections":7,"links":144,"malformed_items":1,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://slack.com/llms-full.txt","bytes":1736,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":287,"domain":"launchdarkly.com","host":"launchdarkly.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://launchdarkly.com/llms.txt","bytes":79955,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://launchdarkly.com/llms-full.txt","bytes":79940,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":288,"domain":"launchpad.net","host":"launchpad.net","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://launchpad.net/llms.txt","bytes":9665,"truncated":false,"content_type":"text/html;charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://launchpad.net/llms-full.txt","bytes":9670,"truncated":false,"content_type":"text/html;charset=utf-8","starts_with_heading":null}},{"rank":289,"domain":"booking.com","host":"booking.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.booking.com/llms.txt","bytes":431716,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.booking.com/llms-full.txt","bytes":431820,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":290,"domain":"telegram.me","host":"telegram.me","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://telegram.org/","bytes":19928,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://telegram.org/","bytes":19928,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":291,"domain":"archive.ph","host":"archive.ph","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":292,"domain":"app-analytics-services.com","host":"app-analytics-services.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://app-analytics-services.com/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://app-analytics-services.com/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":293,"domain":"myshopify.com","host":"myshopify.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://myshopify.com/llms.txt","bytes":22,"truncated":false,"content_type":"text/plain; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://myshopify.com/llms-full.txt","bytes":22,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":null}},{"rank":294,"domain":"nature.com","host":"nature.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.nature.com/llms.txt","bytes":99493,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.nature.com/llms-full.txt?error=cookies_not_supported&code=67d99cd8-772d-4642-86d4-aa4c0351b0a8","bytes":99493,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":295,"domain":"www.gov.uk","host":"www.gov.uk","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.gov.uk/llms.txt","bytes":52491,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.gov.uk/llms-full.txt","bytes":52491,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":296,"domain":"tinyurl.com","host":"tinyurl.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://tinyurl.com/llms.txt","bytes":28174,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://tinyurl.com/llms-full.txt","bytes":28174,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":297,"domain":"steampowered.com","host":"steampowered.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://store.steampowered.com/","bytes":1018261,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://store.steampowered.com/","bytes":1018261,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":298,"domain":"canva.com","host":"canva.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.canva.com/llms.txt","bytes":1636,"truncated":false,"content_type":"text/html;charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.canva.com/llms-full.txt","bytes":1636,"truncated":false,"content_type":"text/html;charset=utf-8","starts_with_heading":null}},{"rank":299,"domain":"ggpht.com","host":"ggpht.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":300,"domain":"charter.net","host":"charter.net","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.spectrum.net/llms.txt","bytes":328467,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.spectrum.net/llms-full.txt","bytes":328467,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":301,"domain":"media-amazon.com","host":"media-amazon.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":302,"domain":"online-metrix.net","host":"online-metrix.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":303,"domain":"tiktokcdn-us.com","host":"tiktokcdn-us.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":304,"domain":"gamepass.com","host":"gamepass.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":305,"domain":"wac-msedge.net","host":"wac-msedge.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":306,"domain":"alibaba.com","host":"alibaba.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://error.alibaba.com/error404.htm","bytes":342901,"truncated":false,"content_type":"text/html;charset=UTF-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://error.alibaba.com/error404.htm","bytes":343373,"truncated":false,"content_type":"text/html;charset=UTF-8","starts_with_heading":null}},{"rank":307,"domain":"manulife-sinochem.com","host":"manulife-sinochem.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":308,"domain":"grammarly.com","host":"grammarly.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.grammarly.com/llms.txt","bytes":473196,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.grammarly.com/llms-full.txt","bytes":473671,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":309,"domain":"springer.com","host":"springer.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://link.springer.com/brands/springer?error=cookies_not_supported&code=5b9fd4e7-d360-48e4-b6c8-c0069fa60c9c","bytes":270688,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://link.springer.com/brands/springer?error=cookies_not_supported&code=f648f421-d433-43ee-8a90-b04f8b99f2c8","bytes":270951,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":310,"domain":"jsdelivr.net","host":"jsdelivr.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":311,"domain":"byteoversea.net","host":"byteoversea.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":312,"domain":"arubanetworks.com","host":"www.arubanetworks.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.arubanetworks.com/llms.txt","bytes":385,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.arubanetworks.com/llms-full.txt","bytes":394,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":313,"domain":"userapi.com","host":"userapi.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://vk.com/llms.txt","bytes":13067,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://vk.com/llms-full.txt","bytes":13067,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":314,"domain":"msftncsi.com","host":"msftncsi.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":315,"domain":"onelink.me","host":"onelink.me","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.appsflyer.com/products/deep-linking/","bytes":441434,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.appsflyer.com/products/deep-linking/","bytes":441434,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":316,"domain":"miui.com","host":"miui.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://miui.com/llms.txt","bytes":169,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://miui.com/llms-full.txt","bytes":169,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":317,"domain":"crcdn.pro","host":"crcdn.pro","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":318,"domain":"cloudflareinsights.com","host":"cloudflareinsights.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://cloudflareinsights.com/llms.txt","bytes":498,"truncated":false,"content_type":"text/html;charset=UTF-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://cloudflareinsights.com/llms-full.txt","bytes":498,"truncated":false,"content_type":"text/html;charset=UTF-8","starts_with_heading":null}},{"rank":319,"domain":"ip-api.com","host":"ip-api.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://ip-api.com/","bytes":11848,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://ip-api.com/","bytes":11848,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":320,"domain":"avast.com","host":"avast.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.avast.com/llms.txt","bytes":379,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.avast.com/llms-full.txt","bytes":388,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":321,"domain":"wiley.com","host":"wiley.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.wiley-vch.de/en/","bytes":59979,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.wiley-vch.de/en/","bytes":59979,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":322,"domain":"douyincdn.com","host":"douyincdn.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":323,"domain":"anthropic.com","host":"anthropic.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.anthropic.com/llms.txt","bytes":82916,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.anthropic.com/llms-full.txt","bytes":82926,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":324,"domain":"debian.org","host":"debian.org","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.debian.org/llms.txt","bytes":7467,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.debian.org/llms-full.txt","bytes":7467,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":325,"domain":"vungle.com","host":"vungle.com","robots_state":"ok","skipped":null,"llms":{"kind":"error","status":null,"final_url":"https://vungle.com/llms.txt","bytes":0,"truncated":false,"content_type":""},"llms_full":{"kind":"missing","status":404,"final_url":"https://vungle.com/llms-full.txt","bytes":55278,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":326,"domain":"weibo.com","host":"weibo.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":327,"domain":"heytapmobile.com","host":"heytapmobile.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":328,"domain":"harvard.edu","host":"harvard.edu","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.harvard.edu/llms.txt","bytes":111788,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.harvard.edu/llms-full.txt","bytes":111793,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":329,"domain":"steamserver.net","host":"steamserver.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":330,"domain":"amazon.co.uk","host":"amazon.co.uk","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.amazon.co.uk/llms.txt","bytes":2165,"truncated":false,"content_type":"text/html;charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.amazon.co.uk/llms-full.txt","bytes":2165,"truncated":false,"content_type":"text/html;charset=UTF-8","starts_with_heading":null}},{"rank":331,"domain":"autodesk.com","host":"autodesk.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.autodesk.com/llms.txt","bytes":380,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.autodesk.com/llms-full.txt","bytes":389,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":332,"domain":"vercel-dns-016.com","host":"www.vercel-dns-016.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.vercel-dns-016.com/llms.txt","bytes":107,"truncated":false,"content_type":"text/plain; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.vercel-dns-016.com/llms-full.txt","bytes":107,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":null}},{"rank":333,"domain":"rubiconproject.com","host":"rubiconproject.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.rubiconproject.com/llms.txt","bytes":6420,"truncated":false,"content_type":"text/plain","h1":true,"title":"Magnite: The Largest Independent Sell\\-Side Ad Platform","summary":true,"sections":14,"links":63,"malformed_items":0,"relative_links":0,"duplicates":true,"deep_headings":false,"optional_section":true,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.rubiconproject.com/llms-full.txt","bytes":121036,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":334,"domain":"casalemedia.com","host":"casalemedia.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.indexexchange.com/","bytes":111385,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.indexexchange.com/","bytes":111385,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":335,"domain":"archive.is","host":"archive.is","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":336,"domain":"zendesk.com","host":"zendesk.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.zendesk.com/llms.txt","bytes":741350,"truncated":false,"content_type":"text/plain","h1":true,"title":"Zendesk.com","summary":true,"sections":19,"links":3132,"malformed_items":3,"relative_links":0,"duplicates":false,"deep_headings":true,"optional_section":false,"md_links":0,"over_100kb":true},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.zendesk.com/llms-full.txt","bytes":48557,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":337,"domain":"telecid.ru","host":"www.telecid.ru","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.telecid.ru/llms.txt","bytes":146,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.telecid.ru/llms-full.txt","bytes":146,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":338,"domain":"volcfcdndvs.com","host":"volcfcdndvs.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":339,"domain":"etsy.com","host":"etsy.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.etsy.com/llms.txt","bytes":26713,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Etsy: official reference for AI assistants","summary":true,"sections":7,"links":0,"malformed_items":72,"relative_links":0,"duplicates":false,"deep_headings":true,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.etsy.com/llms-full.txt","bytes":58526,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":340,"domain":"ok.ru","host":"ok.ru","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://ok.ru/llms.txt","bytes":0,"truncated":false,"content_type":""},"llms_full":{"kind":"missing","status":404,"final_url":"https://ok.ru/llms-full.txt","bytes":0,"truncated":false,"content_type":"","starts_with_heading":null}},{"rank":341,"domain":"gmail.com","host":"gmail.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://gmail.com/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://gmail.com/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":342,"domain":"unisys.com","host":"unisys.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.unisys.com/llms.txt","bytes":12999,"truncated":false,"content_type":"text/plain","h1":true,"title":"Unisys","summary":true,"sections":6,"links":52,"malformed_items":0,"relative_links":0,"duplicates":true,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.unisys.com/llms-full.txt","bytes":126269,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":343,"domain":"espn.com","host":"espn.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.espn.com/llms.txt","bytes":1,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.espn.com/llms-full.txt","bytes":1,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":344,"domain":"php.net","host":"php.net","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.php.net/manual-lookup.php?pattern=llms.txt&lang=en&scope=404quickref","bytes":30602,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.php.net/manual-lookup.php?pattern=llms-full.txt&lang=en&scope=404quickref","bytes":30832,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":345,"domain":"clarity.ms","host":"www.clarity.ms","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.clarity.ms/llms.txt","bytes":0,"truncated":false,"content_type":"text/plain; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.clarity.ms/llms-full.txt","bytes":0,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":null}},{"rank":346,"domain":"nflxvideo.net","host":"nflxvideo.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":347,"domain":"mi.com","host":"mi.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.mi.com/llms.txt","bytes":376,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.mi.com/llms-full.txt","bytes":385,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":348,"domain":"smartadserver.com","host":"smartadserver.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.equativ.com/","bytes":142465,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.equativ.com/","bytes":142465,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":349,"domain":"naver.com","host":"naver.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":350,"domain":"imcmdb.net","host":"imcmdb.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":351,"domain":"plex.direct","host":"plex.direct","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":352,"domain":"bilibili.com","host":"bilibili.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.bilibili.com/llms.txt","bytes":10994,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Bilibili / 哔哩哔哩","summary":true,"sections":6,"links":52,"malformed_items":8,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.bilibili.com/llms-full.txt","bytes":5671,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":353,"domain":"trustpilot.com","host":"trustpilot.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":354,"domain":"ea.com","host":"ea.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.ea.com/llms.txt","bytes":12437,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"EA","summary":true,"sections":3,"links":8,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":true,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.ea.com/llms-full.txt","bytes":80118,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":355,"domain":"pubmatic.com","host":"pubmatic.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://pubmatic.com/llms.txt","bytes":919,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":403,"final_url":"https://pubmatic.com/llms-full.txt","bytes":919,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":356,"domain":"paloaltonetworks.com","host":"paloaltonetworks.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.paloaltonetworks.com/llms.txt","bytes":17903,"truncated":false,"content_type":"text/plain;charset=utf-8","h1":true,"title":"Palo Alto Networks","summary":true,"sections":10,"links":46,"malformed_items":69,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://www.paloaltonetworks.com/llms-full.txt","bytes":30788,"truncated":false,"content_type":"text/plain;charset=utf-8","starts_with_heading":true}},{"rank":357,"domain":"gnu.org","host":"gnu.org","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.gnu.org/llms.txt","bytes":11549,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.gnu.org/llms-full.txt","bytes":11554,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":358,"domain":"branch.io","host":"branch.io","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.branch.io/llms.txt","bytes":6608,"truncated":false,"content_type":"text/plain","h1":true,"title":"Branch","summary":true,"sections":6,"links":47,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":true,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.branch.io/llms-full.txt","bytes":180475,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":359,"domain":"tp-link.com","host":"tp-link.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.tp-link.com/llms.txt","bytes":1890,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.tp-link.com/llms-full.txt","bytes":1890,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":360,"domain":"tradingview.com","host":"tradingview.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.tradingview.com/llms.txt","bytes":153751,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.tradingview.com/llms-full.txt","bytes":153862,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":361,"domain":"nvidia.com","host":"nvidia.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.nvidia.com/llms.txt","bytes":2745,"truncated":false,"content_type":"text/markdown; charset=UTF-8","h1":true,"title":"NVIDIA Corporation","summary":true,"sections":6,"links":20,"malformed_items":1,"relative_links":0,"duplicates":false,"deep_headings":true,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.nvidia.com/llms-full.txt","bytes":299558,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":362,"domain":"weebly.com","host":"weebly.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.weebly.com/llms.txt","bytes":4133,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.weebly.com/llms-full.txt","bytes":4133,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":363,"domain":"checkpoint.com","host":"checkpoint.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.checkpoint.com/llms.txt","bytes":12490,"truncated":false,"content_type":"text/plain","h1":true,"title":"Check Point Software\r\r> https://www.checkpoint.com/\r\r> AI-powered cyber security","summary":false,"sections":0,"links":0,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"html","status":202,"final_url":"https://checkpoint.com/llms-full.txt","bytes":0,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":364,"domain":"dell.com","host":"dell.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.dell.com/llms.txt","bytes":90245,"truncated":false,"content_type":"text/plain","h1":true,"title":"Dell Technologies","summary":true,"sections":13,"links":284,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"html","status":200,"final_url":"https://www.dell.com/fr-lu/lp","bytes":430095,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":365,"domain":"cdc.gov","host":"cdc.gov","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.cdc.gov/llms.txt","bytes":20905,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.cdc.gov/llms-full.txt","bytes":20905,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":366,"domain":"okta.com","host":"okta.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.okta.com/llms.txt","bytes":231097,"truncated":false,"content_type":"text/plain; charset=UTF-8","h1":true,"title":"Okta and Auth0 Platforms","summary":true,"sections":11,"links":1533,"malformed_items":6,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":true},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.okta.com/llms-full.txt","bytes":29453,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":367,"domain":"aliyun.com","host":"aliyun.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.aliyun.com/llms.txt","bytes":43024,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.aliyun.com/llms-full.txt","bytes":43024,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":368,"domain":"grammarly.io","host":"grammarly.io","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":369,"domain":"dotomi.com","host":"dotomi.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.epsilon.com/us?redirect=dotomi","bytes":303555,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.epsilon.com/us?redirect=dotomi","bytes":301723,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":370,"domain":"un.org","host":"un.org","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.un.org/llms.txt","bytes":188,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://maintenance.un.org/llms-full.txt","bytes":357,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":371,"domain":"browser-intake-datadoghq.com","host":"browser-intake-datadoghq.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://browser-intake-datadoghq.com/llms.txt","bytes":56,"truncated":false,"content_type":"application/json"},"llms_full":{"kind":"missing","status":403,"final_url":"https://browser-intake-datadoghq.com/llms-full.txt","bytes":56,"truncated":false,"content_type":"application/json","starts_with_heading":null}},{"rank":372,"domain":"worldnic.com","host":"worldnic.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":373,"domain":"cm.com","host":"cm.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://cm.com/llms.txt","bytes":4827,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"CM.com Documentation","summary":true,"sections":4,"links":32,"malformed_items":3,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://cm.com/llms-full.txt","bytes":3142310,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":true}},{"rank":374,"domain":"wsj.com","host":"wsj.com","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":375,"domain":"cdnbuild.net","host":"cdnbuild.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":376,"domain":"google.cn","host":"google.cn","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://google.cn/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://google.cn/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":377,"domain":"on.aws","host":"on.aws","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":378,"domain":"bsky.app","host":"bsky.app","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://bsky.app/llms.txt","bytes":0,"truncated":false,"content_type":"text/plain; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://bsky.app/llms-full.txt","bytes":0,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":null}},{"rank":379,"domain":"dynatrace.com","host":"dynatrace.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.dynatrace.com/llms.txt","bytes":182111,"truncated":false,"content_type":"text/plain","h1":true,"title":"LLM documentation for www.dynatrace.com","summary":true,"sections":13,"links":1105,"malformed_items":2,"relative_links":0,"duplicates":true,"deep_headings":true,"optional_section":false,"md_links":0,"over_100kb":true},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.dynatrace.com/llms-full.txt","bytes":2714,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":380,"domain":"amazon.de","host":"amazon.de","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.amazon.de/llms.txt","bytes":2165,"truncated":false,"content_type":"text/html;charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.amazon.de/llms-full.txt","bytes":2165,"truncated":false,"content_type":"text/html;charset=UTF-8","starts_with_heading":null}},{"rank":381,"domain":"gitlab.com","host":"gitlab.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://gitlab.com/users/sign_in","bytes":5599,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":403,"final_url":"https://gitlab.com/users/sign_in","bytes":5599,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":382,"domain":"elasticbeanstalk.com","host":"elasticbeanstalk.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":383,"domain":"chatgpt.site","host":"chatgpt.site","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://chatgpt.com/features/sites/","bytes":747201,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://chatgpt.com/features/sites/","bytes":747259,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":384,"domain":"netease.com","host":"www.netease.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.netease.com/llms.txt","bytes":2426,"truncated":false,"content_type":"text/html; charset=GBK"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.netease.com/llms-full.txt","bytes":2426,"truncated":false,"content_type":"text/html; charset=GBK","starts_with_heading":null}},{"rank":385,"domain":"atlassian.net","host":"atlassian.net","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.atlassian.com/software","bytes":1838845,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.atlassian.com/software","bytes":1838833,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":386,"domain":"stanford.edu","host":"stanford.edu","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.stanford.edu/llms.txt","bytes":240354,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.stanford.edu/llms-full.txt","bytes":240364,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":387,"domain":"shopifysvc.com","host":"shopifysvc.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":388,"domain":"dns.google","host":"dns.google","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://dns.google/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://dns.google/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":389,"domain":"name.com","host":"name.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.name.com/llms.txt","bytes":549,"truncated":false,"content_type":"text/plain; charset=UTF-8","h1":true,"title":"Name.com","summary":false,"sections":0,"links":0,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://www.name.com/llms-full.txt","bytes":1317,"truncated":false,"content_type":"text/plain; charset=UTF-8","starts_with_heading":true}},{"rank":390,"domain":"allawnos.com","host":"allawnos.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":391,"domain":"globo.com","host":"globo.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.globo.com/llms.txt","bytes":4167,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.globo.com/llms-full.txt","bytes":4167,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":392,"domain":"wps.com","host":"wps.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.wps.com/llms.txt","bytes":6576,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"WPS Office","summary":true,"sections":10,"links":53,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":true,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.wps.com/llms-full.txt","bytes":13845,"truncated":false,"content_type":"text/html;charset=utf-8","starts_with_heading":null}},{"rank":393,"domain":"issuu.com","host":"issuu.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://issuu.com/llms.txt","bytes":52929,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://issuu.com/llms-full.txt","bytes":52944,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":394,"domain":"myhuaweicloud.com","host":"myhuaweicloud.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":395,"domain":"nasa.gov","host":"nasa.gov","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.nasa.gov/llms.txt","bytes":192919,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.nasa.gov/llms-full.txt","bytes":192919,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":396,"domain":"opendns.com","host":"opendns.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.opendns.com/llms.txt","bytes":8064,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.opendns.com/llms-full.txt","bytes":8064,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":397,"domain":"go.com","host":"go.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.go.com/","bytes":359741,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.go.com/","bytes":359741,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":398,"domain":"xboxlive.com","host":"xboxlive.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":399,"domain":"bloomberg.com","host":"bloomberg.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.bloomberg.com/llms.txt","bytes":47423,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Bloomberg: Americas Homepage","summary":true,"sections":26,"links":138,"malformed_items":0,"relative_links":0,"duplicates":true,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.bloomberg.com/llms-full.txt","bytes":305240,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":400,"domain":"adnxs.com","host":"adnxs.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://adnxs.com/llms.txt","bytes":153,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://adnxs.com/llms-full.txt","bytes":153,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":401,"domain":"tiktokv.us","host":"tiktokv.us","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":402,"domain":"live-video.net","host":"live-video.net","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://live-video.net/llms.txt","bytes":111,"truncated":false,"content_type":"application/xml"},"llms_full":{"kind":"missing","status":403,"final_url":"https://live-video.net/llms-full.txt","bytes":111,"truncated":false,"content_type":"application/xml","starts_with_heading":null}},{"rank":403,"domain":"cookiedatabase.org","host":"cookiedatabase.org","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":404,"domain":"awsglobalaccelerator.com","host":"awsglobalaccelerator.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":405,"domain":"plesk.com","host":"plesk.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.plesk.com/llms.txt","bytes":8960,"truncated":false,"content_type":"text/plain; charset=UTF-8","h1":true,"title":"Plesk: Build, Secure and Run Apps and Websites","summary":true,"sections":18,"links":82,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":true,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.plesk.com/llms-full.txt","bytes":317166,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":406,"domain":"samsungcloudsolution.com","host":"samsungcloudsolution.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":407,"domain":"washingtonpost.com","host":"washingtonpost.com","robots_state":"ok","skipped":null,"llms":{"kind":"error","status":null,"final_url":"https://www.washingtonpost.com/llms.txt","bytes":0,"truncated":false,"content_type":""},"llms_full":{"kind":"error","status":null,"final_url":"https://www.washingtonpost.com/llms-full.txt","bytes":0,"truncated":false,"content_type":"","starts_with_heading":null}},{"rank":408,"domain":"githubusercontent.com","host":"www.githubusercontent.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":409,"domain":"amazontrust.com","host":"amazontrust.com","robots_state":"missing","skipped":null,"llms":{"kind":"error","status":null,"final_url":"https://amazontrust.com/llms.txt","bytes":0,"truncated":false,"content_type":""},"llms_full":{"kind":"error","status":null,"final_url":"https://amazontrust.com/llms-full.txt","bytes":0,"truncated":false,"content_type":"","starts_with_heading":null}},{"rank":410,"domain":"impervadns.net","host":"impervadns.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":411,"domain":"withgoogle.com","host":"withgoogle.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.google.com/","bytes":86952,"truncated":false,"content_type":"text/html; charset=ISO-8859-1"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.google.com/","bytes":86927,"truncated":false,"content_type":"text/html; charset=ISO-8859-1","starts_with_heading":null}},{"rank":412,"domain":"spov-msedge.net","host":"spov-msedge.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":413,"domain":"claude.ai","host":"claude.ai","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://claude.ai/llms.txt","bytes":157051,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"html","status":200,"final_url":"https://claude.ai/llms-full.txt","bytes":157051,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":414,"domain":"ibyteimg.com","host":"ibyteimg.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":415,"domain":"spotifycdn.com","host":"www.spotifycdn.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.spotifycdn.com/llms.txt","bytes":0,"truncated":false,"content_type":""},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.spotifycdn.com/llms-full.txt","bytes":0,"truncated":false,"content_type":"","starts_with_heading":null}},{"rank":416,"domain":"yandex.com","host":"yandex.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://yandex.com/llms.txt","bytes":9,"truncated":false,"content_type":"text/plain; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://yandex.com/llms-full.txt","bytes":9,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":null}},{"rank":417,"domain":"scdn.co","host":"www.scdn.co","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.scdn.co/llms.txt","bytes":0,"truncated":false,"content_type":""},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.scdn.co/llms-full.txt","bytes":0,"truncated":false,"content_type":"","starts_with_heading":null}},{"rank":418,"domain":"capcutapi.com","host":"capcutapi.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":419,"domain":"firetvcaptiveportal.com","host":"firetvcaptiveportal.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":420,"domain":"calendly.com","host":"calendly.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://calendly.com/llms.txt","bytes":11913,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Calendly","summary":true,"sections":10,"links":65,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://calendly.com/llms-full.txt","bytes":216301,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":421,"domain":"adobe.net","host":"adobe.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":422,"domain":"gcdn.co","host":"gcdn.co","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":423,"domain":"substack.com","host":"substack.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://substack.com/llms.txt","bytes":18944,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Substack","summary":true,"sections":10,"links":60,"malformed_items":14,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":60,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://substack.com/llms-full.txt","bytes":518285,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":true}},{"rank":424,"domain":"duckduckgo.com","host":"duckduckgo.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://duckduckgo.com/llms.txt","bytes":27341,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://duckduckgo.com/llms-full.txt","bytes":27632,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":425,"domain":"163.com","host":"163.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"http://www.163.com/","bytes":271577,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"http://www.163.com/","bytes":271577,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":426,"domain":"aol.com","host":"aol.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.aol.com/llms.txt","bytes":10684,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.aol.com/llms-full.txt","bytes":10699,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":427,"domain":"line.me","host":"line.me","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://line.me/llms.txt","bytes":7835,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://line.me/llms-full.txt","bytes":7835,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":428,"domain":"indeed.com","host":"indeed.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://indeed.com/llms.txt","bytes":27569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":403,"final_url":"https://indeed.com/llms-full.txt","bytes":27584,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":429,"domain":"temu.com","host":"temu.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.temu.com/llms.txt","bytes":0,"truncated":false,"content_type":""},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.temu.com/llms-full.txt","bytes":0,"truncated":false,"content_type":"","starts_with_heading":null}},{"rank":430,"domain":"steamcommunity.com","host":"steamcommunity.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://steamcommunity.com/","bytes":45857,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://steamcommunity.com/","bytes":45857,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":431,"domain":"unsplash.com","host":"unsplash.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":401,"final_url":"https://unsplash.com/.within.website?redir=%2Fllms.txt","bytes":9357,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":401,"final_url":"https://unsplash.com/.within.website?redir=%2Fllms-full.txt","bytes":9357,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":432,"domain":"ripn.net","host":"ripn.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":433,"domain":"expireddomains.com","host":"expireddomains.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://expireddomains.com/llms.txt","bytes":153,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://expireddomains.com/llms-full.txt","bytes":153,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":434,"domain":"spaceweb.pro","host":"spaceweb.pro","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":435,"domain":"kwai-pro.com","host":"www.kwai-pro.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.kwai-pro.com/llms.txt","bytes":576,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.kwai-pro.com/llms-full.txt","bytes":581,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":436,"domain":"tiktokcdn-eu.com","host":"tiktokcdn-eu.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":437,"domain":"telekom.de","host":"telekom.de","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.telekom.de/llms.txt","bytes":12422,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.telekom.de/llms-full.txt","bytes":12422,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":438,"domain":"tencent-cloud.net","host":"tencent-cloud.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":439,"domain":"sberbank.ru","host":"sberbank.ru","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":440,"domain":"netcraze.io","host":"netcraze.io","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":441,"domain":"tiktokv.eu","host":"tiktokv.eu","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":442,"domain":"dailymotion.com","host":"dailymotion.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.dailymotion.com/llms.txt","bytes":6153,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Dailymotion","summary":true,"sections":13,"links":0,"malformed_items":64,"relative_links":0,"duplicates":false,"deep_headings":true,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"html","status":200,"final_url":"https://www.dailymotion.com/llms-full.txt","bytes":60241,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":443,"domain":"beian.gov.cn","host":"beian.gov.cn","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":444,"domain":"heytapdl.com","host":"heytapdl.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":445,"domain":"twimg.com","host":"twimg.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":446,"domain":"adobedc.net","host":"adobedc.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":447,"domain":"vkuser.net","host":"vkuser.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":448,"domain":"bluehost.com","host":"bluehost.com","robots_state":"missing","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.bluehost.com/llms.txt","bytes":13006,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Bluehost","summary":true,"sections":17,"links":83,"malformed_items":6,"relative_links":0,"duplicates":true,"deep_headings":false,"optional_section":false,"md_links":1,"over_100kb":false},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.bluehost.com/llms-full.txt","bytes":447250,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":449,"domain":"nr-data.net","host":"nr-data.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":450,"domain":"tiktokpangle.us","host":"tiktokpangle.us","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":451,"domain":"statsigapi.net","host":"statsigapi.net","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://statsigapi.net/llms.txt","bytes":19,"truncated":false,"content_type":"text/plain"},"llms_full":{"kind":"missing","status":403,"final_url":"https://statsigapi.net/llms-full.txt","bytes":19,"truncated":false,"content_type":"text/plain","starts_with_heading":null}},{"rank":452,"domain":"myqcloud.com","host":"myqcloud.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":453,"domain":"vercel-dns-017.com","host":"www.vercel-dns-017.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.vercel-dns-017.com/llms.txt","bytes":107,"truncated":false,"content_type":"text/plain; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.vercel-dns-017.com/llms-full.txt","bytes":107,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":null}},{"rank":454,"domain":"intel.com","host":"intel.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.intel.com/llms.txt","bytes":12892,"truncated":false,"content_type":"text/plain;charset=utf-8","h1":true,"title":"Intel Corporation","summary":true,"sections":9,"links":64,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":true,"md_links":0,"over_100kb":false},"llms_full":{"kind":"file","status":200,"final_url":"https://www.intel.com/llms-full.txt","bytes":28556,"truncated":false,"content_type":"text/plain;charset=utf-8","starts_with_heading":true}},{"rank":455,"domain":"arxiv.org","host":"arxiv.org","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://arxiv.org/llms.txt","bytes":5786,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://arxiv.org/llms-full.txt","bytes":5791,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":456,"domain":"alicdn.com","host":"alicdn.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":457,"domain":"aliexpress.com","host":"aliexpress.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.aliexpress.com/s/error/404","bytes":13874,"truncated":false,"content_type":"text/html;charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.aliexpress.com/s/error/404","bytes":13874,"truncated":false,"content_type":"text/html;charset=utf-8","starts_with_heading":null}},{"rank":458,"domain":"nexthink.cloud","host":"nexthink.cloud","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":459,"domain":"drom.ru","host":"drom.ru","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.drom.ru/llms.txt","bytes":56931,"truncated":false,"content_type":"text/html; charset=windows-1251"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.drom.ru/llms-full.txt","bytes":56951,"truncated":false,"content_type":"text/html; charset=windows-1251","starts_with_heading":null}},{"rank":460,"domain":"hostgator.com","host":"hostgator.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.hostgator.com/llms.txt","bytes":387798,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.hostgator.com/llms-full.txt","bytes":387813,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":461,"domain":"eye4.cn","host":"eye4.cn","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":462,"domain":"run.app","host":"run.app","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://run.app/llms.txt","bytes":1569,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://run.app/llms-full.txt","bytes":1574,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":463,"domain":"taobao.com","host":"taobao.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://error.taobao.com/tbpc/error.html?from=https://www.taobao.com/llms.txt","bytes":1996,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://error.taobao.com/tbpc/error.html?from=https://www.taobao.com/llms-full.txt","bytes":1996,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":464,"domain":"mangosip.ru","host":"mangosip.ru","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":465,"domain":"netangels.ru","host":"netangels.ru","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.netangels.ru/llms.txt","bytes":9,"truncated":false,"content_type":"text/plain; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.netangels.ru/llms-full.txt","bytes":9,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":null}},{"rank":466,"domain":"lijit.com","host":"lijit.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://lijit.com/llms.txt","bytes":111,"truncated":false,"content_type":"application/xml"},"llms_full":{"kind":"missing","status":403,"final_url":"https://lijit.com/llms-full.txt","bytes":111,"truncated":false,"content_type":"application/xml","starts_with_heading":null}},{"rank":467,"domain":"g.page","host":"g.page","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.google.com/search?q=llms.txt&ucbcb=1","bytes":92946,"truncated":false,"content_type":"text/html; charset=ISO-8859-1"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.google.com/search?q=llms-full.txt&ucbcb=1","bytes":92882,"truncated":false,"content_type":"text/html; charset=ISO-8859-1","starts_with_heading":null}},{"rank":468,"domain":"yahoo.co.jp","host":"yahoo.co.jp","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.yahoo.co.jp/llms.txt","bytes":10051,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.yahoo.co.jp/llms-full.txt","bytes":10051,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":469,"domain":"gandi-ns.fr","host":"gandi-ns.fr","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":470,"domain":"pixabay.com","host":"pixabay.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://pixabay.com/llms.txt","bytes":5606,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"missing","status":403,"final_url":"https://pixabay.com/llms-full.txt","bytes":5621,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":471,"domain":"dropcatch.com","host":"dropcatch.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.dropcatch.com/llms.txt","bytes":104198,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.dropcatch.com/llms-full.txt","bytes":104198,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":472,"domain":"mcafee.com","host":"mcafee.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":473,"domain":"featureassets.org","host":"featureassets.org","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://featureassets.org/llms.txt","bytes":19,"truncated":false,"content_type":"text/plain"},"llms_full":{"kind":"missing","status":403,"final_url":"https://featureassets.org/llms-full.txt","bytes":19,"truncated":false,"content_type":"text/plain","starts_with_heading":null}},{"rank":474,"domain":"nmrodam.com","host":"nmrodam.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":475,"domain":"mzstatic.com","host":"mzstatic.com","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.apple.com/","bytes":254917,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.apple.com/","bytes":254917,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":476,"domain":"prodregistryv2.org","host":"prodregistryv2.org","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://prodregistryv2.org/llms.txt","bytes":18,"truncated":false,"content_type":"text/plain"},"llms_full":{"kind":"missing","status":404,"final_url":"https://prodregistryv2.org/llms-full.txt","bytes":18,"truncated":false,"content_type":"text/plain","starts_with_heading":null}},{"rank":477,"domain":"pushy.io","host":"pushy.io","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://pushy.me/llms.txt","bytes":11964,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://pushy.me/llms-full.txt","bytes":11964,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":478,"domain":"duolingo.com","host":"duolingo.com","robots_state":"ok","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://www.duolingo.com/llms.txt","bytes":11518,"truncated":false,"content_type":"text/html; charset=UTF-8"},"llms_full":{"kind":"html","status":200,"final_url":"https://www.duolingo.com/llms-full.txt","bytes":11698,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":479,"domain":"speedtest.net","host":"speedtest.net","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.speedtest.net/llms.txt","bytes":72110,"truncated":false,"content_type":"text/plain"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.speedtest.net/llms-full.txt","bytes":72110,"truncated":false,"content_type":"text/plain","starts_with_heading":null}},{"rank":480,"domain":"azure-dns.com","host":"azure-dns.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":481,"domain":"huawei.com","host":"huawei.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":403,"final_url":"https://www.huawei.com/llms.txt","bytes":378,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":403,"final_url":"https://www.huawei.com/llms-full.txt","bytes":387,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":482,"domain":"shein.com","host":"shein.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.shein.com/llms.txt","bytes":63855,"truncated":false,"content_type":"text/plain; charset=UTF-8","h1":true,"title":"SHEIN","summary":true,"sections":8,"links":189,"malformed_items":14,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.shein.com/llms-full.txt","bytes":399985,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":483,"domain":"trendmicro.com","host":"trendmicro.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.trendmicro.com/llms.txt","bytes":22999,"truncated":false,"content_type":"text/plain;charset=utf-8","h1":true,"title":"Trend Micro","summary":true,"sections":1,"links":78,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":true,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.trendmicro.com/llms-full.txt","bytes":73100,"truncated":false,"content_type":"text/html;charset=utf-8","starts_with_heading":null}},{"rank":484,"domain":"walmart.com","host":"walmart.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.walmart.com/llms.txt","bytes":125796,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.walmart.com/llms-full.txt","bytes":125796,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":485,"domain":"dyndns.org","host":"dyndns.org","robots_state":"html","skipped":null,"llms":{"kind":"html","status":200,"final_url":"https://account.dyn.com/","bytes":34160,"truncated":false,"content_type":"text/html; charset=ISO-8859-1"},"llms_full":{"kind":"html","status":200,"final_url":"https://account.dyn.com/","bytes":34160,"truncated":false,"content_type":"text/html; charset=ISO-8859-1","starts_with_heading":null}},{"rank":486,"domain":"cnbc.com","host":"cnbc.com","robots_state":"missing","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://cnbc.com/llms.txt","bytes":19,"truncated":false,"content_type":"text/plain; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://cnbc.com/llms-full.txt","bytes":19,"truncated":false,"content_type":"text/plain; charset=utf-8","starts_with_heading":null}},{"rank":487,"domain":"kwai.net","host":"www.kwai.net","robots_state":"ok","skipped":"robots-disallows","llms":null,"llms_full":null},{"rank":488,"domain":"dual-s-msedge.net","host":"dual-s-msedge.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":489,"domain":"businessinsider.com","host":"businessinsider.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://www.businessinsider.com/llms.txt","bytes":1066,"truncated":false,"content_type":"text/plain; charset=UTF-8","h1":true,"title":"Business Insider","summary":true,"sections":1,"links":9,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.businessinsider.com/llms-full.txt","bytes":180853,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":490,"domain":"goodreads.com","host":"goodreads.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.goodreads.com/llms.txt","bytes":57259,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.goodreads.com/llms-full.txt","bytes":57447,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":491,"domain":"bx-msedge.net","host":"bx-msedge.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":492,"domain":"visualstudio.com","host":"visualstudio.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://visualstudio.microsoft.com/llms.txt","bytes":146,"truncated":false,"content_type":"text/html"},"llms_full":{"kind":"missing","status":404,"final_url":"https://visualstudio.microsoft.com/llms-full.txt","bytes":146,"truncated":false,"content_type":"text/html","starts_with_heading":null}},{"rank":493,"domain":"wp.com","host":"wp.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://wordpress.com/llms.txt","bytes":7355,"truncated":false,"content_type":"text/plain","h1":true,"title":"WordPress.com","summary":true,"sections":8,"links":20,"malformed_items":36,"relative_links":0,"duplicates":false,"deep_headings":false,"optional_section":false,"md_links":0,"over_100kb":false},"llms_full":{"kind":"missing","status":404,"final_url":"https://wordpress.com/llms-full.txt","bytes":141943,"truncated":false,"content_type":"text/html; charset=UTF-8","starts_with_heading":null}},{"rank":494,"domain":"ietf.org","host":"ietf.org","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.ietf.org/llms.txt","bytes":77297,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.ietf.org/llms-full.txt","bytes":77297,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":495,"domain":"facebook.net","host":"facebook.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":496,"domain":"braze.com","host":"braze.com","robots_state":"ok","skipped":null,"llms":{"kind":"file","status":200,"final_url":"https://braze.com/llms.txt","bytes":97993,"truncated":false,"content_type":"text/plain; charset=utf-8","h1":true,"title":"Braze","summary":true,"sections":6,"links":54,"malformed_items":0,"relative_links":0,"duplicates":false,"deep_headings":true,"optional_section":false,"md_links":19,"over_100kb":false},"llms_full":{"kind":"error","status":500,"final_url":"https://braze.com/llms-full.txt","bytes":2427,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":497,"domain":"kaspersky-labs.com","host":"kaspersky-labs.com","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null},{"rank":498,"domain":"scribd.com","host":"scribd.com","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.scribd.com/llms.txt","bytes":41889,"truncated":false,"content_type":"text/html; charset=utf-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.scribd.com/llms-full.txt","bytes":41889,"truncated":false,"content_type":"text/html; charset=utf-8","starts_with_heading":null}},{"rank":499,"domain":"amazon.co.jp","host":"amazon.co.jp","robots_state":"ok","skipped":null,"llms":{"kind":"missing","status":404,"final_url":"https://www.amazon.co.jp/llms.txt","bytes":2166,"truncated":false,"content_type":"text/html;charset=UTF-8"},"llms_full":{"kind":"missing","status":404,"final_url":"https://www.amazon.co.jp/llms-full.txt","bytes":2166,"truncated":false,"content_type":"text/html;charset=UTF-8","starts_with_heading":null}},{"rank":500,"domain":"bunnyinfra.net","host":"bunnyinfra.net","robots_state":"unreachable","skipped":"robots-unreachable","llms":null,"llms_full":null}]}
