# agentsite-static-version=478df7b6-147e-409e-b52b-50b55cb427c3 # robots.txt for cached content # Policy: Allow all bots (AI crawlers and search engines) # Allow all user agents User-agent: * Allow: / # ========================================== # Resources # ========================================== # Sitemap Sitemap: /sitemap.xml # Original source # https://thetradedesk.com