User-agent: * Allow: / # Block crawlers from /warm-intro and /pipegen-network slug URLs. # The bare paths stay crawlable (marketing/Ads landing pages). # Query-form URLs render scraped network data per visitor and have no # organic-search value: keeping them out of the crawl prevents Google's # Compromised Site classifier from sampling per-user content. Disallow: /warm-intro? Disallow: /pipegen-network? # One sitemap: an index of the marketing pages' sitemap and of the company # pages' and company lists' sitemap files released so far. The API's full # indexes, /c/sitemap.xml and /l/sitemap.xml, are deliberately not named # here: the SEO pages are released in tranches from the main index # (src/config/seoSitemapRollout.ts), and naming the full indexes would # hand crawlers every page at once. Sitemap: https://www.tamtam.ai/sitemap.xml