# VelvetVault Robots.txt # Protect client galleries and private routes from indexing # Portfolio indexing is controlled per-photographer via page-level robots metadata User-agent: * Allow: / Disallow: /g/ Disallow: /api/ Disallow: /dashboard/ Disallow: /admin/ Disallow: /auth/ # Allow Googlebot-Image on public pages (private content is already # blocked by the /g/, /api/, /dashboard/, /admin/ rules above) User-agent: Googlebot-Image Disallow: /g/ Disallow: /api/ Disallow: /dashboard/ Disallow: /admin/ Disallow: /auth/ User-agent: Bingbot Disallow: /g/ Disallow: /api/ # ============================================= # AI Search Crawlers # Allow AI search bots to index public content # so VelvetVault appears in AI search results # (ChatGPT, Perplexity, Google Gemini, etc.) # ============================================= # OpenAI - ChatGPT Search User-agent: OAI-SearchBot Allow: / Disallow: /g/ Disallow: /api/ Disallow: /dashboard/ Disallow: /admin/ Disallow: /auth/ # OpenAI - GPTBot (training + search data sharing with OAI-SearchBot) User-agent: GPTBot Allow: / Disallow: /g/ Disallow: /api/ Disallow: /dashboard/ Disallow: /admin/ Disallow: /auth/ # Perplexity AI User-agent: PerplexityBot Allow: / Disallow: /g/ Disallow: /api/ Disallow: /dashboard/ Disallow: /admin/ Disallow: /auth/ # Google AI (Gemini) User-agent: Google-Extended Allow: / Disallow: /g/ Disallow: /api/ Disallow: /dashboard/ Disallow: /admin/ Disallow: /auth/ # Anthropic (Claude) User-agent: anthropic-ai Allow: / Disallow: /g/ Disallow: /api/ Disallow: /dashboard/ Disallow: /admin/ Disallow: /auth/ # Common Crawl (used by many AI models for training data) User-agent: CCBot Allow: / Disallow: /g/ Disallow: /api/ Disallow: /dashboard/ Disallow: /admin/ Disallow: /auth/ # Sitemap Sitemap: https://velvetvault.app/sitemap.xml