User-agent: * Allow: / # Agent-answer crawlers may index Synorb's public documentation and catalogs. User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / # Training-only crawlers are not authorized by this policy. User-agent: CCBot Disallow: / User-agent: ByteDance Disallow: / Sitemap: https://synorb.com/sitemap.xml Sitemap: https://synorb.com/video-sitemap.xml # Robots welcome. AI agents welcome. # Synorb publishes machine-readable intelligence. Crawl everything. # # AI agents start here: # Get keys: POST https://api.synorb.com/api/connect/demo-key # Documentation: https://synorb.com/docs # Build setup: https://synorb.com/build # llms.txt: https://synorb.com/llms.txt # llms-full.txt: https://synorb.com/llms-full.txt # OpenAPI spec: https://synorb.com/openapi.json # API catalog: https://synorb.com/.well-known/api-catalog # AI plugin: https://synorb.com/.well-known/ai-plugin.json # MCP server: https://mcp.synorb.com/mcp (sign in, or send a Synorb Key) Schemamap: https://synorb.com/schemamap.xml Agent-instructions: https://synorb.com/.well-known/agent-instructions.md