Content Available for AI Training
CreateLex AI welcomes responsible AI crawling and training on the following public content:
- Public documentation and guides
- Blog posts and tutorials
- Product information and features
- FAQ and help content
- Open source code examples
- Technical specifications for Model Context Protocol
Restricted Content
The following content is restricted from AI crawling and training:
- User account information and dashboards
- Private chat conversations and interactions
- Subscription and billing information
- Admin interfaces and internal tools
- API endpoints and private data
- User-generated content without explicit consent
Approved AI Crawlers
We currently allow the following AI crawlers on our public content:
- GPTBot - OpenAI ChatGPT and related services
- PerplexityBot - Perplexity AI search and answers
- CCBot - Common Crawl and various AI trainers
- Applebot - Apple Intelligence and Siri
- Googlebot - Google Search and Bard/Gemini
- Bingbot - Microsoft Bing and Copilot
Content Removal Requests
If you believe your content has been inappropriately included in AI training data, or if you wish to request removal of specific content, please contact us:
Email: [email protected]
Subject: AI Content Removal Request
Include: Specific URLs and reasoning for removal
AI Partnership Inquiries
We're open to partnerships with AI companies and researchers. If you're interested in:
- Licensing our Model Context Protocol documentation
- Collaborating on AI development tools
- Integrating CreateLex AI into your platform
- Research partnerships in AI-assisted development
Please reach out to us at [email protected]
Technical Implementation
Our robots.txt file and meta tags clearly indicate which content is available for crawling. We use standard web protocols to communicate our preferences:
- robots.txt directives for crawler guidance
- noindex meta tags for restricted content
- Structured data markup for better understanding
- Clear content licensing in our terms of service
Updates to This Policy
This policy may be updated from time to time. We will notify users of significant changes through our website and documentation. The current version is always available at this URL.
Last updated: January 13, 2025