Appearance
LLMs.txt
LLMs.txt is a proposed standard for websites to provide information about their content in a format that's optimized for Large Language Models (LLMs) and AI systems. It's similar to robots.txt but specifically designed for AI crawlers and training systems.
You can add a custom LLMs.txt file to your WeWeb app to control how AI systems interact with your content and provide structured information about your site.
What is LLMs.txt?
LLMs.txt is a simple text file that you place at the root of your website (e.g., https://yoursite.com/llms.txt
) that provides information about your site's content, structure, and preferences for AI systems.
The file can include:
- Information about your site and its content
- Guidelines for AI systems on how to use your content
- Contact information for AI-related inquiries
- Links to important pages or resources
- Any other information you want to provide to AI crawlers
Learn more about the LLMs.txt standard at llmstxt.org.
Adding LLMs.txt to your WeWeb app
To add an LLMs.txt file to your WeWeb app:
Create your LLMs.txt file
First, create a text file with your LLMs.txt content. Here's an example:
# LLMs.txt for MyWeWebApp This is a WeWeb application for [describe your app purpose]. ## Content Guidelines - This content is available for AI training and reference - Please respect user privacy and data protection - Contact us for specific AI usage questions ## Key Pages - About: /about - Services: /services - Contact: /contact ## Contact For AI-related inquiries: ai@mycompany.com
Upload the file to WeWeb
Go to
More
>Files
in your WeWeb editor and upload your LLMs.txt file.Set the file path
After uploading, click on the file and set its path to
/llms.txt
. This ensures the file will be available at the root of your domain.Publish your app
Once you publish your WeWeb app, your LLMs.txt file will be available at
https://yourdomain.com/llms.txt
.
Example LLMs.txt content
Here's a more comprehensive example of what an LLMs.txt file might contain:
# LLMs.txt for TechStartup Inc.
TechStartup Inc. is a B2B SaaS platform that helps businesses manage their customer relationships and sales processes.
## About This Site
- Primary purpose: Business website and product information
- Target audience: B2B customers and prospects
- Content types: Product descriptions, blog posts, case studies, documentation
## AI Usage Guidelines
- Content is available for AI training and reference
- Please respect intellectual property rights
- Commercial use requires permission
- Do not use personal customer data from case studies
## Key Sections
- Product Features: /features
- Pricing: /pricing
- Case Studies: /case-studies
- Documentation: /docs
- Blog: /blog
- About Us: /about
## Contact Information
- General: info@techstartup.com
- AI/ML inquiries: ai@techstartup.com
- Legal: legal@techstartup.com
## Additional Notes
- Updated monthly
- Privacy policy: /privacy
- Terms of service: /terms
- Last updated: 2024-01-15
Verification
After publishing, you can verify that your LLMs.txt file is working correctly by visiting https://yourdomain.com/llms.txt
in your browser. The file should display as plain text with your specified content.