How to add llms.txt to HubSpot CMS
HubSpot supports custom file uploads via the Design Tools file manager. Upload llms.txt and map the URL with a 301 redirect.
Before you start
- ✓CMS Hub Starter or above
- ✓Design Tools file manager access
- ✓An llms.txt body ready to upload
Install in 3 steps
- 1
Upload via File Manager
Marketing → Files and Templates → Files. Upload llms.txt and copy the CDN URL.
- 2
Add a URL redirect
Settings → Website → URL Redirects: add /llms.txt redirecting to the CDN file URL.
- 3
Verify
Curl your domain's /llms.txt. Confirm the final response is text/plain.
Troubleshooting
Purge the file in File Manager after each edit. CDN propagation is usually under 5 minutes.
Upgrade to CMS Hub Starter — Free Hub doesn't permit custom file hosting.
Common gotchas
- • HubSpot CDN returns the file with caching headers — purge after edits
- • Free CMS Hub plans limit file uploads — check quota
Generate your llms.txt in 30 seconds
Use the free OptimAIze generator, then follow the steps above to deploy on HubSpot CMS.
Frequently asked questions
Does HubSpot CMS need both llms.txt and robots.txt?
Yes. robots.txt grants crawler permission; llms.txt curates which pages matter. Together they form the minimum AI-search setup on any HubSpot CMS site.
Will adding llms.txt slow down my site?
No. It's a tiny static text file fetched once and cached aggressively. Page-load impact is effectively zero.
How often should I update llms.txt?
Whenever your canonical content set changes — new docs section, new product line, new pricing page. A monthly review is a sensible cadence for most sites.
Can I see whether AI engines read my llms.txt?
Check your server logs for user agents like GPTBot, ClaudeBot, PerplexityBot, and Google-Extended hitting /llms.txt. Most sites see traffic within days of publishing.
Other platforms
Understanding llms.txt for HubSpot CMS
The `llms.txt` protocol offers a crucial mechanism for webmasters to control how large language models (LLMs) access and utilize their website content. For HubSpot CMS users, integrating this file is paramount for maintaining brand voice, protecting proprietary information, and guiding LLMs towards accurate content attribution. This file acts as a directive, signaling to AI crawlers which parts of your site are permissible for training data and which are not. Properly configuring `llms.txt` within HubSpot's environment ensures that your digital assets contribute to AI knowledge bases under your explicit terms, preventing unauthorized scraping or misrepresentation of your carefully crafted content. It's a proactive step in the evolving landscape of AI visibility.
Publishing llms.txt on Your HubSpot Domain
While HubSpot CMS doesn't have a direct 'llms.txt' section, you can effectively publish it by uploading it as a file and then using a redirect. First, create your `llms.txt` file using a plain text editor, specifying your rules (e.g., `User-agent: * Disallow: /private-content/`). Next, navigate to your HubSpot portal, go to Marketing > Files and Templates > Files, and upload this text file. Once uploaded, copy the public URL provided by HubSpot for the file. Then, set up a 301 redirect from `/llms.txt` to the exact public URL of your uploaded file. This ensures that any AI crawler requesting `yourdomain.com/llms.txt` is correctly directed to your hosted policy, making your directives discoverable and actionable by AI systems.
Maintaining and Updating Your LLM Directives
The digital landscape and AI capabilities are constantly evolving, necessitating regular review and potential updates to your `llms.txt` file. As new content is published, or business strategies shift, your directives for AI models may need adjustment. To update, simply edit your local `llms.txt` file with the new rules, then re-upload it to HubSpot's file manager, overwriting the existing version. Since the redirect points to the file's static URL, the changes will propagate immediately. Periodically testing the `yourdomain.com/llms.txt` URL to ensure it serves the correct, most recent file is a vital maintenance step for effective AI visibility management and content governance.
llms.txt Directives & HubSpot Application
| Directive | Purpose for LLMs | HubSpot Implementation Note |
|---|---|---|
| User-agent: * | Applies rules to all LLM bots. | Standard practice; include at top of file. |
| Disallow: /pricing/ | Prevents LLMs from accessing specified paths. | Use specific paths (e.g., 'Disallow: /private/'). |
| Allow: /blog/public-post/ | Explicitly permits LLMs access (overrides disallow). | Useful for allowing specific sub-pages within a disallowed folder. |
| Crawl-delay: 10 | Suggests delay between requests. | Less common for LLMs; primarily for traditional search bots. |
| Sitemap: [URL] | Points to XML sitemap for content discovery. | Include HubSpot sitemap URL for comprehensive indexing. |
Key llms.txt Implementation Checklist for HubSpot
- Create `llms.txt` with appropriate `User-agent` and `Disallow` rules.
- Upload `llms.txt` to HubSpot's 'Files' section.
- Copy the public URL of the uploaded `llms.txt` file.
- Set up a 301 redirect from `/llms.txt` to the file's public URL.
- Verify `yourdomain.com/llms.txt` serves the correct file content.
- Schedule quarterly reviews for your `llms.txt` rules.
Step-by-Step: Deploying llms.txt on HubSpot CMS
- 1Craft Your `llms.txt` File
Use a plain text editor to create a file named `llms.txt`. Define your AI crawler directives, specifying which paths LLM bots (`User-agent: *`) should or should not access. Example: `User-agent: * Disallow: /internal/`.
- 2Upload to HubSpot Files
In your HubSpot portal, navigate to Marketing > Files and Templates > Files. Click 'Upload file', select your `llms.txt`, and complete the upload. Copy the unique public URL HubSpot provides for the file.
- 3Configure 301 Redirect
Go to Website > Website Pages > SEO & Tools > Redirects. Create a new redirect where the 'Original URL' is `/llms.txt` and the 'Redirect to' URL is the full public URL of your uploaded file. Ensure it's a 301 Permanent Redirect.
- 4Verify Deployment
Open your web browser and navigate to `yourdomain.com/llms.txt`. Confirm that the content displayed is exactly what you wrote in your `llms.txt` file. This verifies that AI crawlers will receive your directives correctly.
More questions answered
- Why is `llms.txt` important for my HubSpot site?
- It's crucial for controlling how large language models (LLMs) access and learn from your content. It prevents unwanted scraping, protects proprietary information, and ensures your brand's AI-driven presence aligns with your marketing and data governance strategies.
- Can I block specific LLM bots with `llms.txt`?
- Yes, similar to `robots.txt`, `llms.txt` supports specific `User-agent` directives. If an LLM provider publishes their bot's user-agent string (e.g., `User-agent: Google-Extended`), you can create specific rules for it, alongside general rules for all bots.
- Does HubSpot have a built-in `llms.txt` editor?
- No, HubSpot CMS does not currently offer a dedicated built-in editor or section for `llms.txt`. You must create the file externally, upload it to the file manager, and then use HubSpot's redirect tool to make it accessible at the standard `/llms.txt` path.
- What's the difference between `robots.txt` and `llms.txt`?
- `robots.txt` primarily guides traditional search engine crawlers (like Googlebot) for indexing. `llms.txt` is a newer, distinct protocol specifically designed to communicate directives to large language models and their associated AI crawlers about content usage for training and generation purposes.
Explore further
Connected guides to keep going — short reads, all internally linked.