Robots File
Used to add a robots.txt file to to tell search engine crawlers which pages or files they should not access on your website and point to the XML sitemap.
Content Type Details
- ID: 294
- Name: Robots File
- Minimum user level: Administrator
- Compatible with page layouts: N/A
Guidance
- Content Location: This content type should be added to the homepage section
- Syntax: Add valid syntax for
robots.txtfile to the Robot File element - Output: A
robots.txtfile is created at the root of the site after publishing e.g., at/robots.txt
Content Type Elements Details
| Name | Description | Size | Type | Required | Conditionally Shown |
|---|---|---|---|---|---|
| Name | The Name Element | 80 Characters | Plain Text | Yes | No |
| Robot File | Enter the code you wish to be output in the robots.txt file. | 2000 Characters | Plain Text | Yes | No |