RobotsMetaProvider
Supported implementations for Robots Meta Provider.
Notes
Reads and applies robots directives from HTML <meta name="robots"> tags within web pages. Select one of the supported implementations to configure how robots meta tag instructions (such as noindex and nofollow) are handled.
Examples
The following example disables support for meta tag robot directives.
- YAML
- JSON
- XML
robotsMetaProvider: null
{
"robotsMetaProvider": null
}
<robotsMetaProvider/>
Implementations
- StandardRobotsMetaProvider Default