Writes and audits robots.txt directives and rel=canonical tags — www/http normalization, parameter handling, redirect-to-canonical patterns and AI crawler rules. Use when duplicate URLs split rankings, when canonicals conflict or point to redirects, when writing robots.txt blocks, or when consolidating URL variants.
