Website Management
Generate the files and directives that control how crawlers move through a site, plus link housekeeping helpers.
4 tools
Robots.txt GeneratorCompose crawl directives per user-agent, add sitemap references and download a valid robots.txt.XML Sitemap GeneratorTurn a pasted list of URLs into a valid sitemap.xml with changefreq, priority and lastmod.HTML Viewer & SanitizerPreview HTML with scripts, event handlers and unsafe URLs stripped, and inspect the cleaned markup.URL ShortenerCreate short links that resolve through this workspace, stored locally in your browser for the demo.