Robots.txt checker

Additional page content: Editable from the admin panel -> languages -> choose or create language -> translate app page.

Similar tools

Check the status code returned by a website for a generated missing page.

Checks if a webpage is set to noindex, preventing it from appearing in search engines.

Get all the HTTP headers that an URL returns for a typical GET request.

Get the web-host of a given website.

Find A, AAAA, CNAME, MX, NS, TXT, SOA DNS records of a host.

Get & verify the meta tags of any website.

Get approximate IP details.

Check whether a website is using the Brotli Compression algorithm or not.

Take an IP and try to look for the domain/host associated with it.