Subdomain and robots.txt

If you have a subdomain that has pages that you don’t want indexed, it’s important that you put a robots.txt in that directory’s root. For example, for https://forums.example.com/calendar.php you’d do:

User-agent: *

Disallow: /calendar.php

You can check if it works using
https://technicalseo.com/seo-tools/robots-txt/

Leave a Reply

Your email address will not be published. Required fields are marked *