A file on your website that gives instructions to search engine bots about which areas of your site they should or shouldn’t explore. It’s like a ‘Do Not Enter’ sign for certain parts of your site.
« Back to Glossary IndexRobots.txt
« Back to Glossary Index