SEO Executive Question:

What is robots.txt?

SEO Executive Interview Question
SEO Executive Interview Question

Answer:

Robots.txt is a text file used to give instructions to the search engine crawlers about the caching and indexing of a webpage, domain, directory or a file of a website.


Previous QuestionNext Question
Tell me what is the main purpose of search engine spiders?Which is better Robots.txt or Meta Robots Tag?