Answer:
Robots.txt is a text file. It is through this file, it gives instruction to search engine crawlers about indexing and caching of a webpage, file of a website or directory, domain.
| Previous Question | Next Question |
| Do you know what does the 302 server response code signify? | Tell me what is the difference between PR (page rank) and SERP (Search engine result page)? |