SEO Expert Question: Download SEO Expert PDF
Tell me under what circumstances we intend to eliminate pages from search engines through robots.txt vs. Meta robots tag?
Answer:
Generally, I would continue to employ robots.txt in order to make search engine indexing a directory on a website. This might be often a directory that is concerned with admin function or incorporate contents only in the form of script or image gallery. Generally, robots.txt is employed to prevent a directory and its sub-folders and files to crawl by search engine bot as well as Meta robots tag for a specific web page.
| Previous Question | Next Question |
| Is HTML either a case sensitive or case insensitive? | Tell me what things are significant in organically ranking a website? |