Is it necessary to use Robots.txt file?

[mcafeeactivate]

Hello friends- Is it necessary to use Robots.txt file? It can be affect on website ranking in search engine.

[Rogerdavid]

Yes, Robot.txt file is necessary because it gives instruction to search engine to index the website

[Guest]

If you do want to receive traffic from search engines then a robots.txt file isn't needed but who wouldnt want to right?

It's a must and without it you won't receive any traffic to your site.

[ranson]

Anyone would be stupid enough not to use robots.txt file for their website. You want everything on your site to be fixed and want more exposure to your business right?

[crystal]

Without that you will never rank on search engines so it's very important to have a robots.txt file.

[Rogerdavid]

Yes robot.txt file is necessary because it gives instructions to web robots about the pages that the website owner doesn’t wish to be ‘crawled’.

[seangibson]

Yes if you don't want to index any page of your website and if you want to google bot read your website.