Announcement

Collapse
No announcement yet.

What should I have in my Robots file?

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

  • OliviaSanders
    replied
    Re: What should I have in my Robots file?

    I believe the existing one should not create any issue.

    Leave a comment:


  • MarkRK
    replied
    Re: What should I have in my Robots file?

    Whatever you do not want Google to Index. Simple!

    Leave a comment:


  • BryanWalters
    replied
    Re: What should I have in my Robots file?

    Hello There,

    Can you please provide more details? like the screenshot of notification or robots file url.

    Are you using any plugin for robots.txt?

    Leave a comment:


  • eic2010
    started a topic What should I have in my Robots file?

    What should I have in my Robots file?

    Hi

    So far I have this in my robots.txt file but my google webmaster tools is showing the first three lines as errors. Have I got it wrong?

    User-agent: *
    Disallow: /wp-admin/
    Disallow: /wp-includes/

    User-agent: Mediapartners-Google
    Disallow:


    Sitemap: http://www.mydomain.co.uk/sitemap_index.xml

    Should I have anything else in it?
Working...
X