Wordpress Themes - WP Forum at BFA
There will be no more development for Atahualpa (or any other theme), and no support. Also no new registrations. I turned off the donation system. I may turn the forum to read only if it gets abused for spam. Unfortunately I have no time for the forum or the themes. Thanks a lot to the people who helped in all these years, especially Larry and of course: Paul. Take care and stay healthy -- Flynn, Atahualpa developer, Sep 2021

Wordpress Themes - WP Forum at BFA » WordPress Themes » Atahualpa 3 Wordpress theme » Header configuration & styling »

robots.txt file is blocking Googlebot


 
Prev Previous Post   Next Post Next
  #1  
Old Apr 11, 2013, 02:04 AM
Ken Driver
 
9 posts · Aug 2012
robots.txt file is blocking Googlebot

Not sure this belongs in 'header' threads but could not see a more suitable category...
Keep getting an auto-generated email from Google that their googlebot cannot access the site. Google says the issue is the robots.txt file.
hoxtonindustries.com.au/robots.txt
I did not knowingly put this file on the server, nor did the client's SEO consultant, so assume it was auto-generated by either the Atahualpa theme, or by WordPress itself?
Here is the text that WAS in the file:
User-agent: *
Disallow: /_mm/
Disallow: /_notes/
Disallow: /_baks/
Disallow: /MMWIP/

User-agent: googlebot
Disallow: *.csi
The client's SEO consultant has since removed the last two lines, but still I get Google's 'access error' message. How did the file get there? Should I just delete it? What do /MMWIP/ and *.csi mean?

Also, in the Atahualpa Theme Options, there is some Google Analytics code put there by the SEO consultant. Could this code possibly be conflicting with the theme's own SEO Options? Not sure if this is in any way related to the robots.txt file (?) but I can turn off the theme SEO Options if you think that is advisable.
 

Bookmarks

Tags
googlebot, robots



Similar Threads
Thread Thread Starter Forum Replies Last Post
[SOLVED] tag, category pages are showing noindex,follow for robots meta tag Schafir Atahualpa 3 Wordpress theme 3 Nov 15, 2011 04:44 PM
[SOLVED] Importing Atahualpa settings file, file not valid Neut New Versions, & Updating 12 Feb 1, 2011 07:35 AM
[SOLVED] Where to insert robots meta tags pyoterguru Header configuration & styling 5 Apr 2, 2010 06:18 AM
[SOLVED] robots: can't turn off noindex, nofollow dickeson Atahualpa 3 Wordpress theme 2 Feb 28, 2010 03:54 PM
[SOLVED] Lijit Search, robots.txt, and /Disallow Wimbledon Plugins & Atahualpa 2 Oct 3, 2009 08:24 PM


All times are GMT -6. The time now is 08:14 PM.


Powered by vBulletin® Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.