[SOLVED] Lijit Search, robots.txt, and /Disallow
Hello,
I implement Lijit Search on all my sites, as I really like the control it gives me over the search box and the detailed analytics. I recently received a message from Lijit support (whom are great people, btw) stating this: Quote:
I googled to learn more about the "Disallow" and want to know --- should I Disallow certain folders or can I just delete this line? I am still relatively new to understanding the code and want to be sure that I know what I'm doing so I don't negatively impact how Google search crawlers see the site, etc. Anyone else using Lijit? |
Atahualpa doesn't have a robot.txt, but you might have set one up with WP. See this article about Search Engine Optimization for WordPress.
http://codex.wordpress.org/Search_En...t_Optimization At the bottom is a section on Robots.txt Optimization |
Thanks for the helpful link.
What I realized now is that the robots.txt file is from the MyBB forum installation I paired with Atahualpa for this particular site. Sorry for thinking this was an Atahualpa question... |
All times are GMT -6. The time now is 05:40 PM. |
Powered by vBulletin® Copyright ©2000 - 2024, Jelsoft Enterprises Ltd.