lundi 2 mars 2015

Robots.txt with WordPress and Joomla in same server



  1. Hi! I have this configuration in my server root (hosted):


root -> a Wordpress blog


DirectoryJ -> a Joomla site


DirectoryWP -> Another Wordpress blog


I don't know how to handle the robot.txt. Joomla 3.4 has a new robot.txt and it says i must move it to root. I did.


Wordpress has his own virtual robot.txt, and my WP Sitemap Plugin says: don't create a robot.txt so the plugin will add the http://ift.tt/1vUWgCZ to the virtual robot.txt


I wonder: how i can handle this.


MY robot.txt is this, in my root:


If the Joomla site is installed within a folder such as at


e.g. http://ift.tt/1iHdc5k the robots.txt file MUST be


moved to the site root at e.g. http://ift.tt/1iHdc5m


AND the joomla folder name MUST be prefixed to the disallowed


path, e.g. the Disallow rule for the /administrator/ folder


MUST be changed to read Disallow: /joomla/administrator/


#


For more information about the robots.txt standard, see:


http://ift.tt/Y909fT


#


For syntax checking, see:


http://ift.tt/qeHdbr


User-agent: * Disallow: /DirectoryJ/administrator/ Disallow: /DirectoryJ/bin/ Disallow: /DirectoryJ/cache/ Disallow: /DirectoryJ/cli/ Disallow: /DirectoryJ/components/ Disallow: /DirectoryJ/includes/ Disallow: /DirectoryJ/installation/ Disallow: /DirectoryJ/language/ Disallow: /DirectoryJ/layouts/ Disallow: /DirectoryJ/libraries/ Disallow: /DirectoryJ/logs/ Disallow: /DirectoryJ/modules/ Disallow: /DirectoryJ/plugins/ Disallow: /DirectoryJ/tmp/


Do you think it's well configured? Or should i add:


Disallow: /wp-includes/ Disallow: /wp-admin/ Disallow: /DirectoryWP/wp-includes/ Disallow: /DirectoryWP/wp-admin/


Thank you!





Aucun commentaire:

Enregistrer un commentaire