Advanced Search  
Advanced Search


Pages: [1]
Print
Author Topic: Modifying Robots.txt for better SEO results?  (Read 1306 times)
fwpro145
Offline Offline

Posts: 15



« on: September 15, 2011, 09:39:45 AM »

This file is found in Joomla and appears to limit the indexing of images and certain other content by Google making it near impossible to get good SEO results. Here is what it looks like:

User-agent: *
Disallow: /administrator/
Disallow: /cache/
Disallow: /components/
Disallow: /images/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/

Which ones can we remove from the list and is it still safe for our website? I have an image based website (with news articles) and just found out that this is the reason I am not anywhere to be found on Google Image Search.

Thank-you.
Logged
jonahh
Shape 5 Administrator
Offline Offline

Posts: 17069



WWW
« Reply #1 on: September 15, 2011, 10:35:10 AM »

Only thing i would allow out of that list is /components
Logged

Jonah
------------
Shape 5 Team

- Need a great host for your website? We highly recommend siteground.com!


- Using Firebug will save you so much time, frustration and forum questions:
http://getfirebug.com/


- Need some custom coding done on your site? Use our Shape 5 Hire a Coder program for free:
http://www.shape5.com/hire_a_coder/listauctions
fwpro145
Offline Offline

Posts: 15



« Reply #2 on: September 15, 2011, 01:54:36 PM »

I read on other forum that my images are not indexed because of this so I adjusted by removing both Images and Media. Is there a reason why you would only remove Components?

Thank-you.
Logged
jonahh
Shape 5 Administrator
Offline Offline

Posts: 17069



WWW
« Reply #3 on: September 18, 2011, 01:32:55 PM »

Because this is the only directory that your site uses to create frontend urls from that google will see.  no reason for the bots to look in the other folders.  As for images and media most likely that is the reason for them not showing in image results I was only thinking for content and URLs so if you want your images in the results disallow those 2 folders also
« Last Edit: September 18, 2011, 01:34:32 PM by jonahh » Logged

Jonah
------------
Shape 5 Team

- Need a great host for your website? We highly recommend siteground.com!


- Using Firebug will save you so much time, frustration and forum questions:
http://getfirebug.com/


- Need some custom coding done on your site? Use our Shape 5 Hire a Coder program for free:
http://www.shape5.com/hire_a_coder/listauctions
Pages: [1]
Print

Jump to:  


Powered by SMF 1.1.18 | SMF © 2013, Simple Machines Page created in 0.045 seconds with 17 queries.