Advanced Search
Shape 5
>
General Category
>
Joomla Talk
Topic: Modifying Robots.txt for better SEO results?
Pages: [
1
]
« previous
next »
Author
Topic: Modifying Robots.txt for better SEO results? (Read 1307 times)
fwpro145
Offline
Posts: 15
Modifying Robots.txt for better SEO results?
«
on:
September 15, 2011, 09:39:45 AM »
This file is found in Joomla and appears to limit the indexing of images and certain other content by Google making it near impossible to get good SEO results. Here is what it looks like:
User-agent: *
Disallow: /administrator/
Disallow: /cache/
Disallow: /components/
Disallow: /images/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/
Disallow: /xmlrpc/
Which ones can we remove from the list and is it still safe for our website? I have an image based website (with news articles) and just found out that this is the reason I am not anywhere to be found on Google Image Search.
Thank-you.
Logged
jonahh
Shape 5 Administrator
Offline
Posts: 17069
Re: Modifying Robots.txt for better SEO results?
«
Reply #1 on:
September 15, 2011, 10:35:10 AM »
Only thing i would allow out of that list is /components
Logged
Jonah
------------
Shape 5 Team
- Need a great host for your website? We highly recommend siteground.com!
- Using Firebug will save you so much time, frustration and forum questions:
http://getfirebug.com/
- Need some custom coding done on your site? Use our Shape 5 Hire a Coder program for free:
http://www.shape5.com/hire_a_coder/listauctions
fwpro145
Offline
Posts: 15
Re: Modifying Robots.txt for better SEO results?
«
Reply #2 on:
September 15, 2011, 01:54:36 PM »
I read on other forum that my images are not indexed because of this so I adjusted by removing both Images and Media. Is there a reason why you would only remove Components?
Thank-you.
Logged
jonahh
Shape 5 Administrator
Offline
Posts: 17069
Re: Modifying Robots.txt for better SEO results?
«
Reply #3 on:
September 18, 2011, 01:32:55 PM »
Because this is the only directory that your site uses to create frontend urls from that google will see. no reason for the bots to look in the other folders. As for images and media most likely that is the reason for them not showing in image results I was only thinking for content and URLs so if you want your images in the results disallow those 2 folders also
«
Last Edit: September 18, 2011, 01:34:32 PM by jonahh
»
Logged
Jonah
------------
Shape 5 Team
- Need a great host for your website? We highly recommend siteground.com!
- Using Firebug will save you so much time, frustration and forum questions:
http://getfirebug.com/
- Need some custom coding done on your site? Use our Shape 5 Hire a Coder program for free:
http://www.shape5.com/hire_a_coder/listauctions
Pages: [
1
]
Shape 5
>
General Category
>
Joomla Talk
Topic: Modifying Robots.txt for better SEO results?
« previous
next »
Jump to:
Please select a destination:
-----------------------------
General Category
-----------------------------
=> Pre-Sales Questions
=> Joomla Talk
=> Wordpress Talk
=> Template Showcase
=> Suggest a Template
=> General Talk/Questions/Comments
=> General News
-----------------------------
Joomla Templates
-----------------------------
===> University - Club
-----------------------------
Wordpress Club Themes
-----------------------------
=> FAQ for Wordpress