robots.txt for Dolphin 7.x
layoutzzz
posted 6th of March 2011
in
Community Voice.
6 comments.
As you know in BoonEx Dolphin 7.x absent robots.txt file by default.
I would like to present you my version of robots.txt file for BoonEx Dolphin 7.x
User-Agent: *# DirectoriesDisallow: /administration/Disallow: /backup/Disallow: /cache/Disallow: /cache_public/Disallow: /doc/Disallow: /flash/Disallow: /inc/Disallow: /langs/Disallow: /periodic/
Disallow: /plugins/Disallow: /simg/Disallow: /templates/Disallow: /tmp/Disallow: /xmlrpc/Disallow: /m/google_search/# FilesDisallow: /forgot.phpDisallow: /join.phpDisallow: /logout.phpDisallow: /get_rss_feed.phpDisallow: /searchKeyword.phpDisallow: /search_home.phpDisallow: /search.phpDisallow: /install.txtDisallow: /last_icon.txtDisallow: /license.txtDisallow: /readme.txtDisallow: /crossdomain.xml
Below is the legacy version of the Boonex site, maintained for Dolphin.Pro 7.x support.
The new Dolphin solution is powered by UNA Community Management System.
The new Dolphin solution is powered by UNA Community Management System.
Disallow: /modules/
Because when modules permalinks are off, then all module content begins with http://your.site.com/modules/index.php?r=/abc/de/, as the result most of your site content will not be indexed.
So, please remove this line or make a notice regarding modules permalinks setting.
I have just edited and deleted Disallow: /modules/ line from blog post.
Thank you, so mutch
robots.txt file - is used for allow or deny indexing content by search engine boots.
meta tag - are used for some information about page as keywords, description, author.
I suppose Dolphin script should use robots.txt file and meta tag together