FREE MOD DeeEmm - Sitemap Generator

Official support thread for the FREE DeeEmm - Sitemap Generator MOD

http://www.boonex.com/unity/extensions/entry/FREE_MOD_DeeEmm_Sitemap_Generator

Support also offered via the forums on our website www.deeemm.com

Description

You DeeMan! Well done. I will certainly give it a try. Thanks.

No probs. Be sure to leave a comment if it works for you.

/DM

I'm not exactly sure what this is supposed to do, or what I'm supposed to do other than submit a blank page to Google.

I uploaded the file to the root of my site, but when I call it I get a blank page.

Could you fill me in a little DeeEmm?

Thanks!

Corey

EDIT: The blank page seems to be yet another IE8 issue. I see the content in Chrome and FireFox.

I don't think Google uses IE8 so I will submit away - as is.

Thanks DeeEmm!

Yes, not sure why IE8 does not display it. Maybe it does not like the doctype??

At any rate, I've had a few messages about the mod, so I have updated the description.

Just to clarify...

This MOD creates an automatically generated sitemap that you can use to submit to Google.
The File generates an XML sitemap file that complies with Googles validation requirements.
All you need to do is to submit the URL for the file as your Sitemap in Google tools - http://yoursite.com/sitemap.php
NOTE: An XML extension is not required for your google sitemap as the doctype is specified in the document itself. Also note that this file does not create a clickable page of links - In most browsers it appears as a jumble of URL's. This is normal. To view the file correctly, simply view the page source.

If you want to see the file output, and you are an IE8 user (possibly IE7 too) - You will probably need to view this file with another browser. If you're not bothered about what the output looks like, simply submit the URL as normal.

/DM

Hey DM,

Thanks for the Free Mod(s)

Google is giving me a parse error on line 168. As there is nothing I can screw up, any idea why they would be having problems with it?

168

Parsing error We were unable to read your Sitemap. It may contain an entry we are unable to recognize. Please validate your Sitemap before resubmitting.

Hey DM,

Thanks for the Free Mod(s)

Google is giving me a parse error on line 168. As there is nothing I can screw up, any idea why they would be having problems with it?

168

Parsing error We were unable to read your Sitemap. It may contain an entry we are unable to recognize. Please validate your Sitemap before resubmitting.

Hi.

It's probably an issue with a URL that it does not like. Take a look at the line and see if it is something obvious. It might be something like an illegal character. You will need to view it in something other than Explorer and also you will need to view the source to see the XML properly formatted.

If you cannot see an issue - post the whole node up here - like this...

</url>
<loc>http://yoursite.com/categories.php?action=users</loc>
<priority>0.1</priority>
</url>

...and I will take a look.

/DM

From Google Validator;

validator crash during target reading

Error: Expected ; after entity name, but got =
in unnamed entity at line 168 char 60 of http://www.cityofmemphis.com/sitemap.php

Line 168-172

<url>
<loc>http://www.cityofmemphis.com/forum/?action=live_tracker</loc>

<priority>0.1</priority>
</url>

It looks okay.

What is Google validator? Is this report from webmaster tools?

If not, simply submit the sitemap to Google > Webmaster Tools -> Click on the submit a sitemap button.

Not sure if any third party validators will validate this correctly, it's only designed for Google. If there is an issue with the code in the submission to Google webmaster tools it will return a failure in the status column.

Only other issue I have heard of was for user who had a massive site - Google sitemap only supports a maximum of 50,000 entries

HTH

/DM

Sorry, I didn't make that clear enough.

The initial error I posted was from Google Webmaster Central after submitting the sitemap.

The validator I used to try to get a more specific error was http://www.xml-sitemaps.com/validate-xml-sitemap.html

My website is the exact opposite of massive :)

As I viewed the source of sitemap.php and copy/pasted into Dreamweaver, it is possible that line 168 as I posted is erroneous due to whitespaces etc.

Thanks for taking the time to assist me.

Syde

New Version Available.

Bugfix release to address issue of multiple URL's.

Free to download from link in first post.

/DM

Hi Syde,

Try the new version out and let me know how you get on.

/DM

 Just installed the new version and I get a big ugly red box that say's....

ha - that'd be right.

OK - lemme take a look.

/DM

Nevermind Mick. It was trying to query the events mod and I'm not using that. It's not a problem with the mod.

Thanks for the update  : )

Working okay on both my sites.

Have you commented out the modules that you are not using? - check at top of file - simply comment out those that you do not have installed.

/DM

LOL - you beat me to it

/DM

 I start a little slow sometimes, but I tend to catch up - given time. ha ha  ; )

Appears to have corrected my issue, after commenting out unused modules from sitemap.php. Thanks a ton DM!

Syde

Happy to help :)

/DM

New version of Sitemap generator available. Either download from the market or from attachment to this post

Bugfix release to address issue with query string in URL's

Also XML schema changed to allow submission to Yahho and Microsith.

Also working on a sitemap page (clickable links) Will be available soon.

TIP: make sure you have a robots.txt file that points to your sitemap - this allows other search engines to find it.

Create a file called robots.txt and put the following info in it.

User-agent: *
Disallow: /admin/
Disallow: /inc/
Disallow: /langs/
Disallow: /xml/
Sitemap: http://www.yoursite.com/sitemap.php

Upload it to your webroot.

Enjoy.

/DM

new version gives database query error. no details of any error are shown.

User-agent: *
Disallow: /admin/
Disallow: /inc/
Disallow: /langs/
Disallow: /xml/
Sitemap: http://www.yoursite.com/sitemap.php

Have you enabled / disabled the correct modules for your site?

Please check the readme file for installation instructions

/DM

User-agent: *
Disallow: /admin/
Disallow: /inc/
Disallow: /langs/
Disallow: /xml/
Sitemap: http://www.yoursite.com/sitemap.php

Yahho and Microsith? LMAO

Thanks for the update Mick!

works like a charm now. sorry for late feedback

does it work with 7.0.3 ??

it worked fine wtih 7.0.2

i am getting the following error now with 7.0.3 ...

DeeMee, first of all thanks a lot for this piece of work :-)

Secondly is there a way that the members will be generated as well?

Thanks

DeeEmm this mod is working just fine in my D7.0.3

:)

I got the same...

I think you must install some modules, what this file needs. i also got this alert early, but i installed modules, then all is OK

dont work anymore... this sitemap... google says: Unsupported file format

Your Sitemap does not appear to be in a supported format. Please ensure it meets our Sitemap guidelines and resubmit.

I'm not sure if DeeEmm keeps his free mods on this site up to date anymore.  I think he found better things to do with his time.  You might want to try something else.  I think AndrewP had a free sitemap module, but he's in solitary confinement for a while, and you won't find his products in the market until he's released.

I haven't seen him in quite a while, actually. I've seen quite a number of people complaining that his mods are outdated and no longer work, and he doesn't appear to be updating them.

To fix this on IE you need to make the XML file generated by sitemap.php fully compliant. As written it leaves out the <?xml version="1.0" ?> header required by XML. This may also be why some crawlers have problems with it. The fix is simple. In the sitemap.php file change the SiteMap_header to:

$SiteMap_header = '<?xml version="1.0" ?>' . "\n" . '<urlset xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd" xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">';

I have this error message on Google webmaster tool:

---------------------------------------------------------------------

We've detected that you submitted your Sitemap using a URL path that includes the www prefix (for instance, http://www.example.com/sitemap.xml). However, the URLs listed inside your Sitemap don't use the www prefix (for instance, http://example.com/myfile.htm).

---------------------------------------------------------------------

thanks man, thank god there are people like you around!

Well...actually it doesnt work and google does not support the format.  Good effort anyway...

I get some errors... how i can fix this:

	Line	Status	Details
	384	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.2 Problem detected on: Mar 21, 2011
	389	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.3 Problem detected on: Mar 21, 2011
	394	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.5 Problem detected on: Mar 21, 2011
	519	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.2 Problem detected on: Mar 21, 2011
	524	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.2 Problem detected on: Mar 21, 2011
	529	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.3 Problem detected on: Mar 21, 2011
	534	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.5 Problem detected on: Mar 21, 2011
	649	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.1 Problem detected on: Mar 21, 2011
	654	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.2 Problem detected on: Mar 21, 2011
	659	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.2 Problem detected on: Mar 21, 2011
	664	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.3 Problem detected on: Mar 21, 2011

This format was recognised by Google's sitemaps system, but it timed out due to the sheer number of URLs in our sitemap:

- General HTTP error: HTTP 408 error (Request timeout)
We encountered an error while trying to access your Sitemap.

Thanks for this wonderful mod but I also need the member profiles to be included in the sitemap. Is it possible to add that feature? Thanks again.

I get some errors... how i can fix this:

Format	Submitted URLs	Submitted	Downloaded
Sitemap	174 Index count pending	Mar 21, 2011 Pending download...	--

Sitemap errors and warnings

	Line	Status	Details
	384	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.2 Problem detected on: Mar 21, 2011
	389	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.3 Problem detected on: Mar 21, 2011
	394	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.5 Problem detected on: Mar 21, 2011
	519	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.2 Problem detected on: Mar 21, 2011
	524	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.2 Problem detected on: Mar 21, 2011
	529	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.3 Problem detected on: Mar 21, 2011
	534	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.5 Problem detected on: Mar 21, 2011
	649	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.1 Problem detected on: Mar 21, 2011
	654	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.2 Problem detected on: Mar 21, 2011
	659	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.2 Problem detected on: Mar 21, 2011
	664	Invalid tag value This XML tag has an invalid value. Please fix it and resubmit.	Parent tag: url Tag: priority Value: 1.3 Problem detected on: Mar 21, 2011

I think the problem is due to the priority tags having values more than 1. For example 1.3, 1.2 and 1.5 which should be 1.0 or less than 1.0.

This will depend on the highest number in the "Order" column in the 'sys_menu_top' table in your msql database. Find this code in the sitemap.php file:

//priority based on menu order
$priority =  round($top_menu_items['Order'] / 30, 1);

For example the highest number is 45, then change it to:

//priority based on menu order
$priority =  round($top_menu_items['Order'] / 45, 1);