[pmwiki-users] Crawling through
pmwiki at 911networks.com
pmwiki at 911networks.com
Thu Dec 14 20:48:13 CST 2006
I am trying to make a sitemap to submit to google & yahoo.
I used the free website: xml-sitemaps.com.
I have configured:
$SearchPatterns['default'][] = '!\\.(All)?Recent(Changes|Uploads|Comments)$!';
$SearchPatterns['default'][] = '!\\.Group(Print)?(Header|Footer|Attributes)$!';
$SearchPatterns['default'][] = '!\\.(Left|Right|Side)(Bar|Menu|Note)$!';
$SearchPatterns['default'][] = '!^Site\\.!';
$SearchPatterns['default'][] = '!^PmWiki\\.!';
# disable the page history [globally]
if ($action == 'diff') $action='browse';
# so that only registered users can see the source
$HandleAuth['diff'] = $HandleAuth['source'] = 'edit';
upload is also disabled in local/config.php
The problem that xml-sitemaps.com included all the Site files, the PmWiki files, the footers,
the headers as separate files. It also indexed the same pages as: edit, diff, source, upload
It created the following:
<url>
<loc>http://www.sqlhacks.com/index.php/Retrieve/SqlAlias-in-where-clause?action=source</loc>
<priority>0.5</priority>
<changefreq>weekly</changefreq>
</url>
<url>
<loc>http://www.sqlhacks.com/index.php/Site/RecentChanges?action=edit</loc>
<priority>0.5</priority>
<changefreq>weekly</changefreq>
</url>
<url>
<loc>http://www.sqlhacks.com/index.php/Site/RecentChanges?action=diff</loc>
<priority>0.5</priority>
<lastmod>2006-12-15T02:37:00+00:00</lastmod>
<changefreq>weekly</changefreq>
</url>
<url>
<loc>http://www.sqlhacks.com/index.php/Site/RightBar?action=source</loc>
<priority>0.5</priority>
<changefreq>weekly</changefreq>
</url>
<url>
<loc>http://www.sqlhacks.com/index.php/Site/RightBar?action=upload</loc>
<priority>0.5</priority>
<changefreq>weekly</changefreq>
</url>
<url>
<loc>http://www.sqlhacks.com/index.php/Site/SideBarFooter?action=edit</loc>
<priority>0.5</priority>
<changefreq>weekly</changefreq>
</url>
<url>
<loc>http://www.sqlhacks.com/index.php/Site/SideBarFooter?action=diff</loc>
<priority>0.5</priority>
<lastmod>2006-12-15T02:37:00+00:00</lastmod>
<changefreq>weekly</changefreq>
</url>
<url>
<loc>http://www.sqlhacks.com/index.php/Site/SideBarFooter?action=source</loc>
<priority>0.5</priority>
<changefreq>weekly</changefreq>
</url>
<url>
<loc>http://www.sqlhacks.com/index.php/Site/SideBarFooter?action=upload</loc>
<priority>0.5</priority>
<changefreq>weekly</changefreq>
</url>
Any suggestion?
--
Thanks
http://www.sqlhacks.com
The SQL knowledge base
More information about the pmwiki-users
mailing list