[pmwiki-users] Crawling through

pmwiki at 911networks.com pmwiki at 911networks.com
Thu Dec 14 20:48:13 CST 2006


I am trying to make a sitemap to submit to google & yahoo. 
I used the free website: xml-sitemaps.com.

I have configured:

$SearchPatterns['default'][] = '!\\.(All)?Recent(Changes|Uploads|Comments)$!';
$SearchPatterns['default'][] = '!\\.Group(Print)?(Header|Footer|Attributes)$!';
$SearchPatterns['default'][] = '!\\.(Left|Right|Side)(Bar|Menu|Note)$!';
$SearchPatterns['default'][] = '!^Site\\.!';
$SearchPatterns['default'][] = '!^PmWiki\\.!';

# disable the page history [globally]
if ($action == 'diff') $action='browse';
# so that only registered users can see the source
$HandleAuth['diff'] = $HandleAuth['source'] = 'edit';

upload is also disabled in local/config.php

The problem that xml-sitemaps.com included all the Site files, the PmWiki files, the footers, 
the headers as separate files. It also indexed the same pages as: edit, diff, source, upload

It created the following: 

<url>
  <loc>http://www.sqlhacks.com/index.php/Retrieve/SqlAlias-in-where-clause?action=source</loc>
  <priority>0.5</priority>
  <changefreq>weekly</changefreq>
</url>
<url>
  <loc>http://www.sqlhacks.com/index.php/Site/RecentChanges?action=edit</loc>
  <priority>0.5</priority>
  <changefreq>weekly</changefreq>
</url>
<url>
  <loc>http://www.sqlhacks.com/index.php/Site/RecentChanges?action=diff</loc>
  <priority>0.5</priority>
  <lastmod>2006-12-15T02:37:00+00:00</lastmod>
  <changefreq>weekly</changefreq>
</url>
<url>
  <loc>http://www.sqlhacks.com/index.php/Site/RightBar?action=source</loc>
  <priority>0.5</priority>
  <changefreq>weekly</changefreq>
</url>
<url>
  <loc>http://www.sqlhacks.com/index.php/Site/RightBar?action=upload</loc>
  <priority>0.5</priority>
  <changefreq>weekly</changefreq>
</url>
<url>
  <loc>http://www.sqlhacks.com/index.php/Site/SideBarFooter?action=edit</loc>
  <priority>0.5</priority>
  <changefreq>weekly</changefreq>
</url>
<url>
  <loc>http://www.sqlhacks.com/index.php/Site/SideBarFooter?action=diff</loc>
  <priority>0.5</priority>
  <lastmod>2006-12-15T02:37:00+00:00</lastmod>
  <changefreq>weekly</changefreq>
</url>
<url>
  <loc>http://www.sqlhacks.com/index.php/Site/SideBarFooter?action=source</loc>
  <priority>0.5</priority>
  <changefreq>weekly</changefreq>
</url>
<url>
  <loc>http://www.sqlhacks.com/index.php/Site/SideBarFooter?action=upload</loc>
  <priority>0.5</priority>
  <changefreq>weekly</changefreq>
</url>

Any suggestion?

-- 
Thanks
http://www.sqlhacks.com
The SQL knowledge base




More information about the pmwiki-users mailing list