Quickie Tidbit: Disallow Search Indexing

11 Jun

Some people who run wikis that are publicly accessible have asked us for the ability to set a robots.txt that tells polite search engines like Google, MSN, Alexa, and Yahoo to please not index the content of the public PBwiki.  We listened and added this functionality. If you’d like to enable this on your PBwiki, just go to the “Public / Private” settings tab and click Disable indexing. This sets your robots.txt, updates your page headers, and even puts a setting in your RSS & Atom feeds to discourage feed readers & scrapers from republishing your public feed.

4 Responses to “Quickie Tidbit: Disallow Search Indexing”

  1. Tracy Combs June 11, 2007 at 1:33 pm #

    Just to clarify for my nervous wiki-newbies: a private wiki is NOT indexed?

  2. David Weekly June 14, 2007 at 9:14 am #

    That’s correct, private wikis are inaccessible to search engines AND are marked to disallow indexing. (But without the password, the search engines could not even access the page, much less index it!)

  3. Michael Britcher June 14, 2007 at 9:39 am #

    is there a way to make part of a wiki indexed, but not other bits?

  4. Patrick June 21, 2007 at 9:36 pm #

    Wow — thanks for listening and putting this in. You folks are great!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: