Hello, from the new Web Analyst

21 Nov

I joined PBwiki last month as the first web analyst on the team.  One of my key roles here is to analyze how people interact with their wikis so that we can craft our products and services to best meet your needs.

We can monitor PBwiki to see what’s working and what’s not
One of the greatest facets of having a “software as a service” (SaaS) model is that we have an on-going relationship with our users and can observe how they interact with our product.  Compare that to the standard shrink-wrapped software model, where the vendor sells the product and then disappears from the customer’s sight until they want to sell an upgrade.  The benefit, of course, of us knowing how you are using our product, is that we can enhance the product to better suit your needs.

Case study: How many users use Document Management functionality?
Before the new features
As a concrete example of how PBWiki analyzes user behavior to improve the value of our product, let’s look at our new Document Management capabilities.  On any given day earlier in October, roughly 35% of active wikis were uploading files (see table 1).  This adoption rate indicates that you find document management useful and that we need to focus product development effort on it.  But at the end of the day, this number doesn’t give us much guidance in terms of what direction to take this feature.  To make any decisions regarding the product, we also had to look closely at qualitative data.  The quantitative data (i.e. the 35% adoption rate) lets our product team know what you’re doing, but the qualitative data lets us know why you’re doing what you’re doing.

Table 1 – Pre-feature enhancement adoption rate

Date Adoption
10/11 33.0%
10/12 34.3%
10/13 35.7%

After we released Document Management
After analyzing the qualitative data (e.g. user feedback), we realized the need for several new features (including access control), implemented them, and pushed them live near the end of October.  So, how do we know if these new features were useful?  We monitored the adoption rate and saw it jump over 10% (see table 2)!  The upshot of this example is that at PBwiki, we listen to our users so that we can build the best products to solve their needs.

Table 2 – Post-feature enhancement adoption rate

Date Adoption
10/29 41.3%
10/30 41.1%
10/31 40.0%

Web analytics and your privacy
We take your privacy seriously at PBWiki.  As a reminder, the non-binding English summary of our privacy policy is

  • If you mark your wiki private, we’ll keep it private.
  • We don’t share personally identifiable information with others.
  • We hate spammers, too. We’ll try not to bug you with email.

During any analysis, I will be sifting through the 1 billion events that our users have generated over the past few years.  Because of the immense size of our data set, I work with anonymous and aggregate data.  In the analysis of Document Management above, I included over 100,000 wikis and at no point did I need to drill into the specific details of any one wiki or user.

What kind of data would you like to see?

7 Responses to “Hello, from the new Web Analyst”

  1. Paul November 23, 2008 at 12:45 am #

    What kind of data….. One area I would like to see analysed is the update history.

    How many people clean up their edit history?

    How many people individually delete history items?

  2. Jonathan November 24, 2008 at 8:12 am #

    Welcome to the team!

  3. Tom Collier November 24, 2008 at 2:46 pm #

    Paul, believe it or not, with 1 billion events in our data warehouse, we do not currently store deletion of page history events. That’s not to say the data is completely lost, we’ve likely tracked it in some log file.

    Jonathan, thanks. I’m glad to be here and enjoy working with such a smart group of people.

  4. Kenneth M. Briggs November 25, 2008 at 1:47 pm #

    To whom it may concern,

    My question is how do I “upload” this wiki once I complete it? That would make it a website that anyone can visit anytime. Or do you have to give permission to people to access it? My wiki is an educational project for a Master class. My instructor will grade it after it is completed and she will definitely need access.

    By the way, how come the “Sidebar” is NOT unique for each page? Instead, if I make comments unique to my “Page Two,” it still shows up on my “Front Page!”

    I recently completed a webquest, and when you finish it, they upload it for you and give you a URL website address you can give to anyone who wants to review it. Thanks.

  5. rachel November 26, 2008 at 12:04 pm #

    Hi Kenneth,

    If you set your wiki to be viewable by anyon – it is viewable by all already. Wikis are web-based, so they are “uploaded” already.

    The sidebar is a special page on your wiki that appears on all pages. It will appear on all your pages.

    I hope this helps! If you have any other questions, please get in touch with PBwiki Support & Services through the Help link on your wiki.

    Good luck!

  6. waab December 1, 2008 at 1:56 pm #

    Is there somewhere I can go to learn about Wiki? I have joined but it took me many months to actually get logged on and now I feel I am way behind. There are things posted but I do not know how to access them?

  7. rachel December 4, 2008 at 2:20 pm #

    Hi Waab – the first place to look would be our user manual: pbwikimanual.pbwiki.com. We also have a lot of great videos at pbwiki.com/content/supportcenter.

    And as always, if you have questions, please click the “help” link on your wiki to get in touch with our support team!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: