Web Analytics Success Measurement For Government Websites

Tuesday, October 13, 2009 | 10:54 AM

Labels:

[Cross-posted from the personal blog of Google Analytics Evangelist Avinash Kaushik]

Prickly Problem If you know what the desirable outcomes are from your website, it is not hard to measure performance of the website for you and your customers.

Measuring top line success of ecommerce websites is not very complicated, all the sweet revenue based outcomes are there (at the least).

Measuring non-profit websites is a bit complicated, but not really all that hard because we can, with a small amount of love, figure out outcomes to focus on (donations, # of sign-ups for the protest in DC, # of petitions signed, volunteer applications, etc).

Measuring government websites is a bit more complicated, if for no other reason than that it takes a pinch of effort with a dash of imagination to figure out what one is solving for. What are the desirable outcomes one can focus on to measure success?

The above question came to mind from a kind note I got from Ines Jans who is a part of the team that is responsible for www.belgium.be
belgium.be
Ines and team were just starting to think about analytics (because the love their customers!) and asked for some thoughts.

My first question to Ines was, (surprise!):
Q: Tell me a bit more about what your site does, like what are the real goals (or give me some ideas about it) and what challenges you face, what do you expect people to get out of it?
[Best Practice: Always, always, always start any measurement conversation with the above inquiry. The answer will be key to insights, and without it you'll simply be a glorified Reporting Squirrel.]
The answer, which might fit most government websites was:
A: The goal of our site is to be a portal to all the official information there is about Belgium and make information easy to find. Visitors should be able to figure out which Ministry is responsible for what tasks.
[Best Practice: Don't be surprised in your Analysis Ninja quest if you get answers that just start the conversation, rather then give you a prescription for what you need. Squirrels will despair here, but Ninjas will take clues from what they hear and visit the site and come up with a set of important measurable outcomes.]

Based on the answer above and some time spent on the English language site as well as those in other languages (Google Translate!), I came up with the following five questions I could ask data to measure success.

~ Are Visitors able to find the information they are looking for?

~ Are the Visitors satisfied with their experience?

~ What is the most popular content on the site? What area can we prioritize higher than it currently is?

~ How long does it take for someone to find key information they want?

~ Does the right information actually exist on the website? What major things might we be missing on our website?

Let’s take each of these questions one at a time and figure out the best way to answer each using a true Web Analytics 2.0 strategy.

Q1. Are Visitors able to find the information they are looking for?

Given the singular purpose in life of this government website is to be the one stop shop for all the information one could possibly need, it should be pretty obvious that the very first, and magical, thing we would measure is if Visitors to the site are able to find what they might be looking for.

So would you use a web analytics tool?

Here’s the first surprise: No!

There are certainly tertiary ways in which you can answer this question using Omniture’s Site Catalyst or Google Analytics or other wonderful web analytics tools.
website task completion rate
But the best way to answer this question?

Ask the Visitors!

Using a simple survey that pop-up on-exit (when Visitors leave the website) you can ask your customers to tell you if they were able to complete their task. No interpretation required.

4Q from iPerceptions, available in 18 languages, is a free on-exit survey you can use. If you don’t want to use a external survey build your own, ask four questions, analyze the data for:

Were you able to complete the purpose of your visit today?

The answer to this question becomes the #1 Key Performance Indicator (KPI). You are going to watch it like a hawk, you’ll post it on all your bulletin boards, you’ll set up custom alerts to ensure that your team gets a small electric shock every time this number drops below 65%!

The overall number is good enough, but the data that will be awesomely actionable will be, if you use 4Q: Primary Purpose by Task Completion Rate. . .
primary purpose by task completion rate

You see the second question in 4Q is “Which of the following best describes the primary purpose of your visit?” and a standard report in 4Q will paint the above picture.

Now you not only know if people find what they are looking for, but you also know which tasks are hard to complain.

You need to fix “Complain about the French” : ) because the Visitors are already upset and only 5% are able to complete their task, resulting in them becoming even more mad!

Remember: You don’t need to show the survey to everyone who comes to your site. You can sample just a small percent of your Visitors. You only need 300 responses in a month to get a statistically significant sample of data, and 1,200 if you want to do segmented analysis.

Q2. Are the Visitors satisfied with their experience?
HiPPO’s (the “highest paid person’s opinion”) in the organization, even in the government will love to have a more direct (than task completion rate) answer to the question: Are our Visitors happy with our website?

That’s were it is prudent to measure Customer Satisfaction.

4Q and other surveys of course measure that quite easily: Based on today’s visit, how would you rate your site experience overall?

Measure it. Trend it. Report it. Correlate the trend over time with changes you have made to the site and identify insights (any causal connection between site improvements / campaigns and customer satisfaction?).

An alternative, or additional, way to measure satisfaction is to count and analyze the Contact Us submissions. . . .
belgium.be contact us form
Start with the number of submissions. Trend over time.

Drill down into the type of complaints and do atleast rudimentary sentiment analysis (i.e. read & categorize) of actual messages to gauge customer satisfaction.

Remember: When you do surveys you don’t have to torture your Visitors with billions of questions! In researching this post I went to US government sites and I got a ugly 34 question on one single page looooong survey. 34 questions! Most were irrelevant. I would have answered a few, but this showed a fundamental disrespect for your customers. In the end your Visitors are upset and you suffer from a lack of data.

Only ask what you can action.

Q3. What is the most popular content on the site? What area can we prioritize higher than it currently is?

It is not unusual for content sites to produce content. It is even less unusual for them to produce content that they think potential visitors to the site might want.

What is rare is the analysis of what visitors to the site are actually consuming on the site.
Here’s a simple analysis I had learned from Tim Hart (who was with the J. Paul Getty Trust): Measure the distribution of content in each section of your website and the percentage of Visits to each section.
content vs visit distribution
On the y-axis is each of the sections on the belgium.be website. In blue is the amount of content in each section. In red are the percentage of visits where that content was consumed.

Is it not awesome! Insights galore!!

If this were their data, and it is not, it would be pretty obvious that there is huge interest in content about Housing and Economy tiny fraction of the site’s content is about Housing and Economy.

The balance for Family is a lot less lop sided.

While the government might love Justice, Mobility and Health (and boy do they love Environment!), Visitors to the site are a lot less interested in those pieces of content.

Action? You know what people want, how about giving them more of that content?

When it comes time to prioritize the next set of web pages or videos or podcasts, how about giving higher priority to those big red lines?

Sweet right?

You can also do segmented version of this analysis, see what Visitors to English, Dutch, French and German sites prefer. Or within Family what group of content do people like. Etc etc.

Two more ideas to get into your Visitor’s head. . . .

Measure Downloads:

There are a ton of downloads (pdf’s mostly) on the belgium.be website. Forms, applications, useful guides (like how to marry a belgian or how to prepare for your first job) etc.

It is a trivial cost, analytically, to track these downloads using your web analytics tool. Do it. Measure what your Visitors are most interested in.
tracking downloads

Yes, yes, yes I see my technical squirrel friends raising their hands and saying you can only track that someone clicked on the download link and not that the download was successful. I know.

For our analysis here just intent is fine.

In fact unless a vast majority of your Visitors are connecting using dial up it is safe to assume the download of small files went through. I know that does not make the squirrels happy. I am sorry. You keep squirreling while we make decisions about how to improve the site.

Outbound Link Tracking:

Another thing you’ll notice about the website (see why it helps to surf a site you are supposed to analyze?) is that there are a ton of links on the site that point to other government websites.
Track ‘em!
outbound link tracking
Of course the above is not their data :), it’s just an illustration of how absolutely easy it is to track this data.

From the report it is very easy to then figure out what links your Visitors click, which is a great, positive, indicator of the fact that they found what they wanted and also what they were interested in.

Remember: It is not very hard to do any of the above three types of analysis. All you need to get into your customer’s head is move away from “Top Pages Viewed” and “Page Views Per Visitors” and think a bit more creatively.

Q4. How long does it take for someone to find key information they want?

There are some pieces of content that are so darn important that they are heavily linked (say latest news in case of belgium.be) right from the home page, or that you really do want people to find them asap (in the Health section for example the pdf about how to deal with H1N1 virus in belgium).
For these important pieces of content measure Average Time To This Page.

average time to this page

That’s almost three minutes from the time that someone entered the website to the time they found this page (say the one about swine flu).

On average people give a page two and half seconds before they click/leave. Consider how long three minutes is, and how many people might have given up in the process of finding this key information.

Unfortunately not too many tools, Google Analytics and other Paid Solutions included, provide this as a standard metric. I use ClickTracks and that this delightful metric as a standard offering.

I wish others would have it.

Remember: You can use this data to ensure that your best information is found by Visitors to your site quickly. Fix your top / left / right / bottom / whatever navigation you have on the site. Consider creating a prominent “box” on the top right where you “merchandize” these important links. More things like that.

Q5. Does the right information actually exist on the website? What major things might we be missing on our website?

I have consistently advocated my love for internal site search analysis. It is simply da bomb!

Like many other sites belgium.be has a internal site search engine. Typically Visitors who have a harder time with normal navigation (or limited data on a page) will make liberal use of this site search box.

Why not use that data?
internal site search analysis

Again, this is not their data :).

I recommend looking at the top typed search terms by the Visitor but then also looking at the metric: % Search Exits.

That’s the bounce rate of your search results page. I.E. People come to belgium.be, search for the term hippo and the search results are so bad that 33.33% of the people exit from that page! They don’t even bother to do anything. Just bail. Bounce. Kaput!

Now you know both 1. what information they were looking for, 2. what search results stink and 3. likely because you don’t have the right or enough content about that keyword on your site.

Fix it!

I have one more idea to understand if you are missing information that your Visitors want on your government website.

Use Page Level surveys.

turbotax page level survey-1[1]

There are free page level surveys available or you can build your own (like the one above from a software vendor’s website).

These can be an excellent way to understand what content is missing from your website. You can of course also use the open text voice of customer (VOC) from surveys like 4Q, look for Visits with Task Completion = No.

Remember: These surveys don’t collect any personally identifiable information (PII) information, and that goes for your web analytics tools as well. Many government sites are extra concerned about privacy, as they should be. Do Please familiarize yourself with the privacy policies of the vendor.

Note: What was not tracked or emphasized. . .

Visits.

Unique Visitors.

Page Views.

Time on Site.

And so many more mundane and perhaps more “famous” web metrics.

I am sure most government or normal websites jump to that first. And why not, they are all staring you in the face when you crack open any analytics tool.

The problem is that these aggregate metrics barely contain any insight. If you focus on them, you’ll be left holding a empty bucket / cry a lot / get fired / not get your government pension / dread meetings with your boss.

 I hope the above ideas inspire you to do more, go beyond the obvious and less than useful.

One last quick example. . .

You can use the same strategy for other sites. Though remember the job the site is trying to do and the desired outcomes will decide which key performance indicators you end up using.
recovery.gov

For example for www.recovery.gov in addition to some of the metrics above I would probably also measure Visitor Loyalty and Recency. That’s because the government wants the data provided to be so sticky, and it is updated frequently, that it wants you to come and check it again and again.

In this case perhaps more than downloads I would also measure # of customized graphs created. When I measure content consumed (#3 above) I’ll probably focus on understanding which departments get looked at more on the site (are they the ones most spending money?).

You can also bet I am going to be totally on top of reporting how many complaints we have received on the site for Fraud, Waste & Abuse! Getting a ton of those would be a key performance indicator! : )

Makes sense?

Don’t despair just because you have a government site. Ignore the obvious. Focus on the site’s jobs. Identify key outcomes. Do productive analysis.

Good luck.

Ok now it’s your turn.

Are you responsible for a government website? What are your key performance indicators? What web metrics are important to you? Do you use any of the above strategies? If not, why not? Have you looked at www.belgium.be? What would you have recommend that I did not?

Please share your valuable advice / insights / feedback / critique (on my blog).

Thanks.

PS: Like this post? Perhaps you’ll consider ordering my * new * book: Web Analytics 2.0.

PPS:
Couple other related posts you might find interesting:

57 comments:

Anna said...

great article, thanks for this. most of these rules can be applied to normal websites.

arshad said...

its really very nice i enjoyed a lot to visit..Mobiles Handsets

Unknown said...

Hi.

I read a same topic 2 month ago. The topic helps me to improve my competency.

Apart from that, below article also is the same meaning

key performance indicators examples

Tks again and nice keep posting
Rgs

Anonymous said...

Hi! I would like to suggest you my favorite tool - www.estimix.com - a web site statistics and web analytics service. Here you can find information about every single page on the web.

Anonymous said...

This comment has been removed by the author.

Steve said...

Hello .. firstly I would like to send greetings to all readers. After this, I recognize the content so interesting about this article. For me personally I liked all the information. I would like to know of cases like this more often. In my personal experience I might mention a book called Generic Viagra in this book that I mentioned have very interesting topics, and also you have much to do with the main theme of this article.

willy said...

To start with I would like to congratulate the cradores of this blog, mainly because when I read it I enjoyed it very much. A few years ago I attended a conference called guanacaste costa rica real estate, at that conference had many interesting topics. Perhaps readers may find no relationship between the blog and this conference, but if someday can attend, would realize that there is much to do with this blog.

JeansPilot said...

These can be an excellent way to understand what content is missing from your website. You can of course also use the open text voice of customer (VOC) from surveys like 4Q, look for Visits with Task Completion = No.
Buy Jeans

e-Definers Technology said...

Nice blog created by the blog owner I like this post. It is very informative and attractive also I would like to come at this blog again and again. <a href="http://edtech.in”> Web Designers In Delhi</a>

admin said...

I am not an professional about this topic, however as soon as finding out your blog post, my understanding has improved extensively. Please enable me to getting your rss feed to communicate with any future updates. Good work and can move by way of to my buddies in addition to my web site audience.

admin said...

Good data, a number of thank you to the author. It¡¯s puzzling to me now, on the whole, the usefulness in addition to significance is overpowering. Vastly thanks once more and best of luck!
acid reflux cure

admin said...

We're a bunch of volunteers and starting a brand new initiative in a community. Your weblog supplied us priceless information to work on. You've performed a marvellous job!

admin said...

We're a bunch of volunteers and starting a brand new initiative in a community. Your weblog supplied us priceless information to work on. You've performed a marvellous job!


cholesterol lower foods

Anonymous said...

I would like to thank you for the efforts you have made in writing this article. Common digestive system diseases and disorders Health benefits of saltHealth benefits of salt Prevent wrinkles naturally Hemorrhoids Toothache pain home remedies Hip pain Top fertility foods Dandruff treatment Garlic benefitsHealth benefits of garlic Remedies for sinus headache Get smooth and glowing skinSmooth and glowing skin Cellulite Tighten sagging skin Dry skin patches treatmentDry skin patches Get rid of acneGet rid of acne Driving tips Migraine headache remedies Migraine headache

Unknown said...

With Gain Credit Personal Loans, you can get instant loan/money for a wide range of your personal needs like renovation of your home, marriage in the family, a family holiday, your child's education, buying a house, medical expenses or any other emergencies. With minimum documentation, you can now avail a personal loan at attractive 3% interest rates. This is trust and honest loans which you will not regret, Contact us via Email: gaincreditloan01@gmail.com

Your Full Details:
Full Name. . .. . .. . .. . .. . .
Loan Amount Needed. . ...
Loan Duration. . .. . .. . .. . .
Phone Number. . .. . .. . ..
Applied before. . .. . .. . ..
Country. . .. . .
Email Us: gaincreditloan01@gmail.com

velraj said...

Wow, what a great information. I am sure the info on your blog will help others.Thanks.
SAS Training in Chennai
SAS Analytics Training in Chennai
clinical sas training in chennai
clinical sas course
clinical sas training fees
Placement Training in Chennai
soft skills training institutes in chennai
SAS Training in Chennai

Venkatesh Krishna said...

Thanks for the insightful post

SEO Training in Chennai
SEO Training in Chennai
SEO Training in Chennai
MobAppy
SEO Training in Coimbatore

sharan said...


This is excellent information. It is amazing and wonderful to visit your site.Thanks for sharing this information, this is useful to me
Microsoft Windows Azure Training | Online Course | Certification in chennai | Microsoft Windows Azure Training | Online Course | Certification in bangalore | Microsoft Windows Azure Training | Online Course | Certification in hyderabad | Microsoft Windows Azure Training | Online Course | Certification in pune

Jhon Michael said...

Freelance maintenance technicians also benefit from establishing relationships with multiple clients. Working as a freelancer, you’ll gain employment experience with a variety of businesses, boosting your overall skill set and providing you with more work opportunities in the future.

maintenance technician

Tuckerjackk said...

Lenoxtons20 Buy from Amazon, Bangood and Wallmart at best price. Get discount and offers from lenoxtons20. Find best deals of amazon and wallmart only on lenoxtons20

Vale Co Xenia said...

Great Article
Cloud Computing Projects


Networking Projects

Final Year Projects for CSE


JavaScript Training in Chennai

JavaScript Training in Chennai

The Angular Training covers a wide range of topics including Components, Angular Directives, Angular Services, Pipes, security fundamentals, Routing, and Angular programmability. The new Angular TRaining will lay the foundation you need to specialise in Single Page Application developer. Angular Training

Priyanka said...

Attend The Data Science Courses Bangalore From ExcelR. Practical Data Science Courses Bangalore Sessions With Assured Placement Support From Experienced Faculty. ExcelR Offers The Data Science Courses Bangalore.
Data Science Courses Bangalore

John Smith said...

Today, everyone is serious about data protection, especially personal and confidential data from malware threats and online attacks. There are several antivirus suites available in the global market. Webroot is one of the reliable names in the field of antivirus programs that are capable of providing complete protection, including protection to browsing sites with the help of firewalls for network security. It provides a straightforward method to use the software on the system that attracts users from every corner of the world. In case you wish to know more about this antivirus program, visit the site “webroot.com/safe
.”

360digiTMG Training said...

Great Article it its really informative and innovative keep us posted with new updates. its was really valuable. thanks a lot.
business analytics course

Jhon Michael said...

Freelance maintenance technicians also benefit from establishing relationships with multiple clients. Working as a freelancer, you’ll gain employment experience with a variety of businesses, boosting your overall skill set and providing you with more work opportunities in the future.

maintenance technician

Banumadhu said...

Excellent blog thanks for sharing the valuable information..it becomes easy to read and easily understand the information.
Useful article which was very helpful. also interesting and contains good information.
to know about python training course , use the below link.

Python Training in chennai

Python Course in chennai

Deekshitha said...

very informative blog
data science training in Pune

Mallela said...

Very informative content and intresting blog post.Data science course in Nashik

Mallela said...

Very informative content and intresting blog post.Data science course in Thiruvananthapuram

Dataxpoinstitute said...

Pretty good post. I just stumbled upon your blog and wanted to say that I have really enjoyed reading your blog posts. Any way I’ll be subscribing to your feed and I hope you post again soon.

Data Science Course in Mysore

Deekshitha said...

very informative blog
data analytics training in Pune

Mallela said...

Thanks for posting the best information and the blog is very informative.Data science course in Faridabad

Deekshitha said...

very informative blog
data science training in Patna

Deekshitha said...

Informative blog
data analytics training in Patna

Deekshitha said...

Informative blog
Business Analytics course in Mysuru

Mallela said...

Thanks for posting the best information and the blog is very informative.Data science course in Varanasi

99 Digital Academy said...

Hey Nice Blog!! Thanks For Sharing!!! Wonderful blog & good post. Its really helpful for me. If you want to learn Digital Marketing, then attend Best Digital Marketing training in Gurgaon. 99 Digital Academy is the best Training Institute for Learning Digital Marketing. Join Today.

Data Science Training in Bhilai - 360DigiTMG said...

Stupendous blog huge applause to the blogger and hoping you to come up with such an extraordinary content in future. Surely, this post will inspire many aspirants who are very keen in gaining the knowledge. Expecting many more contents with lot more curiosity further.

data science in bangalore

data analytics courses in bangalore with placement - 360DigiTMG said...

Tremendous blog quite easy to grasp the subject since the content is very simple to understand. Obviously, this helps the participants to engage themselves in to the subject without much difficulty. Hope you further educate the readers in the same manner and keep sharing the content as always you do.

data analytics courses in bangalore with placement

aishu said...

Awesome post. I am glad to see your article. Very interesting to read your article. AWS Certification Course in Chennai

Datascience Course Analyst said...

Great post i must say and thanks for the information. Education is definitely a sticky subject. However, is still among the leading topics of our time. I appreciate your post and look forward to more.
Data Science Course in Bangalore

InstituteBlr said...

I just got to this amazing site not long ago. I was actually captured with the piece of resources you have got here. Big thumbs up for making such wonderful blog page!
data analytics course in bangalore

data analytics books said...

I am a new user of this site, so here I saw several articles and posts published on this site, I am more interested in some of them, hope you will provide more information on these topics in your next articles.
data analytics training in bangalore

Anonymous said...

Thanks for sharing this informative content, keep sharing this content.

To grow your customer base and business, CRM software in Virginia. You may be tempted to use manual methods, but this is not the 21st century.

Unknown said...

www.escortsmate.com
escortsmate.com
https://www.escortsmate.com

data scientist course said...

I am stunned by the information that you have on this blog. It shows how well you fathom this subject.
data scientist course in hyderabad

Deekshitha said...

Informative blog
ai training in hyderabad

x said...

instagram takipçi satın al | takipçi satın al | https://apkarchiv.com

Deekshitha said...

Informative blog
data science course in Nashik

DataScienceBOX said...

I am a new user of this site, so here I saw several articles and posts published on this site, I am more interested in some of them, will provide more information on these topics in future articles.
data science course in london

Data Science Training in Bhilai - 360DigiTMG said...

Thanks for bringing such innovative content which truly attracts the readers towards you. Certainly, your blog competes with your co-bloggers to come up with the newly updated info. Finally, kudos to you.

Data Science Course in Varanasi

Data Science Training in Bhilai - 360DigiTMG said...

Mind-blowing went amazed with the content posted. Containing the information in its unique format with fully loaded valid info, which ultimately grabs the folks to go through its content. Hope you to keep up maintaining the standards in posting the content further too.

Data Science Course in Bangalore

Mallela said...

Thanks for posting the best information and the blog is very good.digital marketing institute in hyderabad

Nikita jawanjal said...

Amazing Article! I would like to thank you for the efforts you had made for writing this awesome article. This article inspired me to read more. keep it up.
Data science course in pune

Mallela said...

Thanks for posting the best information and the blog is very good.artificial intelligence course in hyderabad

Mallela said...

Thanks for posting the best information and the blog is very good.data science institutes in hyderabad

Deekshitha said...

Informative blog
data science course in Nashik