SearchTools Blog
Critique of the Google Custom Search Traffic Report 
29th-Aug-2007 03:30 pm
searchtools.com

Edward Tufte would be disappointed in Google. The traffic reports in the Google Custom Search Business Edition are not only insufficient, but somewhat misleading.

Below is a picture from a CSBE search for a B2B site that I helped install in August 2007. The fact that it's a line chart, with no data points given, filled underneath,makes it look active. It seems as though something's happening, the traffic is making progress, or worse, losing ground. The deep dips look scary, as though the site has done something wrong.

The problems come about because it's the wrong graph format for the content. This is very simple data: one point per day. Look at it as a simple bar graph and it suddenly seems more reasonable. The traffic resolves itself into a rhythm: the dips are on weekends -- all the customers are home. I don't know why they got it so wrong, but it's worth getting right.

Edward Tufte wrote some enlightening books on these topics, including The Visual Display of Quantitative Information, which taught those of us paying attention that how data is presented deeply affects how it is received. I highly recommend getting some of Tufte's books, from Amazon, from Powell's or from your library (using WorldCat).

Please comment whether you agree or disagree. I'm haven't seen quite this problem in other search engine traffic reports, but I'm wondering what other interfaces might look like, and what you think is best. Tell me your opinions, please!

Comments 
29th-Sep-2007 03:52 pm (UTC) - Nice analysis
Anonymous
Check out Tufte's one day course if he is still giving them. Fun. He carries his old first edition galileo and Newton books around to show each attendee how perfect the pop ups and graphics are and still preserved.
29th-Sep-2007 09:25 pm (UTC) - Re: Nice analysis
Thanks, I'd really like to go to one of his talks. I've been a fan for years (decades?).
5th-Feb-2008 10:05 pm (UTC) - there's not much difference
Anonymous
after 10+ years of analytical experience I can tell you -business users don't see a difference between the area graph (not line graph as you describe, since it's filled in) and the bar graph. they would just immediately ask, why does it dip down? And more useful to explaining this graph would be pointing out the days of the week.
17th-Oct-2008 09:00 pm (UTC) - Re: there's not much difference
Good point, whoever you are. Adding the days of the week would instantly make the pattern more clear.
This page was loaded Jul 19th 2009, 2:17 am GMT.