1. Not Quite The Usual
Online Survey
Andrea Evans
andrea.evans@oracle.com
2. A Partial List of Online Survey Tools
Free Only Limited Time Free (or Paid)
surveysurvey.com Ad supported checkbox.com 30 days free
kampyle.com 15 days free
surveygizmo.com 14 days free
Limited Functionality Free (or Paid)
qualtrics.com Paid Only
questionpro.com
snapsurveys.com confirmit.com
supersurvey.com infopoll.com
surveymonkey.com kinesissurvey.com
surveyshare.com nebu.com
esurveyspro.com Free is ad supported surveygold.com
polldaddy.com Free is ad supported surveywriter.com
vovici.com
3. A Partial List of Online Survey Tools
Free Only Limited Time Free (or Paid)
surveysurvey.com Ad supported checkbox.com 30 days free
kampyle.com 15 days free
surveygizmo.com 14 days free
Limited Functionality Free (or Paid)
qualtrics.com Paid Only
questionpro.com
snapsurveys.com confirmit.com
supersurvey.com infopoll.com
surveymonkey.com kinesissurvey.com
surveyshare.com nebu.com
esurveyspro.com Free is ad supported surveygold.com
polldaddy.com Free is ad supported surveywriter.com
vovici.com
4. If your tool is a hammer,
your problems
will look like nails.
5.
6.
7.
8.
9.
10.
11.
12.
13. You check a checkbox,
then immediately
switch to a new tab.
If you switch back to
the first tab,
would you rather see
A or B?
14. On this screen, how would you edit the message text to make some parts of it bold?
o Select the text to be bolded and press Control-B (PC) or Command-B (Mac)
o Type <b> </b> tags around the text to be bolded
o Type <strong> </strong> tags around the text to be bolded
o I don’t know
o Other:
15.
16.
17. JavaScript and Image Map
for Clickstream Capture Demo
<script type="text/javascript">var clickCount=0;var clickArray=new Array;function planets(correct,planet)
{ clickCount++; clickArray.push(planet); if (correct)
{ document.getElementById("Q1").value=clickArray; alert("Correct! That took you " + clickCount + "
click(s)."); } else { alert("Incorrect: this is " + planet + "!"); }}</script> <p><map name="planets"><area
href="#" coords="68,186,6" shape="circle" id="Mercury" onclick="planets(false,this.id)" /><area href="#"
coords="101,180,12" shape="circle" id="Venus" onclick="planets(false,this.id)" /><area href="#"
coords="136,178,10" shape="circle" id="Earth" onclick="planets(false,this.id)" /><area href="#"
coords="175,175,8" shape="circle" id="Mars" onclick="planets(false,this.id)" /><area href="#"
coords="223,169,27" shape="circle" id="Jupiter" onclick="planets(true,this.id)" /><area href="#"
coords="285,170,14" shape="circle" id="Saturn" onclick="planets(false,this.id)" /><area href="#"
coords="357,160,15" shape="circle" id="Uranus" onclick="planets(false,this.id)" /><area href="#"
coords="449,154,11" shape="circle" id="Neptune" onclick="planets(false,this.id)" /><area href="#"
coords="513,142,4" shape="circle" id="Pluto" onclick="planets(false,this.id)" /><!--tweak to stop survey tool
corrupting img tag is to break it over two lines--><img
border="0" src="/AppData/1885224700/users/256801141/User%20Media/planets.png" usemap="#planets" /></map></p>
See the demo at http://ow.ly/aYLOU
Hi, my name’s Andrea Evans. I’m a Principal Usability Engineer and Interaction Designer at Oracle, and I’m here to talk to you about ‘the Usual Online Survey’, and a few ways to make it ‘Not Quite’ Usual.
We’re lucky when it comes to online surveys. We’re spoiled for choice: these days there are plenty of tools to choose from. A lot of them even have free offers, which are limited either by functionality or by time.
We’re lucky when it comes to online surveys. We’re spoiled for choice: these days there are plenty of tools to choose from. A lot of them even have free offers, which are limited either by functionality or by time.
I know surveys can seem like a pretty limited methodology. Sometimes researchers can feel reluctant to use a survey tool, if their problem isn’t a questionnaire gathering demographics, ratings, or opinions.
Do we always make the fullest possible use of online surveys? Or do we tend to use the hammer of online surveys, purely for pounding the nails of questionnaires?
Sure, a mass email with a link is the obvious way to distribute an online survey. It’s the quickest and easiest way to reach lots of people. But emailed invitations to fill out surveys can have terrible response rates: 1 in 100 isn’t impossible.
Take your hammer out of the construction site! Take your survey out of people’s overflowing inboxes! Take it out for a coffee, so it can meet some people! Public wifi means you can take a laptop all sorts of places, and tablets make this even easier.
Cafes and food courts are perfect if your project is for end-user software or websites. When you contact people face-to-face, refusal rates are a lot lower than email, and it’s easier to motivate people to take part.
I’ve been using $5 coffee cards for years now, and they really work as incentives. Position yourself outside a coffee shop, and you’re sure to get people who want what you’re offering. But what if you’re not supporting end-user products, so public venues aren’t for you?
Conferences are excellent venues for surveys targeting particular populations. OpenWorld is a massive conference. But by going to presentations aimed at specific products, I’ve been able to get responses from very specific user types.
For the past couple of years, I’ve run a survey booth at OpenWorld. $5 coffee cards worked so well that last year my survey booth was the most visited out of all 430 Oracle booths at OpenWorld. Take your hammer out of the workshop. Take your survey out of the inbox.
Hammers are handy for other things than pounding nails! Online survey tools are also great at other things than traditional questionnaires. What sort of things? How about Cognitive Walkthroughs!
Sometimes the questions you want answers for aren’t suited to standard questionnaires. People don’t have perfect memory of their own working practices. So instead of just asking them, it’s better to walk them through a task, using a sequence of screenshots, then ask them what they expect.
You can show design mockups and ask people what they think would happen if they clicked this button or typed in that field. Use your hammer for cracking nuts. Use your online survey for cognitive walkthroughs. You can sometimes even tweak the tool; make it do things it isn’t even advertised to do.
Online survey tools don’t do a great job of selling themselves. They don’t tell you about the really interesting things that might be done with them. Sure they write about lots of different question types, but what do they show you pictures of?
Of course, you can do plenty with those sorts of questions. Radio button choices were all that I needed for both of those cognitive walkthroughs I just showed you. But you can do so much more with online survey tools. You can sometimes even collect clickstream data!
You can use JavaScript and image maps to capture and count clicks. The tools won’t tell you you can do this, but as long as your survey tool can include images, hidden questions, and your own code, then you can probably tweak that tool.
You can even record the chronological order of clicks within an image, as well as show alert popups that tell the user when they are clicking on correct or incorrect areas of the image.
So, that’s some of the possibilities of your simple online survey hammer. Sure, you can always use it to pound the nail of traditional emailed questionnaires. But you can also take it out to meet end-users at coffeeshops, and specialists at conferences.
You can use it to crack the nut of cognitive walkthroughs, and, with a bit of tweaking, you could even turn it into a multipurpose tool capable of capturing clickstreams.