PANJAAPOR presentation from AAPOR 2017

1. SPECIAL THANKS TO OUR SPONSORS
AAPOR ANNUAL CONFERENCE 2017 | @PANJAAPOR

2. LET’S TAKE A STEP BACK IN TIME…
HISTORY OF ONLINE PANELS
AAPOR ANNUAL CONFERENCE 2017 | @PANJAAPOR

3. 1990s & Early 2000s
 Internet penetration was at 20% in the mid-1990’s but by 2001, it had
skyrocketed to 50%.
 Online panels were created essentially from mail access panels
 The .dot com boom accelerated online panels
 Researchers wanted a way to lower data collection costs and obtain
results faster
 Response rates for RDD surveys were declining
 Non-probability recruited panels were leading the charge (cheap, fast)
AAPOR ANNUAL CONFERENCE 2017 | @PANJAAPOR

4. Online Panel Timeline
AAPOR ANNUAL CONFERENCE 2017 | @PANJAAPOR
• AOL/Opinion Place
(DMS), Gallup Panel,
Knowledge Networks
(GfK), Harris Poll
(Nielsen), NFO My
Survey (Lightspeed
GMI)
1995-1999
• Survey Spot (SSI),
comScore, Greenfield
(Toluna), I-Say
(IPSOS), E-Rewards
(Research Now),
YouGov (US), Rand
2000-2006 • Mergers and
acquisitions, unique
niche panels
(Hispanic, B2B,
mobile, High level
executives, etc.), DIY
2007-2013
• AmeriSpeak (NORC),
American Trends
Panel (PEW),
increased DIY
2014 to
present
□ Only 2 probability panels from the very beginning (Gallup – multi mode, & KN full online)
□ Currently over 90 online panels across North America
□ Increased DIY packages make it easier and more affordable
□ And now we are seeing a rise in probability panels

5. Our Panel of Experts Today
AAPOR ANNUAL CONFERENCE 2017 | @PANJAAPOR
 J. Michael Dennis - Senior VP, BVI Unit, Executive Director of
AmeriSpeak, NORC
 Mansour Fahimi - Senior VP/Chief Statistician of Marketing & Data
Sciences, GfK
 Michael Link - Division VP, Data Science, Surveys & Enabling
Technologies, Abt Associates
 Chintan Turakhia - Executive Vice President, SSRS

6. PROBABILITY PANELS:
INSIGHTS FROM THE FIELD
AAPOR ANNUAL CONFERENCE 2017 | @PANJAAPOR

7. Probability-based Panels
AAPOR ANNUAL CONFERENCE 2017 | @PANJAAPOR
 Who are the respondents?
 What methods of recruitment are used to build probability panels?
 How does sampling work?
 Incentive offerings
 Why use points, cash or other incentive?
 Pros and cons from panelists’ and vendors’ perspectives on different
incentive offerings

8. Probability & Non-probability Panels
AAPOR ANNUAL CONFERENCE 2017 | @PANJAAPOR
 How do they differ?
 Advantages and disadvantages to each?
 What should researchers consider when choosing whether to field a
study with a probability panel or a non-probability panel?

9. Data Quality
AAPOR ANNUAL CONFERENCE 2017 | @PANJAAPOR
 How reliable are probability panels?
 What are the challenges related to sampling and weighting when using
panels in general?
 How does questionnaire design impact data quality?
 What are the quality measures used in panels?

10. Probability Panels:
When & Why to Use Them
 What should researchers consider when fielding a study with a
probability panel?
 How are probability panels different from traditional methods (ABS,
phone, etc.)?
 What are the advantages of using a probability panel in comparison to
other probability methods?
 What are the challenges?
 Future applications of probability panels?
AAPOR ANNUAL CONFERENCE 2017 | @PANJAAPOR

11. PROBABILITY PANELS: Q&A
AAPOR ANNUAL CONFERENCE 2017 | @PANJAAPOR

12. CONTACT US
AAPOR ANNUAL CONFERENCE 2017 | @PANJAAPOR
J. Michael Dennis dennis-michael@norc.org
Mansour Fahimi Mansour.Fahimi@gfk.com
Michael Link m.link@abtassociates.com @mlink01
Yvonne Shands yshands@ssrs.com @yvonne_shands
Chintan Turakhia cturakhia@ssrs.com @chintant