Your SlideShare is downloading. ×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Donor voice pretest tool webinar deck_final


Published on

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

No notes for slide


  • 1. DonorVoice presents:Innovation Webinar SeriesA Proven Way to Get Better Returnsfrom your Direct Mail Testing Program
  • 2. The Problem Realities of The New World • Cost per donor to acquire goes up • Massive competition Current Testing Process • Biased (too much reliance on conventional wisdom) • Slow & Costly (A/B testing to infinity) • Inefficient (Throwing out baby with bath water)
  • 3. The Solution A New Way to Test • Feedback from target audience • Deceptively simple – let’s ask ‘em (how ask matters, a lot).
  • 4. Battle Tested Should bottle be red, white, blue, green, Product development yellow? What should brand name be? • Member packages What about size/shape of bottle? How much does it cost? • Consumer package goods What marketing messages do we put • Direct mail On bottle?
  • 5. Why Test? Beat the Control. Period. End of Story.
  • 6. How Much Cost to BeatControl? Outer Envelope Type 1 Type 2 Type 3 This is 27 tests OE Color goldenrod brownkraft gray with all Annual Look combinations OE Teaser Free Gift! Appeal Inside! (3x3x3). #10 with OE Type 6x9 #10 Plain window 27 Tests Old Method $88,500 (production costs, opportunity cost) New Method $24,000 (includes tool, 3 live tests) 269% difference
  • 7. But We Don’t Do 27 Tests If you do 7 or more tests a year, this is financially better deal on first project + Odds of finding control beating product sooner are much higher For NO TEST organizations – Think your control can’t be beat? How much money is left on the table with a sub-optimum product?
  • 8. Do survey resultsmatch real world?
  • 9. Case Study #1 • Client needed to identify new family as “face” Possible Test Appeals of organization. • Wet test results performed exactly as predicted producing a test/family that did beat the control. • If conventional wisdom had been relied upon the best options would not have been mailed. Test A, #1 in DV Tool Control, #2 in DV Tool Test B, #3 in DV Control family Tool
  • 10. Case Study #1 Financial Benefit: • Production & postage savings from NOT mailing all test packages $46,000 • Anticipated annual revenue increase with rollout of better performing control $72,000 $118,000
  • 11. Case Study #2 Color of Outer Envelope Personalization Labels Calendar Grid Backend Premium
  • 12. Case Study #2 Financial Benefit: • Savings from not producing & mailing predicted losing test packages $45,000 • Increase in net revenue by doubling panel volume on predicted winners $20,400 $65,400
  • 13. Okay, But… “Our best donors are not online…” “People don’t do what they say...”
  • 14. Other Weaknessesof Current Testing Process
  • 15. “Process” for Deciding Whatto Test Purple it is! What do we test?
  • 16. A/B Testing to Infinity(and Beyond!) 6 variations, 216 possible combinations. 10 tests a year, 22 years Can’t analyze across tests + • Test a did poorly • Test b did okay • Test c did well Unanswered Question: If we combine b and c is that better, great, the same, or worse?
  • 17. Baby in Bath Water Test package that changes everything. It loses. Now what?
  • 18. Our Process.
  • 19. Step One Choose What Package and What Part(s) 1. Envelope 2. Letter 3. Premium (front or back end) 4. Combination of above
  • 20. Premium ExampleGift Amount: $50, $75, $100, $125, $150, $200, $250Teaser Copy: Headline 1…….6
  • 21. Step Two Identify “Ingredients” to be Tested Reply Form Ingredient Size Ingredient Johnson Box Ingredient Message Ingredient Teaser Ingredient
  • 22. Step Three Finalize Grid/Artwork ATTRIBUTE Level 1 Level 2 Level 3 Level 4 L2 (Annual Appeal Labels L1 (LYH labels) - Nov version) none n/a Outside OE2 (double dop OE3 (love heart envelope OE1 (control) cut) teaser) OE4 (4 color image) BS2( double drop Buckslip black and white BS3( Double drop cut insert BS1 (control version) image) with 4 color image) n/a C1 (certificate of C2 (certificate of appreciation - Annual appreciation - LYH Certificate appeal) version) none n/a RS2 (double drop RS3 (double drop cut Reply Slip & RS1 (Control reply cut no image reply with 4 color image RS4 (love heart reply Letter and letter) and letter) reply and letter) and letter) LN2 (lift note black Lift Note none and white) LN3 (yellow and blue) n/a
  • 23. Step Four Design Experiment Our tool determines what combinations to show each respondent.
  • 24. Step Five Conduct the Survey Renewal • Client provides email sample Acquisition • Develop filter questions • Match any profile
  • 25. Step Six Provide Results Informational Insert in Control “Baby” significantly outperforms control Buckslip
  • 26. Step Six Provide Results What to Mail (real examples) • Run live test with lift note in addition to and in place of certificate • Live test (2012) alternative copy against “Year End” • Don’t bother with test colors on OE • Don’t bother with new design on calendar • Flower labels better than anchor for men and women • Tote better than duffle as back-end premium with renewal Who To Mail • Formal education is big discriminator for package preference • Append to file for renewal selection • Look at applying in acquisition (skews lower HH income, in South)
  • 27. Contact Information Kevin Schulman DonorVoice, CEO (202) Twitter: @kschulmanDV Pretest Tool: Get to rollout faster.