The document summarizes research into the effects of splitting long surveys into two shorter surveys. It finds that data quality is maintained or improved with shorter surveys, as respondents make fewer errors and provide more detailed open-ended responses. Results from different question sets are largely equivalent between survey lengths. Respondent satisfaction may also be higher for shorter surveys, as indicated by more positive survey comments. While not a definitive solution, splitting long surveys appears to address issues like respondent fatigue without harming data quality or equivalence.
Previous research has suggested that people who are willing to provide their telephone numbers may be more likely to provide good quality data. This study examined whether asking people for their phone number 1) at the beginning of a survey or or 2) at the end of a survey affects the results. And yes, it matters.
Perhaps we are all speaking English but men and women do it just a little bit differently. Find out what words are used more often by men or women and see how you fit the stereotype.
Previous research has suggested that people who are willing to provide their telephone numbers may be more likely to provide good quality data. This study examined whether asking people for their phone number 1) at the beginning of a survey or or 2) at the end of a survey affects the results. And yes, it matters.
Perhaps we are all speaking English but men and women do it just a little bit differently. Find out what words are used more often by men or women and see how you fit the stereotype.
Just a few years ago, social media research was hailed as the panacea of all marketing research. The ridiculous quantities of brand opinions and opinionators available in social media would mean that focus groups would die, surveys would die, and all research questions would have instant answers. Fast forward to today and surveys continue to thrive. Learn why social media research didn’t hold up to expectations and why it’s finally breaking through. Presented at #IIEXap14 #IIEX
We like to think that everyone answering our surveys is perfectly fluent in English but let's be realistic. About 10% of Americans have difficulty reading/writing in English because it is not their native language. And when we apply standard techniques to identify which survey takers provide good data and which are simply giving random answers, we are often making the mistake of applying measurements that all require high level language skills.
Every great questionnaire deserves a great analysis. Listen to Jeffrey Henning, President of Researchscape International, and Annie Pettit, Chief Research Officer at Peanut Labs, discuss important tips for analyzing your survey data.
Of all the datasets that could be delivered to your desk, the most difficult one to work with might be that big dataset. Besides its massive size, it’s exponential growth even as you work on it, and the variety of data types present, big data presents many issues that make it difficult to turn data into action. In this presentation, you will learn how to take thousands of variables and billions of records and turn them into useable and actionable results, just as you would with any traditional research dataset.
Examination of 4,5,7,and 10 point scales in terms of extreme responding, acquiescent responding, and midpoint responding as well as a comparison of labelled and unlabeled points
Most surveys use data quality techniques such as red herrings, speeding, straightlining, and jibberish monitoring to determine which completes represent good responders or poor responders. This paper, presented at the 2013 NewMR online festival, demonstrates which techniques properly identify good and poor responders.
For the most part, people who answer marketing research surveys want and try to do a good job. However, sometimes respondents want to get through a survey as quick as possible in order to earn the incentive and move to the next task.
- Learn the various types of data quality questions you can use, beyond speeding and straightlining.
- How to fit them into your questionnaire with minimal impact on responders.
- And most importantly, how to use the data quality questions effectively so that you don't accidentally exclude data from honest respondents.
A two part presentation first showing how people talk about their customer experiences in general and with banks. Followed by a case study of how Royal Bank handles customer experience via social media.
Winner of best ESOMAR paper of the year.
By Melanie Courtright, Kartik Pashupati, Roddy Knowles, and Annie Pettit
Discussion of how different types of scales are used differently around the world
Researchers know we're supposed to sample people in the proper proportions but how do we know what those proportions are? In this webinar, I will demonstrate how to use census data to determine what your sample should really look like in terms of variables like age, gender, region and .education
Session Title A or Session Title B: A/B Testing with Concorde Career Collegesemfluence
Have you ever wondered how your emails would perform if you sent them on a different day? With a different subject line? Or maybe in a different format? Senior Account Manager Lindsay Waters shares examples and results from adventures in A/B email testing with Concorde Career Colleges. In this session, you’ll learn how to test your emails and what to look for when determining success.
Summit 2013 - Sourcing5: 140 characters or Less - KasperJobvite
Anyone can post on a social network—but not all posts send the right message to prospective job applicants. Join Jobvite’s Chief Marketing Officer, Kimberley Kasper, in this relevant conversation about understanding and maximizing your use of social media when it comes to sourcing. Learn how to creatively transform social network posts into secret weapons that engage readers while strengthening your recruitment brand. Discover tools within the Jobvite arsenal that help you effectively create, manage, monitor, and track your social media campaigns—so you can gain a real competitive edge.
Kimberley Kasper, Chief Marketing Officer - Jobvite
Justin runs all of the optimization efforts and split tests at Digital Marketer. A top-rated domestic and international speaker, Rondeau has spent his career working on optimization campaigns & has trained some of the leading optimization teams at Fortune 500 companies. Rondeau has run 100s of tests for both B2B and eCommerce brands and has analyzed 3,000+ tests across virtually every industry.
Just a few years ago, social media research was hailed as the panacea of all marketing research. The ridiculous quantities of brand opinions and opinionators available in social media would mean that focus groups would die, surveys would die, and all research questions would have instant answers. Fast forward to today and surveys continue to thrive. Learn why social media research didn’t hold up to expectations and why it’s finally breaking through. Presented at #IIEXap14 #IIEX
We like to think that everyone answering our surveys is perfectly fluent in English but let's be realistic. About 10% of Americans have difficulty reading/writing in English because it is not their native language. And when we apply standard techniques to identify which survey takers provide good data and which are simply giving random answers, we are often making the mistake of applying measurements that all require high level language skills.
Every great questionnaire deserves a great analysis. Listen to Jeffrey Henning, President of Researchscape International, and Annie Pettit, Chief Research Officer at Peanut Labs, discuss important tips for analyzing your survey data.
Of all the datasets that could be delivered to your desk, the most difficult one to work with might be that big dataset. Besides its massive size, it’s exponential growth even as you work on it, and the variety of data types present, big data presents many issues that make it difficult to turn data into action. In this presentation, you will learn how to take thousands of variables and billions of records and turn them into useable and actionable results, just as you would with any traditional research dataset.
Examination of 4,5,7,and 10 point scales in terms of extreme responding, acquiescent responding, and midpoint responding as well as a comparison of labelled and unlabeled points
Most surveys use data quality techniques such as red herrings, speeding, straightlining, and jibberish monitoring to determine which completes represent good responders or poor responders. This paper, presented at the 2013 NewMR online festival, demonstrates which techniques properly identify good and poor responders.
For the most part, people who answer marketing research surveys want and try to do a good job. However, sometimes respondents want to get through a survey as quick as possible in order to earn the incentive and move to the next task.
- Learn the various types of data quality questions you can use, beyond speeding and straightlining.
- How to fit them into your questionnaire with minimal impact on responders.
- And most importantly, how to use the data quality questions effectively so that you don't accidentally exclude data from honest respondents.
A two part presentation first showing how people talk about their customer experiences in general and with banks. Followed by a case study of how Royal Bank handles customer experience via social media.
Winner of best ESOMAR paper of the year.
By Melanie Courtright, Kartik Pashupati, Roddy Knowles, and Annie Pettit
Discussion of how different types of scales are used differently around the world
Researchers know we're supposed to sample people in the proper proportions but how do we know what those proportions are? In this webinar, I will demonstrate how to use census data to determine what your sample should really look like in terms of variables like age, gender, region and .education
Session Title A or Session Title B: A/B Testing with Concorde Career Collegesemfluence
Have you ever wondered how your emails would perform if you sent them on a different day? With a different subject line? Or maybe in a different format? Senior Account Manager Lindsay Waters shares examples and results from adventures in A/B email testing with Concorde Career Colleges. In this session, you’ll learn how to test your emails and what to look for when determining success.
Summit 2013 - Sourcing5: 140 characters or Less - KasperJobvite
Anyone can post on a social network—but not all posts send the right message to prospective job applicants. Join Jobvite’s Chief Marketing Officer, Kimberley Kasper, in this relevant conversation about understanding and maximizing your use of social media when it comes to sourcing. Learn how to creatively transform social network posts into secret weapons that engage readers while strengthening your recruitment brand. Discover tools within the Jobvite arsenal that help you effectively create, manage, monitor, and track your social media campaigns—so you can gain a real competitive edge.
Kimberley Kasper, Chief Marketing Officer - Jobvite
Justin runs all of the optimization efforts and split tests at Digital Marketer. A top-rated domestic and international speaker, Rondeau has spent his career working on optimization campaigns & has trained some of the leading optimization teams at Fortune 500 companies. Rondeau has run 100s of tests for both B2B and eCommerce brands and has analyzed 3,000+ tests across virtually every industry.
#Protips for utilizing social media to drive engagementWill Patch
Presented at Indiana Association for College Admission Counseling Spring Congress 2015. This presentation is designed to help high schools and colleges better engage with students and families through social media. Focus is on Facebook, Twitter, Instagram, Pinterest, and YouTube.
It is always mentioned that the lifestyle between the south and north of Vietnam is different. This report illustrates the media consumption behavior and creative impression differences between south and north
It is always mentioned that the lifestyle between the South and North of Vietnam is different. This report illustrates the media consumption behavior and creative impression differences between South and North
Two case studies demonstrating tracking a campaign (#TheAnswerIsColombia), brand stereotypes (coffee and the drug trade in colombia), as well as a comparison of Shakira and Sofia Vergara
Subject line testing is the only way to stay in front of audience engagement. Check out the webinar where we share real examples of what worked and what didn’t based on results from over 5,000 different subject line tests. Now's your chance to get fresh ideas for your 2016 strategic test plan.
During this webinar we'll walk through:
• The top takeaways from over 80 million emails sent.
• Recommendations for crafting effective subject lines.
• How to utilize pre-header text to reinforce the subject line.
• Strategies for putting together a subject line test plan.
Subject line testing is the only way to stay in front of audience engagement. Check out the webinar where we share real examples of what worked and what didn’t based on results from over 5,000 different subject line tests. Now's your chance to get fresh ideas for your 2016 strategic test plan.
During this webinar we'll walk through:
• The top takeaways from over 80 million emails sent.
• Recommendations for crafting effective subject lines.
• How to utilize pre-header text to reinforce the subject line.
• Strategies for putting together a subject line test plan.
Turning numbers into data. workshop sample slidesKeith Meadows
Our workshop covers the fundamentals of using data visualisation for story telling based on 5 key lessons. The focus being how to effectively communicate data findings.
The workshop includes the makeover of examples collected from participants in advance to illustrate how these lessons can be applied.
These are the supporting slides used in the May 2018 webinar organised by the University of Edinburgh Business School's Gartner Observatory and Kea Company. Here's a link to Gartner’s short podcast on 2017 Cool Vendors, which was mentioned.
https://www.gartner.com/podcasts/reshaping-the-future-gartner-2017-cool-vendors
Annie Pettit's AI presentation at the 2018 annual Travel and Tourism Research Association (TTRA) conference in Miami. Sharing results from a Sklar Wilton white paper on Canadian perceptions of AI, plus applications of AI in marketing research.
Links to videos I showed:
@SklarWilton #AI white paper on what Canadians think about #AI, #VoiceAssistants, and #Chatbots.
https://www.sklarwilton.com/wp-content/uploads/2017/12/Sklar-Wilton-Canadian-Artificial-Intelligence-Paper-2017.pdf
Joy Buolamwini of M.I.T.’s Media Lab shows how facial recognition technology has trouble recognizing dark faces.
https://www.youtube.com/watch?v=TWWsW1w-BVo
Google can now make #AI phone calls that are virtually indistinguishable from human beings.
https://ai.googleblog.com/2018/05/duplex-ai-system-for-natural-conversation.html
#AI can write newspaper articles about anything.
http://articlecreator.fullcontentrss.com/index.php
#AI can create humour that people actually laugh at.
https://www.youtube.com/watch?v=Vhe-JOP7PCs
#AI can read your mind.
https://www.youtube.com/watch?v=RuUSc53Xpeg
mindread
#AI, #Chatbots, and #VoiceAssistants are already running #questionnaires.
https://www.messenger.com/t/202671200242510/?messaging_source=source%3Apages%3Amessage_shortlink
Examples of ten cognitive biases in the marketing world that you can apply to your own work. Presented at the AMA Houston conference in September 2016.
In the first of a two-part session, four research professionals throw caution to the wind and fight for their passionately held beliefs about the way the insight world works. This is the session for those who want to hear the uncensored, unshackled and revolutionary voice of research.
I wish I had kept track of every time a conference speaker said they didn't understand the statistics they were referring to but if anyone had a question, they could find someone to answer it.
I wish I had kept track of every presenter whose 20 slides consisted of 20 pictures.
I wish it was even possible to count the number of infographics floating around the interweebs spewing countless unsubstantiated and out-of-context percentages with multiple decimal places.
In this presentation, I will plead with the audience to reconsider how they communicate to their clients about research, and how they present that research to various audiences.
People are sometimes intimidated by big data because it seems overwhelming and they’re much more familiar with using statistics on survey data or analyzing opinions from focus group data. But here are nine examples from companies like Netflix, Ceasars Entertainment, Walmart, eBay, and UPS, that could have conducted survey or focus group research have instead used big data to accomplish big things.
Theory is nice but data is heaven. Most market researchers have heard a lot of theory about big data, but few have seen the data and worked with it themselves. And we all know that the best way to truly understand and internalise something is to see the raw data for yourself. In this presentation, we'll blast ten big data myths using stories that many researchers can actually relate to - survey panel data. With millions of panellists, millions of profiles, millions of survey clicks, and millions of incentives, market researchers have been sitting on pretty big data for nearly 20 years. See how easy it is for trained scientists like yourselves to learn some SAS, R, or SQL, and dig into that big data on your own.
Surveys have a lot of tradition and norms behind them. And a lot of templates. Many of these templates were written many years ago when formal language made a lot more sense. Today, people expect casual and friendly language everywhere including from brands and companies. This presentation shows what happens to data quality and survey results when real language, not Charles Dickens language, is used.
At CASRO digital in San Antonio, Texas: Five minutes each from four different presenter. See how the US census uses social media, and how other people use it for customer experience and market research.
Behavioral economics has exploded over the last couple of years and market researchers have to begun to explore how it can be used in their work. But is it new or just new to you? This presentation outlines the growth of BE over the last 300 years and also describes some classic psychology experiments over the last 100 years. Moral of the story? If you just heard about a new theory of research, don't conduct research from scratch. Check what's already been done over the last few centuries!
Social media research has generated such hype that clients can be overwhelmed with information, lack of information, and misinformation. Annie Pettit, Vice President of Research Standards at Research Now and Chief Research Officer at Conversition, will share examples of those problems and how they can be detrimental to your research. We’ll cover topics such as brand awareness, incidence, sentiment validity, spam, and other geeked-out topics.
More from Annie Pettit, Research Methodologist (13)
Levelwise PageRank with Loop-Based Dead End Handling Strategy : SHORT REPORT ...Subhajit Sahu
Abstract — Levelwise PageRank is an alternative method of PageRank computation which decomposes the input graph into a directed acyclic block-graph of strongly connected components, and processes them in topological order, one level at a time. This enables calculation for ranks in a distributed fashion without per-iteration communication, unlike the standard method where all vertices are processed in each iteration. It however comes with a precondition of the absence of dead ends in the input graph. Here, the native non-distributed performance of Levelwise PageRank was compared against Monolithic PageRank on a CPU as well as a GPU. To ensure a fair comparison, Monolithic PageRank was also performed on a graph where vertices were split by components. Results indicate that Levelwise PageRank is about as fast as Monolithic PageRank on the CPU, but quite a bit slower on the GPU. Slowdown on the GPU is likely caused by a large submission of small workloads, and expected to be non-issue when the computation is performed on massive graphs.
Explore our comprehensive data analysis project presentation on predicting product ad campaign performance. Learn how data-driven insights can optimize your marketing strategies and enhance campaign effectiveness. Perfect for professionals and students looking to understand the power of data analysis in advertising. for more details visit: https://bostoninstituteofanalytics.org/data-science-and-artificial-intelligence/
Data Centers - Striving Within A Narrow Range - Research Report - MCG - May 2...pchutichetpong
M Capital Group (“MCG”) expects to see demand and the changing evolution of supply, facilitated through institutional investment rotation out of offices and into work from home (“WFH”), while the ever-expanding need for data storage as global internet usage expands, with experts predicting 5.3 billion users by 2023. These market factors will be underpinned by technological changes, such as progressing cloud services and edge sites, allowing the industry to see strong expected annual growth of 13% over the next 4 years.
Whilst competitive headwinds remain, represented through the recent second bankruptcy filing of Sungard, which blames “COVID-19 and other macroeconomic trends including delayed customer spending decisions, insourcing and reductions in IT spending, energy inflation and reduction in demand for certain services”, the industry has seen key adjustments, where MCG believes that engineering cost management and technological innovation will be paramount to success.
MCG reports that the more favorable market conditions expected over the next few years, helped by the winding down of pandemic restrictions and a hybrid working environment will be driving market momentum forward. The continuous injection of capital by alternative investment firms, as well as the growing infrastructural investment from cloud service providers and social media companies, whose revenues are expected to grow over 3.6x larger by value in 2026, will likely help propel center provision and innovation. These factors paint a promising picture for the industry players that offset rising input costs and adapt to new technologies.
According to M Capital Group: “Specifically, the long-term cost-saving opportunities available from the rise of remote managing will likely aid value growth for the industry. Through margin optimization and further availability of capital for reinvestment, strong players will maintain their competitive foothold, while weaker players exit the market to balance supply and demand.”
Show drafts
volume_up
Empowering the Data Analytics Ecosystem: A Laser Focus on Value
The data analytics ecosystem thrives when every component functions at its peak, unlocking the true potential of data. Here's a laser focus on key areas for an empowered ecosystem:
1. Democratize Access, Not Data:
Granular Access Controls: Provide users with self-service tools tailored to their specific needs, preventing data overload and misuse.
Data Catalogs: Implement robust data catalogs for easy discovery and understanding of available data sources.
2. Foster Collaboration with Clear Roles:
Data Mesh Architecture: Break down data silos by creating a distributed data ownership model with clear ownership and responsibilities.
Collaborative Workspaces: Utilize interactive platforms where data scientists, analysts, and domain experts can work seamlessly together.
3. Leverage Advanced Analytics Strategically:
AI-powered Automation: Automate repetitive tasks like data cleaning and feature engineering, freeing up data talent for higher-level analysis.
Right-Tool Selection: Strategically choose the most effective advanced analytics techniques (e.g., AI, ML) based on specific business problems.
4. Prioritize Data Quality with Automation:
Automated Data Validation: Implement automated data quality checks to identify and rectify errors at the source, minimizing downstream issues.
Data Lineage Tracking: Track the flow of data throughout the ecosystem, ensuring transparency and facilitating root cause analysis for errors.
5. Cultivate a Data-Driven Mindset:
Metrics-Driven Performance Management: Align KPIs and performance metrics with data-driven insights to ensure actionable decision making.
Data Storytelling Workshops: Equip stakeholders with the skills to translate complex data findings into compelling narratives that drive action.
Benefits of a Precise Ecosystem:
Sharpened Focus: Precise access and clear roles ensure everyone works with the most relevant data, maximizing efficiency.
Actionable Insights: Strategic analytics and automated quality checks lead to more reliable and actionable data insights.
Continuous Improvement: Data-driven performance management fosters a culture of learning and continuous improvement.
Sustainable Growth: Empowered by data, organizations can make informed decisions to drive sustainable growth and innovation.
By focusing on these precise actions, organizations can create an empowered data analytics ecosystem that delivers real value by driving data-driven decisions and maximizing the return on their data investment.
5. Problem:
Nothing is directly Comparable
• People choose whether to participate
• Each version is different
– Different length
– Different topics
– Different leading/priming questions
Tweet! #AAPOR @LoveStats
6. Tweet! #AAPOR @LoveStats
Agenda
1. Data quality
2. Data equivalence
3. Responder satisfaction
11/6/2014 6
12. Speeding differences not discernable
Tweet! #AAPOR @LoveStats
Long
Short A
Short B
Standardized Number of Seconds
m=0, sd=1, ceiling outliers removed
13. Drop the worst 5%
from each dataset
6.1% of Long
6.3% of Short A
5.2% of Short B
Tweet! #AAPOR @LoveStats
15. Survey Middle: Trips Taken
Tweet! #AAPOR @LoveStats
80%
60%
40%
20%
0%
1 to 3 trips 4 or more trips
Long Short A Short B
16. Survey Middle: Airline Aware
P<.05 P<.05
Tweet! #AAPOR @LoveStats
P<.05
P<.05
100%
75%
50%
25%
0%
Long Short A Short B
17. Survey End: Like Advertising
Tweet! #AAPOR @LoveStats
60%
50%
40%
30%
20%
10%
0%
Youtube Facebook Flyers Billboards
Long Short A Short B
P<.05
21. Same Completion Trend
Optional
watch a
commercial
Optional
watch a
commercial
Tweet! #AAPOR @LoveStats
100%
75%
50%
25%
Long Short A Short B
Grid
22. More Words in Verbatim
Tweet! #AAPOR @LoveStats
60
40
20
0
Verbatim 1 Verbatim 2 Verbatim 3 Verbatim 4 Verbatim 5 Verbatim 6
Long ShortA ShortB
Optional
P<.05
23. Possibly Higher Satisfaction
P<.05
P<.05
Tweet! #AAPOR @LoveStats
100%
75%
50%
25%
0%
Easy Boring Long Reco
Long Short A Short B
P<.05
24. More Positive Survey Comments
Tweet! #AAPOR @LoveStats
75%
86%
93%
Long Short A Short B
Percentage of optional survey comments that were positive
25. Conclusions
• Not a slam-dunk win
• Data quality is as good or better
• Results are equivalent
• Survey satisfaction is as good or
better
Tweet! #AAPOR @LoveStats
26. Final Thoughts
• Responders self-select for a 10 or 20 minute
Tweet! #AAPOR @LoveStats
experience
• Differences are in line with sampling error
• Large portions of most surveys do
not need to be answered by everyone.
Plan ahead.
27. Thank you!
Annie Pettit
Chief Research Officer
Peanut Labs
annie@peanutlabs.com
@LoveStats on Twitter
www.peanutlabs.com
Tweet! #AAPOR @LoveStats
: )