The document discusses Statistics Denmark's efforts to establish a representative web panel for surveys.
1) Statistics Denmark has recruited over 30,000 Danish citizens to their web panel by asking for email addresses during in-person surveys. However, this method leads to biases as those without internet access or unwilling to provide emails are underrepresented.
2) Even selecting panel members proportionally based on variables like gender, age and education only partially reduces biases. Non-response rates also introduce new biases, though weighting attempts to correct for this.
3) As an alternative, the document proposes using Denmark's digital mailbox system ("E-boks") which has over 4 million users, as the base for a new web panel.
Economic Considerations and the EU ReferendumIpsos UK
A new Ipsos MORI study published today finds the public is not optimistic about levels of EU investment in the UK or its ability to export to the EU over the next five years if Britain votes to leave the EU in next month’s referendum.
Ipsos MORI Captains of Industry Survey 2016Ipsos UK
More than four in five business leaders hope UK voters will vote to “stay” in the forthcoming EU referendum according to a new Ipsos MORI study.
The findings, from “Captains of Industry”, a survey of more than 100 of the most senior figures in top UK companies, show most think continuing EU membership would be best for their business (87%), are personally hoping for a “stay” result in the forthcoming referendum (87%) and would themselves vote to stay in (83%) if there was a referendum tomorrow.
This study explored the attitudes of a broad sample of politically interested Swedish voters towards Internet voting. A total of 5683 participants completed a web-based survey concerning participation and security aspects of Internet voting. Attitudes towards Internet voting were positive on the whole and the acceptance of participation in democratic elections using Internet voting was spearheaded by: women, groups with relatively short education, the unemployed and the self-employed. Unlike previous studies, it was found that age was not a significant factor in determining the attitudes towards participation in elections by means of Internet voting. Concerning the security challenges of Internet voting, men were more optimistic than women and participants’ confidence in security increased with age and education length.
Business and Brexit: The risks of taking a stanceIpsos UK
British adults think that businesses should be involved in the EU referendum debate – but that doesn’t mean they will trust them. When asked whether different types of business should take part in the EU referendum campaign, support was high for British businesses to participate by publicly backing one side or the other, especially SMEs. However, this does not necessarily mean the public trust what big businesses say on the issues.
The new survey finds three-quarters (75%) of the public say that small and medium-size British businesses should participate in the debate – more than say the same for other groups such as academics (68%), think tanks (54%) and newspapers (52%). The contributions of SMEs are more welcome than those of big businesses – but still nearly seven in ten (69%) of British adults are happy for big British businesses which trade internationally to make their opinion on Brexit known. However, while three-fifths (57%) say that they trust small business owners on issues relating to the referendum, leaders of large businesses fare worse, being trusted on the issues by just three in ten (29%).
In new research carried out by Ipsos MORI and King’s College London, just under half of Britons (45%) say it is very important to them who wins the election, matching figures normally seen at the very height of the election campaign itself in 2010 and 2005. Indeed, only six months before the last election in November 2009, just 35% said the election result was very important to them. More infomation: http://www.ipsos-mori.com/oneyearout
Facebook Messenger and Zalo are the two most commonly used messaging application in Vietnam. How are they used differently, then? Take a look at our full report to compare the best two apps in Vietnam
Ipsos Survey: Reactions to Brexit in 16 countriesIpsos UK
A major new Ipsos survey across 16 countries provides an insight into how major countries have reacted to Brexit, and what comes next for Britain and the EU. The survey, among online adults aged under 65 in in Belgium, France, Britain, Germany, Hungary, Italy, Poland, Spain, Sweden and seven non-European countries (Canada, US, Japan, Russia, India, Australia and South Africa) provides our first measure of international public opinion.
Economic Considerations and the EU ReferendumIpsos UK
A new Ipsos MORI study published today finds the public is not optimistic about levels of EU investment in the UK or its ability to export to the EU over the next five years if Britain votes to leave the EU in next month’s referendum.
Ipsos MORI Captains of Industry Survey 2016Ipsos UK
More than four in five business leaders hope UK voters will vote to “stay” in the forthcoming EU referendum according to a new Ipsos MORI study.
The findings, from “Captains of Industry”, a survey of more than 100 of the most senior figures in top UK companies, show most think continuing EU membership would be best for their business (87%), are personally hoping for a “stay” result in the forthcoming referendum (87%) and would themselves vote to stay in (83%) if there was a referendum tomorrow.
This study explored the attitudes of a broad sample of politically interested Swedish voters towards Internet voting. A total of 5683 participants completed a web-based survey concerning participation and security aspects of Internet voting. Attitudes towards Internet voting were positive on the whole and the acceptance of participation in democratic elections using Internet voting was spearheaded by: women, groups with relatively short education, the unemployed and the self-employed. Unlike previous studies, it was found that age was not a significant factor in determining the attitudes towards participation in elections by means of Internet voting. Concerning the security challenges of Internet voting, men were more optimistic than women and participants’ confidence in security increased with age and education length.
Business and Brexit: The risks of taking a stanceIpsos UK
British adults think that businesses should be involved in the EU referendum debate – but that doesn’t mean they will trust them. When asked whether different types of business should take part in the EU referendum campaign, support was high for British businesses to participate by publicly backing one side or the other, especially SMEs. However, this does not necessarily mean the public trust what big businesses say on the issues.
The new survey finds three-quarters (75%) of the public say that small and medium-size British businesses should participate in the debate – more than say the same for other groups such as academics (68%), think tanks (54%) and newspapers (52%). The contributions of SMEs are more welcome than those of big businesses – but still nearly seven in ten (69%) of British adults are happy for big British businesses which trade internationally to make their opinion on Brexit known. However, while three-fifths (57%) say that they trust small business owners on issues relating to the referendum, leaders of large businesses fare worse, being trusted on the issues by just three in ten (29%).
In new research carried out by Ipsos MORI and King’s College London, just under half of Britons (45%) say it is very important to them who wins the election, matching figures normally seen at the very height of the election campaign itself in 2010 and 2005. Indeed, only six months before the last election in November 2009, just 35% said the election result was very important to them. More infomation: http://www.ipsos-mori.com/oneyearout
Facebook Messenger and Zalo are the two most commonly used messaging application in Vietnam. How are they used differently, then? Take a look at our full report to compare the best two apps in Vietnam
Ipsos Survey: Reactions to Brexit in 16 countriesIpsos UK
A major new Ipsos survey across 16 countries provides an insight into how major countries have reacted to Brexit, and what comes next for Britain and the EU. The survey, among online adults aged under 65 in in Belgium, France, Britain, Germany, Hungary, Italy, Poland, Spain, Sweden and seven non-European countries (Canada, US, Japan, Russia, India, Australia and South Africa) provides our first measure of international public opinion.
In a unique survey, Ipsos MORI will be interviewing a longitudinal panel of respondents on their attitudes to immigration throughout and after the election campaign.
This will provide a much more detailed understanding of how and why views change.
For the first wave we have also interviewed an unusually large sample of the public (over 4,500), which allows us to look at smaller sub-groups, including followers of all key parties and those who have switched parties since the last election.
SMS Data Collection for measuring attitudes on migrationSample Solutions
Cross country data collection is a complex process however technology has enabled worldwide research to embrace
various interviewing channels that can facilitate this process. According to the FocusVision 2014 Annual MR
Technology Report, trends in research technology show a high usage of more high-tech modes but also lower
volume/minor modes such as SMS surveys are now on the rise. SMS is a minor mode of data collection administered
through a self-completion mode and it gives respondents time to reflect and they may give fewer rounded answers
and more disclosure of socially undesirable behaviors and views differing from the general public opinion, making it
suitable for gathering data on sensitive issues such as migration. Immigration is a highly researched topic through
opinion polls and surveys, the latest Standard Eurobarometer polling (Autumn 2015) by the European Commission
showed that Immigration ranks among the most important issues facing the EU currently. This research will attempt
to show if SMS Surveys are a practical method for collection of cross country information on public attitudes aimed at
immigration, and the various dimensions of economic, public and private life that individuals feel are affected by
immigration. The design and implementation of the cross-country survey methods for this research face multiple
factors such as ensuring the sampling procedures are consistent across nations with complete surveys N=500 per
country and all distributed concurrently. Furthermore, cross-national research design requires specific survey design
such as keeping the survey questionnaires as consistent as possible across all countries by overseeing the survey
translation process. To maintain the quality of the survey implementation three stages are implemented: a pilot
study, the main data collection stage and a follow-up study with the respondents. For comparability reasons, the
objective of the study was to use three countries, specifically Poland and Romania as part of the European Union (EU)
and The Republic of Macedonia as a non-EU country, hereby highlighting the various benefits and constraints of using
SMS surveys and the differences between the three countries thus comparing demographic data in order to examine
the differences in attitudes and the comparability across the three countries pertaining to the current migration crisis
in Europe.
Vietnam’s two biggest cities - HCM and Hanoi is said to have a different culture and people living there have different values in opinions. This survey was made in order to clarify those differences
This survey was conducted among nearly 500 male and female between 18 - 39 years old in HCM and Hanoi in January 2019
Who is the ideal boss and company among Vietnamese? Here is the report of Q&Me survey asking to more than 1000 Vietnamese about their value of work, company and bosses
Survey about the information source for female make-up in Vietnam. How influential is Michelle Phan, famous youtuber for make-up videos who are originally from Vietnam?
Vietnam is a country where smartphones are highly penetrated while IT utilization in the normal work environment is behind.
This survey was made in order to clarify how people communicate at work
This survey was conducted among 18-39 Vietnamese of 579 respondents in January 2019.
Presentation by CJ (All Response Media) and Mark Davies (TNT Post) at the DMA Go Integrated Conference 2012.
This slideshow looks at how offline marketing channels such as inserts and door drops can work alongside an online strategy; driving consumers online with a powerful response mechanism.
The case study discusses all the phases of survey work from problem statement to statistical analysis.
Source: Research Methods in Marketing: Survey Research, Harvard Business Review, Rev. September 29, 1986.
Workshop session 4 - Optimal sample designs for general community telephone s...The Social Research Centre
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Dina Neiger - Chief Statistician (Social Research Centre)
La communication papier et le @ sont des alliés, pas des ennemis.
• le DM soutien votre business
• l’impact du papier adressé
• les forces du papier + le e marketing
• l’impact environnemental du papier
The Kenyan Economy: Perceptions and Realities Ipsos
In this release, we present several findings related to the economy.
Underpinning the specific findings is the general reality that three-quarters of all Kenyan households (75%) report a total family income of Shs. 25,000 or less, with more than half of these households (44%) earning between nothing and only Shs. 10,000 (a figure which increases to 46% if those who declined/were unable to answer this question are excluded). In addition, as is seen in several of the specific findings show below, such extensive poverty takes a clear regional dimension. For example, the proportion of those in the Shs. 10,000 and below category is 56% at the Coast compared to 56% in Nairobi, more than twice.
At the same time, these income-group findings over all three Ipsos surveys since May, 2014 show no statistical change, reflecting both the static nature of income-distribution in Kenya, and the reliability of Ipsos’ survey methodology.
Disrupted Futures 2023 | Relationship between work placement and employment o...EduSkills OECD
This presentation from the OECD Disrupted Futures 2023: International lessons on how schools can best equip students for their working lives conference looks at Work experience placements “Work experience for all; exploring the relationship between work placement and employment outcomes”. Presented by Elnaz Kashef and Chris Percy.
Discover the videos and other sessions from the OECD Disrupted Futures 2023 conference at https://www.oecd.org/education/career-readiness/conferences-webinars/disrupted-futures-2023.htm
Find out more about our work on Career Readiness https://www.oecd.org/education/career-readiness/
Workshop session 10 - Alternatives to CATI (3) address-based sampling and pus...The Social Research Centre
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Anna Lethborg - Research Director (Social Research Centre)
In a unique survey, Ipsos MORI will be interviewing a longitudinal panel of respondents on their attitudes to immigration throughout and after the election campaign.
This will provide a much more detailed understanding of how and why views change.
For the first wave we have also interviewed an unusually large sample of the public (over 4,500), which allows us to look at smaller sub-groups, including followers of all key parties and those who have switched parties since the last election.
SMS Data Collection for measuring attitudes on migrationSample Solutions
Cross country data collection is a complex process however technology has enabled worldwide research to embrace
various interviewing channels that can facilitate this process. According to the FocusVision 2014 Annual MR
Technology Report, trends in research technology show a high usage of more high-tech modes but also lower
volume/minor modes such as SMS surveys are now on the rise. SMS is a minor mode of data collection administered
through a self-completion mode and it gives respondents time to reflect and they may give fewer rounded answers
and more disclosure of socially undesirable behaviors and views differing from the general public opinion, making it
suitable for gathering data on sensitive issues such as migration. Immigration is a highly researched topic through
opinion polls and surveys, the latest Standard Eurobarometer polling (Autumn 2015) by the European Commission
showed that Immigration ranks among the most important issues facing the EU currently. This research will attempt
to show if SMS Surveys are a practical method for collection of cross country information on public attitudes aimed at
immigration, and the various dimensions of economic, public and private life that individuals feel are affected by
immigration. The design and implementation of the cross-country survey methods for this research face multiple
factors such as ensuring the sampling procedures are consistent across nations with complete surveys N=500 per
country and all distributed concurrently. Furthermore, cross-national research design requires specific survey design
such as keeping the survey questionnaires as consistent as possible across all countries by overseeing the survey
translation process. To maintain the quality of the survey implementation three stages are implemented: a pilot
study, the main data collection stage and a follow-up study with the respondents. For comparability reasons, the
objective of the study was to use three countries, specifically Poland and Romania as part of the European Union (EU)
and The Republic of Macedonia as a non-EU country, hereby highlighting the various benefits and constraints of using
SMS surveys and the differences between the three countries thus comparing demographic data in order to examine
the differences in attitudes and the comparability across the three countries pertaining to the current migration crisis
in Europe.
Vietnam’s two biggest cities - HCM and Hanoi is said to have a different culture and people living there have different values in opinions. This survey was made in order to clarify those differences
This survey was conducted among nearly 500 male and female between 18 - 39 years old in HCM and Hanoi in January 2019
Who is the ideal boss and company among Vietnamese? Here is the report of Q&Me survey asking to more than 1000 Vietnamese about their value of work, company and bosses
Survey about the information source for female make-up in Vietnam. How influential is Michelle Phan, famous youtuber for make-up videos who are originally from Vietnam?
Vietnam is a country where smartphones are highly penetrated while IT utilization in the normal work environment is behind.
This survey was made in order to clarify how people communicate at work
This survey was conducted among 18-39 Vietnamese of 579 respondents in January 2019.
Presentation by CJ (All Response Media) and Mark Davies (TNT Post) at the DMA Go Integrated Conference 2012.
This slideshow looks at how offline marketing channels such as inserts and door drops can work alongside an online strategy; driving consumers online with a powerful response mechanism.
The case study discusses all the phases of survey work from problem statement to statistical analysis.
Source: Research Methods in Marketing: Survey Research, Harvard Business Review, Rev. September 29, 1986.
Workshop session 4 - Optimal sample designs for general community telephone s...The Social Research Centre
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Dina Neiger - Chief Statistician (Social Research Centre)
La communication papier et le @ sont des alliés, pas des ennemis.
• le DM soutien votre business
• l’impact du papier adressé
• les forces du papier + le e marketing
• l’impact environnemental du papier
The Kenyan Economy: Perceptions and Realities Ipsos
In this release, we present several findings related to the economy.
Underpinning the specific findings is the general reality that three-quarters of all Kenyan households (75%) report a total family income of Shs. 25,000 or less, with more than half of these households (44%) earning between nothing and only Shs. 10,000 (a figure which increases to 46% if those who declined/were unable to answer this question are excluded). In addition, as is seen in several of the specific findings show below, such extensive poverty takes a clear regional dimension. For example, the proportion of those in the Shs. 10,000 and below category is 56% at the Coast compared to 56% in Nairobi, more than twice.
At the same time, these income-group findings over all three Ipsos surveys since May, 2014 show no statistical change, reflecting both the static nature of income-distribution in Kenya, and the reliability of Ipsos’ survey methodology.
Disrupted Futures 2023 | Relationship between work placement and employment o...EduSkills OECD
This presentation from the OECD Disrupted Futures 2023: International lessons on how schools can best equip students for their working lives conference looks at Work experience placements “Work experience for all; exploring the relationship between work placement and employment outcomes”. Presented by Elnaz Kashef and Chris Percy.
Discover the videos and other sessions from the OECD Disrupted Futures 2023 conference at https://www.oecd.org/education/career-readiness/conferences-webinars/disrupted-futures-2023.htm
Find out more about our work on Career Readiness https://www.oecd.org/education/career-readiness/
Workshop session 10 - Alternatives to CATI (3) address-based sampling and pus...The Social Research Centre
Social Research Centre workshop - Telephone Surveying in the Post-Modern Era, held Thursday 10 October 2019. Presentation by Anna Lethborg - Research Director (Social Research Centre)
Engaging the hard_to_engage_through_innovative_channelsGeorge Van Antwerp
A presentation from the Care Continuum Alliance (CCA) that I gave with Aetna 2 years ago. I found it posted online and decided to share it.
http://www.carecontinuumalliance.org/theforum11/Presentations/Engaging_the_Hard_to_Engage_Through_Innovative_Channels.pdf
Creating Better Customer Experiences Online (with Top Tasks) presented by Ger...Patrick Van Renterghem
Creating Better Customer Experiences Online (with Top Tasks) presented by @GerryMcGovern on Dec. 4th, 2013 @itworks. Interesting for Web (Internet, Intranet, portals) designers, content managers, communication officers, marketing departments, ...
Global Situational Awareness of A.I. and where its headedvikram sood
You can see the future first in San Francisco.
Over the past year, the talk of the town has shifted from $10 billion compute clusters to $100 billion clusters to trillion-dollar clusters. Every six months another zero is added to the boardroom plans. Behind the scenes, there’s a fierce scramble to secure every power contract still available for the rest of the decade, every voltage transformer that can possibly be procured. American big business is gearing up to pour trillions of dollars into a long-unseen mobilization of American industrial might. By the end of the decade, American electricity production will have grown tens of percent; from the shale fields of Pennsylvania to the solar farms of Nevada, hundreds of millions of GPUs will hum.
The AGI race has begun. We are building machines that can think and reason. By 2025/26, these machines will outpace college graduates. By the end of the decade, they will be smarter than you or I; we will have superintelligence, in the true sense of the word. Along the way, national security forces not seen in half a century will be un-leashed, and before long, The Project will be on. If we’re lucky, we’ll be in an all-out race with the CCP; if we’re unlucky, an all-out war.
Everyone is now talking about AI, but few have the faintest glimmer of what is about to hit them. Nvidia analysts still think 2024 might be close to the peak. Mainstream pundits are stuck on the wilful blindness of “it’s just predicting the next word”. They see only hype and business-as-usual; at most they entertain another internet-scale technological change.
Before long, the world will wake up. But right now, there are perhaps a few hundred people, most of them in San Francisco and the AI labs, that have situational awareness. Through whatever peculiar forces of fate, I have found myself amongst them. A few years ago, these people were derided as crazy—but they trusted the trendlines, which allowed them to correctly predict the AI advances of the past few years. Whether these people are also right about the next few years remains to be seen. But these are very smart people—the smartest people I have ever met—and they are the ones building this technology. Perhaps they will be an odd footnote in history, or perhaps they will go down in history like Szilard and Oppenheimer and Teller. If they are seeing the future even close to correctly, we are in for a wild ride.
Let me tell you what we see.
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Data and AI
Round table discussion of vector databases, unstructured data, ai, big data, real-time, robots and Milvus.
A lively discussion with NJ Gen AI Meetup Lead, Prasad and Procure.FYI's Co-Found
Analysis insight about a Flyball dog competition team's performanceroli9797
Insight of my analysis about a Flyball dog competition team's last year performance. Find more: https://github.com/rolandnagy-ds/flyball_race_analysis/tree/main
06-04-2024 - NYC Tech Week - Discussion on Vector Databases, Unstructured Data and AI
Discussion on Vector Databases, Unstructured Data and AI
https://www.meetup.com/unstructured-data-meetup-new-york/
This meetup is for people working in unstructured data. Speakers will come present about related topics such as vector databases, LLMs, and managing data at scale. The intended audience of this group includes roles like machine learning engineers, data scientists, data engineers, software engineers, and PMs.This meetup was formerly Milvus Meetup, and is sponsored by Zilliz maintainers of Milvus.
State of Artificial intelligence Report 2023kuntobimo2016
Artificial intelligence (AI) is a multidisciplinary field of science and engineering whose goal is to create intelligent machines.
We believe that AI will be a force multiplier on technological progress in our increasingly digital, data-driven world. This is because everything around us today, ranging from culture to consumer products, is a product of intelligence.
The State of AI Report is now in its sixth year. Consider this report as a compilation of the most interesting things we’ve seen with a goal of triggering an informed conversation about the state of AI and its implication for the future.
We consider the following key dimensions in our report:
Research: Technology breakthroughs and their capabilities.
Industry: Areas of commercial application for AI and its business impact.
Politics: Regulation of AI, its economic implications and the evolving geopolitics of AI.
Safety: Identifying and mitigating catastrophic risks that highly-capable future AI systems could pose to us.
Predictions: What we believe will happen in the next 12 months and a 2022 performance review to keep us honest.
The Building Blocks of QuestDB, a Time Series Databasejavier ramirez
Talk Delivered at Valencia Codes Meetup 2024-06.
Traditionally, databases have treated timestamps just as another data type. However, when performing real-time analytics, timestamps should be first class citizens and we need rich time semantics to get the most out of our data. We also need to deal with ever growing datasets while keeping performant, which is as fun as it sounds.
It is no wonder time-series databases are now more popular than ever before. Join me in this session to learn about the internal architecture and building blocks of QuestDB, an open source time-series database designed for speed. We will also review a history of some of the changes we have gone over the past two years to deal with late and unordered data, non-blocking writes, read-replicas, or faster batch ingestion.
2. Presentation
Maja Fromseier Petersen, chief consultant and team leader for the survey
consultants
Master from Copenhagen University in Cultural Geography
2003-2007 Statistic Denmark, statistics on entrepreneurs and globalization
2007-2013 Deputy manager at SFI Survey (the data collection department)
on the National Institute of Social research
2014- Merged with Statistic Denmark into ”Statistic Denmark Survey
department”
Contact info: mfm@dst.dk
2
3. The Danish Statistical system
Person
id:
Person-No
Business
register
id:
CVR-No
Building and
Housing
Register (BBR)
id:
Adress
Health
Tax
Employ-
ment
Education
Social
stat
And
more…
CPR
BBR CVR
Web
forms
Inter-
view
Cadastral
4. SD Survey’s business model
SD Survey is a external selling offices in Statistics
Denmark
90% of the turnover on 5 mill. € is from external
customers
Positive result 2015 0.6 mill. €. Overhead 2 mill. €
Contacts annually 300.000 people in 80 surveys
29 employees, 25-50 central interviewers on cati central
and 200 nationwide interviewers
Not products and private marketing
The entire process from sample, questionnaire, weighting
and report
Three principles:
1. Non loss
2. no (much) profit
3. take care of the reputation of Statistic Denmark
4
5. Mission and products
Mission: Make SD methods and register valuable
for others
Products:
Optimized sampling and data collection with:
telephone interviews,
personal interviews,
web forms
paper interviews
experiments and tests on the PC
5
6. A new and well-documented web panel
Representative surveys
Recruiting to the web panel
Selection from the web panel
Non-response in the web panels
Calibration in the web panels
E boks – “panel”
What is E boks and what is the E boks
population?
The E-boks test Who’s answering?
Overview of the presentation
6
7. A new and good web panel
Researchers at universities, government and
research institutions use also cheap web panels
Idea:
Using Statistics Denmark's register of the entire
population, it must be possible to establish a web
panel that comes as close as possible to the
classic representative surveys - by controlling the
bias
7
8. A new and good web panel
Accept bias due to demands about access to the
Internet.
Demand to new web panel:
1.Recruited from representative surveys (simple
random sampling of the total population)
2.Be within the 95% confidence interval for all other
variables not used for selection
8
9. Representative surveys (1)
A ‘sample’ can be selected in many ways,
- for example all who are here today
Only a sample without bias can be really be generalized
Three requirements to probability sampling:
1. All in the target population can be elected
2. Selection with known probability
3. Weighing with the inverse selection probability
9
10. Representative surveys (2)
Probability sampling:
The right answer may as well be higher as lower as
what we can measure
The sample has a statistical uncertainty
The larger sample the smaller the confidence interval
But for all background/ register variables: 19 out of
20 samples are within the classic 95% confidence
interval
The most importen: If a sample is not representative:
A larger sample may just make the estimate more
wrong
10
11. Representative surveys (3)
One of many monthly omnibus
The sample is from the central personal register, the size is
around1,600, and has a random error up to 2.5%
Population Sample
Elementary school 34,9 34,0
High school and vocational edu. 39,6 39,3
Short education 4,2 4,0
Medium education 12,4 13,2
Long education 8,9 9,5
11
12. Representative surveys (4)
For any variables: 19 out of 20 samples are within
the classic 95% confidence interval
Present
Population Sample
Ethnicity
Danish origin 88,4 89,2
Immigrant 10,2 9,2
Descendants 1,5 1,6
12
13. Recruiting to Web panel (1)
For more than three years, DST in representative
samples, asked for e-mail addresses. 1,500 answer
every month and about 600 say yes.
There are currently about 30.000 in the database.
There are three sources of bias in this web panel.
1.The non-response of the initial representative sample
2.Those who do not have Internet access and do not
have an e-mail
3.Those who will not give their e-mail
13
14. Recruiting to Web panel (2)
Examples of bias:
Population Web-panel
18-34 year 29,0% 23,1%
50-64 year 26,8% 30,6%
Elementary school 32,3% 22,2%
Long education 7,5% 10,4%
<100.000 DDK 18,1% 12,3%
>600.000 DDK 15,8% 20,9%
Random error with 30,000 observations around 0,5 percent
14
15. Recruiting to Web panel (3)
More examples of bias:
Population Web-panel
Men 50,1% 49,0%
South Denmark 21,1% 21,6%
Danes 87,8% 94,3%
Western countries 4,7% 2,5%
Non western 7,5% 3,2%
One plan housing 67,9% 74,3%
15
16. Recruiting to Web panel (4)
More examples of bias:
Population Web-panel
Singles without children 28,1% 20,6%
Single parents 28,1% 20,6%
Unmarried 37,7% 30,8%
Married 48,3% 56,5%
Unemployed 20,2% 14,9%
Employed 61,4% 68,3%
16
17. Recruiting to Web panel (5)
Conclusion for recruitment
The three sources of bias worsens picture of the
normal first step non-response on a number of
variables
Gender and geography, however less
Web panel shows a too socially positive picture of
population
17
18. Selection from the web panel (1)
Is it possible to correct the bias by selecting proportionally to registry
variables?
Population GAR EFGAR
G: Men 50,1% 50,1% 50,1%
A: 18-34 year 29,0% 29,1% 29,1%
R: South DK 21,1% 21,1% 21,0%
E: Elementary edu. 32,3% 21,6% 31,6%
F: Single parents 28,1% 20,8% 28,1%
GAR (Gender, Age and Region) can not correct for Education and
Family
18
19. Selection from the web panel (2)
Examples of other factors that are not selected proportionally
EFGAR (Gender, Age, Region, Education and Family)
Population GAR EFGAR
Danes 87,8% 95,3% 93,6%
< 100.000 DKK 18,1% 13,3% 16,9%
Employed 61,4% 68,6% 67,0%
Income, ethnic background and employment bias with EFGAR
Income something better with EFGAR, but still bias.
19
20. Non-respons in web panels
3000 selected proportionally to EFGAR (Education, Family,
Gender, Age and Region)
Selected Response Population
18-34 year 28,8% 22,7% 29,0%
Elementary 31,6% 23,1% 32,3%
Men 50,1% 53,7% 50,1%
Single parents 27,9% 27,5% 28,1%
South DK 20,9% 18,9% 21,1%
Men answering more in web panel. Unlike other collection
methods
Education and age wrong again, even if it been corrected in the
selection
20
21. Calibration in web panels
GREG calibration after gender, age and region, as well as education
and family type
Calibration Population
18-34 year 29,0% 29,0%
Single parents 28,1% 28,1%
Elementary 32,3% 32,3%
<150.000 DKK 23,9% 26,0%
Very bias non-response - large variation in weights.
What calculated up it fits of course. But still not income.
21
22. To sum up on Statistic Denmark’s
Web panel
Even when recruited from representative surveys, there is great bias
Proportional selection with gender, age and region solves nothing
Proportional selection with more than gender, age and region is
necessary and helps
Income and education, plus age, gender and family is better to choose
proportional and weight after
The non-response in the web collection gives new bias
Weighting restores the population, but there is big variation in weights
One could call this web panel for the quasi representative
But is it all ready out dated? And will it be replaced with our E-boks
panel
22
23. An alternative where it is possible to get rid of
”the first bias”
The base is (allmost) the total population
An alternative Web Panel - E-boks
23
24. 2001 E-Boks opens – goal 350.000 users.
2005 All State payslips in DK are now sent out via E-
Boks.
2006 number of users reaches one million.
2011 E-Boks achieves 3 million users in Denmark and
is established in the Norwegian market. The E-Boks
app is also introduced.
2015 E-Boks launches E-boks.se. Meanwhile E-Boks
reaches 11 million users in the Nordics.
E-boks
24
25. “All” Danish citizens of 15+ years
Contact information is maintained by the
respondents
Link to Cpr-numbers and all register information
Limitations to public costumers
Panel of 4 mio users
25
26. Non registered:
The elderly
Heavy registered:
Unemployed on
unemployment
benefits
Families with
children
Users of E-boks
26
Age
Registered
for E-boks
95+ 14,1%
85 til 94 25,8%
75 til 84 53,5%
65 til 74 81,6%
55 til 64 92,1%
45 til 54 95,3%
35 til 44 97,1%
25 til 34 97,6%
15 til 24 98,3%
Total 89,4%
27. Test of using e-boks
27
March 2016
Normal Omnibus – response rate 61,4 pct.
Invitation letter – normal letter
Reminder normal letter
Cati interviewing and extra written reminder for those
without phone number
E boks test - response rate 36 pct.
B boks invitation
E boks reminder
Second e boks reminder
33. E-boks test: Test of using e-boks -
labor market
33
56%
28%
56%
32%
61%
40%
70%
42%
68%
33%
0%
10%
20%
30%
40%
50%
60%
70%
80%
Ordinary E boks
5. Outside labourmarket
1. Students
2. Employees basic levle
3. Employees medium level and higher
4. Self-employed
34. E-boks test: Test of using e-boks –
Family income
34
46%
27%
48%
29%
60%
28%
64%
44%
70%
46%
73%
39%
0%
10%
20%
30%
40%
50%
60%
70%
80%
Ordinary E boks
No income / unknown income 0 -200.000 200-350.000 350-500.000 500-750.000 750+
35. E-boks test: conclusions on who’s
answering
35
The ones answering on E-boks test:
Equal numbers of men and women
The 50+ years (until the get exempt), but the youngest
answers more often than in the normal set up.
The highly educated (shorter higher educated answers
more often than in ordinary set up)
The employed (employed on basic level answers more
often than in ordinary set up)
The ones not living in the big cities
The ones earning more than 350.000 d.kr. a year (around
47.000 euros)
36. Difference in reply pattern
36
Consumer price index - non weighted
How do you think the prices are today, compared with
a year ago?
E-boks Normal
Higher 61 50
Same 34 44
uændret 5 6
Question from National police - non weighted
To what extent are you concerned about crime and
violence in society?
E-boks Normal
Very concerned 18 24
Somewhat concerned 34 32
A bit concerned 37 36
Not at all 11 7
37. Use of e-boks in Omnibus
37
The test has led to a change in the contact strategy for
the normal omnibus
E boks mail
Normal letter after 2 days
Cati interviewing and Second reminder letter
E boks mail 2-3 days before closing
Use of E-boks mail seems to have raised the
completion rate with about 2-3 pct. and lowered the
expenses for postage.
38. We need to be able to led the respondents answer
on phones / tablets
E boks app -> more tablet / phone
Implication for survey software
38
1.K 2015 1. K 2016
Desktop 73% 68%
Tablet 20% 23%
Mobile 7% 9%
39. E-boks omnibus with and with out smileys
39
Extra Omnibus Extra Omnibus
+ Smileys
Daycares can demand parents to
take out the children for 3 weeks
summer holiday
Agree:
28 pct
Agree:
36 pct
0-class obligatory or
not
Agree:
67 pct
Agree:
79 pct
• Fully agree
• Agree
• Both agree and
disagree
• Disagree
• Fully disagree
40. Even when web panel is recruited from representative surveys, there
is great bias
The non-response in the web collection gives new bias
Weighting restores the population, but there is big variation in
weights
One could call this web panel for the quasi representative
E-boks solves the problem about the first sources of bias, but it is still
a problem that some respondents are hard to get to answer.
We still have to weight data to restores the population.
What do you think are the future for these ways of collecting data?
Where should we focus and what should we be aware of?
Web panel and E-boks panel
Conclusions and your questions
40