Statistics Norway conducted quality reviews of 18 statistics to improve quality and efficiency. The reviews mapped processes, identified weaknesses and inefficiencies, and proposed improvements. Over 140 improvement measures were identified, with 60 measures completed so far for 9 of the 18 statistics. The reviews provided a useful examination of statistical processes and documentation, and identified areas for streamlining and cost savings. Statistics Norway found the quality review approach to be a cost-effective way to evaluate processes and plans to continue reviews focused on related statistical themes.
This document summarizes findings from time use surveys conducted in Finland. It finds that:
1) Response rates were higher for telephone interviews (62%) than face-to-face interviews (58%), but total non-response was lower for telephone interviews.
2) There were no significant differences in diary quality or number of activities reported between face-to-face and telephone interviews.
3) A light paper diary pilot survey had a very low response rate of 17.4% and differences compared to full surveys, suggesting interviewer assistance is needed for quality and response.
The document discusses the historical development of statistics in Iceland from its origins under Danish rule to modern times. It makes three key points:
1) Icelandic statistics began in the late 19th century under Danish influence, with early censuses and publications conducted in Copenhagen. Statistics Iceland was founded in 1914 to oversee domestic data collection and production.
2) In the 20th century, there were alternating periods of centralization and decentralization. Statistics were centralized under the early free market but decentralized during periods of economic regulation as sectoral groups took over some data collection.
3) Joining the EEA in 1994 reversed decentralization trends, requiring comparable EU-standard data. This increased Statistics Iceland's coordination role
Statistics Norway conducted quality reviews of 18 statistics to improve quality and efficiency. The reviews mapped processes, identified weaknesses and inefficiencies, and proposed improvements. Over 140 improvement measures were identified, with 60 measures completed so far for 9 of the 18 statistics. The reviews provided a useful examination of statistical processes and documentation, and identified areas for streamlining and cost savings. Statistics Norway found the quality review approach to be a cost-effective way to evaluate processes and plans to continue reviews focused on related statistical themes.
This document summarizes findings from time use surveys conducted in Finland. It finds that:
1) Response rates were higher for telephone interviews (62%) than face-to-face interviews (58%), but total non-response was lower for telephone interviews.
2) There were no significant differences in diary quality or number of activities reported between face-to-face and telephone interviews.
3) A light paper diary pilot survey had a very low response rate of 17.4% and differences compared to full surveys, suggesting interviewer assistance is needed for quality and response.
The document discusses the historical development of statistics in Iceland from its origins under Danish rule to modern times. It makes three key points:
1) Icelandic statistics began in the late 19th century under Danish influence, with early censuses and publications conducted in Copenhagen. Statistics Iceland was founded in 1914 to oversee domestic data collection and production.
2) In the 20th century, there were alternating periods of centralization and decentralization. Statistics were centralized under the early free market but decentralized during periods of economic regulation as sectoral groups took over some data collection.
3) Joining the EEA in 1994 reversed decentralization trends, requiring comparable EU-standard data. This increased Statistics Iceland's coordination role
The document discusses exploring how an "integrated approach" to statistical production in the European Statistical System (ESS) aligns with the ESS Code of Practice, which was established to strengthen trust. It analyzes four principles of the Code - on legal mandate for data collection, statistical confidentiality, appropriate statistical procedures, and reducing response burden - in the context of integrated data collection and sharing across national statistical systems. While some data sharing may reduce burden, enterprises are concerned about how data will be protected and used when shared across borders. More discussion is needed on how to balance trust, quality, and cost in an increasingly integrated ESS.
The document discusses the history and future of statistics and the statistical office in relation to the state. It covers:
1) The founding of statistical offices in Nordic countries in the mid-19th century to meet needs of developing nations.
2) How statistics evolved alongside major events like wars and independence to meet changing policy needs over the 20th century such as social policy, economic policy, and later EU integration.
3) Future challenges include tighter links between statistics and policy goals at local, EU and global levels, and potential need to adapt methods like using big data to meet changing needs of globalization. The document questions if new approaches will be needed.
This document discusses non-response and motivation measures in Statistics Finland's EU Labour Force Survey from 1997-2013. It summarizes trends in non-response rates over time, with rates peaking around 2005 and declining since. Various motivation measures are discussed, including lengthening field work, improving contact materials, and interviewer training on the survey's importance. Response rates are shown to vary by region and subgroup, with lower response among those with less education or who are unemployed. Advancing information technology is noted as affecting response, though complete recovery is not expected. The need for quality indicators and better use of register data is emphasized to address non-response issues going forward.
This document discusses the need to measure uncertainty in register statistics given their inductive nature. It proposes using Confidence Images (CIm), which restrict potential values of population parameters based on multiple sources of information, each with an associated measure of uncertainty. As a proof of concept, the document calculates CIms for the total number of cattle in Sweden using different combinations of register data, survey data, and prior knowledge. The CIm approach fulfills criteria for providing objective, interpretable and comparable measures of uncertainty for register statistics. Further methodological development is still needed, but CIms could become a useful statistical tool for quantifying uncertainty in register-based estimates.
The MEETS program aims to modernize European business and trade statistics by reducing costs and increasing relevance. It has four key objectives: review priorities, streamline frameworks, increase efficient production, and modernize Intrastat. It has a budget of 42.5 million euros over five years (2009-2013) to support networks, grants to member states, and procurements. Results include the EuroGroups Register providing infrastructure to measure activities of multinational enterprises and profiling analyses to more efficiently collect data from enterprise groups in a confidential manner. It also provides recommendations to revise statistical unit definitions and increase use of administrative and accounts data in statistical warehouses.
This document discusses how the architecture of a criminal coding system impacts statistical quality in Sweden. It summarizes the country's criminal statistics systems and agencies. It then details a study that looked at coding errors across 1600 police reports in 8 crime categories. The results found good quality at higher levels but lower quality capturing context details. Overall coding quality was similar to issues found in 1978. The document concludes that coding quality correlates to administrative needs, detailed instructions are not enough to prevent errors, and coding quality must be considered when creating statistics.
Statistics Finland is developing web data collection for personal surveys through a set of projects running from 2012 to 2014. The goals are to develop infrastructure for web data collection and support mixed-mode data collection, especially for the Labour Force Survey. Four initial projects have been completed, including a mixed-mode pilot of the Consumer Survey. Current projects include developing Statistics Finland's data collection pages and a 2013 web pilot for the Labour Force Survey to study mode effects. By 2017, an internet questionnaire is planned to be available as an alternative for all personal surveys.
Presentation, Digital tentamen på SUNET-dagarna 22/4Mats Brenner
Presentation av projektet Digitalt tentamen - SUNET Inkubator av Mats Brenner, läs mer om projektet på webbsida: https://portal.nordu.net/display/Inkubator/Digital+Tentamen
16 misstag jag gjort inom digital analys (och hur du undviker dem)Daniel Hansson
Är du intresserad av att fördjupa dig inom analyticsområdet men tycker det verkar krångligt, svårt och lätt att göra misstag? Här en fast forward förbi fallgropar jag ramlat i.
Presentation för Lunds universitet SAMHÄLLSVETENSKAPLIGA FAKULTETEN 160612Mats Brenner
Presentation om Morgondagens digitala examinationer - Digitala examinationer - utvecklingsmöjlighet för flertalet examinationsformer. Projekt Digital tentamen II - SUNET Inkubator. Mats Brenner, projektledn.
Utvecklingstrappan - hur får vi in de pedagogisk verktygenMats Brenner
Utvecklingstrappan – hur får vi in de
pedagogiska lärverktygen
Från idé till förvaltning.
Presentation: 2023-05-30, HPU UHR – Temacafé
Deltagare: Mats Brenner, KI – Cecilia Hellekant, KAU – Kent Stening, LNU –
med Jörg Pareigis, KAU och Lotta Fröjdfeldt, MDU (podcast) - Claire
Englund, UMU
DIGITALA EXAMINATIONER: Nuläget och erfarenhetsutbyte av införandeMats Brenner
DIGITALA EXAMINATIONER: Nuläget och erfarenhetsutbyte av införande. Presentation på konferensen nu2018.se, 11/10-2018. Mats Brenner för Projekt Digital tentamen II - SUNET Inkubator
The document discusses exploring how an "integrated approach" to statistical production in the European Statistical System (ESS) aligns with the ESS Code of Practice, which was established to strengthen trust. It analyzes four principles of the Code - on legal mandate for data collection, statistical confidentiality, appropriate statistical procedures, and reducing response burden - in the context of integrated data collection and sharing across national statistical systems. While some data sharing may reduce burden, enterprises are concerned about how data will be protected and used when shared across borders. More discussion is needed on how to balance trust, quality, and cost in an increasingly integrated ESS.
The document discusses the history and future of statistics and the statistical office in relation to the state. It covers:
1) The founding of statistical offices in Nordic countries in the mid-19th century to meet needs of developing nations.
2) How statistics evolved alongside major events like wars and independence to meet changing policy needs over the 20th century such as social policy, economic policy, and later EU integration.
3) Future challenges include tighter links between statistics and policy goals at local, EU and global levels, and potential need to adapt methods like using big data to meet changing needs of globalization. The document questions if new approaches will be needed.
This document discusses non-response and motivation measures in Statistics Finland's EU Labour Force Survey from 1997-2013. It summarizes trends in non-response rates over time, with rates peaking around 2005 and declining since. Various motivation measures are discussed, including lengthening field work, improving contact materials, and interviewer training on the survey's importance. Response rates are shown to vary by region and subgroup, with lower response among those with less education or who are unemployed. Advancing information technology is noted as affecting response, though complete recovery is not expected. The need for quality indicators and better use of register data is emphasized to address non-response issues going forward.
This document discusses the need to measure uncertainty in register statistics given their inductive nature. It proposes using Confidence Images (CIm), which restrict potential values of population parameters based on multiple sources of information, each with an associated measure of uncertainty. As a proof of concept, the document calculates CIms for the total number of cattle in Sweden using different combinations of register data, survey data, and prior knowledge. The CIm approach fulfills criteria for providing objective, interpretable and comparable measures of uncertainty for register statistics. Further methodological development is still needed, but CIms could become a useful statistical tool for quantifying uncertainty in register-based estimates.
The MEETS program aims to modernize European business and trade statistics by reducing costs and increasing relevance. It has four key objectives: review priorities, streamline frameworks, increase efficient production, and modernize Intrastat. It has a budget of 42.5 million euros over five years (2009-2013) to support networks, grants to member states, and procurements. Results include the EuroGroups Register providing infrastructure to measure activities of multinational enterprises and profiling analyses to more efficiently collect data from enterprise groups in a confidential manner. It also provides recommendations to revise statistical unit definitions and increase use of administrative and accounts data in statistical warehouses.
This document discusses how the architecture of a criminal coding system impacts statistical quality in Sweden. It summarizes the country's criminal statistics systems and agencies. It then details a study that looked at coding errors across 1600 police reports in 8 crime categories. The results found good quality at higher levels but lower quality capturing context details. Overall coding quality was similar to issues found in 1978. The document concludes that coding quality correlates to administrative needs, detailed instructions are not enough to prevent errors, and coding quality must be considered when creating statistics.
Statistics Finland is developing web data collection for personal surveys through a set of projects running from 2012 to 2014. The goals are to develop infrastructure for web data collection and support mixed-mode data collection, especially for the Labour Force Survey. Four initial projects have been completed, including a mixed-mode pilot of the Consumer Survey. Current projects include developing Statistics Finland's data collection pages and a 2013 web pilot for the Labour Force Survey to study mode effects. By 2017, an internet questionnaire is planned to be available as an alternative for all personal surveys.
Presentation, Digital tentamen på SUNET-dagarna 22/4Mats Brenner
Presentation av projektet Digitalt tentamen - SUNET Inkubator av Mats Brenner, läs mer om projektet på webbsida: https://portal.nordu.net/display/Inkubator/Digital+Tentamen
16 misstag jag gjort inom digital analys (och hur du undviker dem)Daniel Hansson
Är du intresserad av att fördjupa dig inom analyticsområdet men tycker det verkar krångligt, svårt och lätt att göra misstag? Här en fast forward förbi fallgropar jag ramlat i.
Presentation för Lunds universitet SAMHÄLLSVETENSKAPLIGA FAKULTETEN 160612Mats Brenner
Presentation om Morgondagens digitala examinationer - Digitala examinationer - utvecklingsmöjlighet för flertalet examinationsformer. Projekt Digital tentamen II - SUNET Inkubator. Mats Brenner, projektledn.
Utvecklingstrappan - hur får vi in de pedagogisk verktygenMats Brenner
Utvecklingstrappan – hur får vi in de
pedagogiska lärverktygen
Från idé till förvaltning.
Presentation: 2023-05-30, HPU UHR – Temacafé
Deltagare: Mats Brenner, KI – Cecilia Hellekant, KAU – Kent Stening, LNU –
med Jörg Pareigis, KAU och Lotta Fröjdfeldt, MDU (podcast) - Claire
Englund, UMU
DIGITALA EXAMINATIONER: Nuläget och erfarenhetsutbyte av införandeMats Brenner
DIGITALA EXAMINATIONER: Nuläget och erfarenhetsutbyte av införande. Presentation på konferensen nu2018.se, 11/10-2018. Mats Brenner för Projekt Digital tentamen II - SUNET Inkubator
Frukostseminarium, utvärdering av förändringsarbete, 2 sep 2010Metamatrix
Bilder från ett frukostseminarium kring utvärderingsmetodik som gav tips på hur utvärdering blir ett praktiskt verktyg för förändringsarbete inom en organisation. En av utmaningarna med utvärdering av program eller projekt är att skapa en gemensam bild av problemen och av målen för insatsen eller projektet. Man bör arbeta för att skapa en mental förberedelse för förändringsarbetet hos den berörda organisationen och dess personal. En annan utmaning handlar om de uppsatta målen och den styrning som man har för att nå ökad måluppfyllelse. Ofta är målen inte möjliga att följa upp. Ibland beror detta på att målen är politiska bestämda och därför ”medvetet” otydliga ibland beror det på att man inte har kunnat skapa mål som är tidsatta eller kvantifierbara på något sätt. När det gäller målstyrningen så finns det ofta mycket att vidareutveckla inom projektet eller programmet, ofta finns det en otydlig koppling mellan insatserna och de mål man har satt upp. För att kunna få en praktisk nytta av utvärdering så behöver en organisation skapa ett system för kontinuerlig uppföljning och styrning mot uppsatta mål.
Kultur och kvalitet för distansutbildning och nätbaserat lärande_09dec2022.pdfEbba Ossiannilsson
Kultur och kvalitet för distansutbildning och nätbaserat lärande
En översikt över nationella och internationella kvalitesramverk för öppen, flexibel distansutbildning (OFDL) för kulturutveckling och kvalitet. Presentation av Ebba Ossiannilsson, Professor, Dr. Svenska Riksorganisationen för öppen flexibel distansutbildning (SVERD) 12 december 2022 (PDF)
Similar to Rammeverk: Genomlysning av statistik (20)
This document discusses trends and challenges facing Nordic statistics and suggests areas for potential Nordic cooperation. It notes that while statistics have historically played an important role, their influence may diminish as more actors share information. Two potential cooperative projects are outlined: 1) Creating scenarios about the future of Nordic statistics looking out to 2033 to understand uncertainties and opportunities. 2) Conducting horizon scanning to identify new emerging issues that need to be addressed. The goal is to help statistics remain relevant by anticipating changes and renewing methods and content.
The document discusses the establishment of a Nordic PIAAC Database containing data from the OECD's Survey of Adult Skills (PIAAC) and national registers from five Nordic countries and Estonia. The goals of the Nordic PIAAC Network, which is financing the database, are to create the database, publish a report on skills in the Nordic region, and make the microdata available for other research. The database will contain background questionnaire data, cognitive scores, and register data from national sources and will be housed securely at Statistics Denmark with researchers applying for access. Combining survey and register data provides more information and allows the database to be updated over time.
This document summarizes a presentation given by Maija Metsä-Pauri of Statistics Finland about statistical communication and quality in the age of open data. It discusses how user needs are changing with digitalization and social media, requiring a shift from data dissemination to active communication. Statistics Finland has launched new interactive websites and a blog to better engage with readers. It also emphasizes the importance of statisticians telling statistical stories, collaborating with data journalists, and focusing on quality over quantity of information as open data becomes more prevalent.
This document summarizes the results of an interview study conducted with 11 non-respondents to government surveys in Sweden. The interviews explored reasons for non-response from a qualitative perspective. Some key findings included:
- Some saw value in contributing if they understood how it could make a meaningful difference, while others did not feel it was important or would lead to anything good.
- Attitudes toward authorities and power influenced responses, with some expressing mistrust while others believed the government wants to do good.
- Experiences and knowledge of statistics varied, with some skeptical due to how questions are asked or outdated data is used to draw conclusions.
- Three types of non-respondents were identified based on
This document summarizes an experimental study on the use of show cards in telephone surveys. The study tested show cards on alcohol consumption and chronic diseases in three different surveys. It found that show cards had a negative effect on response rates, especially for those with lower education levels. The presence of show cards did not significantly affect response distributions or improve data quality. Additionally, not many respondents reported using the show cards. In conclusion, show cards were found to increase non-response bias without improving data quality or response distributions.
The document discusses how integrating spatial information throughout the statistical production process can improve quality. It summarizes the INSPIRE Directive which establishes a common infrastructure for spatial data in Europe. Statistics Sweden has developed methods to incorporate spatial data, like delineating localities, and aims to further integrate spatial data and tools across the entire production chain for higher quality statistics and new insights.
Produksjonsprosessen: Kvalitetsmåling av populasjonsregistre i SSB
Rammeverk: Genomlysning av statistik
1. 20.8.2013 Christina Telasuo 1
Genomlysning av Statistik
• Erfarenheter av deltagarorienterad
kvalitetsgranskning mellan olika
statistikproducerande organisationer
3. 20.8.2013 Christina Telasuo 3
Bakgrund
• Deltagarorienterad kvalitetsgranskning
– Samarbete mellan olika
statistikproducerande organisationer
• Finska Tullen, statistikenheten och
Skogsforskningsinstitutet i Finland
– Pilot
4. 20.8.2013 Christina Telasuo 4
Bakgrund
• Utgångspunkt: European Statistics Code of Practice och Eurostats Quality
Assurance Framwork
• Utvecklad av Statistikcentralen för internt bruk
• Ett kvalitetsgranskningsförfarande som gick under namnet genomlysning
av statistik eller mer formellt; deltagarorienterad kvalitetsgranskning
• 2011 användning mellan olika statistikproducerande organisationer
påbörjas
• Medverkande organisationer :
Finska Tullen, Skogsforskningsinstitutet i Finland, Jord- och
skogsbruksministeriets informationstjänstcentral , Vilt- och
fiskeriforskningsinstitutet och Finlands miljöcentral
5. 20.8.2013 Christina Telasuo 5
Syfte med deltagarorienterad kvalitetsgranskning
Systematisk och sammanhängande metod för kvalitetsgranskning av olika
statistiska produktionsprocesser/enheter
• Syfte
– Förbättra statistikens kvalitet
– En del av det övergripande kvalitetsarbetet
– Kompleterar traditionella självgranskningsmetoder och externa kontroll
eller översyn
• Mål
– Värdera och ifrågasätta gällande arbetssätt, metoder och tekniker
– Identifiera och finna användbar praxis inom produktionen som skulle
kunna spridas till andra
– Öka kunskapen genom att sammanföra experter från olika
organisationer
– Underlätta diskussion mellan organisationer
6. 20.8.2013 Christina Telasuo 6
Inledningsfasen av kvalitetsgranskningen
• Värderingsgruppen
• Experter (2-4 personer, kan vara från olika organisationer)
• Ingen direkt koppling till produktionen av den statistik som ska
granskas
• Värderarna ska vara objektiva och självständiga
• Målgruppen
• Producenter av den statistik som ska granskas (1-10 personer)
• Målgruppen bestämmer de deltagande personerna inom sin grupp
7. 20.8.2013 Christina Telasuo 7
Frågeformulär
• Utvecklad av Statistikcentralen
• Reviderad för att vara organisationsneutral av de andra
producenterna av statistik
• Utgångspukt:
– ESS – Quality Assurance Framework
– ESS – DESAP
• Development of a Self Assessment Programme
• The generic checklist for a systematic quality assessment of
surveys in the European Statistical System
8. 20.8.2013 Christina Telasuo 8
Frågeformulär
• Cirka 130 frågor
• De flesta är alternativfrågor
– ja/nej
– stämmer helt/delvis/inte als
– fält för kommentarer efter varje fråga
• Kan besvaras av olika personer och delas upp
9. 20.8.2013 Christina Telasuo 9
Frågeformulär
• Uppdelad i tio huvudsakliga områden
– 1. Administrativa uppgifter
– 2. Planering och ledarskap
– 3. Interaktion med användarna
– 4. De anställdas kompetens och introduktion av nya
medarbetare
– 5. Informationsteknologi
– 6. Datainsamling
– 7. Bearbetning av data
– 8. Distribution
– 9. Dokumentation och arkivering
– 10. Uppföljning, utvärdering, utveckling
10. 20.8.2013 Christina Telasuo 10
Verksamhetsmodell
• Välja deltagarna i grupperna
• Frågeformuläret
– Genomgång av frågeformuläret
– Granskningen börjar med att målgruppen fyller i frågeformuläret
• Självgranskning
– Värderingsgruppen tillhandahålls det ifyllda formuläret samt kompleterande material
• Första mötet
– Produktionsprosessen diskuteras med utgångspukt av svaren
• Värderingsgruppen gör en första version av slutrapporten och skickar den till målgruppen
för kommentarer
• Konsensusmöte – revidering av slutrapporten
– Värderings- och målgruppen är överens om:
• Utvecklingsförslag
• Andra nödvändiga ändringar i produktionsprosessen
• Slutrapport
11. 20.8.2013 Christina Telasuo 11
Deltagarorienterad kvalitetsgranskning som
process
Stage 1:
Target team: Self
Assessment
(questionary+docu
ments)
Stage 2:
Audit team analyses the
Questionary and
documents
Stage 3:
First meeting
Discussion of questionary
and other documents
Stage 4
Audit team produce
first draft of report
and send it to target
team
Stage 5:
Consensus
meeting, revising
the report
Outcome
Final report:
Development
proposals
Good
practices
Other
evaluations
Experiences of auditing
Preparations and
communication
12. 20.8.2013 Christina Telasuo 12
Slutrapport
Utvecklingsförslag
God praxis och användbara arbetssätt
och -procedurer
Slutsatser och iakttagelser
Erfarenheter av granskningen
13. 20.8.2013 Christina Telasuo 13
Slutrapport
Störst betydelse = risk management
• Kvalitetssäkring
– Hur undvika fel i produktionsprocessen
– Valideringsprocessen
• Hur hantera uppkommande fel
– Vilka delar i produktionsprocessen är ”svarta hål”
– Var finns största riskerna för fel
• Revisioner
– Dokumentering av revisioner
– Uppföljning av revisioner
14. 20.8.2013 Christina Telasuo 14
Uppföljning
• Slutrapport
–Instrument for management
–Utvecklingsförslagen kan användas
som underlag för ökade budgetmedel
–Underlag för verksamhetsplaner
15. 20.8.2013 Christina Telasuo 15
Erfarenheter
• Effektivt sätt att öka kunskap för alla
inblandade
– Arbetssätt
– Metoder och tekniker
– Produktion
– Distribution
16. 20.8.2013 Christina Telasuo 16
Erfarenheter
• Mellan organisationner
– Kommunikation
– Diskussion
– Utbyte av idéer och gad praxis
• Risk management
– Användarnas behov
Mycket kostnadseffektivt