Essential phases of register-based survey processing concerning timeliness EU-SILC workshop on best practices for EU-SILC revision: timeliness Marie Reijo, Senior Researcher E-mail: marie.reijo@stat.fi
The Finnish SILC Synergy from integrating with the national IDS/TIDS production processes, expertise involved from Data Collection and Statistical Methods Units of Statistics Finland 4-year rotating panel design since 2010 Efficient sampling and weighting design for output measures: up-to-date and complete sampling frame, 2-phase stratified sampling, 13 socio-economic strata, non-proportional allocation, about 11 000 sample persons Advanced and systematised standard production Extensive use of registers from the coherent register system Interview fieldwork: from the beginning of the survey year CATI of the S-R persons with the Blaise questionnaire 15/10/2014 2
Timing of the Finnish SILC production 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 Publishing Dec April, disseminating final data in March-April Accepted sample, unit non-response corrected base weights Early estimates Early weights Preliminary weights Register data collection, latest registers received in November. Interviewed and register data are processed for most C-variables by December, for some C- and L-variables further ahead by Jan-Apr. CATI-fieldwork Jan April, automatic editing by pre-filled data and checks, filtering and routing of questions built into the Blaise questionnaire Updated sampling frame, sampling Quality analysis, assessment, testing, training, preparing incl. M o n i t o r i n g Blaise-programming etc., presetting exact release dates. Preliminary estimates Final estimates Final weights Corrections due to register updates are very rare! Preliminary = Final estimates 15/10/2014 3
The Finnish SILC: Reliability is prioritised to still earlier data Unit non-response corrected base weights by strata, adjusted further by the total HH-number Early weights (C-data, Final weights in L-data): + calibrated by total demographic and region distributions Preliminary/final weights (C-data): + calibrated by total income component and income receiver sums The latest registers received in November are used for income variables and for the preliminary/final weights. As output of income calibration, the FI-SILC weights give more precise C-estimates on income level, structure and distribution being in line with the Total Income Distribution Statistics (TIDS) figures. 15/10/2014 4
Severely materially deprived (MD) persons by early and final weights, incl. 95 % cl. of the final estimates 3.8 % 200 000 3.6 % 190 000 3.4 % 180 000 3.2 % 3.0 % 2.8 % 2.6 % estimate_dec estimate_aug estimate_june 170 000 160 000 150 000 140 000 130 000 estimate_dec estimate_aug estimate_june 2.4 % 2.2 % 120 000 110 000 2.0 % 2009 2010 2011 2012 2013 100 000 2009 2010 2011 2012 2013 Source: FI-SILC/IDS 2009-2013, early estimates of August are since 2011 15/10/2014 5
Materially deprived (MD) according to the panels (1 4) by early and final weights, incl. 95 % cl. of the final estimates in the whole sample Severely materially deprived, deprived_4 Materially deprived, deprived_3 1_estimate_Aug 1_estimate_Dec 4_estimate_Dec All_estimate_Dec 3_estimate_Dec All_estimate_Aug 2_estimate_Dec 4_estimate_Aug 3_estimate_Aug 2_estimate_Aug 0.0 % 0.5 % 1.0 % 1.5 % 2.0 % 2.5 % 3.0 % 2_estimate_Dec 2_estimate_Aug All_estimate_Dec 3_estimate_Dec 1_estimate_Aug 1_estimate_Dec All_estimate_Aug 4_estimate_Dec 3_estimate_Aug 4_estimate_Aug 0.0 % 2.0 % 4.0 % 6.0 % 8.0 % 10.0 % Source: FI-SILC/IDS 2013, separate panel weights from IDS are used for the panel estimates 15/10/2014 6
Incapacity to face unexpected financial expenses (HS060) according to the panels (1 4) by early and final weights, incl. 95 % cl. of the final estimates in the whole sample All persons Persons, aged 65+ 1_estimate_Aug 1_estimate_Dec 2_estimate_Dec All_estimate_Dec 2_estimate_Aug All_estimate_Aug 3_estimate_Dec 4_estimate_Dec 3_estimate_Aug 4_estimate_Aug 10.0 % 15.0 % 20.0 % 25.0 % 30.0 % 4_estimate_Dec 1_estimate_Aug 1_estimate_Dec 4_estimate_Aug 3_estimate_Dec 3_estimate_Aug All_estimate_Dec All_estimate_Aug 2_estimate_Dec 2_estimate_Aug 10.0 % 15.0 % 20.0 % 25.0 % 30.0 % Source: FI-SILC/IDS 2013, separate panel weights from IDS are used for the panel estimates 15/10/2014 7
Figures on MD and other non-monetary variables level (N,%) based on very early weights are rather reliable (preciseness) compared to final estimates (closer to true values), panel differences exist Information about movements is revealed consistently by early and final estimates: e.g. decline of severe MD in 2010 2012 is statistically significant both by early and final weights Standard and advanced sampling and weighting methods optimised for the survey design and output (revised, initially Income Distribution Statistics (IDS) 2-year rotating panel design) ensure handling annual changes, e.g. biased unit non-responses When (MD) figures are rather stable over consecutive years, different estimates, although close to each other, matter Early information on movements might still have relevance 15/10/2014 8
The Finnish SILC: Accessibility and clarity are provided Total Income Distribution Statistics (TIDS) is published a little bit earlier than the SILC/IDS preliminary estimates Adequate data comparisons are important More and more reliable statistical data are safer to release, e.g. improves figures interpretation Many updated versions of statistical figures aren t preferred in official statistics In addition to timeliness and reliability, quality criteria like accessibility and clarity are followed Current timeliness (preliminary estimates in December of the survey year, final estimates in March-April of the subsequent year) is moderate, no reason for acceleration by weakening quality and credibility. 15/10/2014 9
Thanks for your attention! 15/10/2014 10