Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt- und Berufsforschung, Regensburger Str. 104, Nürnberg, Quality of administrative data - bringing out the best. Testing data corrections for overlaps and inconsistencies European Conference on Quality in Official Statistics, Patrycja Scioch (Research Data Centre of the BA at the IAB, Germany)

Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt- und Berufsforschung, Regensburger Str. 104, Nürnberg, 2 Motivation increasing importance of using administrative data for research in Germany we have two types of such data: -collected for official statistical purposes -by-product of administration (e.g. federal employment services) administrative data: -not collected for research -different and independent sources of data -merging may cause contradictions in information

Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt- und Berufsforschung, Regensburger Str. 104, Nürnberg, 3 The Integrated Employment Biographies - IEB 1.combination of four different sources: Employee History Benefit Recipient History Applicants Pool Data Participants in Measure Dataset 2.subsample: 2.2% random sample latest update characteristics: daily records splitted into episodes quality depends on source of information

Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt- und Berufsforschung, Regensburger Str. 104, Nürnberg, 4 Literature previous findings: concentrate on the analysis of overlaps - qualitative and quantitative (Jaenichen et. al (2005), Bernhard et. al (2006)) correction of single variables (Waller, M. (2007), Kruppe et. al (2007)) evidence: need for data processing in the IEB the way heavily depends on the research question open issues: impact on estimates data processing by transformation of structure of dataset

Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt- und Berufsforschung, Regensburger Str. 104, Nürnberg, 5 Identification/Method assumptions: dataset processing method result within the Case: Wunsch/Lechner (2007) evaluation of labour market programmes in West Germany analyses by comparing matching-estimates time-dependent employment opportunities as outcome 1.step: replication of the data processing and variations of the analysis sample 2.step: replication of the evaluation study 3. step: analyses of the effects of the variations on the results

Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt- und Berufsforschung, Regensburger Str. 104, Nürnberg, 6 Approach/Framework IEB - data set analysis- sample V0 analysis- sample V1 analysis- sample V2 outcome V0 outcome V1 outcome V2 outcome Processing - variable Matching-estimatior - fix Comparison

Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt- und Berufsforschung, Regensburger Str. 104, Nürnberg, 7 Processing rules time windows of two weeks multiple possibilities of spells (different sources, overlaps) goal: exact one state for each period 1.Sort by duration and priority of source 2.Choose the two with capital importance 3.Select one final state using more priority-rules different analysis samples

Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt- und Berufsforschung, Regensburger Str. 104, Nürnberg, 8 Rules of Priority PriorityModel V0Model V1Model V2 1Programme Benefits 2 Employment 3 BenefitsApplicants 4 Programme Differences: Model V1 prefers employment-spells to benefit-spells compared to V0 Model V2 downgrades participation in programmes

Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt- und Berufsforschung, Regensburger Str. 104, Nürnberg, 9 Results before starting the estimation state 1state 2final state window 1benefitemploymentbenefit window 2 (x2)employmentbenefitemployment window 3applicantemployment window 4benefitapplicantbenefit window 5programmebenefit state 1state 2final state window 1 (x3)benefitemploymentbenefit window 2applicantemployment window 3programmebenefitprogramme state 1state 2final state window 1benefitemploymentbenefit window 2 (x2)employmentbenefitemployment window 3applicantemployment window 4 (x2)programmebenefitprogramme IEB- data set analysis- sample V1 programme – employment – benefit – applicant employment – benefit – applicant – programme analysis- sample V0 analysis- sample V2 programme – benefit – employment – applicant

Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt- und Berufsforschung, Regensburger Str. 104, Nürnberg, 10 First results – V0 vs. V1 ObservationsMeanStd. Err. further vocational trainingV0V1V0V1V0V1 monthly earnings < ,0640,1010,0040,005 duration last unemployment (months) ,65,20,05 training measures monthly earnings < ,0710,1060,004 duration last unemployment (months) ,955,60,05 nonparticipants Female ,4520,4170,0050,004 Single ,3740,3940,0050,004 return ,060,050,0030,002 monthly earnings monthly earnings < ,0930,1290,003 duration last unemployment (months) ,617,310,05 duration last employment in (months) ,4420,530,3520,264

Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt- und Berufsforschung, Regensburger Str. 104, Nürnberg, 11 Summary/Prospects differences are significant further descriptive analysis of the different datasets matching comparison of the estimations conclusions

Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt- und Berufsforschung, Regensburger Str. 104, Nürnberg, 12 Thank you for your attention!

Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt- und Berufsforschung, Regensburger Str. 104, Nürnberg, 13 Back-Up References Bernhard, S., Dressel, C., Fitzenberger, B. und Schnitzlein, D. (2006): Überschneidungen in der IEBS: Deskriptive Auswertung und Interpretation, FDZ Methodenreport 4/2006, Nürnberg. Jaenichen, U., Kruppe, T., Stephan, G., Ullrich, B. und Wießner, F. (2005): You can split it if you really want: Korrekturvorschläge für ausgewählte Inkonsistenzen in IEB und MTG, FDZ Datenreport 4/2005, Nürnberg. Kruppe, T., Müller, E., Wichert, L. und Wilke, R. (2007): On the Definition of Unemployment and ist Implementation in Register Data – The Case of Germany, FDZ Methodenreport 3/2007, Nürnberg. Waller, M. (2007): Do Reported End Dates of Treatments Matter for Evaluation Results?, FDZ Methodenreport 1/2007, Nürnberg. Wunsch, C. und Lechner, M. (2007): What Did All the Money Do? On the General Ineffectiveness of Recent West German Labour Market Programmes, University of St. Gallen Department of Economics working paper series , Department of Economics, University of St. Gallen.

Forschungsdatenzentrum der Bundesagentur für Arbeit im Institut für Arbeitsmarkt- und Berufsforschung, Regensburger Str. 104, Nürnberg, 14 Results before starting the estimation state 1state 2final state window 1benefitemploymentbenefit window 2employmentbenefitemployment window 3employmentbenefitemployment window 4applicantemployment window 5benefitapplicantbenefit window 6programmebenefit state 1state 2final state window 1benefitemploymentbenefit window 2benefitemploymentbenefit window 3benefitemploymentbenefit window 4applicantemployment window 5programmebenefitprogramme window 6programmebenefitprogramme state 1state 2final state window 1benefitemploymentbenefit window 2employmentbenefitemployment window 3employmentbenefitemployment window 4applicantemployment window 5programmebenefitprogramme window 6programmebenefitprogramme IEB- data set analysis- sample V1 programme – employment – benefit – applicant employment – benefit – applicant – programme analysis- sample V0 analysis- sample V2 programme – benefit – employment – applicant