<abstract xmlns="http://www.w3.org/1999/xhtml"><p>As occupational data play a crucial part in many social and economic analyses, information on the reliability of these data and, in particular on the role of coding agencies, is important. Based on our review of previous research, we develop four hypotheses, which we test using occupation-coded data from the German General Social Survey and the field test data from the German Programme for the International Assessment of Adult Competencies. Because the same data were coded by several agencies, their coding results could be directly compared. As the surveys used different instruments, and interviewer training differed, the effects of these factors could also be evaluated.</p><p>Our main findings are: the percentage of uncodeable responses is low (1.8–4.9%) but what is classified as “uncodeable” varies between coding agencies. Inter-agency coding reliability is relatively low κ ca. 0.5 at four-digit level, and codings sometimes differ systematically between agencies. The reliability of derived status scores is satisfactory (0.82–0.90). The previously reported negative relationship between answer length and coding reliability could be replicated and effects of interviewer training demonstrated. Finally, we discuss the importance of establishing common coding rules and present recommendations to overcome some of the problems in occupation coding.</p></abstract>

As occupational data play a crucial part in many social and economic analyses, information on the reliability of these data and, in particular on the role of coding agencies, is important. Based on our review of previous research, we develop four hypotheses, which we test using occupation-coded data from the German General Social Survey and the field test data from the German Programme for the International Assessment of Adult Competencies. Because the same data were coded by several agencies, their coding results could be directly compared. As the surveys used different instruments, and interviewer training differed, the effects of these factors could also be evaluated.Our main findings are: the percentage of uncodeable responses is low (1.8–4.9%) but what is classified as “uncodeable” varies between coding agencies. Inter-agency coding reliability is relatively low κ ca. 0.5 at four-digit level, and codings sometimes differ systematically between agencies. The reliability of derived status scores is satisfactory (0.82–0.90). The previously reported negative relationship between answer length and coding reliability could be replicated and effects of interviewer training demonstrated. Finally, we discuss the importance of establishing common coding rules and present recommendations to overcome some of the problems in occupation coding.

How Standardized is Occupational Coding? A Comparison of Results from Different Coding Agencies in Germany

Journal of Official Statistics

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

As occupational data play a crucial part in many social and economic analyses, information on the reliability of these data and, in particular on the role of...

How Standardized is Occupational Coding? A Comparison of Results from Different Coding Agencies in Germany

Published Online: Mar 26, 2019

Page range: 167 - 187

Received: Aug 01, 2017

Accepted: Apr 01, 2018

DOI: https://doi.org/10.2478/jos-2019-0008

Keywords
Occupation coding, coding rules, ISCO

© 2019 Natascha Massing et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

How Standardized is Occupational Coding? A Comparison of Results from Different Coding Agencies in Germany

Published Online: Mar 26, 2019

Page range: 167 - 187

Received: Aug 01, 2017

Accepted: Apr 01, 2018

DOI: https://doi.org/10.2478/jos-2019-0008

KeywordsOccupation coding, coding rules, ISCO

© 2019 Natascha Massing et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Keywords
Occupation coding, coding rules, ISCO