1. bookVolume 34 (2018): Issue 2 (June 2018)
    Special Issue on Establishment Surveys (ICES-V)
Journal Details
License
Format
Journal
eISSN
2001-7367
First Published
01 Oct 2013
Publication timeframe
4 times per year
Languages
English
access type Open Access

Business Data Collection: Toward Electronic Data Interchange. Experiences in Portugal, Canada, Sweden, and the Netherlands with EDI

Published Online: 07 Jun 2018
Page range: 419 - 443
Received: 01 Nov 2016
Accepted: 01 Jan 2018
Journal Details
License
Format
Journal
eISSN
2001-7367
First Published
01 Oct 2013
Publication timeframe
4 times per year
Languages
English
Abstract

This article discusses the experience and the ideas of National Statistical Institutes from four countries – Portugal, Sweden, Canada, and the Netherlands – in order to build a fully automated data collection system, to provide a system-to-system (S2S) data exchange or Electronic Data Interchange (EDI) between all stakeholders in the production chain. This joint work is a summary of an invited session at the Fifth International Conference on Establishment Surveys, which was devoted to ‘the future of business data collection’. Taken together, the four presentations provide an overview of recent experiences with S2S/EDI data collection for financial business data. The basis for such a system is an integrated unbroken digital information chain that runs from the recording of financial data in computerised administrative systems of individual businesses all the way to publishing economic statistics – the Business Information Chain. This chain can be ‘closed’ and made into a cycle by including a feedback loop, for example by providing benchmark data to businesses. However, to make it happen, technical standardisation, vertical and horizontal conceptual harmonisation between all partners in the chain, and positive business cases for all partners are needed. The article starts by putting EDI developments in historical perspective.

Keywords

Baker, R., J.M. Brick, N.A. Bates, M. Battaglia, M.P. Couper, J.A. Dever, K.J. Gile, and R. Tourangeau 2013. “Summary Report of the AAPOR Task Force on Non-probability Sampling.” Journal of Survey Statistics and Methodology 2013(I): 90–143. Doi: https://doi.org/10.1093/jssam/smt00810.1093/jssam/smt008Open DOISearch in Google Scholar

Bakker, B.F.M. and P.J.H. Daas 2012. “Methodological Challenges in Register-Based Research.” Statistica Neerlandica (special issue) 66(1): 2–7. Doi: http://dx.doi.org/10.1111/j.1467-9574.2011.00505.x10.1111/j.1467-9574.2011.00505.xOpen DOISearch in Google Scholar

Bavdaz, M. 2010. “Sources of Measurement Errors in Business Surveys.” Journal of Official Statistics 16(1): 25–42.Search in Google Scholar

Bharosa N., R. van Wijk, N. de Winne, and M. Janssen (eds) 2015. Challenging the Chain. Governing the automated exchange and processing of business information. Amsterdam: IOS Press, Available at: www.iospress.nl/book/challenging-the-chain/ (accessed 19 April 2018).Search in Google Scholar

Biemer, P.P. and L.E. Lyberg. 2003. Introduction to Survey Quality. Hoboken, NJ: Wiley.10.1002/0471458740Search in Google Scholar

Born, A. 2016. “Harmonizing Financial Information from Businesses at Statistics Canada.” In Proceedings of the Fifth International Conference of Establishment Surveys: Statistics (ICESV) Switzerland, 20-23 June 2016, Geneva, Switzerland. Statistics Switzerland. Available at: http://ww2.amstat.org/meetings/ices/2016/proceedings/146_ices15Final00226.pdf (accessed 19 April 2018).Search in Google Scholar

Buiten, G., R. Boom, M. Roos, and G. Snijkers 2016. “Issues in Automated Financial Data Collection in The Netherlands”. In Proceedings of the Fifth International Conference of Establishment Surveys: Statistics (ICESV) Switzerland, 20-23 June 2016, Geneva, Switzerland. Statistics Switzerland. Available at: http://ww2.amstat.org/meetings/ices/2016/proceedings/148_ices15Final00209.pdf (accessed 19 April 2018).Search in Google Scholar

Clayton, R.L., M.A. Searson, and Ch. D. Manning. 2000. “Electronic Data Collection in Selected BLS Establishment Programs.” In Proceedings of the Second International Conference of Establishment Surveys (ICESII), Montreal, 18-21 June 2000, 439–448. Alexandria, VA: American Statistical Association. Available at: http://ww2.amstat.org/meetings/ices/2000/proceedings/S08.pdf (accessed 19 April 2018).Search in Google Scholar

Couper, M.P., R.P. Baker, J. Bethlehem, C.Z.F. Clark, J. Martin, W.L. Nicholls II, and J.M. O’Reilly. 1998. Computer Assisted Survey Information Collection. New York: Wiley.Search in Google Scholar

Couper, M.P. and W.L. Nicholls II. 1998. The History and Development of Computer Assisted Survey Information Collection Methods. Computer Assisted Survey Information Collection, edited by M.P. Couper, R.P. Baker, J. Bethlehem, C.Z.F. Clarck, J. Martin, W.L. Nicholls II, and J.M. O’Reilly, 1–21. New York: Wiley.Search in Google Scholar

Daas, P., M. Puts, B. Buelens, and P. van den Hurk. 2015. “Big Data as a Source for Official Statistics.” Journal of Official Statistics 31(2): 249–262. Doi: https://doi.org/10.1515/jos-2015-0016.10.1515/jos-2015-0016Open DOISearch in Google Scholar

Daas, P., S. Ossen, M. Tennekes, L.-C. Zhang, C. Hendriks, K. Foldal Haugen, A. Bernardi, F. Cerroni, T. Laitila, A. Wallgren, and B. Wallgren 2011. List of Quality Groups and Indicators Identified for Administrative Data Sources. Luxembourg: Eurostat (BLUE-ETS deliverable 4.1).Search in Google Scholar

De Bolster, G.W. and K.J. Metz. 1997. The TELER-EDISENT project. Netherlands Official Statistics (Special issue on EDI: The State of the Dutch Art): 12 (autumn), 51–59. Voorburg/Heerlen: Statistics Netherlands.Search in Google Scholar

Di Consiglio, L., M. Karlberg, M. Skaliotis, and I. Xirouchakis. 2016. “Overview of Big-Data Research in European Statistics Agencies.” In Proceedings of the Fifth International Conference of Establishment Surveys: Statistics (ICESV) Switzerland, 20-23 June 2016, Geneva, Switzerland. Statistics Switzerland. Available at: http://ww2.amstat.org/meetings/ices/2016/proceedings/187_ices15Final00346.pdf (accessed 19 April 2018).Search in Google Scholar

Erikson, A.-G., J. Erikson, and C. Hertzman 2016. “Automated Data Collection and Reuse of Concepts in Order to Minimise the Burden.” In Proceedings of the Fifth International Conference of Establishment Surveys: Statistics (ICESV) Switzerland, 20-23 June, Geneva, Switzerland. Statistics Switzerland. Available at: http://ww2.amstat.org/meetings/ices/2016/proceedings/147_ices15Final00184.pdf (accessed 19 April 2018).Search in Google Scholar

Erikson, J. and L. Nordberg. 2000. “Use of Administrative Data as Substitutes for Survey Data for Small Enterprises in the Swedish Annual Structural Business Statistics.” In Proceedings of the Second International Conference of Establishment Surveys (ICESII), Buffalo, NY, 17-21 June 2000, 813–820. Alexandria, VA: American Statistical Association. Available at: http://ww2.amstat.org/meetings/ices/2000/proceedings/S28.pdf (accessed 19 April 2018).Search in Google Scholar

European Commission 2016. European Standards for the 21st Century. Brussels: European Commission. Available at: http://ec.europa.eu/DocsRoom/documents/16980 (accessed 19 April 2018).Search in Google Scholar

Eurostat. 2010. Business registers: Recommendations manual. Luxembourg: Eurostat. Available at: http://ec.europa.eu/eurostat/ramon/statmanuals/files/KS-32-10-216-EN-C-EN.pdf.Search in Google Scholar

Eurostat, 2017. Smart Statistics. Paper discussed at the Joint Dime/ITDG plenary sessions, 14-15 February 2017. Luxembourg: Eurostat.Search in Google Scholar

Groves, R.M. 2011. “Three Eras of Survey Research.” Public Opinion Quarterly, 75(5): 861–871. Doi: https://doi.org/10.1093/poq/nfr057.10.1093/poq/nfr057Open DOISearch in Google Scholar

Groves, R.M. 2013. Official Statistics and “Big Data”. Paper presented at the 2013 European Conference for New Techniques and Technologies for Statistics (NTTS), Brussels, 5-7 March 2013. Luxembourg: Eurostat.Search in Google Scholar

Groves, R.M., F.J. Fowler, M.P. Couper, J.M. Lepkowski, E. Singer, and R. Tourangeau. 2009. Survey Methodology, 2nd edition. Hoboken, NJ: Wiley.Search in Google Scholar

Hansen, J.V. and N.C. Hill. 1989. “Control and Audit of Electronic Data Interchange.” MIS Quarterly 13(4): 403–414. Available at: http://aisel.aisnet.org/misq/vol13/iss4/2/ (accessed 19 April 2018).10.2307/248724Search in Google Scholar

Haraldsen, G. 2013. “Quality Issues in Business Surveys.” In Designing and Conducting Business Surveys, edited by G. Snijkers, G. Haraldsen, J. Jones, and D.K. Willimack, 83–125. Hoboken, NJ: Wiley.10.1002/9781118447895.ch03Search in Google Scholar

Haraldsen, G., J. Jones, D. Giesen, and L.-Ch. Zhang 2013. “Understanding and Coping with Response Burden.” In Designing and Conducting Business Surveys, edited by G. Snijkers, G. Haraldsen, J. Jones, and D.K. Willimack, 219–252. Hoboken, NJ: Wiley.10.1002/9781118447895.ch06Search in Google Scholar

Haraldsen, G., G. Snijkers, M. Roos, A. Sundvoll, T. Vik, and H.-P. Stax. 2011. Utilizing Web Technology in Business Data Collection: Some Norwegian, Dutch and Danish Experiences, Paper presented at the 2011 European Conference for New Techniques and Technologies for Statistics (NTTS), Brussels, 22-24 February 2011. Luxembourg: Eurostat.Search in Google Scholar

Johnson, N. 2016. “One hundred years of Current Employment Statistics Data collection.” Monthly Labor Review: January 2016. Washington DC: US Bureau of Labor Statistics.10.21916/mlr.2016.2Search in Google Scholar

Lunter. L. 1997. EDIsent after the pilot phase (in Dutch: EDIsent na de pilot fase). Report. Voorburg: Statistics Netherlands.Search in Google Scholar

Martineau, P. 2012. Use of the Chart of Accounts in determining the content of Statistics Canada business surveys. Internal document. Ottawa: Statistics Canada.Search in Google Scholar

Pereira, H.J. 2011. “Simplified Business Information (IES) – Is coordination between public entities really possible.” In Proceedings of the International BLUE-ETS Conference on Burden and Motivation in Official Business Surveys Heerlen, 22-23 March 2011, 177–188. Heerlen: Statistics Netherlands. Available at: https://www.blue-ets.istat.it/index.php?id=78&tx_ttnews%5Btt_news%5D=25&cHash=75a34e2a1c989b918ff346a3911c90fc (accessed 19 April 2018).Search in Google Scholar

Ravindra, D. 2016. “Challenges and Benefits of Producing Business Statistics within a Highly Centralized Model.” In Proceedings of the Fifth International Conference of Establishment Surveys (ICESV), 20-23 June 2016. Geneva, Switzerland. Statistics Switzerland. Available at: http://ww2.amstat.org/meetings/ices/2016/proceedings/153_ices15Final00050.pdf (accessed 19 April 2018).Search in Google Scholar

Reid, G., F. Zabala, and A. Holmberg 2017. “Extending TSE to Administrative Data: A Quality Framework and Case Study from Stats NZ.” Journal of Official Statistics 33(2): 477–511, Doi: https://doi.org/10.1515/jos-2017-002310.1515/jos-2017-0023Open DOISearch in Google Scholar

Saraiva, P. 2016a. Integrated Survey Management System: Statistics Portugal Experience. Presentation at the Fifth International Conference of Establishment Surveys (ICESV), 20-23 June 2016, Geneva, Switzerland. Statistics Switzerland.Search in Google Scholar

Saraiva, P. 2016b. The Experience of Statistics Portugal in the Appropriation of Administrative Data for Statistical Purposes. Invited presentation (in Portuguese) at the 3rd National Conference of Producers and users of Statistics, Geographical and Environmental Information (INFOPLAN). IBGE, December 5-9, 2016, Rio de Janeiro, Brazil.Search in Google Scholar

Saraiva, P. 2016c. Integrating Data Collection: Wins and Challenges. Presentation at the UNECE Workshop on Statistical Data Collection, ‘Visions on Future Surveying’, Statistics Netherlands, The Hague, 1-5 October 2016. Geneva: United Nations Economic Commission for Europe (UNECE).Search in Google Scholar

Saraiva, P. and A. Moreira. 2016. Motivating Respondents: the Importance of Personalised Feedback. Presentation at the UNECE Workshop on Statistical Data Collection, ‘Visions on Future Surveying’, Statistics Netherlands, The Hague, 1-5 October 2016. Geneva: United Nations Economic Commission for Europe (UNECE).Search in Google Scholar

Smith, P. and P. Phipps. 2014. Preface. Journal of Official Statistics (Special Issue on Establishment Surveys) 30(4): 575–577. Doi: https://doi.org/10.2478/jos-2014-003810.2478/jos-2014-0038Open DOISearch in Google Scholar

Snijkers, G. 2016. “Achieving Quality in Organizational Surveys: An Holistic Approach.” In Methodische Probleme in der empirischen Organisationsforschung, edited by S. Liebig and W. Matiaske, 33–59. Wiesbaden: Springer.10.1007/978-3-658-08713-5_3Search in Google Scholar

Snijkers, G., R. Göttgens, and H. Hermans. 2011. Data Collection and Data Sharing at Statistics Netherlands: Yesterday, Today, Tomorrow, Paper presented at the 59th Plenary Session of the Conference of European Statisticians (CES): United Nations Economic Commission for Europe (UNECE), Geneva, June 14–16. Geneva: UNECE Available at: www.unece.org/fileadmin/DAM/stats/documents/ece/ces/2011/20.e.pdf.Search in Google Scholar

Snijkers, G., G. Haraldsen, J. Jones, and D.K. Willimack. 2013. Designing and Conducting Business Surveys. Hoboken, NJ: Wiley.10.1002/9781118447895Search in Google Scholar

Snijkers, G. and J. Jones. 2013. “Business Survey Communication.” Designing and Conducting Business Surveys, edited by G. Snijkers, G. Haraldsen, J. Jones, and D.K. Willimack, 359–430. Hoboken, NJ: Wiley.10.1002/9781118447895.ch09Search in Google Scholar

Snijkers, G., M. Roos, T. Hooijmans, Th. van Kasteren, M. Storms, V. de Haan, and G. Buiten. 2014. Reference Chart of Accounts (RCSFI): a case study – toward a quality framework (in Dutch: Referentie Grootboekschema (RGS): een casestudie – aanzet tot een kwaliteitskader). Report. Heerlen: Statistics Netherlands.Search in Google Scholar

Srinivasan, V. 2017. The Intelligent Enterprise in the Era of Big Data. Hoboken, NJ: Wiley.10.1002/9781118834725Search in Google Scholar

Statistics Canada 2015. Integrated Business Statistics Program Overview. Catalogue No. 68-515-X. Ottawa: Statistics Canada, Available at: http://www.statcan.gc.ca/pub/68-515-x/2015001/mi-rs-eng.htm.Search in Google Scholar

Thomas, R. and P. McSharry 2015. Big Data Revolution: What Farmers, Doctors and Insurance Agents Tell Us about Discovering Big Data Patterns. Hoboken, NJ: Wiley.Search in Google Scholar

Torres van Grinsven, V., I. Bolko, and M. Bavdaz. 2014. “In Search of Motivation for Business Survey Response Task.” Journal of Official Statistics, 30(4): 579–606. Doi: https://doi.org/10.2478/jos-2014-003910.2478/jos-2014-0039Open DOISearch in Google Scholar

UNECE 1995. Guidelines for the Modelling of Statistical Data and Metadata. Geneva: United Nations Economic Commission for Europe (UNECE), Available at: https://www.unece.org/fileadmin/DAM/stats/publications/metadatamodeling.pdf (accessed 19 April 2018).Search in Google Scholar

UNECE. 2000. Terminology on Statistical Metadata. Geneva: United Nations Economic Commission for Europe (UNECE). Available at: http://ec.europa.eu/eurostat/ramon/coded_files/UNECE_TERMINOLOGY_STAT_METADATA_2000_EN.pdfSearch in Google Scholar

UNECE. 2007. Register-based statistics in the Nordic countries: review of best practices with focus on population and social statistics. Geneva: United Nations Economic Commission for Europe (UNECE). Available at: http://www.unece.org/fileadmin/DAM/stats/publications/Register_based_statistics_in_Nordic_countries.pdf.Search in Google Scholar

UNECE. 2011. Using Administrative and Secondary Sources for Official Statistics: A Handbook of Principles and Practices. Geneva: United Nations Economic Commission for Europe. Available at: https://www.unece.org/fileadmin/DAM/stats/publications/Using_Administrative_Sources_Final_for_web.pdf (accessed 19 April 2018).Search in Google Scholar

Wallgren, A. and B. Wallgren 2007. Register-Based Statistics – Administrative Data for Statistical Purposes. Hoboken, NJ: Wiley.10.1002/9780470061350Search in Google Scholar

Willimack, D.K. and G. Snijkers. 2013. “The Business Context and its Implications for the Business Response Process.” In Designing and Conducting Business Surveys, edited by G. Snijkers, G. Haraldsen, J. Jones, and D.K. Willimack, 39–82. Hoboken, NJ: Wiley.10.1002/9781118447895.ch02Search in Google Scholar

Ypma, W.F.H., A.J. Willeboordse, and W.J. Keller. 1997, EDI in the collection of statistical data: an introduction. Netherlands Official Statistics (Special issue on EDI: The State of the Dutch Art) 12 (autumn): 7–15. Voorburg/Heerlen: Statistics Netherlands.Search in Google Scholar

Zhang. L.-C. 2012. “Topics of Statistical Theory for Register-Based Statistics and Data Integration.” Statistica Neerlandica, 66(1): 41–63. Doi: http://dx.doi.org/10.1111/j.1467-9574.2011.00508.x10.1111/j.1467-9574.2011.00508.xOpen DOISearch in Google Scholar

Recommended articles from Trend MD

Plan your remote conference with Sciendo