1. bookVolume 60 (2021): Issue 3 (September 2021)
Journal Details
License
Format
Journal
eISSN
1854-2476
First Published
29 Jul 2010
Publication timeframe
4 times per year
Languages
English
Open Access

Variation in perception of safety culture in out-of-hours family medicine service in Croatia

Published Online: 28 Jun 2021
Volume & Issue: Volume 60 (2021) - Issue 3 (September 2021)
Page range: 152 - 157
Received: 22 Dec 2020
Accepted: 19 Apr 2021
Journal Details
License
Format
Journal
eISSN
1854-2476
First Published
29 Jul 2010
Publication timeframe
4 times per year
Languages
English
Introduction

Even though the very first sentence of the Hippocratic Oath – First, do no harm – primes physicians to focus on the importance of patient safety, the trend of occurrence of the term “patient safety” in research publications has only seen steady growth in the last 20 years, since the report “To Err Is Human” was published (1, 2). Measuring patient safety culture has proved to be a challenge, and different approaches have been used (3, 4). The Safety Attitudes Questionnaire (SAQ) has been among the most frequently cited tools for measuring safety culture in various healthcare settings (3, 5). The SAQ was originally developed for a hospital setting, but soon after its development, it was adapted for use in the ambulatory setting as the SAQ-AV (6). Recently, the SAQ-AV has been translated and validated in several European countries (7, 8, 9, 10, 11, 12, 13).

Research on variability of safety attitudes regarding job positions and healthcare settings is still scarce. Gehring et al. found differences in safety culture between job positions and types of office organizations in primary healthcare (14). Bondevik et al. analysed differences in SAQ subscales regarding job position, gender and age, and found differences in safety climate and job satisfaction (8). Kwon at al found difference in SAQ subscales between nurses and doctors in operating room settings (15). Klemenc-Ketiš et al. found differences in patient safety climate scores and quality of collaboration scores between physicians, nurse practitioners, and practice nurses (16).

To the best of our knowledge, there has been no previous research on variation in safety attitudes in primary healthcare in Croatia. Out-of-hours (OOH) primary healthcare services in Croatia are provided by healthcare centres and emergency medical services. In healthcare centres, OOH services are provided by family physicians, who rotate between practice in normal working hours and OOH service. Their OOH services are available on weekends and holidays, excluding night shifts.

In this study we present results of a patient safety attitudes survey in OOH family medicine service in Croatia. The study was a part of the international study Patient Safety Culture in European Out-of-hours Services (SAFE-EUR-OOH) led by the Norwegian coordinating group of the European research network for out-of-hours primary healthcare (EurOOHnet). We aim to identify patterns of variation in the Croatian version of the SAQ-AV sub-dimensions in relation to geographical region and job positions, as well as among SAQ-AV subscales.

Methods
Type of study and settings

In July and August 2015, we carried out a cross-sectional observational study in the 29 largest Croatian healthcare centres providing out-of-hours (OOH) family medicine service (FM). These centres account for 85% of family medicine service staff in Croatia. Regional analysis was based on the level two statistical regions (NUTS2) in the European Union (17).

Participants

Family physicians, nurses, and residents with e mail addresses, working at the 29 healthcare centres, were contacted by e-mail and asked to fill out an anonymous and voluntary online survey. In this way, 385 people were invited to participate in the survey. All nurses were practice nurses.

Data collection

Out of 385 invited participants, 185 filled in the online survey (response rate 51.7%). After descriptive analysis, three outliers and participants with missing demographic data were excluded, resulting in a sample size of 140.

Questionnaire

We used the Croatian version of the Safety Attitudes Questionnaire – Ambulatory Version (SAQ-AV). Psychometric properties of this questionnaire were analysed by Mesaric et al. (11). The original questionnaire comprised 62 items where study participants rated their agreement on a 5 point ordinal scale (from fully disagree to fully agree). Scores of negatively worded items were reversed before analysis. Only items confirmed in the previous analysis were used (37 items) (11). Scores on the total scale and five subscales, namely Organizational climate (14 items), Teamwork climate (8 items), Stress recognition (6 items), Ambulatory process of care (5 items), and Perceptions of workload (4 items), were calculated as additive scores with a range between 0 and 100. The total score was calculated using only items from the subscales Organizational climate, Teamwork climate, and Ambulatory process of care (27 items), because Stress recognition and Perception of workload were reliable scales, but were not sub-dimensions of patient safety culture attitude (11). Higher score values indicate more positive perception of patient safety culture. The study also included demographic data on gender, age, working experience, and job position.

Statistical analysis

Statistical analysis comprised descriptive analysis and repeated measurement analysis of variance, followed by Tukey’s Honest Significant Difference method for post-hoc pair-wise comparisons (18). In order to assess variation in SAQ scores over SAQ sub-scales and among job positions we performed repeated measurement analysis of variance with SAQ sub-scale (Organizational climate, Teamwork climate, and Ambulatory process of care) as a within-subject factor and job position as a cross-subject factor. All statistical tests were conducted at the level of statistical significance α=0.05. Analyses were done in R and RStudio (19, 20).

Results

Table 1 summarizes descriptive statistics for demographic variables. The sample comprised 114 (81.4%) female, and 26 (18.6%) male participants. There were 85 (60.7%) physicians, 28 (20.0%) residents, and 27 (19.3%) nurses. Almost a third of all participants (n=45, 32.1%) were between 31 and 40 years old. There were 41 (29.3%) junior staff with up to five years of working experience. Healthcare centres from all four NUTS2 regions of Croatia were well represented, and the largest group of participants (n=54, 38.6%) came from the healthcare centres in the City of Zagreb.

Demographic characteristics of the Croatian out-of-hours family medicine service employees participating in the study (N=140).

Variablen (%)
Position

Nurse27 (19.3)
Resident28 (20.0)
Physician85 (60.7)

Gender

Male26 (18.6)
Female114 (81.4)

Age (years)

<=3032 (22.9)
31-4045 (32.1)
41-5025 (17.9)
51-6033 (23.6)
>=615 (3.6)

Working experience

<=541 (29.3)
6-1029 (20.7)
11-2024 (17.1)
21-3030 (21.4)
31-4015 (10.7)

NUTS2 region

City of Zagreb54 (38.6)
Adriatic Croatia29 (20.7)
Pannonian Croatia28 (20.0)
North Croatia29 (20.7)

Descriptive statistics for the five subscales and the total SAQ scale, broken down by NUTS2 regions of Croatia, are presented in Table 2. The lowest mean scores were those for Stress recognition, and the highest for the Teamwork climate. There were no statistically significant differences among the NUTS2 regions in any of the sub-scales. There were also no significant differences in any of the SAQ sub-scales regarding gender, age and working experience.

Descriptive statistics for SAQ sub-scales and the total score by NUTS2 regions of Croatia.

SAQ sub-scalesCity of Zagreb (SD)Adriatic Croatia (SD)Pannonian Croatia (SD)North Croatia (SD)Croatia (SD)p
Organizational climate60.8 (22.3)68.8 (17.9)64.5 (19.9)57.9 (23.2)62.6 (21.3)0.6490
Teamwork climate77.9 (13.7)81.2 (14.5)82.8 (12.6)73.6 (13.9)78.7 (13.9)0.3377
Stress recognition42.9 (23.1)44.0 (19.8)45.1 (25.6)41.8 (22.1)43.3 (22.6)1.0000
Ambulatory process of care67.4 (21.1)71.7 (18.6)70.9 (19.1)65.3 (22.0)68.6 (20.3)1.0000
Perceptions of workload62.0 (21.6)65.5 (24.4)56.2 (26.5)49.8 (25.0)59.1 (24.3)0.3377
Total score67.1 (17.3)73.1 (15.4)71.1 (14.7)64.0 (17.0)68.5 (16.5)0.5548

Legend: SAQ – Safety Attitudes Questionnaire; – mean; SD – standard deviation; NUTS2 – EU nomenclature of territorial units for statistics, level 2; p – p-value for ANOVA by NUTS2 region using Holms’ adjustment for multiple testing

Comparison in SAQ sub-scales between staff on differentjob positions is provided in Table 3.

Descriptive statistics for SAQ sub-scales, SAQ total score, Stress recognition, and Perceptions of workload by job position.

ScaleJob position
p
Nurse (SD)Resident (SD)Physician (SD)
Organizational climate72.7 (20.9)53.7 (18.6)62.4 (21.1)0.0180
Teamwork climate83.6 (15.7)74.6 (12.2)78.5 (13.6)0.1626
Ambulatory process of care77.0 (21.4)63.4 (22.4)67.6 (18.6)0.1347
SAQ total76.7 (17.5)61.7 (13.2)68.1 (16.2)0.0159
Stress recognition45.8 (27.3)45.8 (21.3)41.7 (21.5)1.0000
Perceptions of workload58.1 (27.5)62.3 (20.0)58.3 (24.7)1.0000

Legend: SAQ – Safety Attitudes Questionnaire; – mean; SD – standard deviation; p – p-value for ANOVA by NUTS2 region using Holms’ adjustment for multiple testing

Results of repeated measurements analysis of variance with job position as a cross subject factor, and SAQ subscale as a within subject factor are reported in Table 4.

Repeated measurements analysis of variance for SAQ scores with SAQ sub-scale as a within-subject factor and job position as a cross-subject factor.

Source of variationdf 1df 2Fp
Intercept12743003.09<0.0001
Job position21375.910.0035
SAQ sub-scale227456.59<0.0001
Interaction42741.180.3201

Legend: df 1 – numerator degrees of freedom; df 2 – nominator degrees of freedom

Interaction between job position and SAQ sub-scale was not significant. Post hoc, Tukey’s honestly significant difference test revealed no significant difference between residents and physicians, while both residents and physicians differed significantly from nurses, with nurses’ average scores being the highest. All pairwise comparisons among SAQ sub-scales were statistically significant. Average Teamwork climate scores were the highest and average Organization climate score the lowest. Figure 1 shows estimated fixed effects on SAQ sub-scales for different sub-scales and job positions.

Figure 1

Fixed effects for SAQ sub-scales and job position.

Discussion

Psychometric analysis of the Croatian version of SAQ-AV revealed a three factor structure with subscales for Organizational climate, Teamwork climate, and Ambulatory process of care. (11). These scales are, however, not directly comparable to other studies using SAQ questionnaire, because sets of items loading on these subscales are not the same. Analysis of variation in SAQ subscales over job position, gender, age, working experience, and NUTS2 region revealed significant variation only among job positions. Nurses consistently had more positive perceptions of patient safety culture than physicians, followed by residents. Similar findings were reported by Bondevik et al. (8) and Smits et al. (21). Klemenc-Ketiš et al. also report more positive perceptions by nurses; however, differences among professional groups were not significant (16). Smits et al. (ibid.) attribute this finding to the fact that nurses spend more time at the FM office, while physicians and residents often rotate. The same argument applies in the case of Croatia.

Residents’ perception of Organizational climate was the lowest, indicating need to improve organizational support to resident GPs. To the best of the authors’ knowledge, there were no studies on residents’ perceptions of workload and organizational support in OOH FM in Croatia. However, a recent Swiss study reported that residents in general practice “… indicated not having enough time for a private life”, they also had higher risk of burnout, and lower mental wellbeing in comparison to physicians (22). Comparing SAQ sub-scales, all job position groups assessed teamwork climate with the highest average scores, and Organization climate with the lowest average scores. All pair-wise comparisons between SAQ sub-scales were statistically significant. Teamwork climate was also perceived more positively in other similar studies (8, 16, 21, 23, 24). Stress recognition and Perceptions of workload were not recognized as dimensions of patient safety (11), and in our analysis they had the lowest overall scores. This may be a consequence of a chronic lack of staff and high turnover in OOH FM service.

It is hard to provide evidence based explanation for these findings, due to the scarcity of research on OOH family medicine services in Croatia. Regional comparison showed that variation among Croatian regions in patient safety culture is relatively small. However, we have included in this study only the largest healthcare centres, and results might be different if smaller healthcare centres were included. On the other hand, the SAQ questionnaire was developed for larger organizations, and might not be valid for such small healthcare centres.

The relatively low response rate is a limitation of the study. We have no information about the non-respondents, and that could be a source of bias. We used the Croatian version of the SAQ-AV questionnaire, which has a somewhat different factor structure from the original, thus the comparability of scores is somewhat limited. The study included all large healthcare centres and presents, to the best of our knowledge, the first study of patient safety attitudes in OOH FM service in Croatia.

Future research could explore to what extent perceptions of patient safety culture varies across work sites in Croatian OOH FM service (25). Such a result would indicate how large the potential for improvement is.

Conclusions

The study shows that the SAQ-AV can be used to identify areas for improvement in patient safety at OOH FM service. Low results for Stress recognition and Perceptions of workload point to the need to improve staffing in OOH FM service. Residents’ low assessment of Organizational climate show the need to improve support for OOH FM residents. Further research is needed in order to gain a better understanding of factors influencing observed variations among job positions.

Figure 1

Fixed effects for SAQ sub-scales and job position.
Fixed effects for SAQ sub-scales and job position.

Descriptive statistics for SAQ sub-scales, SAQ total score, Stress recognition, and Perceptions of workload by job position.

Scale Job position
p
Nurse (SD) Resident (SD) Physician (SD)
Organizational climate 72.7 (20.9) 53.7 (18.6) 62.4 (21.1) 0.0180
Teamwork climate 83.6 (15.7) 74.6 (12.2) 78.5 (13.6) 0.1626
Ambulatory process of care 77.0 (21.4) 63.4 (22.4) 67.6 (18.6) 0.1347
SAQ total 76.7 (17.5) 61.7 (13.2) 68.1 (16.2) 0.0159
Stress recognition 45.8 (27.3) 45.8 (21.3) 41.7 (21.5) 1.0000
Perceptions of workload 58.1 (27.5) 62.3 (20.0) 58.3 (24.7) 1.0000

Descriptive statistics for SAQ sub-scales and the total score by NUTS2 regions of Croatia.

SAQ sub-scales City of Zagreb (SD) Adriatic Croatia (SD) Pannonian Croatia (SD) North Croatia (SD) Croatia (SD) p
Organizational climate 60.8 (22.3) 68.8 (17.9) 64.5 (19.9) 57.9 (23.2) 62.6 (21.3) 0.6490
Teamwork climate 77.9 (13.7) 81.2 (14.5) 82.8 (12.6) 73.6 (13.9) 78.7 (13.9) 0.3377
Stress recognition 42.9 (23.1) 44.0 (19.8) 45.1 (25.6) 41.8 (22.1) 43.3 (22.6) 1.0000
Ambulatory process of care 67.4 (21.1) 71.7 (18.6) 70.9 (19.1) 65.3 (22.0) 68.6 (20.3) 1.0000
Perceptions of workload 62.0 (21.6) 65.5 (24.4) 56.2 (26.5) 49.8 (25.0) 59.1 (24.3) 0.3377
Total score 67.1 (17.3) 73.1 (15.4) 71.1 (14.7) 64.0 (17.0) 68.5 (16.5) 0.5548

Demographic characteristics of the Croatian out-of-hours family medicine service employees participating in the study (N=140).

Variable n (%)
Position

Nurse 27 (19.3)
Resident 28 (20.0)
Physician 85 (60.7)

Gender

Male 26 (18.6)
Female 114 (81.4)

Age (years)

<=30 32 (22.9)
31-40 45 (32.1)
41-50 25 (17.9)
51-60 33 (23.6)
>=61 5 (3.6)

Working experience

<=5 41 (29.3)
6-10 29 (20.7)
11-20 24 (17.1)
21-30 30 (21.4)
31-40 15 (10.7)

NUTS2 region

City of Zagreb 54 (38.6)
Adriatic Croatia 29 (20.7)
Pannonian Croatia 28 (20.0)
North Croatia 29 (20.7)

Repeated measurements analysis of variance for SAQ scores with SAQ sub-scale as a within-subject factor and job position as a cross-subject factor.

Source of variation df 1 df 2 F p
Intercept 1 274 3003.09 <0.0001
Job position 2 137 5.91 0.0035
SAQ sub-scale 2 274 56.59 <0.0001
Interaction 4 274 1.18 0.3201

Schreiber M, Klingelhöfer D, Groneberg DA, Brüggmann D. Patient safety: the landscape of the global research output and gender distribution. BMJ Open. 2016;6(2):e008322. doi: 10.1136/bmjopen-2015-008322. Schreiber M Klingelhöfer D Groneberg DA Brüggmann D Patient safety: the landscape of the global research output and gender distribution BMJ Open 2016 6 2 e008322 10.1136/bmjopen-2015-008322476210826873042Open DOISearch in Google Scholar

Institute of Medicine. To err is human: building a safer health system. Washington, DC: National Academies Press, 2000. Accessed Nov 18th, 2020 at: http://www.nap.edu/catalog/9728 Institute of Medicine To err is human: building a safer health system. Washington, DC: National Academies Press, 2000. Accessed Nov 18th, 2020 at http://www.nap.edu/catalog/9728Search in Google Scholar

Halligan M, Zecevic A. Safety culture in healthcare: a review of concepts, dimensions, measures and progress. BMJ Qual Saf. 2011;20(4):338-43. doi: 10.1136/bmjqs.2010.040964. Halligan M Zecevic A Safety culture in healthcare: a review of concepts, dimensions, measures and progress BMJ Qual Saf 2011 20 4 338 43 10.1136/bmjqs.2010.04096421303770Open DOISearch in Google Scholar

Parker D, Wensing M, Esmail A, Valderas JM. Measurement tools and process indicators of patient safety culture in primary care: a mixed methods study by the LINNEAUS collaboration on patient safety in primary care. Eur J Gen Pract. 2015;21(Suppl 1):26-30. doi: 10.3109/13814788.2015.1043732. Parker D Wensing M Esmail A Valderas JM Measurement tools and process indicators of patient safety culture in primary care: a mixed methods study by the LINNEAUS collaboration on patient safety in primary care Eur J Gen Pract 2015 21 Suppl 1 26 30 10.3109/13814788.2015.1043732482862026339832Open DOISearch in Google Scholar

Sexton JB, Helmreich RL, Neilands TB, Rowan K, Vella K, Boyden J, et al. The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research. BMC Health Serv Res. 2006;6:44-54. doi: 10.1186/1472-6963-6-44. Sexton JB Helmreich RL Neilands TB Rowan K Vella K Boyden J et al The Safety Attitudes Questionnaire: psychometric properties, benchmarking data, and emerging research BMC Health Serv Res 2006 644 54 10.1186/1472-6963-6-44148161416584553Open DOISearch in Google Scholar

Modak I, Sexton JB, Lux TR, Helmreich RL, Thomas EJ. Measuring safety culture in the ambulatory setting: the safety attitudes questionnaire--ambulatory version. J Gen Intern Med. 2007;22(1):1-5. doi: 10.1007/s11606-007-0114-7. Modak I Sexton JB Lux TR Helmreich RL Thomas EJ Measuring safety culture in the ambulatory setting: the safety attitudes questionnaire--ambulatory version J Gen Intern Med 2007 22 1 1 5 10.1007/s11606-007-0114-7222758917351834Open DOISearch in Google Scholar

Bondevik GT, Hofoss D, Hansen EH, Deilkås ECT. The safety attitudes questionnaire - ambulatory version: psychometric properties of the Norwegian translated version for the primary care setting. BMC Health Serv Res. 2014;14:139. doi: 10.1186/1472-6963-14-139. Bondevik GT Hofoss D Hansen EH Deilkås ECT The safety attitudes questionnaire - ambulatory version: psychometric properties of the Norwegian translated version for the primary care setting BMC Health Serv Res 2014 14139 10.1186/1472-6963-14-139399424524678764Open DOISearch in Google Scholar

Bondevik GT, Hofoss D, Hansen EH, Deilkås ECT. Patient safety culture in Norwegian primary care: a study in out-of-hours casualty clinics and GP practices. Scand J Prim Health Care. 2014;32(3):132-8. doi: 10.3109/02813432.2014.962791. Bondevik GT Hofoss D Hansen EH Deilkås ECT Patient safety culture in Norwegian primary care: a study in out-of-hours casualty clinics and GP practices Scand J Prim Health Care 2014 32 3 132 8 10.3109/02813432.2014.962791420656125263763Open DOISearch in Google Scholar

Deilkås ET, Hofoss D. Psychometric properties of the Norwegian version of the Safety Attitudes Questionnaire (SAQ), Generic version (Short Form 2006). BMC Health Serv Res. 2008;8:191-200. doi: 10.1186/1472-6963-8-191. Deilkås ET Hofoss D Psychometric properties of the Norwegian version of the Safety Attitudes Questionnaire (SAQ), Generic version (Short Form 2006) BMC Health Serv Res 2008 8191 200 10.1186/1472-6963-8-191257261218808693Open DOISearch in Google Scholar

Klemenc-Ketis Z, Maletic M, Stropnik V, Deilkås ET, Hofoss D, Bondevik GT. The safety attitudes questionnaire - ambulatory version: psychometric properties of the Slovenian version for the out-of-hours primary care setting. BMC Health Serv Res. 2017;17(1):36. doi: 10.1186/s12913-016-1972-7. Klemenc-Ketis Z Maletic M Stropnik V Deilkås ET Hofoss D Bondevik GT The safety attitudes questionnaire - ambulatory version: psychometric properties of the Slovenian version for the out-of-hours primary care setting BMC Health Serv Res 2017 17 1 36 10.1186/s12913-016-1972-7523724028086919Open DOISearch in Google Scholar

Mesarić J, Šimić D, Katić M, Tveter Deilkås EC, Hofoss D, Bondevik GT. The safety attitudes questionnaire for out-of-hours service in primary healthcare - psychometric properties of the Croatian version. PLoS One. 2020;15(11):e0242065. doi: 10.1371/journal.pone.0242065. Mesarić J Šimić D Katić M Tveter Deilkås EC Hofoss D Bondevik GT The safety attitudes questionnaire for out-of-hours service in primary healthcare - psychometric properties of the Croatian version PLoS One 2020 15 11 e0242065 10.1371/journal.pone.0242065766582833186353Open DOISearch in Google Scholar

Smits M, Keizer E, Giesen P, Deilkås ECT, Hofoss D, Bondevik GT. The psychometric properties of the ‘safety attitudes questionnaire’ in out-of-hours primary care services in the Netherlands. PLoS One. 2017;12(2):1-12. doi: 10.1371/journal.pone.0172390. Smits M Keizer E Giesen P Deilkås ECT Hofoss D Bondevik GT The psychometric properties of the ‘safety attitudes questionnaire’ in out-of-hours primary care services in the Netherlands PLoS One 2017 12 2 1 12 10.1371/journal.pone.0172390531318628207909Open DOISearch in Google Scholar

Zimmermann N, Küng K, Sereika SM, Engberg S, Sexton B, Schwendimann R. Assessing the Safety Attitudes Questionnaire (SAQ), German language version in Swiss university hospitals - a validation study. BMC Health Serv Res. 2013;13:347. doi: 10.1186/1472-6963-13347. Zimmermann N Küng K Sereika SM Engberg S Sexton B Schwendimann R Assessing the Safety Attitudes Questionnaire (SAQ), German language version in Swiss university hospitals - a validation study BMC Health Serv Res 2013 13347 10.1186/1472-6963-13347Open DOISearch in Google Scholar

Gehring K, Schwappach DLB, Battaglia M, Buff R, Huber F, Sauter P, et al. Safety climate and its association with office type and team involvement in primary care. Int J Qual Health Care. 2013;25(4):394402. doi: 10.1093/intqhc/mzt036. Gehring K Schwappach DLB Battaglia M Buff R Huber F Sauter P et al Safety climate and its association with office type and team involvement in primary care Int J Qual Health Care 2013 25 4 394402 10.1093/intqhc/mzt03623667155Open DOISearch in Google Scholar

Kwon E, Kim YW, Kim SW, Jeon S, Lee E, Kang H-Y, et al. A comparative study on patient safety attitude between nurses and doctors in operating rooms. J Int Med Res. 2020;48(4):030006051988450. doi: 10.1177/0300060519884501. Kwon E Kim YW Kim SW Jeon S Lee E Kang H-Y et al A comparative study on patient safety attitude between nurses and doctors in operating rooms J Int Med Res 2020 48 4 030006051988450 10.1177/0300060519884501778325631880182Open DOISearch in Google Scholar

Klemenc-Ketis Z, Deilkås E, Hofoss D, Bondevik GT. Variations in patient safety climate and perceived quality of collaboration between professions in out-of-hours care. J Multidiscip Healthc. 2017;10:417-23. doi: 10.2147/JMDH.S149011. Klemenc-Ketis Z Deilkås E Hofoss D Bondevik GT Variations in patient safety climate and perceived quality of collaboration between professions in out-of-hours care J Multidiscip Healthc 2017 10417 23 10.2147/JMDH.S149011568736129184416Open DOISearch in Google Scholar

European Commission. Statistical Office of the European Union. Statistical regions in the European Union and partner countries: NUTS and statistical regions 2021. Luxembourg: Publications Office, 2020. Accessed Dec 9th, 2020 at: https://data.europa.eu/doi/10.2785/850262 European Commission Statistical Office of the European Union. Statistical regions in the European Union and partner countries: NUTS and statistical regions 2021. Luxembourg: Publications Office, 2020. Accessed Dec 9th, 2020 at https://data.europa.eu/doi/10.2785/850262Search in Google Scholar

Miller RG. Simultaneous statistical inference. New York: Springer, 1981. Miller RG Simultaneous statistical inference New York Springer 198110.1007/978-1-4613-8122-8Search in Google Scholar

R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing, 2020. Accessed Dec 21st, 2020 at: https://www.R-project.org R Core Team. R: a language and environment for statistical computing. Vienna: R Foundation for Statistical Computing, 2020. Accessed Dec 21st, 2020 at https://www.R-project.orgSearch in Google Scholar

RStudio Team. RStudio: integrated development for R. Boston, MA: RStudio, 2020. Accessed Dec 21st, 2020 at: http://www.rstudio.com/ RStudio Team RStudio: integrated development for R. Boston, MA: RStudio, 2020. Accessed Dec 21st, 2020 at http://www.rstudio.com/Search in Google Scholar

Smits M, Keizer E, Giesen P, Deilkås ECT, Hofoss D, Bondevik GT. Patient safety culture in out-of-hours primary care services in the Netherlands: a cross-sectional survey. Scand J Prim Health Care. 2018;36(1):28-35. doi: 10.1080/02813432.2018.1426150. Smits M Keizer E Giesen P Deilkås ECT Hofoss D Bondevik GT Patient safety culture in out-of-hours primary care services in the Netherlands: a cross-sectional survey Scand J Prim Health Care 2018 36 1 28 35 10.1080/02813432.2018.1426150590143729334826Open DOISearch in Google Scholar

Lindemann F, Rozsnyai Z, Zumbrunn B, Laukenmann J, Kronenberg R, Streit S. Assessing the mental wellbeing of next generation general practitioners: a cross-sectional survey. BJGP Open. 2019;3(4):bjgpopen19X1016. doi: 10.3399/bjgpopen19X101671. Lindemann F Rozsnyai Z Zumbrunn B Laukenmann J Kronenberg R Streit S Assessing the mental wellbeing of next generation general practitioners: a cross-sectional survey BJGP Open 2019 3 4 bjgpopen19X1016 10.3399/bjgpopen19X101671699585931615787Open DOISearch in Google Scholar

Klemenc-Ketiš Z, Deilkås ET, Hofoss D, Bondevik GT. Patient safety culture in Slovenian out-of-hours primary care clinics. Zdr Varst. 2017;56(4):203-10. doi: 10.1515/sjph-2017-0028. Klemenc-Ketiš Z Deilkås ET Hofoss D Bondevik GT Patient safety culture in Slovenian out-of-hours primary care clinics Zdr Varst 2017 56 4 203 10 10.1515/sjph-2017-0028563980929062394Open DOISearch in Google Scholar

Klemenc-Ketiš Z, Poplas Susič A. Safety culture at primary healthcare level: a cross-sectional study among employees with a leadership role. Zdr Varst. 2020;59(1):42-6. doi: 10.2478/sjph-2020-0006. Klemenc-Ketiš Z Poplas Susič A Safety culture at primary healthcare level: a cross-sectional study among employees with a leadership role Zdr Varst 2020 59 1 42 6 10.2478/sjph-2020-0006747808332952702Open DOISearch in Google Scholar

Deilkås ECT, Hofoss D, Hansen EH, Bondevik GT. Variation in staff perceptions of patient safety climate across work sites in Norwegian general practitioner practices and out-of-hour clinics. PLoS One. 2019;14(4):e0214914. doi: 10.1371/journal.pone.0214914. Deilkås ECT Hofoss D Hansen EH Bondevik GT Variation in staff perceptions of patient safety climate across work sites in Norwegian general practitioner practices and out-of-hour clinics PLoS One 2019 14 4 e0214914 10.1371/journal.pone.0214914645754830970041Open DOISearch in Google Scholar

Recommended articles from Trend MD