The APISS Questionnaire: A New Tool to Assess the Epidemiology of Systemic Allergic Reactions to Bee Venom in Beekeepers

1. Bilo MB, Pravettoni V, Bignardi D, Bonadonna P, Mauro M, Novembre E, et al. Hymenoptera venom allergy: management of children and adults in clinical practice. J Investig Allergol Clin Immunol. 2019;29(3):180–205. doi: 10.18176/jiaci.0310. BiloMB PravettoniV BignardiD BonadonnaP MauroM NovembreE Hymenoptera venom allergy: management of children and adults in clinical practice J Investig Allergol Clin Immunol 2019 29 3 180 205 10.18176/jiaci.0310 Open DOISearch in Google Scholar

2. Casale TB, Burks AW. Clinical practice. Hymenoptera-sting hypersensitivity. N Eng J Med. 2014;10;370(15):1432–1439. doi: 10.1056/NEJMcp1302681. CasaleTB BurksAW Clinical practice. Hymenoptera-sting hypersensitivity N Eng J Med 2014 10 370 15 1432 1439 10.1056/NEJMcp1302681 Open DOISearch in Google Scholar

3. Bilo MB, Tontini C, Martini M, Corsi A, Agolini S, Antonicelli L. Clinical aspects of Hymenoptera venom allergy and venom immunotherapy. Eur Ann Allergy Clin Immunol. 2019;51(6):244–258. doi: 10.23822/EurAnnACI.1764-1489.113. BiloMB TontiniC MartiniM CorsiA AgoliniS AntonicelliL Clinical aspects of Hymenoptera venom allergy and venom immunotherapy Eur Ann Allergy Clin Immunol 2019 51 6 244 258 10.23822/EurAnnACI.1764-1489.113 Open DOISearch in Google Scholar

4. Blank S, Haemmerle S, Jaeger T, Russkamp D, Ring J, Schmidt-Weber CB, et al. Prevalence of Hymenoptera venom allergy and sensitization in the population-representative German KORA cohort. Allergo J Int. 2019;28(6):183–191. doi: 10.1007/s40629-018-0089-4. BlankS HaemmerleS JaegerT RusskampD RingJ Schmidt-WeberCB Prevalence of Hymenoptera venom allergy and sensitization in the population-representative German KORA cohort Allergo J Int 2019 28 6 183 191 10.1007/s40629-018-0089-4 Open DOISearch in Google Scholar

5. Becerril-Angeles M, Nuñez-Velázquez M, Grupo del Programa de Control de la Abeja Africanizada, SAGARPA. [Risk factors for allergy to honey-bee venom in Mexican beekeepers]. Rev Alerg Mex. 2013;60(3):100–104. Becerril-AngelesM Nuñez-VelázquezM Grupo del Programa de Control de la Abeja Africanizada, SAGARPA [Risk factors for allergy to honey-bee venom in Mexican beekeepers] Rev Alerg Mex 2013 60 3 100 104 Search in Google Scholar

6. Ediger D, Terzioglu K, Ozturk RT. Venom allergy, risk factors for systemic reactions and the knowledge levels among Turkish beekeepers. Asia Pac Allergy. 2018;8(2):e15. doi: 10.5415/apallergy.2018.8.e15. EdigerD TerziogluK OzturkRT Venom allergy, risk factors for systemic reactions and the knowledge levels among Turkish beekeepers Asia Pac Allergy 2018 8 2 e15 10.5415/apallergy.2018.8.e15 Open DOISearch in Google Scholar

7. Richter AG, Nightingale P, Huissoon AP, Krishna MT. Risk factors for systemic reactions to a bee venom in British beekeepers. Ann Allergy Asthma Immunol. 2011;106(2):159–163. doi: 10.1016/j.anai.2010.11.005. RichterAG NightingaleP HuissoonAP KrishnaMT Risk factors for systemic reactions to a bee venom in British beekeepers Ann Allergy Asthma Immunol 2011 106 2 159 163 10.1016/j.anai.2010.11.005 Open DOISearch in Google Scholar

8. Carli T, Locatelli I, Košnik M, Kukec A. Epidemiology and risk factors of self-reported systemic allergic reactions to a Hymenoptera venom in beekeepers: A protocol for a systematic literature review of epidemiological observational studies in beekeepers worldwide. BMJ Open. 2022;12(7):1–5. doi: 10.1136/bmjopen-2021-058130. CarliT LocatelliI KošnikM KukecA Epidemiology and risk factors of self-reported systemic allergic reactions to a Hymenoptera venom in beekeepers: A protocol for a systematic literature review of epidemiological observational studies in beekeepers worldwide BMJ Open 2022 12 7 1 5 10.1136/bmjopen-2021-058130 Open DOISearch in Google Scholar

9. Münstedt K, Hellner M, Winter D, von Georgi R. Allergy to bee venom in beekeepers in Germany. J Investig Allergol Clin Immunol. 2008;18(2):100–105. MünstedtK HellnerM WinterD von GeorgiR Allergy to bee venom in beekeepers in Germany J Investig Allergol Clin Immunol 2008 18 2 100 105 Search in Google Scholar

10. Prattala R, Helasoja V, Laaksonen M, Laatikainen T, Nikander P, Puska P. CINDI health monitor. Proposal for practical guidelines. Helsinki: Publications of the National Public Health Institute [Internet]. 2019 [cited 2023 Apr 27]. Available from: https://www.julkari.fi/bitstream/handle/10024/78046/2001b14.pdf;sequence=1 PrattalaR HelasojaV LaaksonenM LaatikainenT NikanderP PuskaP CINDI health monitor. Proposal for practical guidelines Helsinki Publications of the National Public Health Institute [Internet] 2019 [cited 2023 Apr 27]. Available from: https://www.julkari.fi/bitstream/handle/10024/78046/2001b14.pdf;sequence=1 Search in Google Scholar

11. Fernandez-Gomez E, Martin-Salvador A, Luque-Vara T, Sanchez-Ojeda MA, Navarro-Prado S, Enrique-Miron C. Content validation through expert judgement of an instrument on the nutritional knowledge, beliefs, and habits of pregnant women. Nutrients. 2020;12(4):1136. doi: 10.3390/nu12041136. Fernandez-GomezE Martin-SalvadorA Luque-VaraT Sanchez-OjedaMA Navarro-PradoS Enrique-MironC Content validation through expert judgement of an instrument on the nutritional knowledge, beliefs, and habits of pregnant women Nutrients 2020 12 4 1136 10.3390/nu12041136 Open DOISearch in Google Scholar

12. McGartland Rubio D, Berg-Weger M, Tebb SS, Lee ES, Rauch S. Objectifying content validity: Conducting a content validity study in social work research. Soc Work Res. 2003;27(2):94–104. doi: 10.1093/swr/27.2.94. McGartland RubioD Berg-WegerM TebbSS LeeES RauchS Objectifying content validity: Conducting a content validity study in social work research Soc Work Res 2003 27 2 94 104 10.1093/swr/27.2.94 Open DOISearch in Google Scholar

13. Davis KA. Validity and reliability in qualitative research on second language: Acquisition and teaching. Another Researcher Comments. TESOL Q. 1992;26(3):605–608. doi: 10.2307/3587190. DavisKA Validity and reliability in qualitative research on second language: Acquisition and teaching. Another Researcher Comments TESOL Q 1992 26 3 605 608 10.2307/3587190 Open DOISearch in Google Scholar

14. Yusoff MSB. ABC of content validation and content validity index calculation. Med Educ. 2019;11(2):49–54. doi: 10.21315/eimj2019.11.2.6. YusoffMSB ABC of content validation and content validity index calculation Med Educ 2019 11 2 49 54 10.21315/eimj2019.11.2.6 Open DOISearch in Google Scholar

15. Zamanzadeh V, Ghahramanian A, Rassouli M, Abbaszadeh A, Alavi-Majd H, Nikanfar A-R. Design and implementation content validity study: Development of an instrument for measuring patient-centered communication. J Caring Sci. 2015;4(2):165–178. doi: 10.15171/jcs.2015.017. ZamanzadehV GhahramanianA RassouliM AbbaszadehA Alavi-MajdH NikanfarA-R Design and implementation content validity study: Development of an instrument for measuring patient-centered communication J Caring Sci 2015 4 2 165 178 10.15171/jcs.2015.017 Open DOISearch in Google Scholar

16. Polit DF, Beck CT. The content validity index: are you sure you know what’s being reported? Critique and recommendations. Res Nurs Health. 2006;29(5):489–497. doi: 10.1002/nur.20147. PolitDF BeckCT The content validity index: are you sure you know what’s being reported? Critique and recommendations Res Nurs Health 2006 29 5 489 497 10.1002/nur.20147 Open DOISearch in Google Scholar

17. Grant JS, Davis LL. Selection and use of content experts for instrument development. Res Nurs Health. 1997;20(3):269–274. doi: 10.1002/(sici)1098-240x(199706)20:3<269:aid-nur9>3.0.co;2-g. GrantJS DavisLL Selection and use of content experts for instrument development Res Nurs Health 1997 20 3 269 274 10.1002/(sici)1098-240x(199706)20:3<269:aid-nur9>3.0.co;2-g Open DOISearch in Google Scholar

18. Hambleton RK, Swaminathan H, Algina J, Coulson D. Criterion-referenced testing and measurement: A review of technical issues and developments. Rev Educ Res. 1978;48:1–47. doi: 10.3102/00346543048001001. HambletonRK SwaminathanH AlginaJ CoulsonD Criterion-referenced testing and measurement: A review of technical issues and developments Rev Educ Res 1978 48 1 47 10.3102/00346543048001001 Open DOISearch in Google Scholar

19. Slovenian Beekeepers Association. General information [Internet]. [cited 2023 Mar 13]. Available from: https://en.czs.si/about/general-information/ Slovenian Beekeepers Association General information [Internet] [cited 2023 Mar 13]. Available from: https://en.czs.si/about/general-information/ Search in Google Scholar

20. Yusoff MSB. ABC of response process validation and face validity index calculation. Med Educ. 2019;11(3):55–61. doi: 10.21315/eimj2019.11.3.6. YusoffMSB ABC of response process validation and face validity index calculation Med Educ 2019 11 3 55 61 10.21315/eimj2019.11.3.6 Open DOISearch in Google Scholar

21. Sin BE, Öztuna D, Gelincik A, Gürlek F, Baysan A, Sin AZ, et al. Quality-of-life in insect venom allergy: Validation of the Turkish version of the “Vespid Allergy Quality of Life Questionnaire” (VQLQ-T). Springerplus. 2016;5:583. doi: 10.1186/s40064-016-2246-x. SinBE ÖztunaD GelincikA GürlekF BaysanA SinAZ Quality-of-life in insect venom allergy: Validation of the Turkish version of the “Vespid Allergy Quality of Life Questionnaire” (VQLQ-T) Springerplus 2016 5 583 10.1186/s40064-016-2246-x Open DOISearch in Google Scholar

22. Elangovan N, Sundaravel E. Method of preparing a document for survey instrument validation by expertes. MethodsX. 2021;8:101326. doi: 10.1016/j.mex.2021.101326. ElangovanN SundaravelE Method of preparing a document for survey instrument validation by expertes MethodsX 2021 8 101326 10.1016/j.mex.2021.101326 Open DOISearch in Google Scholar

23. Rolstad S, Adler J, Rydén A. Respone burden and questionnaire length: Is shorter better? A review and meta-analysis. Value Health. 2011;14(8):1101–1108. doi: 10.1016/j.jval.2011.06.003. RolstadS AdlerJ RydénA Respone burden and questionnaire length: Is shorter better? A review and meta-analysis Value Health 2011 14 8 1101 1108 10.1016/j.jval.2011.06.003 Open DOISearch in Google Scholar

24. Annila IT, Karjalainen ES, Annila PA, Kuusisto PA. Bee and wasp sting reactions in current beekeepers. Ann Alergy Asthma Immunol. 1996;77(5):423–427. doi: 10.1016/S1081-1206(10)63342-X. AnnilaIT KarjalainenES AnnilaPA KuusistoPA Bee and wasp sting reactions in current beekeepers Ann Alergy Asthma Immunol 1996 77 5 423 427 10.1016/S1081-1206(10)63342-X Open DOISearch in Google Scholar

25. Celikel S, Karakaya G, Yurtsever N, Sorkun K, Falyoncu AF. Bee and bee products allergy in Turkish beekeepers: determination of risk factors for systemic reactions. Allergol Immunopathol (Madr.). 2006;34(5):180–184. doi: 10.1157/13094024. CelikelS KarakayaG YurtseverN SorkunK FalyoncuAF Bee and bee products allergy in Turkish beekeepers: determination of risk factors for systemic reactions Allergol Immunopathol (Madr.) 2006 34 5 180 184 10.1157/13094024 Open DOISearch in Google Scholar

26. Morton LM, Cahill J, Hartge P. Reporting participation in epidemiologic studies: A survey of practice. Am J Epidemiol. 2005;163(3):197–203. doi: 10.1093/aje/kwj036. MortonLM CahillJ HartgeP Reporting participation in epidemiologic studies: A survey of practice Am J Epidemiol 2005 163 3 197 203 10.1093/aje/kwj036 Open DOISearch in Google Scholar

27. Blumenberg C, Menezes AMB, Gonçalves H, Formoso Assunçao MC, Wehrmeister FC, Barros FC, et al. The role of questionnaire length and reminders frequency on response rates to a web-based epidemiologic study: A randomised trial. Int J Soc Res Methodol. 2019;22(6):626–635. doi: 10.1080/13645579.2019.1629755. BlumenbergC MenezesAMB GonçalvesH Formoso AssunçaoMC WehrmeisterFC BarrosFC The role of questionnaire length and reminders frequency on response rates to a web-based epidemiologic study: A randomised trial Int J Soc Res Methodol 2019 22 6 626 635 10.1080/13645579.2019.1629755 Open DOISearch in Google Scholar

28. Beekeeping Academy of Slovenia. Beekeeping in Slovenia [Internet]. 2012 [Cited 2023 Mar 17]. Available from: https://sca.kis.si/en/slovenian-beekeeping/ Beekeeping Academy of Slovenia Beekeeping in Slovenia [Internet] 2012 [Cited 2023 Mar 17]. Available from: https://sca.kis.si/en/slovenian-beekeeping/ Search in Google Scholar

29. Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35(6):382–385. LynnMR Determination and quantification of content validity Nurs Res 1986 35 6 382 385 Search in Google Scholar

30. Jokiniemi K, Meretoja R, Pietilä AM. Constructing content validity of clinical nurse specialist core competencies: Exploratory sequential mixed-method study. Scand J Caring Sci. 2018;32(4):1428–1436. doi: 10.1111/scs.12588. JokiniemiK MeretojaR PietiläAM Constructing content validity of clinical nurse specialist core competencies: Exploratory sequential mixed-method study Scand J Caring Sci 2018 32 4 1428 1436 10.1111/scs.12588 Open DOISearch in Google Scholar

31. Chang L. A psychometric evaluation of 4-point and 6-point Likert-type scales in relation to reliability and validity. Appl Psychol Meas; 1994:18(3):205–215. doi: 10.1177/01466216940180030. ChangL A psychometric evaluation of 4-point and 6-point Likert-type scales in relation to reliability and validity Appl Psychol Meas 1994 18 3 205 215 10.1177/01466216940180030 Open DOISearch in Google Scholar

32. Polit DF, Tatano Beck C, Owen SVV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459–467. doi: 10.1002/nur.20199. PolitDF Tatano BeckC OwenSVV Is the CVI an acceptable indicator of content validity? Appraisal and recommendations Res Nurs Health 2007 30 4 459 467 10.1002/nur.20199 Open DOISearch in Google Scholar

33. Rodrigues IB, Adachi JD, Beattle KA, MacDermid JC. Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis. BMC Musculoskelet Disord. 2017;18(1):540. doi: 10.1186/s12891-017-1914-5. RodriguesIB AdachiJD BeattleKA MacDermidJC Development and validation of a new tool to measure the facilitators, barriers and preferences to exercise in people with osteoporosis BMC Musculoskelet Disord 2017 18 1 540 10.1186/s12891-017-1914-5 Open DOISearch in Google Scholar

34. Almanasreh E, Moles R, Chen TF. Evaluation of methods used for estimating content validity. Resocial Adm Phar. 2019;15(2):214–221. doi: 10.1016/j.sapharm.2018.03.066. AlmanasrehE MolesR ChenTF Evaluation of methods used for estimating content validity Resocial Adm Phar 2019 15 2 214 221 10.1016/j.sapharm.2018.03.066 Open DOISearch in Google Scholar