The dilemmas of systematic literature review: the context of crowdsourcing in science

Adams, R.J., Smart, P., & Huff, A.S. (2017). Shades of grey: guidelines for working with the grey literature in systematic reviews for management and organizational studies. International Journal of Management Reviews, 19, 432–454. AdamsR.J. SmartP. HuffA.S. 2017 Shades of grey: guidelines for working with the grey literature in systematic reviews for management and organizational studies International Journal of Management Reviews 19 432 454 10.1111/ijmr.12102 Search in Google Scholar

Atkinson, L., & Cipriani, A. (2018). How to carry out a literature search for a systematic review: a practical guide. BJPsych Advances, 24(2), 74–82. AtkinsonL. CiprianiA. 2018 How to carry out a literature search for a systematic review: a practical guide BJPsych Advances 24 2 74 82 10.1192/bja.2017.3 Search in Google Scholar

Bassi, H., Lee, C.J., Misener, L., & Johnson, A.M. (2020). Exploring the characteristics of crowdsourcing: an online observational study. Journal of Information Science, 46(3), 291–312. BassiH. LeeC.J. MisenerL. JohnsonA.M. 2020 Exploring the characteristics of crowdsourcing: an online observational study Journal of Information Science 46 3 291 312 10.1177/0165551519828626 Search in Google Scholar

Boell, S.K., & Cecez-Kecmanovic, D. (2014). A hermeneutic approach for conducting literature reviews and literature searches. Communications of the Association for Information Systems, 34(1), 257–286. BoellS.K. Cecez-KecmanovicD. 2014 A hermeneutic approach for conducting literature reviews and literature searches Communications of the Association for Information Systems 34 1 257 286 10.17705/1CAIS.03412 Search in Google Scholar

Bramer, W.M., de Jonge,, G.B.., Rethlefsen L., Mast, F., & Kleijnen, J. (2018). A systematic approach to searching: an efficient and complete method to develop literature searches. Journal of the Medical Library Association, 106(4), 531–541. BramerW.M. de JongeG.B. RethlefsenL. MastF. KleijnenJ. 2018 A systematic approach to searching: an efficient and complete method to develop literature searches Journal of the Medical Library Association 106 4 531 541 10.5195/jmla.2018.283 Search in Google Scholar

Bramer, W.M., Rethlefsen, M.L., Kleijnen, J., & Franco, O.H. (2017). Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study. Systematic Reviews, 6(245), 1–12. BramerW.M. RethlefsenM.L. KleijnenJ. FrancoO.H. 2017 Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study Systematic Reviews 6 245 1 12 10.1186/s13643-017-0644-y Search in Google Scholar

Breretona, P., Kitchenhama, B.A., Budgenb, D., Turnera, M., & Khalilc, M. (2007). Lessons from applying the systematic literature review process within the software engineering domain. Journal of Systems and Software, 80(4), 571–583. BreretonaP. KitchenhamaB.A. BudgenbD. TurneraM. KhalilcM. 2007 Lessons from applying the systematic literature review process within the software engineering domain Journal of Systems and Software 80 4 571 583 10.1016/j.jss.2006.07.009 Search in Google Scholar

Cronin, P., Ryan, F., & Coughlan, M. (2008). Undertaking a literature review: a step-by-step approach. British Journal of Nursing, 17(1), 38–43. CroninP. RyanF. CoughlanM. 2008 Undertaking a literature review: a step-by-step approach British Journal of Nursing 17 1 38 43 10.12968/bjon.2008.17.1.28059 Search in Google Scholar

Czakon, W. (2011). Metodyka systematycznego przeglądu literatury. Przegląd Organizacji, 3, 57–61. CzakonW. 2011 Metodyka systematycznego przeglądu literatury Przegląd Organizacji 3 57 61 10.33141/po.2011.03.13 Search in Google Scholar

Czakon, W., Klimas, P., & Kawa, A. (2019). Krótkowzroczność strategiczna – metodyczne aspekty systematycznego przeglądu literatury. Studia Oeconomica Posnaniensia, 7(2), 27–37. CzakonW. KlimasP. KawaA. 2019 Krótkowzroczność strategiczna – metodyczne aspekty systematycznego przeglądu literatury Studia Oeconomica Posnaniensia 7 2 27 37 10.18559/SOEP.2019.2.2 Search in Google Scholar

Davis, J., Mengersen, K., Bennett, S., & Mazerolle, L. (2014). Viewing systematic reviews and meta-analysis in social research through different lenses. SpringerPlus, 3, 1–9. DavisJ. MengersenK. BennettS. MazerolleL. 2014 Viewing systematic reviews and meta-analysis in social research through different lenses SpringerPlus 3 1 9 10.1186/2193-1801-3-511 Search in Google Scholar

Denyer, D., & Tranfield, D. (2009). Producing a systematic review. In D.A. Buchanan & A. Bryman (Eds.), The SAGE handbook of organizational research methods (pp. 671–689). SAGE Publications Ltd. DenyerD. TranfieldD. 2009 Producing a systematic review In BuchananD.A. BrymanA. (Eds.), The SAGE handbook of organizational research methods 671 689 SAGE Publications Ltd. Search in Google Scholar

Egger, M., Juni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003). How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technology Assessment, 7(1), 1–76. EggerM. JuniP. BartlettC. HolensteinF. SterneJ. 2003 How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study Health Technology Assessment 7 1 1 76 10.3310/hta7010 Search in Google Scholar

Falagas, M.E., Pitsouni, E.I., Malietzis, G.A., & Pappas, G. (2008). Comparison of PubMed, Scopus, Web of Science, and Google Scholar: strengths and weaknesses. The FASEB Journal, 22, 338–342. FalagasM.E. PitsouniE.I. MalietzisG.A. PappasG. 2008 Comparison of PubMed, Scopus, Web of Science, and Google Scholar: strengths and weaknesses The FASEB Journal 22 338 342 10.1096/fj.07-9492LSF Search in Google Scholar

Ferguson, C.J., & Brannick, M.T. (2012). Publication bias in psychological science: Prevalence, methods for identifying and controlling, and implications for the use of meta-analyses. Psychological Methods, 17(1), 120–128. FergusonC.J. BrannickM.T. 2012 Publication bias in psychological science: Prevalence, methods for identifying and controlling, and implications for the use of meta-analyses Psychological Methods 17 1 120 128 10.1037/a0024445 Search in Google Scholar

Fusar-Poli, P., Radua, J. (2018). Ten simple rules for conducting umbrella reviews. Evidence-Based Mental Health, 21, 95–100. Fusar-PoliP. RaduaJ. 2018 Ten simple rules for conducting umbrella reviews Evidence-Based Mental Health 21 95 100 10.1136/ebmental-2018-300014 Search in Google Scholar

Gough, D., Thomas, J., & Oliver, S. (2012). Clarifying differences between review designs and methods. Systematic Reviews, 1(8), 1–9. GoughD. ThomasJ. OliverS. 2012 Clarifying differences between review designs and methods Systematic Reviews 1 8 1 9 10.1186/2046-4053-1-28 Search in Google Scholar

Greenhalgh, T. & Peacock, R. (2005). Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources. British Medical Journal, 331, 1064–1065. GreenhalghT. PeacockR. 2005 Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources British Medical Journal 331 1064 1065 10.1136/bmj.38636.593461.68 Search in Google Scholar

Hiebl, M.R.W. (2021). Sample selection in systematic literature reviews of management research. Organizational Research Methods, https://journals.sagepub.com/doi/pdf/10.1177/1094428120986851. HieblM.R.W. 2021 Sample selection in systematic literature reviews of management research Organizational Research Methods https://journals.sagepub.com/doi/pdf/10.1177/1094428120986851. 10.1177/1094428120986851 Search in Google Scholar

Howe, J. (2006). The rise of crowdsourcing, Wired, 14. HoweJ. 2006 The rise of crowdsourcing Wired 14 Search in Google Scholar

Ioannidis, J.P.A. (2016). The mass production of redundant, misleading, and conflicted systematic, reviews and meta-analyses. The Milbank Quarterly, 94(3), 485–514. IoannidisJ.P.A. 2016 The mass production of redundant, misleading, and conflicted systematic, reviews and meta-analyses The Milbank Quarterly 94 3 485 514 10.1111/1468-0009.12210 Search in Google Scholar

Kastner, M., Straus, S.E., McKibbon, K.A., & Goldsmith, C.H. (2009). The capture-mark-recapture technique can be used as a stopping rule when searching in systematic reviews. Journal of Clinical Epidemiology, 62(2), 149–157. KastnerM. StrausS.E. McKibbonK.A. GoldsmithC.H. 2009 The capture-mark-recapture technique can be used as a stopping rule when searching in systematic reviews Journal of Clinical Epidemiology 62 2 149 157 10.1016/j.jclinepi.2008.06.001 Search in Google Scholar

Khangura, S., Konnyu, K., Cushman, R., Grimshaw, J., Moher, D. (2012). Evidence summaries: the evolution of a rapid review approach. Systematic Reviews, 1(1), 1–10. KhanguraS. KonnyuK. CushmanR. GrimshawJ. MoherD. 2012 Evidence summaries: the evolution of a rapid review approach Systematic Reviews 1 1 1 10 10.1186/2046-4053-1-10 Search in Google Scholar

Kitchenham, B., & Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering. Technical Report EBSE 2007-001, Keele University and Durham University Joint Report. KitchenhamB. ChartersS. 2007 Guidelines for performing systematic literature reviews in software engineering Technical Report EBSE 2007-001, Keele University and Durham University Joint Report. Search in Google Scholar

Klimas, P., Czakon, W., & Fredrich, V. (2021). Strategy frames in coopetition: An examination of coopetition entry factors in high-tech firms. European Management Journal, https://www-1sciencedirect-1com-13wmmwumo09f7.hps.bj.uj.edu.pl/science/article/pii/S0263237321000554#bib28 KlimasP. CzakonW. FredrichV. 2021 Strategy frames in coopetition: An examination of coopetition entry factors in high-tech firms European Management Journal https://www-1sciencedirect-1com-13wmmwumo09f7.hps.bj.uj.edu.pl/science/article/pii/S0263237321000554#bib28 10.1016/j.emj.2021.04.005 Search in Google Scholar

Klimas, P., Stańczyk, S., & Sachpazidu-Wójcicka, K. (2020). Metodyka systematycznego przeglądu literatury – wyzwania selekcji a posteriori podczas tworzenia bazy literatury. In Sopińska, A., & Modliński, A. (Eds). Współczesne zarządzanie – koncepcje i wyzwania, Oficyna Wydawnicza SGH, Warszawa. KlimasP. StańczykS. Sachpazidu-WójcickaK. 2020 Metodyka systematycznego przeglądu literatury – wyzwania selekcji a posteriori podczas tworzenia bazy literatury In SopińskaA. ModlińskiA. (Eds). Współczesne zarządzanie – koncepcje i wyzwania Oficyna Wydawnicza SGH Warszawa Search in Google Scholar

Kraus, S., Breier, M., & Dasí-Rodríguez, S. (2020). The art of crafting a systematic literature review in entrepreneurship research. International Entrepreneurship and Management Journal”, 16(3), 1023–1042. KrausS. BreierM. Dasí-RodríguezS. 2020 The art of crafting a systematic literature review in entrepreneurship research International Entrepreneurship and Management Journal” 16 3 1023 1042 10.1007/s11365-020-00635-4 Search in Google Scholar

Lakhani, K., Jeppesen, L., Lohse, P., & Panetta, J. (2007). The value of openness in scientific problem solving, Working Paper, 07-050. Harvard Business School. LakhaniK. JeppesenL. LohseP. PanettaJ. 2007 The value of openness in scientific problem solving, Working Paper, 07-050 Harvard Business School Search in Google Scholar

Lenart-Gansiniec, R., (2021). Systematyczny przegląd literatury w naukach społecznych. Przewodnik dla studentów, doktorantów i nie tylko. Wydawnictwo Naukowe Scholar, Warszawa. Lenart-GansiniecR. 2021 Systematyczny przegląd literatury w naukach społecznych. Przewodnik dla studentów, doktorantów i nie tylko Wydawnictwo Naukowe Scholar Warszawa Search in Google Scholar

Linnenluecke, M.K., Marrone, M., & Singh, A.K. (2020). Conducting systematic literature reviews and bibliometric analyses. Australian Journal of Management, 45(2), 175–194. LinnenlueckeM.K. MarroneM. SinghA.K. 2020 Conducting systematic literature reviews and bibliometric analyses Australian Journal of Management 45 2 175 194 10.1177/0312896219877678 Search in Google Scholar

Moher, D., Liberati, A., & Tetzlaff, J.A.D. (2009). Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement. Open Medicine”, 3(2), 123–130. MoherD. LiberatiA. TetzlaffJ.A.D. 2009 Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement Open Medicine 3 2 123 130 Search in Google Scholar

Okoli, C. (2015). A guide to conducting a standalone systematic literature review. Communications of the Association for Information Systems, 37(43), 879–910. OkoliC. 2015 A guide to conducting a standalone systematic literature review Communications of the Association for Information Systems 37 43 879 910 10.17705/1CAIS.03743 Search in Google Scholar

Palmatier, R.W., Houston, M.B., & Hulland, J. (2018). Review articles: Purpose, process, and structure. Journal of the Academy of Marketing Science”, 46(1), 1–5. PalmatierR.W. HoustonM.B. HullandJ. 2018 Review articles: Purpose, process, and structure Journal of the Academy of Marketing Science” 46 1 1 5 10.1007/s11747-017-0563-4 Search in Google Scholar

Papaioannou, D., Sutton, A., Carroll, C., Booth, A., & Wong, R. (2010). Literature searching for social science systematic reviews: consideration of a range of search techniques. Health Information & Libraries Journal, 27, 114–122. PapaioannouD. SuttonA. CarrollC. BoothA. WongR. 2010 Literature searching for social science systematic reviews: consideration of a range of search techniques Health Information & Libraries Journal 27 114 122 10.1111/j.1471-1842.2009.00863.x Search in Google Scholar

Paré, G., & Templier, M. (2015). A framework for guiding and evaluating literature reviews. Communications of the Association for Information Systems, 37(6), 112–137. ParéG. TemplierM. 2015 A framework for guiding and evaluating literature reviews Communications of the Association for Information Systems 37 6 112 137 10.17705/1CAIS.03706 Search in Google Scholar

Petrosino, A., Boruch, R.F., Soydan, H., Duggan, L., Sanchez-Meca, J. (2001), Meeting the challenges of evidence-based policy: The Campbell Collaboration. Annals of the American Academy of Political and Social Science, 578, 14–34. PetrosinoA. BoruchR.F. SoydanH. DugganL. Sanchez-MecaJ. 2001 Meeting the challenges of evidence-based policy: The Campbell Collaboration Annals of the American Academy of Political and Social Science 578 14 34 10.1177/000271620157800102 Search in Google Scholar

Petticrew, M., Roberts, H. (2012). Systematic reviews in the social sciences: A practical guide (12th ed.). Blackwell Publishing. PetticrewM. RobertsH. 2012 Systematic reviews in the social sciences: A practical guide 12th ed. Blackwell Publishing Search in Google Scholar

Randolph, J. (2009). A guide to writing the dissertation literature review. Practical Assessment, Research, and Evaluation, 14(13), 1–13. RandolphJ. 2009 A guide to writing the dissertation literature review Practical Assessment, Research, and Evaluation 14 13 1 13 Search in Google Scholar

Rojon, C., McDowall, A., & Saunders, M.N.K. (2011). On the experience of conducting a systematic review in industrial, work, and organizational psychology: yes, it is worthwhile. Journal of Personnel Psychology, 10(3), 133–138. RojonC. McDowallA. SaundersM.N.K. 2011 On the experience of conducting a systematic review in industrial, work, and organizational psychology: yes, it is worthwhile Journal of Personnel Psychology 10 3 133 138 10.1027/1866-5888/a000041 Search in Google Scholar

Shaffril, H.A.M., Samah, A.A., & Samsuddin S.F. (2021). Guidelines for developing a systematic literature review for studies related to climate change adaptation. Environmental Science and Pollution Research, 28(18), 22265–2227. ShaffrilH.A.M. SamahA.A. SamsuddinS.F. 2021 Guidelines for developing a systematic literature review for studies related to climate change adaptation Environmental Science and Pollution Research 28 18 22265 2227 10.1007/s11356-021-13178-0 Search in Google Scholar

Shelby, L.B., & Vaske, J.J. (2008). Understanding meta-analysis: A review of the methodological literature. Leisure Sciences, 30(2), 96–110. ShelbyL.B. VaskeJ.J. 2008 Understanding meta-analysis: A review of the methodological literature Leisure Sciences 30 2 96 110 10.1080/01490400701881366 Search in Google Scholar

Short, J.C., Sharma, P., Lumpkin, G.T., & Pearson, A.W. (2016). Oh, the places we’ll go! reviewing past, present, and future possibilities in family business research. Family Business Review, 29(1), 11–16. ShortJ.C. SharmaP. LumpkinG.T. PearsonA.W. 2016 Oh, the places we’ll go! reviewing past, present, and future possibilities in family business research Family Business Review 29 1 11 16 10.1177/0894486515622294 Search in Google Scholar

Short, J. (2009). The art of writing a review article. Journal of Management, 35(6), 1312–1317. ShortJ. 2009 The art of writing a review article Journal of Management 35 6 1312 1317 10.1177/0149206309337489 Search in Google Scholar

Snyder, H. (2019). Literature review as a research methodology: an overview and guidelines. Journal of Business Research, 104, 333–339. SnyderH. 2019 Literature review as a research methodology: an overview and guidelines Journal of Business Research 104 333 339 10.1016/j.jbusres.2019.07.039 Search in Google Scholar

Torraco, R.J. (2005). Writing integrative literature reviews guidelines and examples. Human Resource Development Review, 4(3), 356–367. TorracoR.J. 2005 Writing integrative literature reviews guidelines and examples Human Resource Development Review 4 3 356 367 10.1177/1534484305278283 Search in Google Scholar

Uhlmann, E.L., Ebersole, C.R., Chartier, C.R., Errington, T.M., Kidwell, M.C., Lai, C.K., McCarthy, R.J., Riegelman, A., Silberzahn, R., & Nosek, B.A. (2019). Scientific utopia III: crowdsourcing science. Perspectives on Psychological Science, 14(5), 711–733. UhlmannE.L. EbersoleC.R. ChartierC.R. ErringtonT.M. KidwellM.C. LaiC.K. McCarthyR.J. RiegelmanA. SilberzahnR. NosekB.A. 2019 Scientific utopia III: crowdsourcing science Perspectives on Psychological Science 14 5 711 733 10.1177/1745691619850561 Search in Google Scholar

Webster, J., & Watson, R.T. (2002). Analyzing the past to prepare for the future: writing a literature review. MIS Quarterly, 26(2), xiii–xxiii. WebsterJ. WatsonR.T. 2002 Analyzing the past to prepare for the future: writing a literature review MIS Quarterly 26 2 xiii xxiii Search in Google Scholar

Williams, R.I., Clark, L.A., Clark, W.R., & Raffo, D.M. (2021). Re-examining systematic literature review in management research: additional benefits and execution protocols. European Management Journal, 39(4), 521–533. WilliamsR.I. ClarkL.A. ClarkW.R. RaffoD.M. 2021 Re-examining systematic literature review in management research: additional benefits and execution protocols European Management Journal 39 4 521 533 10.1016/j.emj.2020.09.007 Search in Google Scholar

Xiao, Y, Watson, M. (2019). Guidance on conducting a systematic literature review. Journal of Planning Education and Research, 39(1), 93–112. XiaoY WatsonM. 2019 Guidance on conducting a systematic literature review Journal of Planning Education and Research 39 1 93 112 10.1177/0739456X17723971 Search in Google Scholar