Prospective analysis of inter-observer and intra-observer variability in multi ultrasound descriptor assessment of thyroid nodules

1. Guth S, Theune U, Aberle J, Galach A, Bamberger CM: Very high prevalence of thyroid nodules detected by high frequency (13 MHz) ultrasound examination. Eur J Clin Invest 2009; 39: 699–706. Guth S Theune U Aberle J Galach A Bamberger CM : Very high prevalence of thyroid nodules detected by high frequency (13 MHz) ultrasound examination . Eur J Clin Invest 2009 ; 39 : 699 – 706 . 10.1111/j.1365-2362.2009.02162.x19601965 Search in Google Scholar

2. Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE et al.: 2015 American Thyroid Association management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: the American Thyroid Association guidelines task force on thyroid nodules and differentiated thyroid cancer. Thyroid 2016; 26: 1–133. Haugen BR Alexander EK Bible KC Doherty GM Mandel SJ Nikiforov YE : 2015 American Thyroid Association management guidelines for adult patients with thyroid nodules and differentiated thyroid cancer: the American Thyroid Association guidelines task force on thyroid nodules and differentiated thyroid cancer . Thyroid 2016 ; 26 : 1 – 133 . 10.1089/thy.2015.0020473913226462967 Search in Google Scholar

3. Didkowska J, Wojciechowska U, Olasek P: Nowotwory złośliwe w Polsce w 2015 roku. Centrum Onkologii – Instytut im. Marii Skłodowskiej-Curie, Warszawa 2017. Didkowska J Wojciechowska U Olasek P : Nowotwory złośliwe w Polsce w 2015 roku . Centrum Onkologii – Instytut im. Marii Skłodowskiej-Curie , Warszawa 2017 . Search in Google Scholar

4. Instytut ZEiPNCO: Krajowy Rejestr Nowotworów. Available from: http://onkologia.org.pl/raporty/#tabela_nowotwor. Instytut ZEiPNCO : Krajowy Rejestr Nowotworów . Available from: http://onkologia.org.pl/raporty/#tabela_nowotwor Search in Google Scholar

5. Choi SH, Kim EK, Kwak JY, Kim MJ, Son EJ: Interobserver and intraobserver variations in ultrasound assessment of thyroid nodules. Thyroid 2010; 20: 167–172. Choi SH Kim EK Kwak JY Kim MJ Son EJ : Interobserver and intraobserver variations in ultrasound assessment of thyroid nodules . Thyroid 2010 ; 20 : 167 – 172 . 10.1089/thy.2008.035419725777 Search in Google Scholar

6. Brito JP, Gionfriddo MR, Nofal A, Boehmer KR, Leppin AL, Reading C et al.: The accuracy of thyroid nodule ultrasound to predict thyroid cancer: systematic review and meta-analysis. J Clin Endocrinol Metab 2013; 99: 1253–1263. Brito JP Gionfriddo MR Nofal A Boehmer KR Leppin AL Reading C : The accuracy of thyroid nodule ultrasound to predict thyroid cancer: systematic review and meta-analysis . J Clin Endocrinol Metab 2013 ; 99 : 1253 – 1263 . 10.1210/jc.2013-2928397378124276450 Search in Google Scholar

7. Campanella P, Ianni F, Rota CA, Corsello SM, Pontecorvi A: Quantification of cancer risk of each clinical and ultrasonographic suspicious feature of thyroid nodules: A systematic review and meta-analysis. Eur J Endocrinol 2014; 170: R203–R211. Campanella P Ianni F Rota CA Corsello SM Pontecorvi A : Quantification of cancer risk of each clinical and ultrasonographic suspicious feature of thyroid nodules: A systematic review and meta-analysis . Eur J Endocrinol 2014 ; 170 : R203 – R211 . 10.1530/EJE-13-099524536085 Search in Google Scholar

8. Remonti LR, Kramer CK, Leitao CB, Pinto LCF, Gross JL: Thyroid ultrasound features and risk of carcinoma: A systematic review and meta-analysis of observational studies. Thyroid 2015; 25: 538–550. Remonti LR Kramer CK Leitao CB Pinto LCF Gross JL : Thyroid ultrasound features and risk of carcinoma: A systematic review and meta-analysis of observational studies . Thyroid 2015 ; 25 : 538 – 550 . 10.1089/thy.2014.0353444713725747526 Search in Google Scholar

9. Kwak JY, Han KH, Yoon JH, Moon HJ, Son EJ, Park SH et al.: Thyroid imaging reporting and data system for US features of nodules: A step in establishing better stratification of cancer risk. Radiology 2011; 260: 892–899. Kwak JY Han KH Yoon JH Moon HJ Son EJ Park SH : Thyroid imaging reporting and data system for US features of nodules: A step in establishing better stratification of cancer risk . Radiology 2011 ; 260 : 892 – 899 . 10.1148/radiol.1111020621771959 Search in Google Scholar

10. Salmaslıoğlu A, Erbil Y, Dural C, İşsever H, Kapran Y, Özarmağan S et al.: Predictive value of sonographic features in preoperative evaluation of malignant thyroid nodules in a multinodular goiter. World J Surg 2008; 32: 1948–1954. Salmaslıoğlu A Erbil Y Dural C İşsever H Kapran Y Özarmağan S : Predictive value of sonographic features in preoperative evaluation of malignant thyroid nodules in a multinodular goiter . World J Surg 2008 ; 32 : 1948 – 1954 . 10.1007/s00268-008-9600-218443853 Search in Google Scholar

11. Moon WJ, Jung SL, Lee JH, Na DG, Baek JH, Lee YH et al.: Benign and malignant thyroid nodules: US differentiation – multicenter retrospective study. Radiology 2008; 247: 762–770. Moon WJ Jung SL Lee JH Na DG Baek JH Lee YH : Benign and malignant thyroid nodules: US differentiation – multicenter retrospective study . Radiology 2008 ; 247 : 762 – 770 . 10.1148/radiol.247307094418403624 Search in Google Scholar

12. Szczepanek-Parulska E, Woliński K, Stangierski A, Gurgul E, Biczysko M, Majewski P et al.: Comparison of diagnostic value of conventional ultrasonography and shear wave elastography in the prediction of thyroid lesions malignancy. PLoS One 2013; 8: e81532. Szczepanek-Parulska E Woliński K Stangierski A Gurgul E Biczysko M Majewski P : Comparison of diagnostic value of conventional ultrasonography and shear wave elastography in the prediction of thyroid lesions malignancy . PLoS One 2013 ; 8 : e81532 . 10.1371/journal.pone.0081532384366724312313 Search in Google Scholar

13. Szczepanek-Parulska E, Woliński K, Stangierski A, Gurgul E, Ruchała M: Biochemical and ultrasonographic parameters influencing thyroid nodules elasticity. Endocrine 2014; 47: 519–527. Szczepanek-Parulska E Woliński K Stangierski A Gurgul E Ruchała M : Biochemical and ultrasonographic parameters influencing thyroid nodules elasticity . Endocrine 2014 ; 47 : 519 – 527 . 10.1007/s12020-014-0197-y24535467 Search in Google Scholar

14. Tian W, Hao S, Gao B, Jiang Y, Zhang X, Zhang S et al.: Comparing the diagnostic accuracy of RTE and SWE in differentiating malignant thyroid nodules from benign ones: a meta-analysis. Cell Biochem 2016; 39: 2451–2463. Tian W Hao S Gao B Jiang Y Zhang X Zhang S : Comparing the diagnostic accuracy of RTE and SWE in differentiating malignant thyroid nodules from benign ones: a meta-analysis . Cell Biochem 2016 ; 39 : 2451 – 2463 . 10.1159/00045251327832644 Search in Google Scholar

15. Hu X, Liu Y, Qian L: Diagnostic potential of real-time elastography (RTE) and shear wave elastography (SWE) to differentiate benign and malignant thyroid nodules: A systematic review and meta-analysis. Medicine 2017; 96: e8282. Hu X Liu Y Qian L : Diagnostic potential of real-time elastography (RTE) and shear wave elastography (SWE) to differentiate benign and malignant thyroid nodules: A systematic review and meta-analysis . Medicine 2017 ; 96 : e8282 . 10.1097/MD.0000000000008282567182929068996 Search in Google Scholar

16. Dighe M, Hippe DS, Thiel J: Artifacts in shear wave elastography images of thyroid nodules. Ultrasound Med Biol 2018; 44: 1170–1176. Dighe M Hippe DS Thiel J : Artifacts in shear wave elastography images of thyroid nodules . Ultrasound Med Biol 2018 ; 44 : 1170 – 1176 . 10.1016/j.ultrasmedbio.2018.02.007591026129573887 Search in Google Scholar

17. Moon HJ, Yoon JH, Kwak JY, Chung WY, Nam KH, Jeong JJ et al.: Positive predictive value and interobserver variability of preoperative staging sonography for thyroid carcinoma. AJR Am J Roentgenol 2011; 197: W324–W330. Moon HJ Yoon JH Kwak JY Chung WY Nam KH Jeong JJ : Positive predictive value and interobserver variability of preoperative staging sonography for thyroid carcinoma . AJR Am J Roentgenol 2011 ; 197 : W324 – W330 . 10.2214/AJR.10.557621785060 Search in Google Scholar

18. Park CS, Kim SH, Jung SL, Kang BJ, Kim JY, Choi JJ et al.: Observer variability in the sonographic evaluation of thyroid nodules. J Clin Ultrasound 2010; 38: 287–293. Park CS Kim SH Jung SL Kang BJ Kim JY Choi JJ : Observer variability in the sonographic evaluation of thyroid nodules . J Clin Ultrasound 2010 ; 38 : 287 – 293 . 10.1002/jcu.2068920544863 Search in Google Scholar

19. Friedrich-Rust M, Meyer G, Dauth N, Berner C, Bogdanou D, Herrmann E et al.: Interobserver agreement of Thyroid Imaging Reporting and Data System (TIRADS) and strain elastography for the assessment of thyroid nodules. PLoS One 2013; 8: e77927. Friedrich-Rust M Meyer G Dauth N Berner C Bogdanou D Herrmann E : Interobserver agreement of Thyroid Imaging Reporting and Data System (TIRADS) and strain elastography for the assessment of thyroid nodules . PLoS One 2013 ; 8 : e77927 . 10.1371/journal.pone.0077927381202524205031 Search in Google Scholar

20. Park SH, Kim SJ, Kim EK, Kim MJ, Son EJ, Kwak JY: Interobserver agreement in assessing the sonographic and elastographic features of malignant thyroid nodules. AJR Am J Roentgenol 2009; 193: W416–W423. Park SH Kim SJ Kim EK Kim MJ Son EJ Kwak JY : Interobserver agreement in assessing the sonographic and elastographic features of malignant thyroid nodules . AJR Am J Roentgenol 2009 ; 193 : W416 – W423 . 10.2214/AJR.09.254119843721 Search in Google Scholar

21. Cosgrove D, Piscaglia F, Bamber J, Bojunga J, Correas JM, Gilja O et al.: EFSUMB guidelines and recommendations on the clinical use of ultrasound elastography. Part 2: clinical applications. Ultraschall Med 2013; 34: 238–253. Cosgrove D Piscaglia F Bamber J Bojunga J Correas JM Gilja O : EFSUMB guidelines and recommendations on the clinical use of ultrasound elastography. Part 2: clinical applications . Ultraschall Med 2013 ; 34 : 238 – 253 . 10.1055/s-0033-133537523605169 Search in Google Scholar

22. Shiina T, Nightingale KR, Palmeri ML, Hall TJ, Bamber JC, Barr RG et al.: WFUMB guidelines and recommendations for clinical use of ultrasound elastography: Part 1: basic principles and terminology. Ultrasound Med Biol 2015; 41: 1126–1147. Shiina T Nightingale KR Palmeri ML Hall TJ Bamber JC Barr RG : WFUMB guidelines and recommendations for clinical use of ultrasound elastography: Part 1: basic principles and terminology . Ultrasound Med Biol 2015 ; 41 : 1126 – 1147 . 10.1016/j.ultrasmedbio.2015.03.00925805059 Search in Google Scholar

23. Jarząb B, Dedecjus M, Słowińska-Klencka D, Lewiński A, Adamczewski Z, Anielski R et al.: Guidelines of Polish National Societies Diagnostics and Treatment of Thyroid Carcinoma. 2018 Update. Endokrynol Pol 2018; 69: 34–74. Jarząb B Dedecjus M Słowińska-Klencka D Lewiński A Adamczewski Z Anielski R : Guidelines of Polish National Societies Diagnostics and Treatment of Thyroid Carcinoma. 2018 Update . Endokrynol Pol 2018 ; 69 : 34 – 74 . 10.5603/EP.2018.001429442352 Search in Google Scholar

24. Straccia P, Rossi ED, Bizzarro T, Brunelli C, Cianfrini F, Damiani D et al.: A meta-analytic review of the Bethesda System for Reporting Thyroid Cytopathology: has the rate of malignancy in indeterminate lesions been underestimated? Cancer Cytopathol 2015; 123: 713–722. Straccia P Rossi ED Bizzarro T Brunelli C Cianfrini F Damiani D : A meta-analytic review of the Bethesda System for Reporting Thyroid Cytopathology: has the rate of malignancy in indeterminate lesions been underestimated? Cancer Cytopathol 2015 ; 123 : 713 – 722 . 10.1002/cncy.2160526355876 Search in Google Scholar

25. Asteria C, Giovanardi A, Pizzocaro A, Cozzaglio L, Morabito A, Somalvico F et al.: US-elastography in the differential diagnosis of benign and malignant thyroid nodules. Thyroid 2008; 18: 523–531. Asteria C Giovanardi A Pizzocaro A Cozzaglio L Morabito A Somalvico F : US-elastography in the differential diagnosis of benign and malignant thyroid nodules . Thyroid 2008 ; 18 : 523 – 531 . 10.1089/thy.2007.032318466077 Search in Google Scholar

26. Fleiss JL, Levin B, Paik MC: Statistical Methods for Rates and Proportions. John Wiley & Sons 2013. Fleiss JL Levin B Paik MC : Statistical Methods for Rates and Proportions . John Wiley & Sons 2013 . Search in Google Scholar

27. Landis JR, Koch GG: The measurement of observe agreement for categorical data. Biometrics 1977; 33: 159–174. Landis JR Koch GG : The measurement of observe agreement for categorical data . Biometrics 1977 ; 33 : 159 – 174 . 10.2307/2529310 Search in Google Scholar

28. Horvath E, Majlis S, Rossi R, Franco C, Niedmann JP, Castro A et al.: An ultrasonogram reporting system for thyroid nodules stratifying cancer risk for clinical management. J Clin Endocrinol Metab 2009; 94: 1748–1751. Horvath E Majlis S Rossi R Franco C Niedmann JP Castro A : An ultrasonogram reporting system for thyroid nodules stratifying cancer risk for clinical management . J Clin Endocrinol Metab 2009 ; 94 : 1748 – 1751 . 10.1210/jc.2008-172419276237 Search in Google Scholar

29. Russ G, Royer B, Bigorgne C, Rouxel A, Bienvenu-Perrard M, Leenhardt L: Prospective evaluation of thyroid imaging reporting and data system on 4550 nodules with and without elastography. Eur J Endocrinol 2013; 168: 649–655. Russ G Royer B Bigorgne C Rouxel A Bienvenu-Perrard M Leenhardt L : Prospective evaluation of thyroid imaging reporting and data system on 4550 nodules with and without elastography . Eur J Endocrinol 2013 ; 168 : 649 – 655 . 10.1530/EJE-12-093623416955 Search in Google Scholar

30. Russ G, Bonnema SJ, Erdogan MF, Durante C, Ngu R, Leenhardt L: European Thyroid Association guidelines for ultrasound malignancy risk stratification of thyroid nodules in adults: the EU-TIRADS. Eur Thyroid J 2017; 6: 225–237. Russ G Bonnema SJ Erdogan MF Durante C Ngu R Leenhardt L : European Thyroid Association guidelines for ultrasound malignancy risk stratification of thyroid nodules in adults: the EU-TIRADS . Eur Thyroid J 2017 ; 6 : 225 – 237 . 10.1159/000478927565289529167761 Search in Google Scholar

31. Tessler FN, Middleton WD, Grant EG, Hoang JK, Berland LL, Teefey SA et al.: ACR thyroid imaging, reporting and data system (TI-RADS): white paper of the ACR TI-RADS committee. J Am Coll Radiol 2017; 14: 587–595. Tessler FN Middleton WD Grant EG Hoang JK Berland LL Teefey SA : ACR thyroid imaging, reporting and data system (TI-RADS): white paper of the ACR TI-RADS committee . J Am Coll Radiol 2017 ; 14 : 587 – 595 . 10.1016/j.jacr.2017.01.04628372962 Search in Google Scholar

32. Migda B, Migda M, Migda MS, Slapa RZ: Use of the Kwak Thyroid Image Reporting and Data System (K-TIRADS) in differential diagnosis of thyroid nodules: systematic review and meta-analysis. Eur Radiol 2018; 28: 2380–2388. Migda B Migda M Migda MS Slapa RZ : Use of the Kwak Thyroid Image Reporting and Data System (K-TIRADS) in differential diagnosis of thyroid nodules: systematic review and meta-analysis . Eur Radiol 2018 ; 28 : 2380 – 2388 . 10.1007/s00330-017-5230-0593828929294156 Search in Google Scholar

33. Moon HJ, Sung JM, Kim EK, Yoon JH, Youk JH, Kwak JY: Diagnostic performance of gray-scale US and elastography in solid thyroid nodules. Radiology 2012; 262: 1002–1013. Moon HJ Sung JM Kim EK Yoon JH Youk JH Kwak JY : Diagnostic performance of gray-scale US and elastography in solid thyroid nodules . Radiology 2012 ; 262 : 1002 – 1013 . 10.1148/radiol.1111083922357900 Search in Google Scholar

34. Bojunga J, Herrmann E, Meyer G, Weber S, Zeuzem S, Friedrich-Rust M: Real-time elastography for the differentiation of benign and malignant thyroid nodules: a meta-analysis. Thyroid 2010; 20: 1145–1150. Bojunga J Herrmann E Meyer G Weber S Zeuzem S Friedrich-Rust M : Real-time elastography for the differentiation of benign and malignant thyroid nodules: a meta-analysis . Thyroid 2010 ; 20 : 1145 – 1150 . 10.1089/thy.2010.007920860422 Search in Google Scholar