CPr task with RN10 | CPr task with mRN10 | ||||||
---|---|---|---|---|---|---|---|
HPTT present | HPTT present not | sum | HPTT present | HPTT present not | sum | ||
Model HPTT present output | 79 | 8 | Model HPTT present output | 90 | 11 | ||
Model output HPTT not present | 20 | 13 | Model output HPTT not present | 9 | 10 | ||
CPr |
CPr |
CLoc |
CLoc |
|||
---|---|---|---|---|---|---|
Sensitivity [95% CI] | 0.800 [0.719; 0.877] | 0.365 [0.268; 0.460] | ||||
Specificity [95% CI] | 0.476 [0.263; 0.690] | 0.257 | 0.807 [0.759; 0.854] | 0.910 | ||
Positive predictive value [95% CI] | 0.891 [0.830; 0.951] | 0.507 | 0.407 [0.303; 0.511] | 0.089 | ||
Negative predictive value [95% CI] | 0.394 [0.227; 0.560] | 0.205 | 0.777 [0.728; 0.827] | |||
Accuracy [95% CI] | 0.767 [0.681; 0.839] | 0.689 [0.638; 0.736] | ||||
AUCROC | 0.815 | / | 0.702 |
CLoc |
CLoc |
||
---|---|---|---|
Sensitivity [95% CI] | 0.552 [0.453; 0.652] | ||
Specificity [95% CI] | 0.811 [0.763; 0.858] | ||
Positive predictive value [95% CI] | 0.515 [0.418; 0.611] | ||
Negative predictive value [95% CI] | 0.833 [0.787; 0.878] | ||
Accuracy [95% CI] | 0.742 [0.693; 0.786] |
Model name | mRN10 | RN10 | |||||
---|---|---|---|---|---|---|---|
parameters # Trainable (millions) | 33.5 | 14.3 | 46.2 | 85.2 | 112.9 | 85.2 | 85.2 |
Optimal learning initial rate | 0.0136 | 0.0136 | 2.15*10-3 | 1.47*10-4 | 0.316 | 1.47*10-4 | 2.15*10-3 |
Mean CPr AUCROC [95% CI] | 0.754 [0.624; 0.980] | 0.527 [0.410; 0.639] | 0.703 [0.606; 0.905] | 0.739 [0.486; 0.998] | 0.752 [0.653; 0.966] |