UMLS | ||||
---|---|---|---|---|
Symmetry | Antisymmetry | Inversion | Composition | |
ComplEx | - | 0.8806 | 0.8615 | 0.8732 |
Rotate | - | 0.9065 | 0.9069 | 0.9141 |
HAKE | - | 0.8558 | 0.8650 | 0.8723 |
LineaRE | - | 0.9446 | 0.9441 | 0.9490 |
ContE | - |
Nations | ||||
---|---|---|---|---|
MRR | Hits@N | |||
1 | 3 | 10 | ||
TransE ( |
0.4813 | 0.2189 | 0.6667 | 0.9801 |
DistMult ( |
0.7131 | 0.5970 | 0.7761 | 0.9776 |
ComplEx ( |
0.6677 | 0.5274 | 0.7413 | 0.9776 |
ConvE ( |
0.5616 | 0.3470 | 0.7155 | 0.9946 |
Rotate ( |
0.7155 | 0.5796 | 0.7985 | 1.0 |
HAKE ( |
0.7157 | 0.5945 | 0.7786 | 0.9851 |
LineaRE ( |
0.8146 | 0.7114 | 0.8881 | 0.9975 |
ContE |
Models | #Parameters | Time Complexity |
---|---|---|
TransE | ||
NTN | ||
ComplEx | ||
TransR | ||
SimplE | ||
ContE |
Dataset | | |
| |
|training| | |validation| | |test| |
---|---|---|---|---|---|
14,541 | 237 | 272,115 | 17,535 | 20,466 | |
135 | 46 | 5,216 | 652 | 661 | |
14 | 55 | 1,592 | 199 | 201 | |
271 | 2 | 1,111 | 24 | 24 | |
271 | 2 | 1,063 | 24 | 24 | |
271 | 2 | 985 | 24 | 24 |
FB15K-237 | ||||
---|---|---|---|---|
MRR | Hits@N | |||
1 | 3 | 10 | ||
TransE ( |
0.279 | 0.198 | 0.376 | 0.441 |
DistMult ( |
0.281 | 0.199 | 0.301 | 0.446 |
ComplEx ( |
0.278 | 0.194 | 0.297 | 0.45 |
ConvE ( |
0.312 | 0.225 | 0.341 | 0.497 |
ConvKB ( |
0.289 | 0.198 | 0.324 | 0.471 |
R-GCN ( |
0.164 | 0.10 | 0.181 | 0.30 |
SimplE ( |
0.169 | 0.095 | 0.179 | 0.327 |
CapsE ( |
0.150 | - | - | 0.356 |
Rotate ( |
0.338 | 0.241 | 0.375 | 0.533 |
ContE |
UMLS | ||||
---|---|---|---|---|
MRR | Hits@N | |||
1 | 3 | 10 | ||
TransE ( |
0.7966 | 0.6452 | 0.9418 | 0.9841 |
DistMult ( |
0.868 | 0.821 | - | 0.967 |
ComplEx ( |
0.8753 | 0.7942 | 0.9531 | 0.9713 |
ConvE ( |
0.957 | 0.932 | - | 0.994 |
NeuralLP ( |
0.778 | 0.643 | - | 0.962 |
NTP-λ ( |
0.912 | 0.843 | - | 1.0 |
MINERVA ( |
0.825 | 0.728 | - | 0.968 |
KGRRS+ComplEx ( |
0.929 | 0.887 | - | 0.985 |
KGRRS+ConvE ( |
0.940 | 0.902 | - | 0.992 |
Rotate ( |
0.9274 | 0.8744 | 0.9788 | 0.9947 |
HAKE ( |
0.8928 | 0.8366 | 0.9387 | 0.9849 |
LineaRE ( |
0.9508 | 0.9145 | 0.9992 | |
ContE | 0.9811 |
Model | Scoring function |
Parameters |
---|---|---|
TransE | || |
|
ComplEx |
|
|
SimplE |
|
|
ConvE |
|
|
ConvKB | ||
Rotate | || |
|
HAKE | || |
|
− |
||
ContE | < |
Countries_S2 | Countries_S3 | |||||||
---|---|---|---|---|---|---|---|---|
MRR | Hits@N | MRR | Hits@N | |||||
1 | 3 | 10 | 1 | 3 | 10 | |||
TransE | 0.6997 | 0.50 | 0.9375 | 1.0 | 0.1206 | 0.00 | 0.0833 | 0.3542 |
DistMult | 0.7813 | 0.5833 | 1.0 | 1.0 | 0.2496 | 0.0625 | 0.333 | 0.6250 |
ComplEx | 0.7934 | 0.6042 | 0.2731 | 0.0833 | 0.3958 | |||
Rotate | 0.6979 | 0.4792 | 0.9583 | 1.0 | 0.1299 | 0.00 | 0.0833 | 0.4792 |
HAKE | 0.6667 | 0.4583 | 0.8333 | 0.9583 | 0.2472 | 0.0625 | 0.3333 | 0.5417 |
LineaRE | 0.7873 | 0.6458 | 0.9583 | 0.9792 | 0.2393 | 0.0625 | 0.3542 | 0.5208 |
ContE | 0.9583 | 0.9792 | 0.625 |
Model | Symmetry | Antisymmetry | Inversion | Composition |
---|---|---|---|---|
TransE ( |
× | ✓ | ✓ | ✓ |
DistMult ( |
✓ | × | × | × |
ComplEx ( |
✓ | ✓ | ✓ | × |
SimplE ( |
✓ | ✓ | ✓ | × |
ConvE ( |
− | − | − | − |
ConvKB ( |
− | − | − | − |
RotatE ( |
✓ | ✓ | ✓ | ✓ |
HAKE ( |
✓ | ✓ | ✓ | ✓ |
KGCR ( |
✓ | ✓ | ✓ | × |
LineaRE ( |
✓ | ✓ | ✓ | ✓ |
ContE | ✓ | ✓ | ✓ | ✓ |
Countries_S1 | ||||
---|---|---|---|---|
MRR | Hits@N | |||
1 | 3 | 10 | ||
TransE ( |
0.8785 | 0.7708 | 1.0 | 1.0 |
DistMult ( |
0.9028 | 0.8125 | 1.0 | 1.0 |
ComplEx ( |
0.9792 | 0.9583 | 1.0 | 1.0 |
Rotate ( |
0.8750 | 0.7708 | 1.0 | 1.0 |
HAKE ( |
0.9045 | 0.8333 | 0.9792 | 1.0 |
LineaRE ( |
1.0 | 1.0 | 1.0 | 1.0 |
Nations | ||||
---|---|---|---|---|
Symmetry | Antisymmetry | Inversion | Composition | |
ComplEx | - | 0.6499 | 0.6487 | 0.6499 |
Rotate | - | 0.6825 | 0.6970 | 0.6907 |
HAKE | - | 0.6953 | 0.6835 | 0.6844 |
LineaRE | - | 0.8189 | 0.8240 | |
ContE | - | 0.8303 |