Category | Source | Description |
---|---|---|
Application | Tsai et al. (2013) | Describes existing application of the core problem and method in this article |
Dataset | Describes related datasets to this article | |
Evaluation | Describes related evaluation methods to this article | |
Method | Huang & Wan (2013) | Describes previous work related to the core method of the article |
Method+ Problem | Describes the core method of the article and introduces what problems it can be used to solve | |
Problem | Kondo et al. (2009) | Describes previous work related to the core research problem of the article |
Problem+ Method | Describes the core research problem of the article and introduces the existing method to the problem | |
Tool | Describes related tools used in this article | |
Topic-irrelevant | Describes previous work not very relevant |
Candidate paper list | |
Rank papers by relevance scores | |
Add candidate paper into new recommendation list | |
Continue | |
New recommendation list |
Metrics | Runs | Top 5 | Top 10 | Top 20 | Top 30 |
---|---|---|---|---|---|
Precision | BM25 | 10.6% | 12.6% | 7.1% | 6.0% |
W2V-VSM | 12.8% | 12.0% | 10.8% | 8.9% | |
TFW-BM25 | 13.6% | 16.6% | 9.6% | 7.4% | |
TFW-W2V-VSM | |||||
Recall | BM25 | 14.9% | 35.1% | 40.0% | 50.6% |
W2V-VSM | 17.5% | 38.7% | 48.9% | 58.6% | |
TFW-BM25 | 19.0% | 46.4% | 53.6% | 61.9% | |
TFW-W2V-VSM | |||||
F1-score | BM25 | 12.4% | 18.5% | 12.1% | 10.7% |
W2V-VSM | 14.8% | 18.3% | 17.7% | 17.2% | |
TFW-BM25 | 17.5% | 24.5% | 16.3% | 13.2% | |
TFW-W2V-VSM |
Classification of term function | Authors |
---|---|
Head, goal, method, other | Kondo (2009) |
Technology, effect | Nanba, Kondo, & Takezawa (2010) |
Focus, technique, domain | Gupta & Manning (2012) |
Technique, application | Tsai, Kundu, & Roth (2013) |
Method, task, other | Huang & Wan (2013) |
Domain-independent: Research topic, Research method | |
Domain-related: Case, tool, dataset, etc. |
Metrics | Runs | Top 5 | Top 10 | Top 20 | Top 30 |
---|---|---|---|---|---|
Precision | BM25 | 11.1% | 10.5% | 8.2% | 7.0% |
W2V-VSM | 13.6% | 12.9% | 10.5% | 9.5% | |
TFW-BM25 | 12.9% | 13.0% | 9.1% | 8.2% | |
TFW-W2V-VSM | |||||
Recall | BM25 | 15.6% | 29.6% | 46.3% | 59.3% |
W2V-VSM | 19.5% | 34.3% | 52.6% | 67.9% | |
TFW-BM25 | 18.1% | 36.7% | 51.5% | 69.6% | |
TFW-W2V-VSM | |||||
F1-score | BM25 | 13.0% | 15.5% | 13.9% | 12.5% |
W2V-VSM | 16.0% | 18.7% | 17.5% | 16.7% | |
TFW-BM25 | 15.1% | 19.2% | 15.4% | 17.2% | |
TFW-W2V-VSM |
Metrics | Runs | Top 5 | Top 10 | Top 20 | Top 30 |
---|---|---|---|---|---|
Precision | BM25 | 14.3% | 12.1% | 7.5% | 6.4% |
W2V-VSM | 16.4% | 14.8% | 12.3% | 11.7% | |
TFW-BM25 | 17.1% | 15.7% | 10.7% | 8.3% | |
TFW-W2V-VSM | |||||
Recall | BM25 | 21.3% | 36.2% | 44.7% | 57.4% |
W2V-VSM | 24.7% | 44.4% | 54.2% | 73.1% | |
TFW-BM25 | 25.5% | 46.8% | 63.8% | 74.5% | |
TFW-W2V-VSM | |||||
F1-score | BM25 | 17.1% | 18.1% | 12.8% | 11.5% |
W2V-VSM | 19.7% | 21.9% | 20.0% | 20.2% | |
TFW-BM25 | 20.5% | 23.5% | 18.3% | 14.9% | |
TFW-W2V-VSM |