<abstract xmlns="http://www.w3.org/1999/xhtml"><sec id="j_jdis-2017-0020_s_005_w2aab3b7b4b1b6b1aab1c17b1Aa"><h3>Purpose</h3><p>This paper proposes an expert assignment method for scientific project review that considers both accuracy and impartiality. As impartial and accurate peer review is extremely important to ensure the quality and feasibility of scientific projects, enhanced methods for managing the process are needed.</p></sec><sec id="j_jdis-2017-0020_s_006_w2aab3b7b4b1b6b1aab1c17b2Aa"><h3>Design/methodology/approach</h3><p>To ensure both accuracy and impartiality, we design four criteria, the reviewers’ <italic>fitness degree</italic>, <italic>research intensity</italic>, <italic>academic association</italic>, and potential <italic>conflict of interest</italic>, to express the characteristics of an appropriate peer review expert. We first formalize the expert assignment problem as an optimization problem based on the designed criteria, and then propose a randomized algorithm to solve the expert assignment problem of identifying reviewer adequacy.</p></sec><sec id="j_jdis-2017-0020_s_007_w2aab3b7b4b1b6b1aab1c17b3Aa"><h3>Findings</h3><p>Simulation results show that the proposed method is quite accurate and impartial during expert assignment.</p></sec><sec id="j_jdis-2017-0020_s_008_w2aab3b7b4b1b6b1aab1c17b4Aa"><h3>Research limitations</h3><p>Although the criteria used in this paper can properly show the characteristics of a good and appropriate peer review expert, more criteria/conditions can be included in the proposed scheme to further enhance accuracy and impartiality of the expert assignment.</p></sec><sec id="j_jdis-2017-0020_s_009_w2aab3b7b4b1b6b1aab1c17b5Aa"><h3>Practical implications</h3><p>The proposed method can help project funding agencies (e.g. the National Natural Science Foundation of China) find better experts for project peer review.</p></sec><sec id="j_jdis-2017-0020_s_010_w2aab3b7b4b1b6b1aab1c17b6Aa"><h3>Originality/value</h3><p>To the authors’ knowledge, this is the first publication that proposes an algorithm that applies an impartial approach to the project review expert assignment process. The simulation results show the effectiveness of the proposed method.</p></sec></abstract>

PurposeThis paper proposes an expert assignment method for scientific project review that considers both accuracy and impartiality. As impartial and accurate peer review is extremely important to ensure the quality and feasibility of scientific projects, enhanced methods for managing the process are needed.Design/methodology/approachTo ensure both accuracy and impartiality, we design four criteria, the reviewers’ fitness degree, research intensity, academic association, and potential conflict of interest, to express the characteristics of an appropriate peer review expert. We first formalize the expert assignment problem as an optimization problem based on the designed criteria, and then propose a randomized algorithm to solve the expert assignment problem of identifying reviewer adequacy.FindingsSimulation results show that the proposed method is quite accurate and impartial during expert assignment.Research limitationsAlthough the criteria used in this paper can properly show the characteristics of a good and appropriate peer review expert, more criteria/conditions can be included in the proposed scheme to further enhance accuracy and impartiality of the expert assignment.Practical implicationsThe proposed method can help project funding agencies (e.g. the National Natural Science Foundation of China) find better experts for project peer review.Originality/valueTo the authors’ knowledge, this is the first publication that proposes an algorithm that applies an impartial approach to the project review expert assignment process. The simulation results show the effectiveness of the proposed method.

An Accurate and Impartial Expert Assignment Method for Scientific Project Review

Journal of Data and Information Science

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

{"article-title":"An Accurate and Impartial Expert Assignment Method for Scientific Project Review"}

PurposeThis paper proposes an expert assignment method for scientific project review that considers both accuracy and impartiality. As impartial and accurate...

An Accurate and Impartial Expert Assignment Method for Scientific Project Review

Article Category: Research Paper

Online veröffentlicht: 29. Dez. 2017

Seitenbereich: 65 - 80

Eingereicht: 23. Juni 2017

Akzeptiert: 06. Nov. 2017

DOI: https://doi.org/10.1515/jdis-2017-0020

Schlüsselwörter
Expert assignment, Accuracy, Impartiality, Randomized algorithm

© 2017 Walter de Gruyter GmbH, Berlin/Boston

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

An Accurate and Impartial Expert Assignment Method for Scientific Project Review

Article Category: Research Paper

Online veröffentlicht: 29. Dez. 2017

Seitenbereich: 65 - 80

Eingereicht: 23. Juni 2017

Akzeptiert: 06. Nov. 2017

DOI: https://doi.org/10.1515/jdis-2017-0020

SchlüsselwörterExpert assignment, Accuracy, Impartiality, Randomized algorithm

© 2017 Walter de Gruyter GmbH, Berlin/Boston

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Schlüsselwörter
Expert assignment, Accuracy, Impartiality, Randomized algorithm