<abstract xmlns="http://www.w3.org/1999/xhtml">

<sec><h3>Purpose</h3>
<p>The adequacy of research performance of universities or research institutes have often been evaluated and understood in two axes: “quantity” (i.e. size or volume) and “quality” (i.e. what we define here as a measure of excellence that is considered theoretically independent of size or volume, such as clarity in diamond grading). The purpose of this article is, however, to introduce a third construct named “substantiality” (“ATSUMI” in Japanese) of research performance and to demonstrate its importance in evaluating/understanding research universities.</p>
</sec>
<sec><h3>Design/methodology/approach</h3>
<p>We take a two-step approach to demonstrate the effectiveness of the proposed construct by showing that (1) some characteristics of research universities are not well captured by the conventional constructs (“quantity” and “quality”)-based indicators, and (2) the “substantiality” indicators can capture them. Furthermore, by suggesting that “substantiality” indicators appear linked to the reputation that appeared in university reputation rankings by simple statistical analysis, we reveal additional benefits of the construct.</p>
</sec>
<sec><h3>Findings</h3>
<p>We propose a new construct named “substantiality” for measuring research performance. We show that indicators based on “substantiality” can capture important characteristics of research institutes. “Substantiality” indicators demonstrate their “predictive powers” on research reputation.</p>
</sec>
<sec><h3>Research limitations</h3>
<p>The concept of “substantiality” originated from IGO game; therefore the ease/difficulty of accepting the concept is culturally dependent. In other words, while it is easily accepted by people from Japan and other East Asian countries and regions, it might be difficult for researchers from other cultural regions to accept it.</p>
</sec>
<sec><h3>Practical implications</h3>
<p>There is no simple solution to the challenge of evaluating research universities’ research performance. It is vital to combine different types of indicators to understand the excellence of research institutes. Substantiality indicators could be part of such a combination of indicators.</p>
</sec>
<sec><h3>Originality/value</h3>
<p>The authors propose a new construct named substantiality for measuring research performance. They show that indicators based on this construct can capture the important characteristics of research institutes.</p>
</sec>
</abstract>

Purpose
The adequacy of research performance of universities or research institutes have often been evaluated and understood in two axes: “quantity” (i.e. size or volume) and “quality” (i.e. what we define here as a measure of excellence that is considered theoretically independent of size or volume, such as clarity in diamond grading). The purpose of this article is, however, to introduce a third construct named “substantiality” (“ATSUMI” in Japanese) of research performance and to demonstrate its importance in evaluating/understanding research universities.

Design/methodology/approach
We take a two-step approach to demonstrate the effectiveness of the proposed construct by showing that (1) some characteristics of research universities are not well captured by the conventional constructs (“quantity” and “quality”)-based indicators, and (2) the “substantiality” indicators can capture them. Furthermore, by suggesting that “substantiality” indicators appear linked to the reputation that appeared in university reputation rankings by simple statistical analysis, we reveal additional benefits of the construct.

Findings
We propose a new construct named “substantiality” for measuring research performance. We show that indicators based on “substantiality” can capture important characteristics of research institutes. “Substantiality” indicators demonstrate their “predictive powers” on research reputation.

Research limitations
The concept of “substantiality” originated from IGO game; therefore the ease/difficulty of accepting the concept is culturally dependent. In other words, while it is easily accepted by people from Japan and other East Asian countries and regions, it might be difficult for researchers from other cultural regions to accept it.

Practical implications
There is no simple solution to the challenge of evaluating research universities’ research performance. It is vital to combine different types of indicators to understand the excellence of research institutes. Substantiality indicators could be part of such a combination of indicators.

Originality/value
The authors propose a new construct named substantiality for measuring research performance. They show that indicators based on this construct can capture the important characteristics of research institutes.

Substantiality: A Construct Indicating Research Excellence to Measure University Research Performance

Journal of Data and Information Science

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Purpose
The adequacy of research performance of universities or research institutes have often been evaluated and understood in two axes: “quantity” (i.e. size...

Substantiality: A Construct Indicating Research Excellence to Measure University Research Performance

Article Category: Research Paper

Publicado en línea: 25 jul 2021

Páginas: 76 - 89

Recibido: 03 mar 2021

Aceptado: 06 jul 2021

DOI: https://doi.org/10.2478/jdis-2021-0029

Palabras clave
Substantiality, Research excellence, University research performance, Accumulation of excellent players

© 2021 Masashi Shirabe et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Substantiality: A Construct Indicating Research Excellence to Measure University Research Performance

Article Category: Research Paper

Publicado en línea: 25 jul 2021

Páginas: 76 - 89

Recibido: 03 mar 2021

Aceptado: 06 jul 2021

DOI: https://doi.org/10.2478/jdis-2021-0029

Palabras claveSubstantiality, Research excellence, University research performance, Accumulation of excellent players

© 2021 Masashi Shirabe et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Palabras clave
Substantiality, Research excellence, University research performance, Accumulation of excellent players