Impact of classification granularity on interdisciplinary performance assessment of research institutes and organizations

Figure 1.

Figure 2.

Figure 3.

Figure 4.

Figure 5.

Figure 6.

Figure 7.

Difinitions of research levels_

Research Level	Biomedical definition	Non-biomedical definition
1	Clinical observation	Applied technology
2	Clinical mix	Engineering-technological mix
3	Applied research	Applied research
4	Basic research	Basic scientific research

The average rankings of four organizations_

Society	The mean of rankings
	macro level	meso level	micro level
FHG	74.67	113.19	128.86
HGF	97.83	55.06	37.22
WGL	161.31	141.31	136.72
MPG	157.49	152.80	147.79

Regression analysis of factors affecting ranking changes_

Change of levels	variables	coef	sth err	t	P>|t|	[0.025	0.975]	R-squared
From Macro to Meso	intercept	−16.9987	5.032	−3.378	0.001	−27.038	−6.959	0.73
	Ranking change of variety	0.2577	0.051	5.064	0	0.156	0.359
	Ranking change of evenness	0.6059	0.06	10.101	0	0.486	0.726
	Ranking change of disparity	0.5397	0.08	6.747	0	0.38	0.699
From Meso to Micro	intercept	−5.5774	1.768	−3.154	0.002	−9.105	−2.05	0.638
	Ranking change of variety	−0.176	0.076	−2.322	0.023	−0.327	−0.025
	Ranking change of evenness	0.3443	0.07	4.931	0	0.205	0.484
	Ranking change of disparity	0.8479	0.127	6.672	0	0.594	1.101

Number of meso- and micro-level categories in each macro level category_

Macro category	Number of meso level categories	Number of micro level categories	Share of publications
			FHG	HGF	MPG	WGL
1 Clinical & Life Sciences	132	915	0.13	0.25	0.25	0.24
2 Chemistry	37	265	0.16	0.15	0.14	0.14
3 Agriculture, Environment & Ecology	28	221	0.04	0.09	0.07	0.18
4 Electrical Engineering, Electronics & Computer Science	27	170	0.32	0.09	0.05	0.04
5 Physics	26	210	0.15	0.21	0.36	0.15
6 Social Sciences	24	246	0.05	0.02	0.04	0.15
7 Engineering & Materials Science	20	141	0.13	0.08	0.02	0.02
8 Earth Sciences	12	68	0.02	0.10	0.05	0.06
9 Mathematics	12	93	0.01	0.01	0.02	0.01
10 Arts & Humanities	8	62	0.00	0.00	0.01	0.00

Proportions of applied research of four societies_

Society	Number of applied research papers	Number of all papers	Proportion
HGF	69,028	115,188	0.60
MPG	20,169	64,712	0.31
WGL	24,509	40,389	0.61
FHG	12,135	14,037	0.86

Average share of publications in each cluster across macro categories_

macro	Cluster
	1	2	3	4	5	6	7
1 Clinical & Life Sciences	0.7458	0.0990	0.0278	0.0732	0.0716	0.1757	0.0769
2 Chemistry	0.0849	0.0023	0.1192	0.0126	0.3456	0.0425	0.0378
3 Agriculture, Environment & Ecology	0.0776	0.0226	0.0048	0.0072	0.0335	0.6720	0.2147
4 Electrical Engineering, Electronics & Computer Science	0.0279	0.0570	0.0277	0.7334	0.1415	0.0161	0.0360
5 Physics	0.0132	0.0028	0.7842	0.0262	0.1581	0.0044	0.0280
6 Social Sciences	0.0228	0.7176	0.0043	0.1093	0.0218	0.0332	0.0606
7 Engineering & Materials Science	0.0091	0.0025	0.0180	0.0148	0.1759	0.0062	0.0607
8 Earth Sciences	0.0069	0.0068	0.0095	0.0099	0.0126	0.0489	0.4670
9 Mathematics	0.0072	0.0046	0.0039	0.0078	0.0377	0.0005	0.0080
10 Arts & Humanities	0.0047	0.0848	0.0005	0.0057	0.0015	0.0005	0.0103

Numbers of each type of institutes in the four societies_

Society	Type of institute	Number of institutes
HGF	BRI	6
	MRI	12
	ARI	0
MPG	BRI	58
	MRI	14
	ARI	9
WGL	BRI	21
	MRI	36
	ARI	30
FHG	BRI	1
	MRI	23
	ARI	46

Effects of organization and institution type on Ranking Changes_

	coef	sth err	t	P>|t|	[0.025	0.975]
Intercept	−46.3744	9.5920	−4.8347	0.0000	−65.2661	−27.4827
sektor[T.HGF]	122.3198	28.6161	4.2745	0.0000	65.9594	178.6803
sektor[T.MPG]	52.2014	15.0183	3.4759	0.0006	22.6223	81.7805
sektor[T.WGL]	55.2645	12.3258	4.4837	0.0000	30.9885	79.5405
inst_type[T.BFI]	13.1273	13.9912	0.9383	0.3490	−14.4288	40.6835
inst_type[T.MFI]	−2.1380	11.9009	−0.1797	0.8576	−25.5773	21.3013
count_paper	−0.0001	0.0033	−0.0162	0.9871	−0.0065	0.0064