Open Access

CiteOpinion: Evidence-based Evaluation Tool for Academic Contributions of Research Papers Based on Citing Sentences


Cite

Figure 1

Diagram for Concept of Citation Content.
Diagram for Concept of Citation Content.

Figure 2

Measurement framework for academic contribution of representative paper.
Measurement framework for academic contribution of representative paper.

Figure 3

CiteOpinion system framework.
CiteOpinion system framework.

Figure 4

Move structure category recognition model.
Move structure category recognition model.

Figure 5

Changes in major new research topics of representative paper’s citing papers.
Changes in major new research topics of representative paper’s citing papers.

Figure 6

Distribution of representative work’s citing sentences in different disciplines.
Distribution of representative work’s citing sentences in different disciplines.

Comparison of contribution points of representative work and citing sentences.

Contribution points mentioned by the author in the original representative workWe describe a new learning procedure, back-propagation, for networks of neurone-like units.
Contribution points mentioned in the citing sentences1. In MBGD, the learning rate is very important to the convergence speed and quality in training. Many different schemes, e.g., momentum [6], averaging [15], AdaGrad [16], RMSProp [17], Adam [18], etc., have been proposed to optimize the learning rate in neural network training. Adam may be the most popular one among them. [43.84%]
2. As for the extrapolation, a smooth activation function that only acts on the hidden layer(s) is recommended. Back-propagation is the second part of the algorithm [37]. This is the central mechanism that allows neural network methods to “learn.” [42.36%]
3. The feedforward multilayer perceptron is one of the most popular types of ANNs; it was developed by Rumelhart et al. [23], and it is presented in Supplementary 1. This network also consists of an input layer, one or more hidden layers, and one output layer. [10.95%]

Highlights of citing sentences praising the contribution point as a breakthrough.

Highlights of Citing SentenceTitles of Citing Paper
1The steepest descent algorithm, also known as the error backpropagation (EBP) algorithm [8,9], dispersed the dark clouds on the field of artificial neural networks and could be regarded as one of the most significant breakthroughs for training neural networks.Application of Neural Networks to Automatic Load Frequency Control
2In addition to the development of new ANN algorithms that were more neural-inspired (e.g. Hopfield networks), another major breakthrough that helped lead to a resurgence in neural network research was the rediscovery of the backpropagation technique (LeCun, 1985, Rumelhart et al., 1986, Werbos, 1990).A historical survey of algorithms and hardware architectures for neural-inspired and neuromorphic computing applications
3The next major breakthrough happened in late 80s with the invention of back-propagation and a gradient-based optimization algorithm to train a neural network with one or two hidden layers with any desired number of nodes (Rumelhart et al., 1986).Meta-analysis of deep neural networks in remote sensing: A comparative study of mono-temporal classification to support vector machines

Representative papers of Geoffrey Hinton.

#AuthorRepresentative PapersCiting Papers
1Hinton GeoffreyDeep learning7,630
2Hinton GeoffreyReducing the dimensionality of data with neural networks4,509
3Hinton GeoffreyA fast learning algorithm for deep belief nets4,538
4Hinton GeoffreyLearning representations by back propagating errors6,598
5Hinton GeoffreyDropout: A Simple Way to Prevent Neural Networks from4,142
Overfitting

Sentiment categorization of citing sentences.

Sentiment CategoryDefinitionSentiment Score
Range (E)
PositiveHolding commendatory, approving and admiring attitude1>E>0
NeutralBrief statement or rephrasing, without obvious expression of sentimentE=0
NegativeDescribing defects, shortcomings or mistakes0>E>-1

Comparison between CiteOpinion and Conventional Quantitative Analysis Tools.

Quantitative Analysis ToolCiteOpinion
Data objectMetadata of paperCiting sentences
Data granularityArticleSentence
Analysis focusStatistical indicatorsText content mining
Result formRelationship diagrams and data sheetsEvaluation evidence text, relationship diagrams and data sheets
eISSN:
2543-683X
Language:
English
Publication timeframe:
4 times per year
Journal Subjects:
Computer Sciences, Information Technology, Project Management, Databases and Data Mining