Research project evaluation and selection is mainly concerned with evaluating a number of research projects and then choosing some of them for implementation. It involves a complex multiple-experts multiple-criteria decision making process. Thus this paper presents an effective method for evaluating and selecting research projects by using the recently-developed evidential reasoning (ER) rule. The proposed ER rule based evaluation and selection method mainly includes (1) using belief structures to represent peer review information provided by multiple experts, (2) employing a confusion matrix for generating experts’ reliabilities, (3) implementing utility based information transformation to handle qualitative evaluation criteria with different evaluation grades, and (4) aggregating multiple experts’ evaluation information on multiple criteria using the ER rule. An experimental study on the evaluation and selection of research proposals submitted to the National Science Foundation of China demonstrates the applicability and effectiveness of the proposed method. The results show that (1) the ER rule based method can provide consistent and informative support to make informed decisions, and (2) the reliabilities of the review information provided by different experts should be taken into account in a rational research project evaluation and selection process, as they have a significant influence to the selection of eligible projects for panel review.
In the process industry, an alarm system is one of the important ways of condition monitoring. Due to the complexity and irregularity of process information in condition monitoring, there are too many false alarms in the current alarm system. In order to solve the problem of designing an alarm system, this paper proposes a multivariate alarm design method based on the evidence reasoning (ER) rule, considering interval-valued reliability, which can make full use of process information to make accurate alarm decisions. Firstly, the referential evidence matrixes (REMs) are constructed based on the training samples of process variables, and the real-time samples of the process variables are converted into alarm evidence by activating the REMs. Alarm evidence is then fused by the ER rule. In this fusion process, in order to better describe the uncertainty of the process information, the reliability of the alarm evidence is characterized by random variables with certain probability distributions, and it can be adjusted in dynamic intervals according to the real-time change of alarm evidence. Finally, the reactor fault case is implemented in the Tennessee Eastman (TE) process, which shows that the adjustment of interval-valued reliability can adapt to the irregular change of process information and obtains consistent alarm results to further improve the accuracy of alarm decisions.
A single highly cited article can give a big but temporary lift in its host journal's impact factor evidenced by the striking example of "A short history of SHELX" published in Acta Crystallographica Section A. By using Journal Citation Reports and Web of Science's citation analysis tool, we find a more general and continuous form of this phenomenon in the Particle Physics field. The highly-cited "Review of Particle Physics" series have been published in one of the major Particle Physics journals biennially. This study analyses the effect of these articles on the Impact Factor (IF) of the host journals. The results show that the publication of Review of Particle Physics articles has a direct effect of lifting the IF of its host journal. However the effect on the IF varies according to whether the host journal already has a relatively high or low IF, and the number of articles that it publishes. The impact of these highly cited articles clearly demonstrates the limitations of journal impact factor, and endorses the need to use it more wisely when deciding where to publish and how to evaluate the relative impact of a journal.