专家评审特征分析及专家反评估方法研究

doi:10.3969/j.issn.1007-7375.2020.06.017

工业工程 ›› 2020, Vol. 23 ›› Issue (6): 124-130,154.doi: 10.3969/j.issn.1007-7375.2020.06.017

专家评审特征分析及专家反评估方法研究

张尧¹, 林春²

1. 东北林业大学经济管理学院，黑龙江哈尔滨 150040;
2. 黑龙江东方学院计算机科学与电气工程学部，黑龙江哈尔滨 150066

收稿日期:2019-09-27 发布日期:2020-12-18
通讯作者: 林春(1977-),女,黑龙江省人,高级实验师,硕士,主要研究方向为高校实验室信息化.E-mail:87318435@qq.com E-mail:87318435@qq.com
作者简介:张尧(1981-)，男，黑龙江省人，讲师，博士，主要研究方向为农业信息化、国际农业合作
基金资助:
黑龙江省哲学社会科学研究规划资助项目(18GLE456)；黑龙江省教育科学“十三五”规划2019度重点资助课题(GJB1319117)；黑龙江省政府博士后资助项目(LBH-Z14021)；中央高校基本科研业务费专项资金资助项目(41413110)

The Review Characteristics of Expert and Anti-assessment Research

ZHANG Yao¹, LIN Chun²

1. College of Economics and Management, Northeast Forestry University, Harbin 150040, China;
2. Department of Computer Science and Electrical Engineering, East University of Heilongjiang, Harbin 150066, China

Received:2019-09-27 Published:2020-12-18

摘要/Abstract

摘要： 高质量专家库是公平、公正评审的保障，而对评审专家评审质量的监督和评价是建立高质量专家库的基础。首先针对评价维度提出了相应定量描述方法，利用整体网分析方法估计了专家的学术圈地位以反映专家的学术水平；利用Pearson相似性分析方法测算专家项目评分一致性及项目评价指标评分一致性，反映专家评审的评分可信度；通过对专家评审资助命中率及不资助命中率的综合分析讨论专家评审专业度的分析方法。最后利用TOPSIS评价方法，对评审专家进行评价，验证了本研究的理论及应用价值。

关键词: 专家特征, 评审水平评价, 整体网分析, Person相关, TOPSIS

Abstract: The high quality of expert database guarantees project reviews to be fair and just. Supervision and evaluation of experts review quality will benefit building high quality of expert database. Firstly whole network analysis method is used to estimate experts' power within the academic community to reflect their academic level. Secondly Pearson similarity analysis method is used to measure consistency in projects' score and project evaluation index score of experts reflect their credibility of expert. Thirdly through analyzing hit rate of project's support and no support, review professional level of experts is discussed. Finally TOPSIS evaluation method is used to evaluate review expert and verify the theoretical and application value of the research.

Key words: characteristics of expert, review level evaluations, whole network analysis, Pearson correlation, TOPSIS

中图分类号:

G311

张尧, 林春. 专家评审特征分析及专家反评估方法研究[J]. 工业工程, 2020, 23(6): 124-130,154.

ZHANG Yao, LIN Chun. The Review Characteristics of Expert and Anti-assessment Research[J]. Industrial Engineering Journal, 2020, 23(6): 124-130,154.

参考文献

[1] 万猛. 关于科技评审专家的选择及其评审行为的判断方法[J]. 研究与发展管理, 2007, 19(3): 119-122, 129
WAN Meng. The selection of science and technology appraisal expert and judgement method for their appraisal behavior[J]. R&D Management, 2007, 19(3): 119-122, 129
[2] 江笑颜, 李栋亮. 多层次、智能化的项目评审专家管理体系构建研究——基于广东科研项目评审专家管理的优化[J]. 科技管理研究, 2018, 38(16): 212-217
JIANG Xiaoyan, LI Dongliang. A multi-level intelligent project evaluation expert management system: based on the optimization of expert management of Guangdong research projects[J]. Science and Technology Management Research, 2018, 38(16): 212-217
[3] 张志清, 凡艳, 苏顺华. 基于SNA的科研项目评审专家选择与回避策略研究[J]. 武汉理工大学学报 (信息与管理工程版), 2016, 38(3): 367-371
ZHANG Zhiqing, FAN Yan, SU Shunhua. Strategy for experts selection and avoidance of scientific research project evaluation based on social network analysis[J]. Journal of Wuhan University of Technology (Information & Management Engineering), 2016, 38(3): 367-371
[4] 刘丹. 国内同行评议专家库研究综述[J]. 重庆大学学报 (社会科学版), 2012, 18(5): 87-91
LIU Dan. Review of domestic research on the experts database of peer review[J]. Journal of Chongqing University (Social Science Edition), 2012, 18(5): 87-91
[5] 徐林生, 王执铨, 戴跃伟. 评审专家可信度评价模型及应用[J]. 南京理工大学学报 (自然科学版), 2010, 34(1): 30-34
XU Linsheng, WANG Zhiquan, DAI Yuewei. Expert's credibility model and evaluation method[J]. Journal of Nanjing University of Science and Technology (Natural Science), 2010, 34(1): 30-34
[6] 高鑫, 杨如艳, 官晓飞, 等. 葡萄酒评酒专家评价的可信度量化模型及应用[J]. 云南农业大学学报, 2014, 29(2): 235-240
GAO Xin, YANG Ruyan, GUAN Xiaofei, et al. Wine professional sommelier's credibility model and evaluation method[J]. Journal of Yunnan Agricultural University (Natural Science), 2014, 29(2): 235-240
[7] 李旭彦, 宋英华, 杨晓秋. 基于PageRank的评审专家信誉度度量方法[J]. 科研管理, 2016, 37(3): 133-142
LI Xuyan, SONG Yinghua, YANG Xiaoqiu. Reviewer reputation measuring approach based on PageRank algorithm[J]. Science Research Management, 2016, 37(3): 133-142
[8] 赵亚娟. 专家群评价结果可信度分析与检验[J]. 中国科学技术大学学报, 2016, 46(2): 165-172
ZHAO Yajuan. Reliability analysis of group experts and testing of evaluation outcomes[J]. Journal of University of Science and Technology of China, 2016, 46(2): 165-172
[9] 蔡文学, 温旖旎, 郑顺潮, 等. 基于偏差度权重的科技项目评审专家绩效评价方法研究[J]. 科技管理研究, 2012, 32(15): 75-78, 83
CAI Wenxue, WEN Yini, ZHENG Shunchao, et al. Research on performance evaluation method of technology projects appraising experts based on deviation rate[J]. Science and Technology Management Research, 2012, 32(15): 75-78, 83
[10] 李海峰, 党延忠. 专家反评估与项目评价相结合的科技项目评审方法研究[J]. 科学学与科学技术管理, 2010(10): 59-63
LI Haifeng, DANG Yanzhong. Expert anti-assessment and project evaluation combined project review method research[J]. Science of Science and Management of Science & Technology, 2010(10): 59-63
[11] 朱红, 方文, 李青, 等. 基于模糊评价的评标专家考评管理机制研究[J]. 湖北省社会主义学院学报, 2017(1): 92-96
ZHU Hong, FANG Wen, LI Qing, et al. Research on evaluation management mechanism of experts based on fuzzy evaluation[J]. Journal of Hubei Institute of Socialism, 2017(1): 92-96
[12] 徐雯. 基于群决策-熵模型的评标专家可靠性评价[J]. 项目管理技术, 2018, 16(10): 7-10
XU Wen. Reliability evaluation of bid evaluation experts based on entropy model of group decision[J]. Project Management Technology, 2018, 16(10): 7-10
[13] 汪建, 王裴裴, 丁俊. 科技项目专家评审的元评价综合模型研究[J]. 科研管理, 2020, 41(2): 183-192
WANG Jian, WANG Peipei, DING Jun. A comprehensive model on the meta-evaluation of science and technology projects by review experts[J]. Science Research Management, 2020, 41(2): 183-192
[14] FREEMAN L C. Centrality in networks: I. conceptual clarification[J]. Social Networks., 1979, 1(3): 215-239
[15] CHO J, KWON K, PARK Y. Implicit user credibility extraction for reputation rating mechanism in B2C e-commerce[J]. International Journal of Intelligent Information and Database Systems, 2007, 1(3): 247-263
[16] WANG C L, YOON K. Multiple attribute decision making: methods and applications[M]. NewYork: Springer Verlag, 1981.

专家评审特征分析及专家反评估方法研究

The Review Characteristics of Expert and Anti-assessment Research

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 10

编辑推荐

Metrics

本文评价

[1]	卢建锋, 牟瑞芳, 赵佳虹, 王小霞. 危化品事故连续消耗型应急物资调度模型[J]. 工业工程, 2020, 23(5): 103-108,117.
[2]	孟子博, 牛占文, 刘超超. 预制构件厂精益设计方案评价研究[J]. 工业工程, 2020, 23(5): 140-148.
[3]	唐中君, 周亚丽. 结合区间理论熵权和TOPSIS的映前总票房区间预测[J]. 工业工程, 2020, 23(4): 75-83.
[4]	卢翔, 赵淼, 贾宝惠. 基于熵权-TOPSIS方法的民机直接维修成本分配模型[J]. 工业工程, 2019, 22(4): 12-17.
[5]	朱玉杰，李谚. 基于改进的TOPSIS法与RSR法的质量改善项目综合评估[J]. 工业工程, 2016, 19(3): 122-129.
[6]	汤良1,2，赵希男2. 基于理想点的DEA交叉效率评价研究[J]. 工业工程, 2015, 18(6): 93-96.
[7]	张峰，殷秀清，董会忠. 基于TRIZ理论的供料机效率提升改善研究[J]. 工业工程, 2014, 17(5): 53-58.
[8]	肖俊华1,2，侯云先1. 综合模糊TOPSIS决策的应急物资储备库多级覆盖选址模型[J]. 工业工程, 2013, 16(1): 91-98.
[9]	库洪锋，吴清烈. 基于TOPSIS算法的双边多议题智能协商[J]. 工业工程, 2012, 15(3): 52-56.
[10]	郑斌, 刘凤国. 重视熵权的供应商选择DEA/TOPSIS联合方法[J]. 工业工程, 2011, 14(6): 55-59.