Study on ranking ability evaluation for sensory assessors based on rank correlation andcluster analysis

Authors

SHI Bolin, Food and Agriculture Standardization Institute, China National Institute of Standardization, Beijing 100191, China
WANG Houyin, Food and Agriculture Standardization Institute, China National Institute of Standardization, Beijing 100191, China
HUAN Chang, Department of Computer Engineering and Science, Shanghai University, Shanghai 200444, China
ZHANG Lulu, Food and Agriculture Standardization Institute, China National Institute of Standardization, Beijing 100191, China
ZHI Ruicong, Food and Agriculture Standardization Institute, China National Institute of Standardization, Beijing 100191, China
XIE Nan, Food and Agriculture Standardization Institute, China National Institute of Standardization, Beijing 100191, China
ZHAO Lei, Food and Agriculture Standardization Institute, China National Institute of Standardization, Beijing 100191, China
CHEN Xiuhong, Food and Agriculture Standardization Institute, China National Institute of Standardization, Beijing 100191, China

Abstract

The commonly used tastes of sweet and sour were respectively set to six concentrations system as the test samples for ranking ability screening of sensory assessors. In consideration of the sensory adaption, 12 assessors were asked to rank three times to each taste. Firstly, the accuracy of every assessor was evaluated by Spearman test. And Kendall test was used to evaluate the repeatability of the assessor. Finally, the ranking ability of each assessor was evaluated and analyzed comprehensively through fusion the data characteristics of accuracy and repeatability by clustering analysis. The results were showed that No. 5 assessor need to be eliminated for his poor performance and No. 3 assessor need to be trained more, while No. 1, 6, 7, 8 assessors showed good ranking ability and No. 2, 4, 9, 10, 11, 12 could directly carry out the test because of their excellent ranking ability. It was also found that W value of Kendall test and r_s value of Spearman test were overall positively related. However, W value of Kendall test could distinguish the ability more accurately among assessors. This paper provides theoretical guidance and practical experience for assessor screening and maintenance in sensory analysis laboratory.

Publication Date

4-28-2015

First Page

71

Last Page

75,221

DOI

10.13652/j.issn.1003-5788.2015.02.014

Recommended Citation

Bolin, SHI; Houyin, WANG; Chang, HUAN; Lulu, ZHANG; Ruicong, ZHI; Nan, XIE; Lei, ZHAO; and Xiuhong, CHEN (2015) "Study on ranking ability evaluation for sensory assessors based on rank correlation andcluster analysis," Food and Machinery: Vol. 31: Iss. 2, Article 14.
DOI: 10.13652/j.issn.1003-5788.2015.02.014
Available at: https://www.ifoodmm.cn/journal/vol31/iss2/14

References

[1] 赵镭, 刘文. 感官分析技术应用指南［M］. 北京: 中国轻工业出版社, 2011.
[2] 史波林, 赵镭, 汪厚银, 等. 感官分析评价小组及成员表现评估技术动态分析［J］. 食品科学, 2014, 35(8): 29～35.
[3] Jian Bi, Kuesten C. Intraclass Correlation Coefficient (ICC): A Framework for monitoring and assessing performance of trained sensory panels and panelists［J］. Journal of Sensory Studies, 2012(27): 352～364.
[4] 郑日昌, 孙大强. 心理测量与测验［M］. 北京: 中国人民大学出版社, 2008.
[5] 中国合格评定国家认可中心, 国家认证认可监督管理委员会, 中国计量科学研究院, 等. GB/T 16291.1—2012 感官分析选拔、培训与管理评价员一般导则第1部分:优选评价员［S］. 北京: 中国标准出版社, 2012.
[6] 甘怡群, 张轶文, 邹玲. 心理与行为科学统计［M］. 北京: 北京大学出版社, 2009.
[7] 鲍贵. 评估者之间信度分析:从理论到实践［J］. 外语电化教学, 2010(132): 21～25.
[8] 李春林, 陈旭红. 应用多元统计分析［M］. 北京: 清华大学出版社, 2013.
[9] 王静龙. 非参数统计分析［M］. 北京: 高等教育出版社, 2012.