The evaluation of qualitative characteristics of fresh pig thighs to be used for seasoning is made by expert assessors, which divide the examined raw hams in different quality classes basing on their visual aspect. This evaluation is subjected to various risks connected to the subjectivity and to the changeability of the human eye. Therefore, to estimate quantitatively the degree of objectivity of human evaluation of visual aspect, digital RGB images were acquired on a series of 198 raw ham samples and then (by means of a graphical user interface implemented ad hoc) subjected repeatedly in random order to the classification by a panel of six expert assessors in three quality categories related to the red skin defect. The results obtained from the panel have been analysed by proper statistical tools on the basis of two performance indicators of the assessors: Validity, i.e., the correctness of the response, and Reliability, i.e., the ability of the assessor to reproduce his own results. Moreover, also the percentage of assignations of each sample to the correct class was estimated. The results suggest that the proposed approach can be used both to monitor the reliability of the single assessors, and to identify samples whose class assignation is reasonably indubitable, e.g. to be used for the development of automated classification methods.

Reproducibility evaluation of classification by expert assessors of raw ham red skin defect.

TASSONE, FRANCESCO;NANNI COSTA, LEONARDO
2008

Abstract

The evaluation of qualitative characteristics of fresh pig thighs to be used for seasoning is made by expert assessors, which divide the examined raw hams in different quality classes basing on their visual aspect. This evaluation is subjected to various risks connected to the subjectivity and to the changeability of the human eye. Therefore, to estimate quantitatively the degree of objectivity of human evaluation of visual aspect, digital RGB images were acquired on a series of 198 raw ham samples and then (by means of a graphical user interface implemented ad hoc) subjected repeatedly in random order to the classification by a panel of six expert assessors in three quality categories related to the red skin defect. The results obtained from the panel have been analysed by proper statistical tools on the basis of two performance indicators of the assessors: Validity, i.e., the correctness of the response, and Reliability, i.e., the ability of the assessor to reproduce his own results. Moreover, also the percentage of assignations of each sample to the correct class was estimated. The results suggest that the proposed approach can be used both to monitor the reliability of the single assessors, and to identify samples whose class assignation is reasonably indubitable, e.g. to be used for the development of automated classification methods.
Proceedings of the 6th International Symposium on the Mediterranean Pig.
360
365
Lo Fiego D.P.; Ulrici A. ; Ielo M.C.; Comellini M.; Tassone F. ; Nanni Costa L.
File in questo prodotto:
Eventuali allegati, non sono esposti

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11585/64601
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact