Reliable assessment of operative performance

详细信息    查看全文

• 作者：Elif Bilgic ; B.Sc.<sup>asup> ; Yusuke Watanabe ; M.D.<sup>asup><sup> ; sup><sup>bsup> ; Katherine McKendy ; M.D.<sup>asup> ; Amani Munshi ; M.D.<sup>asup> ; Yoichi M. Ito ; Ph.D.<sup>csup> ; Gerald M. Fried ; M.D.<sup>asup> ; Liane S. Feldman ; M.D.<sup>asup> ; Melina C. Vassiliou ; M.D. ; M.Ed<sup>asup><sup> ; sup><sup>melina.vassiliou@mcgill.ca" class="auth_mail" title="E-mail the corresponding authorsup>
• 关键词：Generalizability theory ; Reliability ; Surgery ; Assessment
• 刊名：The American Journal of Surgery
• 出版年：2016
• 出版时间：February 2016
• 年：2016
• 卷：211
• 期：2
• 页码：426-430
• 全文大小：208 K

文摘

There is no consensus regarding the number of intraoperative assessments required to reliably measure trainee performance. This study used generalizability theory (GT) to describe factors contributing to score variance and to estimate the number of assessments needed to achieve high standards of reliability.

sSec_2">Methods

spara0015">While performing laparoscopic procedures, trainees were assessed by the attending surgeon using Global Operative Assessment of Laparoscopic Skills (GOALS). Data were collected prospectively (2-month intervals), assessing each trainee multiple times. Reliability coefficient was calculated using trainees, cases, and raters as factors.

sSec_3">Results

spara0020">Eighteen trainees were included for a total of 65 assessments. Total variance in scores was accounted for as follows: 66.1% by trainees, 31.6% by the interaction between trainees and cases, and 2.3% by raters. At least 3 cases are required for reliable scores using GOALS.

sSec_4">Conclusions

spara0025">Trainees accounted for most of the variance in GOALS scores with a minimum of 3 cases required to improve the reliability of the scores obtained. These data may guide the implementation of performance assessments in surgical training programs.