You are here

Article Text

Article menu
Download PDFPDF
Extended report
Clinical science - Extended reports
Microsurgical lab testing is a reliable method for assessing ophthalmology residents’ surgical skills
  1. J B Taylor1,
  2. G Binenbaum3,
  3. P Tapino2,
  4. N J Volpe2
  1. 1
    Department of Ophthalmology, University of California—San Francisco, CA, USA
  2. 2
    Department of Ophthalmology, University of Pennsylvania School of Medicine, Scheie Eye Institute, Philadelphia, PA, USA
  3. 3
    Department of Ophthalmology, Children’s Hospital of Philadelphia, Philadelphia, PA, USA
  1. N J Volpe, Scheie Eye Institute, 51 North 39th Street, Philadelphia, PA 19104, USA; nickvolp{at}mail.med.upenn.edu

Abstract

Background: Formal assessment of clinical competencies is necessary to ensure that all residents are acquiring important skills and, in the United States, will soon become a requirement for residency programme accreditation by the Accreditation Council for Graduate Medical Education (ACGME). The Eye Surgical Skills Assessment Test (ESSAT), a laboratory-based surgical skills obstacle course, was developed in response to the need for improved tools for the assessment of surgical skills during residency. The ESSAT has previously been shown to have face and content validity, and in this study we sought to determine its inter-rater reliability and, to some extent, its construct validity.

Methods: Twenty-seven content experts (residency programme directors and faculty members involved with resident surgical training) watched videos of a junior resident and senior resident completing the three ESSAT stations (skin suturing, muscle recession, and phacoemulsification: wound construction & suturing technique) and completed assessment forms, both task-specific checklists and a global rating scale of performance.

Results: The ESSAT showed strong inter-rater reliability for determining whether a resident “passed” a threshold of competency at each station for both the checklists and global rating scale. In addition, for each station, the senior resident was consistently rated above a “passing” threshold using either assessment form, whereas the junior resident was more often rated below (94% vs 30% passing on completed forms).

Conclusion: These results, along with the findings of our face and content validity analysis, support the reliability and validity of the ESSAT, and indicate that it could be a useful tool for improving the assessment of surgical skill during residency. The ESSAT is a tool that all residency programmes could implement as a part of their ophthalmic surgical curriculum and competency assessment, and may be useful to set a threshold of competence that all residents would need to achieve prior to entering the operating room.

https://doi.org/10.1136/bjo.2007.123083

Statistics from Altmetric.com

    Request Permissions

    If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

    View Full Text

    Footnotes

    • Material in this manuscript was presented at the Association for University Professors of Ophthalmology Annual Meeting, February 2007, the Scheie Eye Institute 132nd Anniversary Meeting, May 2006 and the American Academy of Ophthalmology Annual Meeting, November 2006.

    • Competing interests: None.

    • JBT was supported by a Doris Duke Fellowship, and GB was supported by a Heed Fellowship and Society of Heed Fellows Fellowship.

    • Abbreviations:
      ACGME

      Accreditation Council for Graduate Medical Education

      ESSAT

      Eye Surgical Skills Assessment Test