Searching for an Alternative Method to Evaluate Surgical Knowledge: Does a Drawing Quiz Reflect Knowledge Gains and In-Service Exam Performance?
Jaclyn T. Mauch, B.A., Valeriy Shubinets, M.D., M.S., Benjamin Chang, M.D., Ines C. Lin, M.D.
Background: The best methods to assess surgical knowledge are still debated. We used a non-multiple-choice test as a pre- and post-conference assessment to measure residentsí knowledge gains with comparison to a standard summative assessment tool.
Methods: At one didactic conference, plastic surgery residents at a single institution were given a pre-test of drawing and labeling structures in the extensor mechanism of the finger and within the carpal tunnel. The quiz was followed by a lecture on the same material and a subsequent post-test. Scores were correlated with in-service exam performance.
Results: Pre-test scores (n=13) were positively correlated with PGY until PGY-3. Performance on labeling structures was higher than performance on the respective drawing prompt. Residentsí ability to label structures increased more strongly with PGY than their ability to draw structures. The post-test (n=8) demonstrated that teaching improves performance on labeling questions (pre-test score=62%; post-test score=87%). Improvement was observed across all PGYs. Pre-test results were positively correlated with in-service exam performance.
Conclusion: Our study suggests that a knowledge test focused on drawing and labeling structures given to surgical residents is a valid, nontraditional method for assessing resident knowledge. Such a quiz would offer programs an alternative method for regularly evaluating residents aside from in-service questions, in order to identify residents who may need targeted training for the in-service exam and to inform teaching plans. Additionally, residents could use quiz feedback to guide study efforts and prime conference-related learning.
Back to 2019 Abstracts