Validity of self-assessment using electronic clinical cases in continuing medical education

June 6, 2017 8:00 AM – 9:15 AM

Arash Hadadgar, Karolinksa Institutet
Andrzej Kononowicz, Jagiellonian University
Tahereh Changiz, Isfahan University of Medical Sciences
Arash Najimi, Isfahan University of Medical Sciences
Nahidossadat Mirshahzadeh, Isfahan University of Medical Sciences
Nabil Zary , Karolinksa Institutet
Italo Masiello, Karolinksa Institutet

Introduction: There is evidence about physicians’ limited ability to self-assess their learning needs accurately. A combination of a self-driven approach validated by an automated external source may increase its accuracy. Electronic cases used for assessment could simulate the real patient encounter and the provision of tailored feedback. A valid assessment instrument requires the gathering of evidence in a systematic manner. This study aimed at analyzing the validity of self-assessment test with electronic cases in measuring general practitioners’ diagnosing and management competences of common infectious disease in an outpatient setting.

Methods: We designed a self-assessment with electronic cases in an eCME platform. The data collected were analyzed for five forms of evidence: content evidence, response process evidence, internal structure evidence, relations with other variables evidence and finally consequences evidence.

Results: 48 GPs participated in the study. More than 80% of the GPs’ were satisfied with the cases and the self-assessment and about 85% of them became more curious about antibiotic prescription after participation in the program. We couldn’t find any statistical significant association between the assessment scores and their previous actual prescription outcomes.

Discussion: Using electronic self-assessment cases as an eCME activity was perceived useful by GPs, but developing valid cases needs more interdisciplinary faculty involvement. We recommend using self-assessment as a tool to personalize learning at course level or even at CME level.