Information OSCE

This OSCE presents a clinical case and then monitors the user's use of websites and asks the learner to submit answers when done.

Click here to obtain the installation files.

Presentations based on this OSCE:

Badgett R, Hunt DK. Information OSCE. J Gen Intern Med 2007;22 (supplememt 1):193. Presented at the 2007 SGIM Annual Meeting. Toronto, CA. (8.9 meg pdf - see page 193)

Badgett RG, Hunt DK. Novel Information OSCE. APDIM Spring Conference. San Diego, CA 4/2007 (received award for educational innovation)

References

1. Real-time EBM: from bed board to keyboard and back.

Stark R, Helenius IM, Schimming LM, Takahara N, Kronish I, Korenstein D.
J Gen Intern Med 2007;22(12):1656-60. PMID: 17922170
PubMed: Abstract
Fulltext options: CrossRef - EBSCO - OVID

Summary: "An inpatient EBM searching tutorial improved searching techniques of IM residents and resulted in increased comfort with MEDLINE and the Cochrane Library, but did not impact overall searching success."

2. Instruments for evaluating education in evidence-based practice: a systematic review.

Shaneyfelt T, Baum KD, Bell D, Feldstein D, Houston TK, Kaatz S, Whelan C, Green M.
JAMA 2006;296(9):1116-27. PMID: 16954491
PubMed: Abstract
Fulltext options: JAMA website - CrossRef - EBSCO - OVID

Summary: "Instruments with reasonable validity are available for evaluating some domains of EBP and may be targeted to different evaluation needs. Further development and testing is required to evaluate EBP attitudes, behaviors, and more recently articulated EBP skills."

3. Development of an evaluation of medical student competence in evidence-based medicine using a computer-based OSCE station.

Frohna JG, Gruppen LD, Fliegel JE, Mangrulkar RS.
Teach Learn Med 2006;18(3):267-72. PMID: 16776616
PubMed: Abstract
Fulltext options: CrossRef - EBSCO - OVID

Summary: "This computer-based tool appears to measure several EBM skills independently and combines simple administration and scoring. Its generalizability to other cases and settings requires further study."

4. Introducing an evidence-based medicine curriculum into a family practice residency--is it effective?

Ross R, Verdieck A.
Acad Med 2003;78(4):412-7. PMID: 12691976
PubMed: Abstract
Fulltext options: EBSCO - OVID

Summary: "Administering a structured EBM curriculum increased residents' knowledge and use of EBM constructs during patient care."

5. A Web-based compendium of clinical questions and medical evidence to educate internal medicine residents.

Crowley SD, Owens TA, Schardt CM, Wardell SI, Peterson J, Garrison S, Keitz SA.
Acad Med 2003;78(3):270-4. PMID: 12634206
PubMed: Abstract
Fulltext options: EBSCO - OVID

Summary: " In summary, the use of an evidence-based critical appraisal resource led residents to engage the medical literature on behalf of their patients and influenced approximately half of their patient-care decisions. Residents benefited from questions previously searched by other residents, allowing them to address a wider spectrum of CQs during ward rotations."

6. A computer-based OSCE station to measure competence in evidence-based medicine skills in medical students.

Fliegel JE, Frohna JG, Mangrulkar RS.
Acad Med 2002;77(11):1157-8. PMID: 12431934
PubMed: Abstract
Fulltext options: EBSCO - OVID

Summary: "Although there are many curricula for teaching EBM concepts, there are few tools to measure whether students are competent in applying their EBM skills. Our pilot station appears to be an innovative and promising tool to measure several EBM skills independently. By being computer-based, it is relatively simple to administer, grade, and evaluate. While preliminary data show good inter-rater reliability with our use of a single case, future work will include further testing of reliability and assessment of different types of cases. We will also use the results of this assessment to drive continuous improvement in our EBM curriculum. The students who completed this pilot station had not received an extensive formal EBM curriculum, whereas future groups will. We also will explore whether scores on our station correlate with those on other OSCE stations that also assess critical thinking skills, or if scores correlate with a student's clinical grades or overall class standing. We hope to test these hypotheses: (1) skills used in EBM are useful and valid measures of critical thinking abilities in learners and (2) tools such as ours will help to measure these essential competencies."

7. Resident utilization of information technology.

Cabell CH, Schardt C, Sanders L, Corey GR, Keitz SA.
J Gen Intern Med 2001;16(12):838-44. PMID: 11903763
PubMed: Abstract
Fulltext options: J Gen Intern Med website - EBSCO - OVID

Summary: "A simple educational intervention can markedly increase resident searching activity."

8. Factors associated with successful answering of clinical questions using an information retrieval system.

Hersh WR, Crabtree MK, Hickam DH, Sacherek L, Rose L, Friedman CP.
Bull Med Libr Assoc 2000;88(4):323-31. PMID: 11055299
PubMed: Abstract
Fulltext options: EBSCO - OVID

Summary: "Medical and nurse-practitioner students obtained comparable benefits in the ability to answer clinical questions from use of the information retrieval system. Future research must examine strategies that improve successful search and retrieval of clinical questions posed by clinicians in practice."

9. Assessing the ability of medical students to apply evidence in practice: the potential of the OSCE.

Bradley P, Humphris G.
Med Educ 1999;33(11):815-7. PMID: 10583788
PubMed: Abstract
Fulltext options: Med Educ website - EBSCO - OVID

Summary: "Assessment is a powerful tool in promoting learning and adoption of such assessment strategies may help to address concerns surrounding apparent poor effect of critical appraisal training."

10. Effectiveness of clinician-selected electronic information resources for answering primary care physicians' information needs.

McKibbon KA, Fridsma DB.
J Am Med Inform Assoc ;13(6):653-9. PMID: 16929042
PubMed: Abstract
Fulltext options: J Am Med Inform Assoc website - CrossRef - EBSCO - OVID

Summary: "For the primary care physicians studied, electronic information resources of choice did not always provide support for finding correct answers to simulated clinical questions and in some instances, individual resources may have contributed to an initially correct answer becoming incorrect."

11. Factors associated with success in searching MEDLINE and applying evidence to answer clinical questions.

Hersh WR, Crabtree MK, Hickam DH, Sacherek L, Friedman CP, Tidmarsh P, Mosbaek C, Kraemer D.
J Am Med Inform Assoc ;9(3):283-93. PMID: 11971889
PubMed: Abstract
Fulltext options: EBSCO - OVID

Summary: "Medical and nurse practitioner students in this study were at best moderately successful at answering clinical questions correctly with the assistance of literature searching. The results confirm the importance of evaluating both search ability and the ability to use the resulting information to accomplish a clinical task."