From the AOBS Chairman - Item Development/Construction

The American Osteopathic Board of Surgery (AOBS) uses both science and time tested methodologies for writing high stakes exam questions for its 21 separate board certification and recertification exams it offers annually to board-eligible osteopathic surgeons. All items on written tests are single, positive one-best answer, multiple-choice questions with a stem introducing the topic(s) to be tested followed by four (4) distractors (possible answers). The goal of the item writer is to present three (3) incorrect yet plausible answers from which the examinee must choose with only one answer being correct. When AOBS members meet as a discipline (e.g. general, vascular, urology, neurosurgery, plastic and reconstructive, cardio-thoracic, and critical care) to construct test questions, they follow professional item writing guidelines provided by our psychometricians. Each specialty has a Bureau of Examiners (BOE) with the AOBS charged with writing their specialty specific examinations. Every AOBS BOE member is required to attend at least one item writing workshop for high-stakes testing every two (2) years.   

Tests should be fair, reflect essential special knowledge, and provide test-takers the best opportunity to demonstrate what they know. The AOBS strives to construct its test in such a way as to clearly differentiate between candidates with special knowledge from those that cannot demonstrate this ability.  The challenge for the item writer and AOBS is to provide opportunities for candidates to demonstrate the defined special knowledge of their profession, as described in the ACOS/ACGME curriculum, and further identified through the Job or Task Analysis process (collecting data as to what and how often procedures are being done and what surgical diagnosis are being managed), subject matter experts, and relevant reference textbooks and journal articles within five (5) years of publication.  Item writing is an excellent option for obtaining extra CME credits and accumulating points towards becoming a Fellow of the American College of Osteopathic Surgeons (FACOS).  

Please contact the AOBS office at www.aobs.org if you are interested in writing items, attending an item-writing workshop or becoming a member of your disciplines Bureau of Examiners.  

Timothy M. Burandt, DO, FACOS
Chairman, American Osteopathic Board of Surgery