Question Writing Guide ABNM SAM Questions
description
Transcript of Question Writing Guide ABNM SAM Questions
![Page 1: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/1.jpg)
Question Writing GuideABNM SAM Questions
J. Anthony Parker, MD PhDAssociate Executive Director, ABNM
Beth Israel Deaconess Medical CenterBoston, Massachusetts
Caveat Lector
![Page 2: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/2.jpg)
PsychometricsOrigin for Questions Writing Rules
Psychometrics is the field of study concerned with the theory and technique of psychological measurement, which includes the measurement of knowledge, abilities, attitudes, personality traits, and educational measurement. The field is primarily concerned with the construction and validation of measurement instruments such as questionnaires, tests, and personality assessments.
– Wikipedia
![Page 3: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/3.jpg)
Test Goal is to Measure AbilityLogistic regression where the probability of a correctanswer is a function of
Fn, the ability of person, nbi, the difficulty of question, i
Prob
abili
ty
Ability of person , n, Fn
Difficulty of question, i, bi
Ability 0.3
Wikipedia
![Page 4: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/4.jpg)
Can Also Measure Question DifficultyLogistic regression where the probability of a correctanswer is a function of
Fn, the ability of person, nbi, the difficulty of question, i
Prob
abili
ty
Difficulty of question, i, bi
Ability of person , n, Fn
Difficulty 0.3
Wikipedia
![Page 5: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/5.jpg)
Question DiscriminationThe slope determines how well a questiondiscriminates between candidate abilities
ai, ability discriminationlog-odds correct answer = ai • (Fn - bi)
Wikipedia
Prob
abili
ty
Difficulty of question, i, bi
Ability of person , n, Fn = 0.3
Difficulty 0.3
Slope, aiDiscrimination
![Page 6: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/6.jpg)
ABNM Procedure
Assume questions are good and correctly keyedMeasure candidate tentative abilityUsing tentative abilities measure question difficulty
Discard questions that are too hard or too easyAlso measure question-ability discrimination
Correct wrong keysDiscard questions that not correlated with ability
Using improved test, measure final candidate abilityAdjust to standard independent of candidates and test
![Page 7: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/7.jpg)
Writing Good Questions:Questions that Correlate with Ability
Psychometricians have developed rulesfor writing good questions
Rules are based on question performanceBad questions test abilities unrelated to
the test goal
![Page 8: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/8.jpg)
Some Rules for Good Questions
No negatives (not, except, none)No absolutes (always, never, all, every, only, must)No overlapping rangesNo “all of the above” or “none of the above”No mutually exclusive answers (one is correct)Logical order (numerical, alphabetical, category)Single concept per question
No multiple true / false questions
![Page 9: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/9.jpg)
Which of the following is truein Nuclear Medicine?
MIBG is used to image somatostatin receptorsA photon is completely absorbed during a
Compton interaction18F-FDG is transported into cells by GLUTLymphoma is never FDG-avid
Multiple true / false “which is true?”Multiple unrelated concepts“Never” is an absolute
![Page 10: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/10.jpg)
With regard to the thyroid which is correct?
Pentetreotide is taken up in the parafollicular cellsFollicular cells are non-iodine-avidStromal cells take up iodidePentetreotide is not taken by the thyroid
Multiple true / false “which is correct?”First and last answers are mutually exclusive
One of them must be correct“Non” and “not” are negatives
![Page 11: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/11.jpg)
In the thyroid, pentetreotide istaken up MOST avidly in:
parafollicular cells (C cells)follicular cellscolloidstroma
![Page 12: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/12.jpg)
In the thyroid, pentetreotide istaken up MOST avidly in:
parafollicular cells (C cells)follicular cellscolloidstroma
![Page 13: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/13.jpg)
Which of the following is not correct?
11C-acetate is metabolized in the the TCA cycle11C-choline can be used for prostate cancer18F-fluorodexoyglucose (FDG) is not
phosphorylated in the cell18F-fluorothymidine (FLT) is correlated with cellular
proliferation
Not in stem and in 3rd answerMultiple true / false “which is correct?”Multiple unrelated concepts
![Page 14: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/14.jpg)
MOST closely correlatedwith proliferation?
11C-acetate11C-choline18F-fluorodexoyglucose (FDG)18F-fluorothymidine (FLT)
![Page 15: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/15.jpg)
MOST closely correlatedwith proliferation?
Good distractors are often partially true,but not the best answer
11C-acetate11C-choline18F-fluorodexoyglucose (FDG)18F-fluorothymidine (FLT)
![Page 16: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/16.jpg)
What is the BEST administered dose to use for a 18F-FDG PET pediatric scan?
≤ 1 MBq/kg (≤ 0.03 mCi/kg)1 - 4 MBq/kg (0.03 - 0.11 mCi/kg)4 - 16 MBq/kg (0.11 - 0.43 mCi/kg)10 - 64 MBq/kg (0.27 - 1.73 mCi/kg)
Overlapping ranges4-16 and 10-64 both include 10-161-4 and 4-16 both include 4
![Page 17: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/17.jpg)
What is the BEST administered dose to use for a 18F-FDG PET pediatric scan?
1 MBq/kg (0.03 mCi/kg)4 MBq/kg (0.11 mCi/kg)16 MBq/kg (0.43 mCi/kg)64 MBq/kg (1.73 mCi/kg)
![Page 18: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/18.jpg)
What is the BEST administered dose to use for a 18F-FDG PET pediatric scan?
1 MBq/kg (0.03 mCi/kg)4 MBq/kg (0.11 mCi/kg)16 MBq/kg (0.43 mCi/kg)64 MBq/kg (1.73 mCi/kg)
Gelfand: Pediatric radiopharmaceutical administeredDoses: 2010 north american consensus guidelines.J Nucl Med 2011;52:318
![Page 19: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/19.jpg)
Parallel Answers / Avoid Teaching
Answers should be parallel in constructionand length
Good test takers know that “teachers like to teach”The correct answer is often the longest
Tendency to make correct answer exactly correctFor testing, avoid teaching
![Page 20: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/20.jpg)
Urinary excretion of FDG is related to:
FDG concentration overwhelms GLUTrenal GLUT has low affinity for FDGboth of the proximal and distal convoluted tubule
sodium glucose transporters (SGLT1 & SGLT2respectively) have low affinity for FDG
there is little hexokinase in the kidney
Asymmetric answersTeaching
![Page 21: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/21.jpg)
Urinary excretion of FDG is related to:
FDG concentration overwhelms GLUTrenal GLUT has low affinity for FDGSGLT1/2 have low affinity for FDGthere is little hexokinase in the kidney
![Page 22: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/22.jpg)
Urinary excretion of FDG is related to:
FDG concentration overwhelms GLUTrenal GLUT has low affinity for FDGSGLT1/2 have low affinity for FDGthere is little hexokinase in the kidney
![Page 23: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/23.jpg)
Glucose Reuptake in the Kidney
![Page 24: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/24.jpg)
Stem (Question)
1. Ask a questionGiven …, what is the MOST likely diagnosis?
2. Give and incomplete statementGiven …, the BEST next step is:
3. Describe a situation followed #1 or #2A one-year-old girl had jaundice and a5 x 6 cm mass in the porta. Total bilirubinis 7 mg/dL. …
![Page 25: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/25.jpg)
Stem (Question)
Put most of the content in stemAnswers short
Move common words in answers to stemRemove unnecessary words or sentences
![Page 26: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/26.jpg)
In a 73-year-old man with metastaticmelanoma, what is the MOST likely causeof the FDG uptake shown in the figure?
prostate cancermelanomanormal bladdernormal urethra
![Page 27: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/27.jpg)
In a 73-year-old man with metastaticmelanoma, what is the MOST likely causeof the FDG uptake shown in the figure?
prostate cancermelanomanormal bladdernormal urethra
![Page 28: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/28.jpg)
Distractors (Incorrect Answers)
Should be plausibleLogical misconceptionsCommon misunderstandingsReasonable
not the BEST answernot the MOST likely answer
![Page 29: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/29.jpg)
Testing vs. TeachingWright Map
candidates itemsmore able
less able
hard
easy
Testingdistinguish candidatesdifficult itemsjudgment requiredlow passing %
Teachinghelp learningeasier itemsemphasize key points
![Page 30: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/30.jpg)
Question Taxonomy
Recall (fact)The energy of 99mTc is:
Interpretive (diagnosis)A patient with … had an FDG-PET/CT shownin the figure. The MOST likely diagnosis is:
Problem solving (management, judgment)A patient with … had an FDG-PET/CT shownin the figure. The BEST next step is:
![Page 31: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/31.jpg)
Higher Taxonomy Preferred
Often involve more advanced reasoningMore complex medical taskStill single clinical concept
Distractors may be easier to writeSome topics require lower taxonomy questions
![Page 32: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/32.jpg)
Stable iodine (SSKI or Lugol’s solution) should be administered prior to:
pentetreotide (Octreoscan®)iobenguane (MIBG)a contrast FDG-PET/CTibritumomab tiuxetan (Zevalin®)
![Page 33: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/33.jpg)
Stable iodine (SSKI or Lugol’s solution) should be administered prior to:
pentetreotide (Octreoscan®)iobenguane (MIBG)a contrast FDG-PET/CTibritumomab tiuxetan (Zevalin®)
Recall questionpentetreotide confused with MIBG
ibritumomab tiuxetan confused with tositumomab
![Page 34: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/34.jpg)
Based on the electrocardiogram, whatis the BEST diagnosis?
Difficult to come up with 4 plausible diagnoses
![Page 35: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/35.jpg)
A 45 y/o diabetic man with weakness and shortness of breath for 3 days presents for exercise MPI. The pre-
exercise ECG is shown.
![Page 36: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/36.jpg)
What should be done next?
Obtain right precordial leads.Use dipyridamole stress instead.Accompany the patient to the EW.Proceed as planned.
![Page 37: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/37.jpg)
![Page 38: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/38.jpg)
What should be done next?
Obtain right precordial leads.Use dipyridamole stress instead.Accompany the patient to the EW.Proceed as planned.
![Page 39: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/39.jpg)
Writing Distractors
Difficulty writing reasonable distractorsChange taxonomy
Management distractors often easier to write
![Page 40: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/40.jpg)
The BEST diagnosis is:
![Page 41: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/41.jpg)
The BEST diagnosis is:
normal thymusmediastinal metastases??
Diagnostic question
![Page 42: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/42.jpg)
The uptake in the chest is related to:
![Page 43: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/43.jpg)
The uptake in the chest is related to:
the Na / I symportersomatostatin receptor, type 2brown fatmetastases
Diagnosis & biodistribution
![Page 44: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/44.jpg)
A syringe of 90Y-ibritumomab tiuxetan (Zevalin ®) measuring 1025 MBq (27.7 mCi) needs to be discarded due to QC failure. After transfer to a vial, measurements are vial: 815 MBq (22.0 mCi), syringe: 15 MBq
(0.4 mCi). What should be done next?
Declare a medical eventSurvey the areaCall the radiation safety officer (RSO)Store for decay
![Page 45: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/45.jpg)
A syringe of 90Y-ibritumomab tiuxetan (Zevalin ®) measuring 1025 MBq (27.7 mCi) needs to be discarded due to QC failure. After transfer to a vial, measurements are vial: 815 MBq (22.0 mCi), syringe: 15 MBq
(0.4 mCi). What should be done next?
Declare a medical eventSurvey the areaCall the radiation safety officer (RSO)Store for decay
![Page 46: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/46.jpg)
Which Isotope is MOST Difficult toAccurately Measure in a Dose Calibrator?
18F90Y99mTc111In
![Page 47: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/47.jpg)
Which Isotope is MOST Difficult toAccurately Measure in a Dose Calibrator?
18F90Y99mTc111In
![Page 48: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/48.jpg)
What radiopharmaceutical was administered?
99mTc-pertechnetate67Ga-citrate111In-pentetreotide123I-MIBG
![Page 49: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/49.jpg)
What radiopharmaceutical was administered?
99mTc-pertechnetate67Ga-citrate111In-pentetreotide123I-MIBG
![Page 50: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/50.jpg)
What’s the Radiopharmaceutical?Stupid Questions, but I Use Them
Should knownormal and common variant biodistributionat organ, cell, and receptor level
To be able toidentify abnormal biodistributionidentify radiopharmaceutical QCunderstand unusual findings
![Page 51: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/51.jpg)
After injection of 111In-DTPA in a patientwith normal renal function?
the half-time of excretion is 16 minutesthe half-time of excretion 8 minutesthe half-time of excretion 1.7 hoursthe half-time of excretion 36 minutes
Repeated words in answers
![Page 52: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/52.jpg)
How long after injection of 111In-DTPA is 1/2 excreted with normal renal function?
16 minutes8 minutes1.7 hours36 minutes
Answers not in logical order
![Page 53: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/53.jpg)
How long after injection of 111In-DTPA is 1/2 excreted with normal renal function?
8 minutes16 minutes36 minutes1.7 hours
![Page 54: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/54.jpg)
How long after injection of 111In-DTPA is 1/2 excreted with normal renal function?
8 minutes16 minutes36 minutes1.7 hours
http://www.doseinfo-radar.com/
Renogram
![Page 55: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/55.jpg)
Some Rules for Good Questions (1/2)
No negatives (not, except, none)No absolutes (always, never, all, every, only, must)No overlapping rangesNo “all of the above” or “none of the above”No mutually exclusive answers (one is correct)Logical order (numerical, alphabetical, category)Symmetric answers
![Page 56: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/56.jpg)
Some Rules for Good Questions (2/2)
Put concepts and common words in stemDistractors should be reasonableTry to use higher taxonomy
Often easier to write distractorsSome fact questions are appropriate
Single concept per questionNo multiple true / false questionsMedically, not question, complexity
![Page 57: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/57.jpg)
Reference Guidelines
3-page guideABNM_Well_Formatted_SAM_Question.docx
1-page list of does and don’tsABNM_QuestionWritingDoesAndDonts.docx
26-page guide (ABNM psychometric consultants)http://www.measurementresearch.com/
24-page guideABR_Item_Writers_Guide.pdf
![Page 58: Question Writing Guide ABNM SAM Questions](https://reader036.fdocuments.net/reader036/viewer/2022081502/568165e6550346895dd9066c/html5/thumbnails/58.jpg)
Applause