Adea Nbde Update

Update on the National Board Dental Examinations

American Dental Education AssociationSan Diego, California

March 2011

© 2011 Joint Commission on National Dental Examinations,American Dental Association. All rights reserved.

Research & Development/Psychometrics

Tsung-Hsun Tsai, [email protected]

mailto:[email protected]�

Updates

Research

• the highest score reliability is found at the pass/fail point,

• high score reliability is found on the current content structure with 8-10 cases on Part II, and

• psychometrically defensible models and procedures are developed to detect aberrant responses for computer-based examinations.


Updates

Planned 2011 Part II Practice Analysis

Domain of entry-level dentistry65 revised, consolidated clinical competencies of the New General Dentistry

criticalitySurvey frequency

ad hoc content review Data analysis


UpdatesNew Item Types

• Multiple correct answers, extended matching, and ordering are coming to National Board Examinations in 2012.

• These new item types will be scored objectively with a well defined scoring rubric.

• Responses on these new item types must match the scoring rubric exactly in order to get a score of "1" for the item. If there is no exact match, the score for the item will be "0". There is no partial credit.


Updates

• For example, for an item with multiple correct answers and four options: A, B, C, and D, if the correct answers are B and D, both B and D and no other options must be selected to get a score of "1". Otherwise, the score for this item will be "0."


Updates

Multiple Correct Answers

From the following list, select the three symptoms associated with candidosis.

A. Small blistersB. Parasitic in natureC. Reduced prothrombinD. Fungal in natureE. BruxismF. Maladsorption syndromeG. Bacterial in nature


Updates

Extended MatchingFor each symptom listed below, select the correct disorder from the list provided.


Symptom Disorder

___ 1. White patches easily removed with light abrasion___ 2. Buccal lesion with erythematosus surface___ 3. Dorsal tongue carcinoma___ 4. Paterson -Kelly Syndrome___ 5. Abdominal pain, diarrhea, weight loss, fever___ 6. Multiple bluish -purple macules or plaques on

lower extremities___ 7. Hairy tongue

A. Squamous cell carcinoma B. Candidosis C. Syphilis D. Iron deficiency E. Crohn’s disease F. Sjögren syndrome G. Kaposi sarcoma H. Paget’s disease I. Hypothyroidism J. Septicemia

Updates

Ordering

Order the citric cycle as it occurs. Match each letter with its proper sequence number


Don’t Forget

• The implementation of Pass/Fail reporting for candidate performance on National Boards will take effect on January 1, 2012. After that date, passing candidates will receive the status of Pass, “P”, while failing candidates will receive raw score information for each discipline with the status of Fail, “F”.


Don’t Forget

• The dental school profiles will be discontinued on January 1, 2012 when score reporting on the National Board examinations becomes Pass/Fail.

The Joint Commission is developing a model for providing feedback to dental schools for evaluation purposes.


• Trends in candidate performance and failure rates on Part I and Part II based on reference groups are presented in Figures 1 to 4 below.

• A reference group is defined as candidates who took the examination for the first time and who enrolled in accredited dental schools in U.S and Canada.

Score Trends


Figure 1. Part I Average Scores


85.4 85.1 85.5 85.4 85.1 85.783.0 81.5 82.6 82.3

49

54

59

64

69

74

79

84

89

94

99

2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

Figure 2. Part II Average Scores


81.9 82.0 81.7 81.5 82.7 81.2 81.1 81.6 79.2 79.8

4954596469747984899499

2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

Figure 3. Trend in the Failure Rates for Part I


01020304050607080

2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

8.2 10.5 9.7 10.0 13.47.8 3.5 7.4 5.3 5.3

Figure 4. Trend in the Failure Rates for Part II


01020304050607080

2001 2002 2003 2004 2005 2006 2007 2008 2009 2010

7.0 7.2 8.0 7.3 4.7 6.0 6.4 5.313.7

10.6

Transition to a Single ExamTest Administration Updates

Laura M. Neumann, DDS, MPHInterim Secretary, JCNDE

[email protected]

mailto:[email protected]�

Transition to a Single Exam• Parts I & II will disappear; to be replaced by

single, comprehensive exam• JCNDE Committee for and Integrated Exam

(CIE) leading process• Information and progress

– JCNDE Newsletters– CIE website (pending)– Questions and feedback to [email protected]

Integrated Exam – Current status• Model for domain of general dentistry definedo65 clinical competencies cross-link with

10 areas of scientific foundation knowledge

oValidation in progress• Practice analysis planned for mid-2011 >

establish test specifications• Anticipated implementation – at least 4 years

Policy Updates

• Score reports effective 1/1/12: P or F … no numerical score unless candidate tested prior to that date.

• Candidates who have passed may not retest unless required by state board

• DENTPIN™ required to apply/test.

DENTPIN™• 8-digit unique personal identifier• Candidate/student must register him/herself• Used by:

– DAT, NBDE I & II, NBDHE– ADEA AADSAS– TMDSAS– PASS– CAAPID

• 35,221 DENTPINs assigned since 2009

Exam Administration Trends

2008 2009 2010

Part I 8,044 9,209 7,696

Part II 6,232 6,449 7,185

NBDE Part I Volume by Month

0200400600800

100012001400160018002000

2008

2009

2010

NBDE Part II Monthly Volume

0200400600800

100012001400160018002000

200820092010

Testing Accommodations Volume

-

20

40

60

80

100

120

140

Jan Feb Mar Apr May June Jul Aug Sep Oct Nov Dec

2009

2010

Reschedule /No-Show Volume

NBDE I NBDE II

Reschedule No-Show Reschedule No-Show

5,48371%

472 1,61022%

180

Irregularities• NBDE I: 1,984• NBDE II: 2,551• Incidents resulting in action/penalty:41 warning letters31 notices of violation/penaltyo30 appeals

• 4 granted• 27 denied, including 8 wait time to

retest reduced

See our video: Cheating Helps No Onehttp://www.ada.org/2667.aspx

http://www.ada.org/2667.aspx�

Questions

• Joint Commission on National Dental Examinations211 E. Chicago Ave., Suite 600Chicago, Illinois 60611Fax: (312) 587-4105

http://www.ada.org/JCNDE.aspx.

http://www.ada.org/JCNDE.aspx�

Adea Nbde Update

Documents

Transcript of Adea Nbde Update