Welcome and Introductions OAA Focus – Test Security/Data Quality Accountability Rules/Hot Topics...

1

Agenda• Welcome and Introductions• OAA Focus – Test Security/Data

Quality• Accountability Rules/Hot

Topics 2013• SDRR – Rosters• CIITS/Student Data Tool• Tips for Successful Testing• K-PREP• Alternate K-PREP

• K-PREP End-of-Course (QualityCore®)

• College/Career Readiness• ACT• COMPASS®• KYOTE• WorkKeys• KOSSA• ASVAB• KDE UpdateKDE:OAA:DSR 2/7/2013

https://intranet.education.ky.gov/offices/OGSS/DOC/Logos/Brand_4color%20reduced.jpg

2

K-PREP END-OF-COURSEQUALITYCORE®

English IIAlgebra IIBiologyU.S. History

KDE:OAA:DSR 2/7/2013


End-of-Course Overview• EOC assessments establish a common rigor for core

courses.

• Current EOC assessments are for courses which are high school graduation requirements.

• ACT’s QualityCore® program will link student performance to national results.

KDE:OAA:DSR 2/7/2013 3


4

Changes to EOC• Score reports may be created in one PDF for all students

or one student report at a time.• Constructed Response (CR) may be generated and scored

locally. QualityCore resources may be used.• Local school will determine how to incorporate the CR

into a student’s final grade.


Policy Change: Students are tested at the completion of all coursework.


5

Test DetailsSession Type Questions Time Student

ScoreSchool Score Score Returns

MC1 Paper Booklet or CBT

35-38 MC 45 minutes CBT – ImmediatelyPaper – 10 days from ACT receipt

MC2 Paper Booklet or CBT

35-38 MC 45 minutes CBT – ImmediatelyPaper – 10 days from ACT receipt

Scale Score = MC1 + MC2 = Accountability



6

EOC Scores to Letter GradesA psychometric study linking QualityCore® results (scale scores) of multiple-choice scores to student class grades was developed using Kentucky scores.


STATE-REQUIRED END-OF-COURSE EXAMS RECOMMENDED LINK TO CLASSROOM LETTER GRADES FOR 2012-13

(Based on Multiple-Choice Sections)

Subject A B C D FCPE-linked

College Readiness

BenchmarkEnglish II 175-160 159-154 153-152 151-141 140-125 154

Algebra II 175-151 150-148 147-143 142-138 137-125 148

Biology 175-157 156-154 153-146 145-140 139-125 154

U.S. History 175-151 150-147 146-144 143-139 138-125 147


7

EOC WindowsWindow Administration Dates (2012-13)

# 1 August 1-September 15 (new addition)# 2 October 1-November 16# 3 December 1-January 15# 4 February 1-March 15

(CR Materials returned unused)# 5 April 15-June 15 (No CR Materials received)#6 June 16-July 15

(CBT, except for accommodated forms)

KDE:OAA:DSR 2/7/2013Choose 10 consecutive days within the larger window for testing.


Traditional vs. Non-Traditional Settings10 Day Traditional• 10 consecutive testing days

chosen within the larger window.

• Each content area must be completed in 1 day.

• All materials shipped on same day.

Flexible (Non-Traditional)• May test at any time during the

larger window.• Each content area must be

completed in 1 day per student.• Materials shipped as students

complete tests.– Place Supplemental Order for

additional header sheets.


QualityCore® Customer Service 866/764-7228


New Test Materials FormatsOne document per student per test• Test booklet pre-printed with

student and teacher name• Answer sheet pre-filled with

student information• Answer sheet bound as

perforated sheet into test booklet

• Reference Sheet for Algebra II bound as perforated sheet into test booklet

One document per Test Supervisor• Test Supervisor’s Manual• Pre-filled School Header• Pre-filled Group Header

(possible)


Beginning April 15


Computer-Based Testing (CBT)• Review support documents

– Best Practices– QualityCore Testing Helpful Hints– Online User Guide from ACT website

• Increase number of proctors in the room for– Better monitoring– Quicker starting of tests

• Computer Testing:– Multiple testing sessions can be utilized in a single day. Note: A 10-15 minute break is allowed between test sessions.


New Policy: The first computer-based test must begin at the same time as the paper based test.

10


11KDE:OAA:DSR 2/7/2013

Accommodations• IEP• PSP• 504 Plan (Not in

SDRR)

100-Day Rule Accountability based

on summative window

Order Materials Online

http://qc.vantage.com Seating Chart

http://qc.vantage.com/


12

Accommodated Testing MaterialsPaper Only• R = Reader• A = Audio• B = Braille• LP = Large Print • Scribe

Paper and Computer• Extended Time• Paraphrasing• Manipulatives• Prompting/Cueing• Behavior Modification• Interpreter (sign language)• Dictionaries/Thesauri


Applies to students with IEP, 504 Plan or PSP


13

EOC MaterialsComputer-basedProhibited:• Notes• Foreign language or English dictionary• Electronic devices and cell phonesAllowed:• Scratch Paper-Please collect and

destroy securely.• Calculators• Reference Sheets (Algebra II)

Pencil/PaperProhibited:• Scratch paper• Notes• Foreign language or English dictionary• Electronic devices and cell phonesAllowed:• Scratch work is to be done in the test

booklet.• Calculators• Reference Sheets (Algebra II)



English Learners• First year EL students enrolled in a U.S. school are

exempt from accountability. Students are required to take the Algebra II and Biology for federal participation rate.

• Second year or more EL students fully participate.• Accommodations are available for students with a

Program Services Plan (PSP).KDE:OAA:DSR 2/7/2013

Participation = 4 MC (minimum)

14


Trainings & Materials• Recorded Trainings available on KDE website

http://education.ky.gov/AA/distsupp/Pages/EOC.aspx

• Kentucky QualityCore® Specific website http://www.act.org/stateservices/kentucky

KDE:OAA:DSR 2/7/2013 15



http://www.act.org/stateservices/kentucky


Contact InformationACTACT Customer Services [email protected]: (866)764-0228

Joe Dell Brasel, [email protected]

KDEAssessment Support & [email protected]: (502) 564-4394

Jennifer [email protected]

KDE:OAA:DSR 2/7/2013 16

mailto:[email protected]





17

COLLEGE READINESS

College Admissions Assessments (ACT)College Placement Assessments (COMPASS & KYOTE)



KDE:OAA:DSR 2/7/2013 18

College/Career Readiness RateCollege Ready:Must meet benchmarks on one of the following:

College Ready

ACT

COMPASS

KYOTE

Career Ready: Must meet benchmarks for one requirement in Career Academic area and must meet one requirement inCareer Technical area

Career Ready Academic

Career Ready Technical

Armed Services Vocational Aptitude Battery (ASVAB)

ACT WorkKeys (Applied Math,

Locating information, and Reading

for Information)

Kentucky Occupational

Skills Standards Assessment

(KOSSA)

Industry Certificates

Bonus: College AND Career Ready must meet at least one from each area

College Ready Academic Career Ready Technical

ACT or COMPASS or KYOTE

KOSSA


NOTES: (1) By meeting the College Ready Academic definition, the student does not have to take the additional tests of ASVAB or WorkKeys for the bonus area. (2) For accountability purposes, the bonus shall not allow the readiness percentageto exceed 100 percent.

18


19

Opportunities to Demonstrate College Readiness

• ACT – Junior year (required)

• COMPASS or KYOTE – Senior year (optional)

• The assigned grade level shall determine the state tests to administer. 703 KAR 5:240

What If… Student doing credit recovery jumps from grade 10 to grade 12 this year. How does this student demonstrate college readiness?


COMPASS or KYOTE


20

College Ready

ACT• Reading = 20• English = 18• Mathematics = 19

COMPASS• Reading = 85• English (Writing Skills) = 74• Mathematics = 36

KYOTE• Mathematics = 22• Reading = 20• English (Writing) = 6

KDE:OAA:DSR 2/7/2013College Placement Tests

College Entrance Exam


21

ACT

March 5 Initial Test Day March 19 Make-up Test Day

March 5-19 ACT Accommodations Window



22

Important 2013 Dates

February 25 March 4 March 5 March 6

Secure Materials Arrive this week

Remind Students of Testing; Make certain pre-test session completed

STATE TEST DAYAccommodations Window for ACT

begins

Return Standard Materials


March 6 March 12-14 March 19 March 20

Order materials for Makeup Day by 5 p.m. CST

Makeup Day materials arrive

STATE MAKEUP TEST DAY

Accommodations Window for ACT ends

Return materials(Make-up & Accomms.)

Hold school supervised pre-test session(s) before test day, not on

the same day as testing


23

Grade Level Assessment• The assigned grade level shall determine the state tests to

administer. 703 KAR 5:240 • Standard Time Testing: On March 5 & 19, students

classified as Grade 11 in Infinite Campus take the ACT March Administration

• Accommodated Testing: On March 5 through 19, students classified as Grade 11 in Infinite Campus take the ACT March Administration



24

Who is Tested?• All grade 11 students, except Alternate Assessment, foreign

exchange and first year EL.• Any student retained in grade 11 should complete the ACT

assessment again.

What If…Student changed from grade 10 to grade 11 in IC after March 6. Will the student test in the make-up session on March 19?


Yes, using standard time overage materials.


25

Important Reminders• All answer documents sent to ACT will be scanned and

included in public reporting.• Do NOT submit any blank answer documents to ACT with

the scorable materials.


ACT Customer Service800-553-6244

General Questions ext. 2800Accommodated Testing ext. 1788

www.act.org/aap/state/contact.html

http://www.act.org/aap/state/contact.html


26

DAC Responsibilities• DAC is responsible in SDRR for

– completing official state roster.– working with Test Supervisor to record nonparticipation (i.e., who did not

test and why).– printing copies and/or saving the roster electronically.

• REPORTING– Student reports will be sent directly to student’s home (3-8 weeks).– High Schools will receive:

• School reports in late July to high school principals.• Labels for transcripts will be sent to the high school counselor 3-8 weeks after

testing.– DAC will receive all district reports from ACT in late July.



27

Accommodations Affect Accountability

• Used in Growth calculation• Used in College/Career Readiness

ACT-Approved Accommodations = College Reportable Score

• Used in Growth calculation• Not used in College/Career Readiness (even if benchmarks met)

State-Allowed Accommodations = Non-College Reportable Score



28

ACT Rosters• ACT rosters open in the Student Data Review and Reporting

(SDRR) application on March 6 and close March 28.

• Fields in SDRR:– Name (first and last)– Date of birth– SSID– Testing school– Exemptions



29

College/Career Readiness Rate • Based on Grade 12 students (graduates or

completers with G-Codes in Infinite Campus) • Includes best score on English, Math and Reading

from all ACT State and National Administrations in Kentucky

• Data reviewed by schools and districts prior to fall report


Use Student Name from IC

Must meet CPE’s ACT Benchmarks


30

What’s New• ID requirement (pp. 24-26 ACT Supervisor’s Manual)

– Photo ID (school or government issued) is required if student cannot be checked in through personal recognition

– Personal recognition is still acceptable– No longer accept recent published photo, and transcript with

photo • Phase out of cassettes

– Cassettes no longer available starting spring 2014• ACT and KDE representatives may observe



31

What’s New

E-mail address collected on answer document



32

COMPASS®College Placement Assessment for Seniors


http://compass.act.org/eCompass


33

COMPASS® College Placement• Course Placement for colleges and universities

(Mathematics assessment includes Algebra and Pre-Algebra scores to aid course placement)

• COMPASS® will not replace ACT as an admissions exam.

• For College Admission requirements, contact the individual institution.



34KDE:OAA:DSR 2/7/2013

COMPASS®

Computer Adaptive

Accommodations (No Special Forms)

Test Irregularity

ReportInterventions

Seating Charts

http://education.ky.gov/AA/distsupp/Pages/COMPASS.aspx


35

COMPASS® Testing DatesNo testing window restrictions


Open through

June 15, 2013


36

COMPASS® Cut Scores


SubjectCOMPASS®

Score (at or above)

ACT Benchmarks

CPE ACT Benchmarks

English (Writing Skills)

74 18 18

Mathematics (Algebra)

36 22 19

Reading 85 21 20


37

College Ready Status File• Electronic File by School on Secure Site

– College Ready– NOT College Ready– Unknown


Name of Student

Writing Skills (English) Mathematics Reading

Pam Powers XFrank Potter X X

Available each Fall


38

College Ready Status File (continued)• Includes students in the school prior to December 1• Does not include

– Students who transferred into your school/district from public, private or out-of-state schools since beginning of December

– School is responsible for getting graduates/completers (those with G-Codes) College and Career Ready


Based upon State and National ACT assessments prior to May 2012


39

Training for COMPASS® Administrators

• Annual Administration Code and Inclusion of Special Populations Regulations

• Previously trained staff must view the COMPASS® Update Training (~30 minutes)

• New staff must complete the New Administration Training– Online COMPASS® Training Series available from– http://education.ky.gov/AA/distsupp/Pages/COMPASS.aspx


http://education.ky.gov/AA/distsupp/Pages/COMPASS.aspx


40

DAC ResponsibilitiesDAC is responsible for

– downloading and sharing the College Ready Status File.– attending COMPASS Update Training.– ensuring all staff administering COMPASS has yearly Administration Code

and Inclusion of Special Populations training and has watched the COMPASS Update Training.

– making certain that new staff watch New COMPASS Training Series.– remitting staff administrator updates to KDE (School or District Staff Change

Form).



41

COMPASS® Contact InformationKDE• General Program Information

(OAA)– Jennifer Stafford – Pam Powers

(502) [email protected]

• Intervention Information– April Pieper (NGL)

(502) 564-2106

ACT• COMPASS® Technical Support

– (800) 645-1992– Option 2– Available 24 x 7




42

KYOTE

College Readiness (College Algebra) Math Placement Exam for Seniors


https://www.kyote.org

https://www.kyote.org/


43

KYOTE USER’S GUIDE• Step by step approach

– Create class and student accounts– Administer exam– Access results

• Information – Preparing computers for exams– Calculator policies– Testing frequency policies– Passing scores



44

KYOTE Cut Scores


Subject KYOTE Score (at or above)

ACT Benchmarks

CPE ACT Benchmarks

Mathematics College Readiness Exam 22 --- 19

Mathematics College Algebra Exam 14 22 22

Reading 20 21 20

KYOTE Writing Exam is not used in CCR.


45

KYOTEMathematics ACT (18 and below) College Readiness Exam

• Purpose students to be placed in entry level mathematics credit bearing courses

• Included in CCR calculation

Mathematics ACT (19-21) College Algebra Exam

• Purpose students to be placed in College Algebra as require by their college major

• Included in CCR calculation



46

KYOTE Retakes


• Mathematics• Test is given at the end of course (regardless of whether a

pre-test is given at beginning of course). • Student within 2 points of passing the exam may re-take

the exam within a week • 20 or 21 on the college readiness exam; • 12 or 13 on the college algebra exam.

• Reading• Students may take the reading exam only once


47

KYOTE Placement AccountsIt is strongly recommended that schools create a placement account for each student:• Log on to www.kyote.org. • Click on Register under Students. Enter the student’s

– e-mail address, – first name, last name and– unique SSID-KDE Infinite Campus student number . It is essential that this number

be entered correctly. There is no way to change it once the account is created. • For the complete process of setting up placement accounts consult the

KYOTE User’s Guide


http://www.kyote.org/


48

KYOTE Data to KDE• To facilitate the matching of students taking the

KYOTE assessments, schools will upload student information from Infinite Campus (IC) to KYOTE.

• Critical information for matching is correct name and SSID.

• KYOTE will return the student scores to KDE for inclusion in College Readiness.



49

KYOTE Contacts

Paul Eakin• (859) 257-6798• [email protected]

Steve Newman• (859) 572-5332• [email protected]





50

CAREER READINESS

Career Academic (WorkKeys & ASVAB)Career Technical (KOSSA & Industry Certificates)



KDE:OAA:DSR 2/7/2013 51

College/Career Readiness RateCollege Ready:Must meet benchmarks on one of the following:

College Ready

ACT

COMPASS

KYOTE

Career Ready: Must meet benchmarks for one requirement in Career Academic area and must meet one requirement inCareer Technical area

Career Ready Academic

Career Ready Technical

Armed Services Vocational Aptitude Battery (ASVAB)

ACT Work Keys (Applied Math,

Locating information, and Reading

for Information)

Kentucky Occupational

Skills Standards Assessment

(KOSSA)


Bonus: College AND Career Ready must meet at least one from each area

College Ready Academic Career Ready Technical

ACT or COMPASS or KYOTE

KOSSA


NOTES: (1) By meeting the College Ready Academic definition, the student does not have to take the additional tests of ASVAB or Work Keys for the bonus area. (2) For accountability purposes, the bonus shall not allow the readiness percentageto exceed 100 percent.

51


52

Opportunities to Demonstrate Career Readiness

• Career Measures – Throughout high school– Career academic (ASVAB or WorkKeys)– Career technical (KOSSA or Industry certificates)

• While the tests are optional, students must have these measures to be CCR.

• Unless CTE Preparatory Student, ASVAB and WorkKeys does not increase your CCR.



53

Preparatory StudentsStudent who has completed two career and technical education credits in a preparatory program and is enrolled in the third credit course(s) in the same career pathway.

What If…A student is enrolled in welding for 2 credits and takes nursing for another credit. Is this student considered a Preparatory Student?


No. Student must be enrolled in third credit of the same career pathway.


54

Career ReadyACADEMIC• WorkKeys = Silver or Above

– Applied Math– Locating Information– Reading for Information

---OR---• ASVAB = 50

– Armed Services Vocational Aptitude Battery

TECHNICAL• KOSSA

– Multiple-Choice = 70– Constructed-Response = 75

---OR---• Industry Certificate

– Certification based on industry standards


Preparatory Student:Student who has

completed two career and technical education

credits in a preparatory program and is enrolled in the third credit course(s).


55

College & Career Ready BonusAcademicCollege Ready

• ACT and/or• COMPASS and/or• KYOTE

TechnicalCareer Ready• KOSSA or• Industry Certificate


Must be a CTE Preparatory

Student


56

DAC Responsibilities for CCR• Make certain all graduating students have had the

opportunity to meet college benchmarks or are career ready.

• Work with TEDS Coordinator on Career Readiness.• Work with high school coordinator/BACs on

College Readiness.



57

College/Career Readiness for All

Introducing KDE’s new resource page for CCR information designed to be the starting point for all

your College/Career Readiness answers.

http://education.ky.gov/educational/CCR/Pages/default.aspx





58

WORKKEYS



WorkKeys• Job Skills Assessment• Available through local Area Technology Center or

directly through ACT, Inc.• ACT, Inc. provides data to KDE to assist with

matching names. Students not matching should be entered into TEDS by the school/district.

KDE:OAA:DSR 2/7/2013 59


60

WorkKeys® Assessments

3 WorkKeys® Assessments:– Applied Mathematics– Locating Information– Reading for Information



61

WorkKeys Resource Page

• ACT WorkKeys Webcast (Overview of WorkKeys)• WorkKeys Preparation and Test Taking Strategies

PowerPoint• ACT WorkKeys Website • Administration Code Training for ATC Principals,

Local Districts & Administrators KDE:OAA:DSR 2/7/2013

http://education.ky.gov/curriculum/CTE/cter/Pages/WorkKeys.aspx

http://education.ky.gov/curriculum/CTE/cter/Pages/WorkKeys.aspx


62

WorkKeys Contact Information


•[email protected]

Office of Career and Technical

Education

•[email protected]

Office of Assessment and Accountability

•[email protected] Office of

Employment and Training








63

KOSSA Kentucky Occupational Skill Standards Assessment



64

KOSSA• Testing window: February 1-28• Administered at local high schools• Required for Senior Preparatory Students or a

related industry certification• Requires Administration Code and Inclusion of

Special Populations training



65

KOSSA• Agriculture• Business and Marketing• Construction • Engineering and Technology• Family and Consumer Science• Health Science• Industrial Education• Information Technology• Manufacturing• Transportation

Associated

Pathways



66

KOSSA Resources• KOSSA Training video

http://education.ky.gov/curriculum/CTE/kossa/Pages/KOSSAwebcast.aspx

• Industry Certificates Listhttp://education.ky.gov/curriculum/CTE/kossa/Pages/ValidKOSSAList.aspx


http://education.ky.gov/curriculum/CTE/kossa/Pages/KOSSAwebcast.aspx

http://education.ky.gov/curriculum/CTE/kossa/Pages/ValidKOSSAList.aspx


67

KOSSA Contacts

Office of Career and

Technical Education

Laura Arnold

Pam Moore

(502) 564-3472



68

ASVABArmed Services Vocational Aptitude Battery



69

ASVAB• Part of CCRR, the ASVAB assesses academic ability and

predicts success in a wide variety of careers.• The Armed Forces Qualification Test or AFQT is the score

computed from these four components of the ASVAB —Word Knowledge (WK), Arithmetic Reasoning (AR), Paragraph Comprehension (PC) and Mathematics Knowledge (MK).

• To be considered Career Ready, students must score at or above the 50th percentile.



70

ASVAB Accommodations

The only accommodation allowed for students with special needs is “extended time”. A student may be allowed only 30 minutes extra.

No other accommodation is permitted.



71

ASVAB ContactGlenn N. StegemannASVAB Program ManagerLouisville [email protected], Ext. 2241 (office)502-451-9316 (cell)502-582-6566 (fax)




Welcome and Introductions OAA Focus – Test Security/Data Quality Accountability Rules/Hot Topics...

Documents

Transcript of Welcome and Introductions OAA Focus – Test Security/Data Quality Accountability Rules/Hot Topics...