11

CAHSEE CAHSEE Administration Administration Training UpdateTraining Update

November- December 2007November- December 2007

22

Before TestingBefore Testing

• Ordering Materials• Special Versions• Pre-ID Services• Distribution of Materials

33

CAHSEE Central CAHSEE Central www.ets.org/cahseewww.ets.org/cahsee

44

CAHSEE Project CalendarCAHSEE Project Calendarhttp://www.ets.org/Media/Tests/CAHSEE/http://www.ets.org/Media/Tests/CAHSEE/

pdf/calendar.pdfpdf/calendar.pdf

55

Orders and Pre-IDOrders and Pre-ID

• Mark the deadlines• Plan for orders

Administration Order Pre-ID Late Pre-ID

Supple-mental

February 5-6 12/18 1/2 1/21 1/30

March 11-12 1/28 2/6 2/22 3/5

May 6-7 3/24 4/3 4/22 4/30

66

OrdersOrdersAdmin. Feb. 5-6 March 11-12 May 6-7

Order

Deadline

12/18 1/28 3/24

• Automatic Overages of standard books:•5% for schools•10% for districts

• The over-order penalty does not count these books – plan for this resource

77

CAHSEE OnlineCAHSEE Online

88

Order StatusOrder Status

99

Supplemental OrdersSupplemental Orders• Use 5% school, 10% district overage first• Initial orders are required to place

supplemental orders• 5% of original order assured• Orders over 5% filled if materials available• Special versions (braille, large print, audio

CDs) risky, late orders will be filled as inventory permits

• Supplemental Shipment Order Request in CAHSEE-Online

1010

How to Place Supplemental OrderHow to Place Supplemental Order

1111

Test VersionsTest Versions

• Standard Versions– 1-168 per administration– Different versions for

field test sets• 7 F/T items per ELA and

12 per math form

• Code version number on page 3, now 3-digits

1212

Special VersionsSpecial Versions

• Large Print

• Audio CD with parallel Version 1– No longer specific Version 97

• Braille package now includes:– Braille book– Parallel Large-Print version– Parallel Audio CD version– Administration-specific Braille information sheet

1313

Ordering Special VersionsOrdering Special Versions• Special versions must be ordered (and

produced) in advance:– Large Print– Audio CD and accompanying test booklets– Braille sets

• Late orders are risky and uncertain for special versions

1414

Pre-IDPre-ID• Use 2007-08 layout• REMEMBER: disability codes have changed

from 2006-07 layout• Nonpublic School (NPS) codes are found at:

www.cde.ca.gov/re/sd

Admin Feb 5-6 March 11-12 May 6-7

Pre-ID Deadline

1/2 2/6 4/2

Late Pre-ID

1/21 2/22 4/22

1515

How to Submit Pre-IDHow to Submit Pre-ID

1616

Edit Student Demographics Edit Student Demographics Until Day of the TestUntil Day of the Test

1717

District Profile for DemographicsDistrict Profile for Demographics

1818

District Profile DetailDistrict Profile Detail

1919

Non-Public, Non-Sectarian SchoolsNon-Public, Non-Sectarian Schools

• Districts are responsible for testing students placed by the IEP into an NPS

• NPS assigns examiners

• Ensure NPS examiners – Receive training– Sign security affidavits before receiving

materials

2020

Look-Up Tool for NPS CodeLook-Up Tool for NPS Code

http://www.cde.ca.gov/re/sd/

2121

During TestingDuring Testing

• Security

• Answer Documents

• Special Education Coding

• Testing Variations

• Accommodations and Modifications

2222

SecuritySecurity– Sign the security agreement/affidavit– Access allowed ONLY to those who have signed the

affidavit– District and Test Site Coordinators sign the “Security

Agreement” – “Security Agreement” affirms that all test

administrators have been trained– Test Examiners/Proctors/Scribes sign the “Security

Affidavit” – All materials will be locked in secure storage at all

times except during testing sessions

2323

Security Security (cont.)(cont.)

– Do NOT remove shrink wrap on test booklets until absolutely necessary

– Test Examiners must check out and check in testing materials on each day of testing (verifying the count and signing for them)

– Account for materials before dismissing students from testing room

2424

Security Security (cont.)(cont.)

– Report missing booklets on the “District Packing List and Security Tracking Form”

– Report security breaches to CAHSEE Support immediately

– Professional test monitors (Global Compliance Services) will visit a sample of schools and districts

– Booklets will be scanned in after testing to determine if any are missing

2525

Answer DocumentsAnswer Documents

• Ensure Pre-ID document is only used by the student whose name is on the document

• Use only ONE answer document per student• Code answer doc correctly

– Demographics not included on Pre-ID– Special education

• Modifications/Accommodations• Disability code – new numbers• NPS information

2626

Special Education CodingSpecial Education Coding

• County/District Code of Residence (Box 11)• Primary Disability (Box 12a)• Served at a NPS (Box 12b) NPS Code (Box 12c)• Accommodations and Modifications (Box 13)

– 13 a. Offered (grid with signature)– 13 b. Used (grid AFTER the exam)

• Assessed with CAPA (Box 14)• Special Education Exit Date (Box 15)

2727

District Code of ResidenceDistrict Code of Residence(Box 11)(Box 11)

• Used for accountability

http://www.cde.ca.gov/re/sd/

2828

Disability Codes, (Box 12a)Disability Codes, (Box 12a)

• Changed from 2006-07 layout

• Same information, different numbers

2929

NPS Status and School CodeNPS Status and School Code(Boxes 12 b & c) (Boxes 12 b & c)

http://www.cde.ca.gov/re/sd/

3030

Accommodations and Modifications Accommodations and Modifications (Box 13)(Box 13)

• Complete Box 13a for ALL students with IEP or Section 504 Plan

• Accommodations and Modifications were made available to student

• Signature• Grid 13b only if used

3131

Accommodations and Modifications Accommodations and Modifications (Box 13b)(Box 13b)

• Grid only IF USED• Codes in DFA• Grid all that apply• Modifications affect

study score status• Modification errors are

difficult and costly to correct

3232

Special Education CAPA (Box 14) Special Education CAPA (Box 14) and Exit Date (Box 15)and Exit Date (Box 15)

• Used for accountability

• Must have disability code if CAPA

• Grid score code Z for CAPA

• Three-year horizon for exit date

3333

English Language Learner CodingEnglish Language Learner Coding

• Box 17 – English Proficiency

• Box 18 – EL Variations

• Box 22 – EL 1st Enrollment in US

• Box 23 – RFP Date

• Box 24 – Program Participation

3434

English Proficiency (Box 17)English Proficiency (Box 17)• Status as of day of

testing• Can be edited

through demographic corrections

• Important data points for AYP and API

3535

EL Testing Variations (Box 18)EL Testing Variations (Box 18)

• Do NOT affect scores

• Use only if regularly used in instruction

• See DFA for codes

3636

EL and RFP Dates (Boxes 22 & 23)EL and RFP Dates (Boxes 22 & 23)

• EL 1st enrollment in US– Territories included – Used for accountability– Can be edited through

demographic corrections

• RFP date of reclassification– Used for accountability– Can be edited through

demographic corrections

3737

Program Participation (Box 24)Program Participation (Box 24)

• Grid only ONE for EL programs

• Other programs can be multiples

• Significant importance for research

• Can be edited through demographic corrections

3838

Correct Score Codes (Box 3) Correct Score Codes (Box 3) Mark One for Each ELA and Math Mark One for Each ELA and Math

• R: Previously met CAHSEE Requirement• S: Score• A: Absent• E: Significant Medical Emergency (Grade 10

only)• I: Invalidated (cheating)• Z: Student sat for test, made no marks

Or assessed with CAPA• T: Grade 10 student took CAHSEE at

previous district (Transfer)• M: Moved

3939

After TestingAfter Testing

• Preparation and Return of Materials

• Scheduling Make-up Testing (Grade 10)

• Reporting Results

• Data Correction

4040

Batches with Separate SGIDsBatches with Separate SGIDs

– Grade 10 census: required for every grade 10 enrolled student at time of testing including absent

– Grade 10 make-up: must have been reported “Absent” during Census

– Grade 11– Grade 12– Adult Education students

4141

SGID for 11, 12, AdultSGID for 11, 12, Adult

• Use correct SGID for each grade level– Grade 10: Blue– Grade 11: Teal– Grade 12: Burgundy– Adult: Green

• Grid accurate number of answer documents in each batch

• Each batch must have an SGID

4242

SGID for Grade 10 SGID for Grade 10 Census or Make-UpCensus or Make-Up

• School might have:– Census

batch only– Make-up

batch only– Both census

and make-up batches

4343

Scheduling Makeup TestingScheduling Makeup Testing• NOT required, but can help meet 95%

participation• Note the names of Grade 10 students who

missed one or both census sessions (February or March)

• Plan for make-up session (March or May)

– Observe tight timelines!– Place orders based on absence patterns– Have your Pre-ID plan ready

4444

Return MaterialsReturn Materials

• Batch answer docs

• SGID: with each answer document batch– For NPS, batch all answer documents under

school code 0000001.– (NPS answer documents’ school code =

correct NPS code in Box 12 c)

• Call for pick-up no later than 5 days after testing – early returns are welcome!

4545

Student ReportsStudent Reports

• New design• Color• Security paper to

resist tampering• Data elements

unchanged• Retains left

address window

4646

New Process for On-line ReportingNew Process for On-line Reporting

• Unique district detail file will post to unique district folder in CAHSEE-Online

• Encryption code no longer necessary

• One full year of data will be maintained on-line

• BUT, please do be smart and store the data locally!

4747

Demographic Data CorrectionsDemographic Data Corrections• Individual corrections and mass

corrections available• Closed on the days of each administration • Closed until results available• Data will be open for corrections when not

closed for running reports

4848

Demographic Data Corrections via Demographic Data Corrections via Mass UpdatesMass Updates

• Census/Make-up is correctable (field 601 – for post edits only, not a Pre-ID field)

• SSID is correctable (position 131-142)– Local ID number and last name REQUIRED

to match in mass update process

4949

How to Make Data CorrectionsHow to Make Data Corrections

5050

Demographic EditsDemographic Edits

5151

Coming Soon!Coming Soon!Dynamic Aggregate Score ReportingDynamic Aggregate Score Reporting

• Use demographic edits page

• On-line aggregate score reports at school and district level

• Aggregate reports will recalculate after edits

• Available Spring 2008 before annual demographic edit windows

5252

Administration Training MaterialsAdministration Training Materials

• Presentation materials posted at:– www.ets.org/cahsee– Look under “Resources” tab

• Webcasts archived at:– http://www.sdcoe.tv/archives.asp

Look under “Test Prep”– September 2007 update posted– December 2005 training includes CAHSEE-

Online tutorial

5353

Opportunities to ParticipateOpportunities to Participate• Readers for Essays

– English Teachers needed– http://www.ets.org - Scoring

Opportunities– CAHSEE Scorer@ets.org

• Reviewers– Content reviews in February and

March– Bias and sensitivity reviews in April– DIF after each administration

5454

For More InformationFor More Information• Testing Policy and General Information:

(916) 445-9449www/cde/ca/gov/ta/tg/hs

• State and Federal Accountability Programs: (916) 319-0863www.cde.gov/ta/ac

• Testing Logistics: (800) 241-5687 www.ets.org/cahsee

5555

Questions?Questions?Contact

CAHSEE Support at

1-800-241-5687

Email questions to

CAHSEE-Support@ets.org