DATA, DATA, DATA How to prevent online analysis paralysis? SEPTEMBER 21, 2009.
September 2012Demographic Data Corrections1 2012 STAR Demographic Data Corrections Webcast September...
-
Upload
dennis-foster -
Category
Documents
-
view
218 -
download
2
Transcript of September 2012Demographic Data Corrections1 2012 STAR Demographic Data Corrections Webcast September...
September 2012 Demographic Data Corrections 1
2012 STAR2012 STARDemographic Data Demographic Data
CorrectionsCorrections
Webcast
September 27, 2012
Start time 9 a.m.
September 2012 Demographic Data Corrections 2
ObjectivesObjectives
District STAR coordinators will understand:• Why data should be corrected• Which data can be corrected• What the cost is for correcting data• When data can be corrected• How to make data corrections• Data corrections vs. handscoring end-of-
course mathematics and science tests
September 2012 Demographic Data Corrections 3
What’s New?What’s New?
• Layout Changes– See the “What’s New” table starting on page 1 of the
Demographic Data Corrections Manual for changes to the data layout.
• Search for Student– You can search by student SSID when matching
unmatched grades four and seven students multiple choice with unmatched writing.
September 2012 Demographic Data Corrections 4
Why Correct Data?Why Correct Data?
• Correct API and AYP calculations– Corrected data are sent to the CDE’s
Academic Accountability Unit for recalculation
• Score uncoded and rescore miscoded end-of-course mathematics or science tests– Other option is to hand score
• Obtain corrected data CD
September 2012 Demographic Data Corrections 5
• SSID• CAPA Level• County and district code for student’s
residence if residence is other than where student attends school/receives services
• Special Testing Conditions (except for certain fields)
• Accommodations or Modifications Used• Adult Testing Irregularities• Inappropriate Test Preparation
Fields used for API and/or AYP Fields used for API and/or AYP calculations that may be corrected calculations that may be corrected
September 2012 Demographic Data Corrections 6
Fields used for API and/or AYP Fields used for API and/or AYP calculations that may be corrected calculations that may be corrected
• Student’s English Proficiency• English Learner Date First Enrolled in U.S.
School• R-FEP student scored PRO or ADV any 3
years on CST and/or CMA for ELA• National School Lunch Program (NSLP)• Primary Disability • Receives special education services at a
nonpublic, nonsectarian school (NPS) based on IEP
September 2012 Demographic Data Corrections 7
• Hispanic or Latino
• Ethnicity/Race
• Parent Education Level
• CBEDS Enrollment—District
• CBEDS Enrollment—School
• CST/CMA for Mathematics Test Taken
• CST for Science Test Taken
Fields used for API and/or AYP Fields used for API and/or AYP calculations that may be corrected calculations that may be corrected
September 2012 Demographic Data Corrections 8
Demographic fields that may Demographic fields that may NOTNOT be be corrected corrected
• District Name
• County/District Code
• School Name
• School Code
• Grade Level of Test Taken (enrollment grade may be changed, however)
September 2012 Demographic Data Corrections 9
How much does it cost?How much does it cost?
• One setup fee of $630– Regardless of number of administrations
changed• 16 cents per record
– ALL students tested on the administration• Additional cost for replacement reports and CD
September 2012 Demographic Data Corrections 10
ExampleExample
• Two administrations– 1,000 students tested on admin 1– 5,000 students tested on admin 2
• Correct 900 students on admin 1– Cost = $630 + (0.16 x 1000) = $790
• Correct 3,000 students on admin 2– Cost = $630 + (0.16 x 5000) = $1,430
• Correct 900 students on admin 1 plusCorrect 3,000 students on admin 2– Cost = $630 +(0.16 x 6000) = $1,590
September 2012 Demographic Data Corrections 11
Cost of Cost of Replacement ReportsReplacement Reports
Report Cost per student tested in the admin.
Student Reports (paper)Student Reports (PDFs on DVD-ROM) Student Record Label
$1.50$0.25$0.80
Student Master List $0.60
Student Master List Summary, School level $0.60
Student Master List Summary, District level $0.60
Subgroup Summaries $0.85
Student Master List Summary: End-of-course CST results, end-of-course CMA results
$0.60
Student Data File on CD-ROM $0.32
September 2012 Demographic Data Corrections 12
TimelineTimeline
• Submit form– Form available on www.startest.org/forms.html – Last day for submissions is October 20
• System OPEN for corrections on October 1• System CLOSED for corrections on November 9
– Last day to request file download is November 8; corrected file then must be uploaded by November 9
• Corrected STAR Internet reports to be posted in January – Not the same as accountability reports
September 2012 Demographic Data Corrections 13
The ProcessThe Process
• Complete and submit form.• Obtain new password.• Access “STAR 2012 Administration.” • Make data corrections.
– Online– Offline
• Request download file NO LATER than November 8
• Match unmatched records (optional).– Online only
• Select to “Approve – District Complete.”– If this step is NOT completed, NO data changes will
be sent to the CDE.– Must be completed by 6 p.m. (PST) November 9.
September 2012 Demographic Data Corrections 14
Online & Offline UpdatesOnline & Offline Updates
Scenario One Scenario Two
1. Request and download file.2. Edit data in file.3. Upload corrected file.
1. Edit data online.2. Submit online corrections.
Scenario Three Scenario Four
1. Edit data online.2. Submit online corrections.3. Request and download file.4. Edit data in file.5. Upload corrected file.
1. Request and download file 1.2. Edit data online.3. Submit online corrections.4. Request and download file 2.5. Edit data in file 2.6. Upload file 2.
September 2012 Demographic Data Corrections 15
Download & Upload Download & Upload FormatFormat
• Based on STAR Student Data Layout – Includes ALL data in one file– Includes additional control data fields
• 838 Characters long
• Includes records for ALL administrations
• File includes CST, CMA, and CAPA records– STS records not included
September 2012 Demographic Data Corrections 16
Format of Data FileFormat of Data FileAppendix C of Demographic Data Corrections Manual
September 2012 Demographic Data Corrections 17
Sample Data FileSample Data File
Header Record – Do NOT remove or alter
Trailer Record – Do NOT remove or alter
September 2012 Demographic Data Corrections 18
After DownloadAfter Download
• Save a COPY of download file to desktop• Do NOT make online data changes in
between downloading and uploading• Use text editor to make data changes
– Do not use Excel
ImportantIf downloading and correcting the entire file, use text file (.txt) format only. Do not edit data in Microsoft Excel or any other application that could potentially reformat the data. Be sure to upload the entire corrected text file (.txt), including the header and trailer records. Do not change the sequence of any of the records in the file.
September 2012 Demographic Data Corrections
After Download (continued)After Download (continued)
• Keep data in same columns and sequence• Do NOT remove records• Do NOT change fields UIN (3–22) or “ETS
Use Only” (777–838)• Do NOT adjust header or trailer records
19
September 2012 Demographic Data Corrections 20
Upload File Upload File Phase 1, File CheckPhase 1, File Check
• Unsuccessful– All records rejected– Possible errors
• Header record error• Trailer record error• Records deleted or added• Latest download file not used for upload• File format
September 2012 Demographic Data Corrections 21
Upload File Upload File Phase 1, File CheckPhase 1, File Check
• Successful– Proceed to Phase 2
Record checkOnly modified records will be checked
September 2012 Demographic Data Corrections 22
Upload File Upload File Phase 2, Record CheckPhase 2, Record Check
• Data for entire record has to be valid
• Updates record if all data valid
• Rejects record if ANY data on the record are invalid
• E-mail sent to inform that Phase 2 has been completed
September 2012 Demographic Data Corrections 23
E-mailE-mail
From: [email protected] Subject: Student Demographic Edit File Status Notification
Below is the file processing status for: STAR Student Demographic Edit Upload File
Filename: PN543.1txt.txt
Date Submitted: 2012-10-15 09:20:22.0
Submitter: District STAR Coordinator
Status: Error
The following fatal errors have occurred while processing the file:
Total Number of Records: 51
Total Number of Accepted Records: 50
Total Number of Rejected Records: 1
Please return to [URL] to download the detailed error report for this file.
Contact customer service at (800) 955-2954 if you need further assistance.
September 2012 Demographic Data Corrections 24
ResubmitResubmit
• Download data
• Locate records in error
• Correct errors
• Upload ENTIRE file– Not just the corrected error records
September 2012 Demographic Data Corrections 25
SoftwareSoftwareDemonstrationDemonstration
Online Updates
Matching Records
Download & Upload Files
September 2012 Demographic Data Corrections 26
Logon to 2012 DatabaseLogon to 2012 Database
September 2012 Demographic Data Corrections 27
Welcome ScreenWelcome Screen
September 2012 Demographic Data Corrections 28
Online CorrectionsOnline CorrectionsSearch for StudentSearch for Student
September 2012 Demographic Data Corrections 29
Online CorrectionsOnline CorrectionsSearch for Student ResultsSearch for Student Results
September 2012 Demographic Data Corrections 30
Online CorrectionsOnline CorrectionsUpdate Student DataUpdate Student Data
Cannot update online
– Special test conditions
– Modifications and accommodations
– Must make these corrections offline
September 2012 Demographic Data Corrections 31
Online CorrectionsOnline CorrectionsMatching RecordsMatching Records
• Matching only available online
• Grade 4 and 7 multiple choice & writing
Step 1: Match Demographic Records form
Step 2: Match Demographic Records search results
September 2012 Demographic Data Corrections 32
Online CorrectionsOnline CorrectionsMatching Records (cont.)Matching Records (cont.)
Step 3: Unmatched record search
September 2012 Demographic Data Corrections 33
Online CorrectionsOnline CorrectionsMatching Records (cont.)Matching Records (cont.)
Step 4: Unmatched record search results
Step 5: Unmatched records—student results
September 2012 Demographic Data Corrections 34
Offline CorrectionsOffline CorrectionsRequest FileRequest File
September 2012 Demographic Data Corrections 35
Offline CorrectionsOffline CorrectionsDownload FileDownload File
Available the next day for download
September 2012 Demographic Data Corrections 36
Offline CorrectionsOffline CorrectionsEdit FileEdit File
Text editor
September 2012 Demographic Data Corrections 37
Offline CorrectionsOffline CorrectionsUpload FileUpload File
September 2012 Demographic Data Corrections 38
Upload MessagesUpload MessagesSuccess
Failure
September 2012 Demographic Data Corrections 39
Offline CorrectionsOffline CorrectionsCheck File StatusCheck File Status
September 2012 Demographic Data Corrections 40
ApproveApprove
September 2012 Demographic Data Corrections 41
Final StepsFinal Steps
• Request & save a copy of final corrected data file
• Approve – District Complete– Sends data for inclusion in January
Internet posting– Sends invoice from ETS
September 2012 Demographic Data Corrections 42
Score uncoded and rescore Score uncoded and rescore miscoded miscoded
end-of-course mathematics or end-of-course mathematics or science testsscience tests
• Two options– Demographic data corrections– Handscore
September 2012 Demographic Data Corrections 43
Data Corrections Hand Scoring
Question: What is the fee to the school district?
Zero additional cost ……if district is already performing demographic
data corrections to correct other data.
$52 per student
Question: Will updated data be sent to CDE for inclusion in Internet data posting and API/AYP calculations?
YES NO
Question: Will updated summary reports, data CD, etc., be available?
YES NO
Question: Will there be notification of new score(s) (Student Master List, Student Record Label, data CD, etc.)?
YESThe updated Student Master List, Student
Record Label, and the student data file CD will be available for an additional charge.
YESLetter will be sent to the district STAR coordinator
containing the new/revised scores.
Question: Will updated STAR Student Reports be available?
YESPaper and PDF available
NO
Data Corrections vs. Handscoring FAQs Data Corrections vs. Handscoring FAQs for EOC Mathematics or Sciencefor EOC Mathematics or Science
September 2012 Demographic Data Corrections 44
Questions?Questions?
QuizQuiz
Which of these methods can be used to correct student demographic data online?
A. Request a hand-score.
B. Resubmit my Pre-ID file.
C. Use the search for student feature to correct one student record at a time.
D. Upload an Excel spreadsheet containing only the corrected records.
September 2012 Demographic Data Corrections 45
QuizQuiz
You should download a file, correct records online, and then upload the file.
True.
False.
September 2012 Demographic Data Corrections 46
QuizQuiz
Which field can be corrected using demographic data corrections?
A. Parent Education Level
B. School code
C. District name
D. Test administration
September 2012 Demographic Data Corrections 47
QuizQuizWhat are the last two tasks you should perform before finishing the demographic data corrections process?
A. Contact the CDE and let them know you are finished, and then call STAR TAC.
B. Request and download a final copy of your district’s demographic corrections for your records, and then select the “Approve – District Complete” button.
C. Make sure to contact your district’s superintendent, and then take a coffee break.
D. Select the “Approve – District Complete” button, and then select “Unapprove.”
September 2012 Demographic Data Corrections 48
September 2012 Demographic Data Corrections 49
Next Webcast:Next Webcast:
2012 STAR Order 2012 STAR Order Management October 17, Management October 17,
2012 2012 Webcast starts at 9 a.m.