Reporting Technical Skill Assessment Data

34
Presentation will start at 2:00 If you are using your phone for audio, please put it on mute. Submit questions through the chat feature For assistance go to: https://oregon.webex.com/oregon/mc and click on Support Oregon Dept. of Education, April 2011 1

description

Reporting Technical Skill Assessment Data. Presentation will start at 2:00 If you are using your phone for audio, please put it on mute. Submit questions through the chat feature For assistance go to: https://oregon.webex.com/oregon/mc and click on Support. - PowerPoint PPT Presentation

Transcript of Reporting Technical Skill Assessment Data

Page 1: Reporting Technical Skill Assessment Data

•Presentation will start at 2:00•If you are using your phone for audio, please put it on mute.•Submit questions through the chat feature•For assistance go to: https://oregon.webex.com/oregon/mc and click on Support

Oregon Dept. of Education, April 2011 1

Page 2: Reporting Technical Skill Assessment Data

Oregon Department of EducationApril 5, 2011

Oregon Dept. of Education, April 2011 2

Page 3: Reporting Technical Skill Assessment Data

Secondary data-entry personnel Postsecondary Perkins contacts CTE Regional Coordinators Perkins direct-recipient grant managers

Oregon Dept. of Education, April 2011 3

Page 4: Reporting Technical Skill Assessment Data

Understand changes in technical skill attainment data reporting requirements for Perkins IV.

Understand timelines for new data reporting.

Understand what qualifies as a valid and reliable technical skill assessment.

Understand which programs should be reporting technical skill assessment data.

Oregon Dept. of Education, April 2011 4

Page 5: Reporting Technical Skill Assessment Data

Tom Thompson – ODE◦ [email protected]◦ (503) 947-5790

Questions will be answered at the end of this presentation or posted on the ODE website.

Oregon Dept. of Education, April 2011 5

Page 6: Reporting Technical Skill Assessment Data

Key features of Perkins IV:◦ CTE Programs of Study◦ Accountability based on data◦ Assessment of Technical Skill Attainment CTE Programs of Study beyond scope of

today’s discussion Accountability based on data◦ Perkins IV Performance Measurement:

http://www.ode.state.or.us/teachlearn/pte/perkinsivperformancemeasurement.pdf

◦ Data for program management and improvement:http://www.ode.state.or.us/data/stats/opte/

Oregon Dept. of Education, April 2011 6

Page 7: Reporting Technical Skill Assessment Data

Today’s focus is on how to collect and report the data for Perkins Performance Measure related to Technical Skill Attainment

Actually, two measures for Technical Skill Attainment for secondary and postsecondary:◦ 2S1(a) and 1P1(a). The long-time approach using

grades in CTE courses (which will continue), and◦ 2S1(b) and 1P1(b). The use of valid and reliable

assessment aligned with standards◦ We are required to report to USDOE using results

from 2S1(b) and 1P1(b) this year.

Oregon Dept. of Education, April 2011 7

Page 8: Reporting Technical Skill Assessment Data

2S1(b) Technical

Skill Attainment

(Using

assessments)

Numerator: Number of CTE concentrators who completed their CTE program and took and passed valid and reliable technical skill measurements that are aligned with industry-recognized standards, if available and appropriate, and completed high school during the reporting year.

Denominator: Number of CTE concentrators who took technical skill assessments and completed high school during the reporting year.

1P1(b)Technical

Skill Attainment

(Using assessments)

Numerator: Number of CTE concentrators who completed their CTE program and took and passed valid and reliable technical skill assessments that are aligned with industry-recognized standards, if available and appropriate, during the reporting year or the following year. Denominator: Number of CTE concentrators who [completed their CTE program and] 1 took technical skill assessments during the reporting year or the following year.

Oregon Dept. of Education, April 2011 8

Page 9: Reporting Technical Skill Assessment Data

Assessments selected locally from an approved list◦ List available through Oregon Skill Sets online

database◦ http://www.ode.state.or.us/go/skillsets

Locally developed assessments allowable◦ Require approval from ODE in advance◦ Also included in the Oregon Skill Sets online

database

Oregon Dept. of Education, April 2011 9

Page 10: Reporting Technical Skill Assessment Data

Click on Quick View

Oregon Dept. of Education, April 2011 10

http://www.ode.state.or.us/go/skillsets

Page 11: Reporting Technical Skill Assessment Data

1. Select Career Area 2. Select Cluster

3. Expand AssessmentsOregon Dept. of Education, April 2011 11

Page 12: Reporting Technical Skill Assessment Data

Part of the Expanded Assessments List for Manufacturing

Oregon Dept. of Education, April 2011 12

Page 13: Reporting Technical Skill Assessment Data

Administered to program completers Secondary completers

◦ ODE online program listing◦ http://www.ode.state.or.us/data/stats/opte/◦ Students completing the program must be

assessed◦ Updates available online April 28, 2011

Postsecondary completers◦ Complete a degree or certificate

AAS Degree Independent certificate of 45 credits or more

◦ http://www.ode.state.or.us/search/page/?id=2526

Oregon Dept. of Education, April 2011 13

Page 14: Reporting Technical Skill Assessment Data

Oregon Dept. of Education, April 2011 14

http://www.ode.state.or.us/data/stats/opte/

Page 15: Reporting Technical Skill Assessment Data

Oregon Dept. of Education, April 2011 15

Page 16: Reporting Technical Skill Assessment Data

Reporting on Secondary Technical Skill Assessment will be done through the CTE Student Data collection◦ CTE data collections open April 28 to June 30, 2011◦ Student information systems should have been updated

using file format data from:◦ https://district.ode.state.or.us/search/page/?id=191

Specific data◦ Assessment date◦ Program code ◦ Assessment Type Code

http://www.ode.state.or.us/teachlearn/pte/techskillassessmentcodes.pdf◦ Met or Did not meet (actual score not reported)

Oregon Dept. of Education, April 2011 16

Page 17: Reporting Technical Skill Assessment Data

Date Program Strand Code

Assessment Type

Met = M; Did Not Meet = D

Oregon Dept. of Education, April 2011 17

Page 18: Reporting Technical Skill Assessment Data

Program Strand Code

Oregon Dept. of Education, April 2011 18

Page 19: Reporting Technical Skill Assessment Data

Divided into general types◦ Performance Assessments (1A, 1B, 1C)◦ Tests (2A, 2B, 2C)◦ Portfolios (3A, 3B, 3C)

Divided into source and use◦ Industry recognized license (1A, 2A, 3A)◦ Externally developed and no license (1B, 2B, 3B)◦ Locally developed (1C, 2C, 3C)

Full list available at: http://www.ode.state.or.us/search/page/?id=1656

Oregon Dept. of Education, April 2011 19

Page 20: Reporting Technical Skill Assessment Data

Most Common Secondary Performance Assessment

Oregon Dept. of Education, April 2011 20

Page 21: Reporting Technical Skill Assessment Data

Most Common Secondary Test

Oregon Dept. of Education, April 2011 21

Page 22: Reporting Technical Skill Assessment Data

Most Common Secondary Portfolio Assessment

Oregon Dept. of Education, April 2011 22

Page 23: Reporting Technical Skill Assessment Data

Reported through OCCURS System Fields and coding similar to secondary Full list of codes available at:

http://www.ode.state.or.us/search/page/?id=1656

Oregon Dept. of Education, April 2011 23

Page 24: Reporting Technical Skill Assessment Data

Oregon Dept. of Education, April 2011 24

Page 25: Reporting Technical Skill Assessment Data

Up to two assessments per student per year can be collected

Collection and reporting of grades will continue

Reporting by ODE to USDOE start 2010-2011 Approved programs must report by 2012-

2013 Not all programs will have technical skill

assessment data in 2010-2011.

Oregon Dept. of Education, April 2011 25

Page 26: Reporting Technical Skill Assessment Data

Oregon Dept. of Education, April 2011 26

Student Assessment

Student Information

SystemState Data

System

•Chosen locally•Local system for reporting•Third-party data usually available•Proficiency score•Sample reporting forms available

•Statewide system (OCCURS or OAIS)•Able to collect data

•Secondary vendors notified•Backup secondary online system•Colleges have made modifications

Page 27: Reporting Technical Skill Assessment Data

Optional secondary reporting document◦ http://www.ode.state.or.us/teachlearn/pte/

secondarytsadatareport.doc

Optional postsecondary reporting document◦ http://www.ode.state.or.us/teachlearn/pte/

tecskillassesssubmissiontemplateccc.xls

Oregon Dept. of Education, April 2011 27

Page 28: Reporting Technical Skill Assessment Data

Make sure there is a local method to move data to the statewide system.

Identify programs that should or could be reporting data for 2010-2011.

Make sure data is being reported during the appropriate timeline.◦ Secondary – April 28 to June 30, 2011◦ Postsecondary – deadline August 5, 2011

Oregon Dept. of Education, April 2011 28

Page 29: Reporting Technical Skill Assessment Data

Understand changes in technical skill attainment data reporting requirements for Perkins IV.

Understand timelines for new data reporting.

Understand what qualifies as a valid and reliable technical skill assessment.

Understand which programs should be reporting technical skill assessment data.

Oregon Dept. of Education, April 2011 29

Page 30: Reporting Technical Skill Assessment Data

This Webinar and Power Point will be posted on the ODE website at:

http://www.ode.state.or.us/search/page/?id=1656 All questions and responses will be posted

on the ODE website. For any additional questions contact Tom

Thompson at [email protected]

Oregon Dept. of Education, April 2011 30

Page 31: Reporting Technical Skill Assessment Data

CTE Regional Coordinators or Perkins Grant Managers

ODE resources on technical skill assessment◦ http://www.ode.state.or.us/search/page/?

id=1656 ODE resources on CTE data quality

◦ http://www.ode.state.or.us/search/page/?id=1623 ODE staff

◦ Technical Skill Assessment – Tom Thompson◦ Perkins Data Reporting – Brent Jacobsen

Oregon Dept. of Education, April 2011 31

Page 32: Reporting Technical Skill Assessment Data

Q: Are the CTECS assessments and the NOCTI Oregon Agriculture assessment considered to be locally developed?

A: Yes. They should be categorized as local assessments without an attached license. That would be code 2C for secondary and TESTLOC*** for postsecondary.

Oregon Dept. of Education, April 2011 32

Page 33: Reporting Technical Skill Assessment Data

Q: When reporting high school data, I think the program code for agriculture is 600 and the code for business is 250. Is that correct?

A: Yes. The correct code for each program can be found on the website at:

http://www.ode.state.or.us/data/stats/opte/apprprgs.aspx

The code is a 3-digit number listed with the Program of Study title.

Oregon Dept. of Education, April 2011 33

Page 34: Reporting Technical Skill Assessment Data

Q: Should I input “met” and “dnm” in the student information system to indicate that the student met or did not meet the proficiency level of the assessment?

A: Possibly. Different student information systems may use different terms. In the end, the community college data system (OCCURS) and K-12 data system will only accept specific characters. These data systems accept M for met and D for did not meet. It is the responsibility of the student information system vendor or developer to make sure the appropriate type of data can be submitted.

Oregon Dept. of Education, April 2011 34