Sector Capability

• Validation in line with Standards for RTOs

– Renae Guthridge

WA Training Institute (WATI)

Validation – KWL

• What do you Know?

• What do you Want to know?

bit.ly/224tnDT

• Later I will ask you what you Learned.

Standards’ Definition

• Validation is the quality review of the assessment process.

Includes the words…

valid, reliable, sufficient, current and authentic

valid sample

recommendations for improvement

acting upon

How is this different to before?

Before the Standards…

• Focus on tool development in line with principles of assessment.

• Rules of evidence were part of process but not a lot of student evidence was viewed – there are exceptions.

• Mapping was a big deal.

• Validation meetings were adhoc, superficial and not taken too seriously.

Overall I would say there was a lot of focus on assessment before it actually took place.

And now?

Tool development and mapping (of some description) is still important but…

• Lens is on student evidence and whether the principles of assessment and rules of evidence have been met (bigger picture).

• Validation is planned, formalised and takes time - if it’s to be done properly.

Overall I would say there is a lot more focus on assessment after it actually takes place.

Key Ideas

• comprehensive plan of systematic validation

• risk-based approach to developing the plan

• Trainers and assessors involved in training and assessment may also participate in the validation process

More Specifics

• Each training product validated once every 5 years…50% in first 3 years of cycle.

• Undertaken by one or more people not directly involved in delivery or assessment.

• Validator/s collectively must have:

– vocational competencies and industry currency

– VET currency

– TAE or assessor skill set

Other Points

• Independent validation only applies to TAE Training Package.

• Sample size – random, representative of all assessment judgements.

• Training Product means AQF qualification, skill set, unit of competency, accredited short course and module.

So What’s Happening in Your RTO?

• What is working?

• What is not working?

• What best practices have you seen?

• What recommendations do you have?

I asked this question to a number of LinkedIn groups last week and these are some of the responses I got…

Practitioner Feedback & Suggestions

• Sit in on a validation session being conducted by a reputable RTO.

• Validating assessment tools before using them is still important.

• Schedule validation and embed into individual calendars.

• Make it someone’s job role.

• Ensure the people who are validating know what they are doing .

More Feedback & Suggestions

• Consider going beyond VET-only practitioners – validators must have a strong understanding of assessment principles and practices.

• Encourage industry to participate.

• Spend time getting the know the documentation before the session.

• Do not rush the meeting but avoid getting bogged down.

• Find a SMS that helps manage the process.

Thank you to R Earl, M Ratcliffe, L Silverman, A bolezny, W Cato, D Makris, K Bosward, J Munro

Tips for Quality Assessment Tool Development

Required Knowledge / Knowledge Evidence

Assessing ‘know-how’…

…tell me…

…written or oral short answer tests.

Is the AQF level of the questions appropriate? Is the context and content of the questions relevant to the unit? Do the questions extend beyond the elements and demonstrate transfer? Is ALL knowledge covered? If other knowledge is covered, has it been distinguished from the required knowledge / knowledge evidence? Is ALL knowledge demonstrated before deeming competency?

Elements and Required Skills / Performance Evidence

Assessing can do…

…show me…

…observation in the workplace or a simulation of a workplace.

Are clear instructions provided to the observer? Are clear instructions provided to the candidate? Are all four dimensions of competency (task skills, task management skills, contingency management skills, and job/role environment skills) met? If third-party evidence-gatherers are used has the Competency standard been contextualised by writing them in familiar language (plain English) and with examples or key points?

Making the Assessment Judgement

Has sufficient evidence been gathered for each mandatory requirement? Is the evidence authentic and current? Have alternative arrangements been offered for candidates with specific needs? Has each mandatory requirement been demonstrated? Has the record been signed off by person(s) with assessor qualifications and vocational expertise?

Resources and Further Information

• Assessment in the VET sector 1st edn (2015) – see Chapter 7 ‘Validation and evaluation’

• TAC – Assessment Validation (fact sheet), Users’ Guide.

• ASQA – Conducting Validation (fact sheet), Guide – Developing Assessment Tools, Users’ Guide, FAQs

Validation – KWL

• What have you Learned?

• Any other feedback or comments?

bit.ly/1P7osFi

Thank you and watch out Foxes and Vixens - bit.ly/1XoyN5U

Renae Guthridge – WA Training Institute

renae@watraininginstitute.com.au

All pictures in these slides were taken from http://search.creativecommons.org/