Lyn Lall and Anita Holt - RSC EM and RSC NW

In Brief - Assessing effective use of technology for quality and improvement

2

RAPTA

Review And Plan for Technology in Action

Session overview

• What is RAPTA?

• The process - RAPTA the SAR and QIP

• The tool

• How do we measure impact?

• Activity

• What next

3

RSC East Midlands 4

• Learning outside classroom through technology

• Effective use of resources including technology

• Effective use of technology in assessment

 

Specific references to use of technologyOfsted inspectors handbook

What is RAPTA?

A tool to identify, evaluate and improve technology's contribution to teaching learning and assessment

RAPTA provides a way of evaluating the impact of...

• The contribution of e-learning

• The relevance of e-learning

• What we are doing

• How we are doing

5

What is RAPTA?

2 themes relating to

•Teaching learning and assessment

•Leadership and management

28 questions

6

7

8

9

10

A look at the RAPTA tool

Versions of the tool

•Moodle (downloadable course on RSC EM Moodle)

•Word (downloadable from Moodle course above)

11

12

13

Response methodology

| 14

What? So What? What Next?

What is being done with technology to address the question?

Take your response

Now demonstrate impact and show evidence for the effect of current technology in action

Having analysed what is being done and its impact, how might you further improve teaching, learning and assessment for this question? And what contribution will technology make?

Focus on current technology in action

Consider how you will evidence impact, in

particular, with use of the ‘double negative statement’

Focus on the improvement of

teaching, learning and assessment first rather than technology in itself

Explain the expected impact and the evidence you will use to prove it

Types of evidence for RAPTA15

Quantitative

•Using data to demonstrate changes, backing this up with an explanation

Qualitative

•Identifying and gathering feedback from learners and others

RAPTA Recommended

•Using a ‘double negative statement’ with users, particularly learners, to gain specific insight about what has changed and improved as a result of technology in action intervention (may be qualitative and quantitative)

How can we measure impact?

16

17

Activity

Use Titanpad to share good practice with effective use of technology for each of the following questions

18

When encouraging independent learning

Q6 How does technology help to foster independent learning that takes place beyond the learning session?

Q7 How effective is the VLE in supporting your learners?

When monitoring, assessing and giving feedback

Q18How effective is the use of technology in assessment?

19

Looking at effective leadership and management

Q25 In providing rigorous performance management:

How does technology contribute to the planning and delivery of professional development to staff, managers and governors?

Activity :Section B Question 6

When encouraging independent learning

How does technology help to foster independent learning that takes place beyond the learning session?

Use the Titanpad link below or in the chat pane to share good practice with effective use of technology and if possible how you know?

http://titanpad.com/Rapta6

21

Ways in which technology might foster independent learning• Electronic individual learning plans allow the

setting and monitoring of targets over time    

• Learners participate in setting and reviewing their targets

• The use of personal and hand held technology is supported in learning design and activity 

• The VLE enables teaching and learning outside the learning sessions

• Use of the internet is built into teaching, learning and assessment 

21

Section E Question 18

When monitoring, assessing and giving feedback

How effective is the use of technology in assessment?

http://titanpad.com/Rapta18

25

How effective is the use of technology in assessment

• Technology is used across the organisation to track completed assessments and this information contributes to the monitoring of learners’ progress and achievement at both course and organisation level

• Assignments are submitted and marked on-line

• Technology is used to track learner targets that the learner can participate in their review and to assess overall progress and achievement

26

How effective is the use of technology in assessment?• Features include allowing the use of personal

and handheld technology, submission of work and assignments using personal spaces (for example, e-portfolios), software and social media

• Formative assessment on assignments in progress is given to learners

• The teaching staff provide learners with timely feedback, both formative and summative, via the VLE on assessed assignments, attendance, punctuality and other factors relevant to making progress

| 27

Section H Question 25Looking at effective leadership and management

In providing rigorous performance management,

How does technology contribute to the planning and delivery of professional development to staff, managers and governors?

http://titanpad.com/Rapta25

28

How does technology contribute to the planning and delivery of professional development to all?

• Where appropriate, general and specialist training for staff is provided through the VLE, which has several courses and communities which staff can join

• Teaching staff complete CPD activity and take part in critical friendship and co-mentoring within and beyond their employment as a means of developing reflective thinking, using e-portfolios or other technology

• Leaders, managers and governors use the same technologies (such as a VLE) as learners in completing internal training.

29

Deployment of RAPTA• How will RAPTA be managed?

 

• How will the narrative and evidence provided be collated and analysed?

 

• Have you a common understanding of what impact and evidence mean in the context of RAPTA?

• Who should be involved?

30

Possible deployment solutions

• Allocating an area in an alternative VLE

• Setting up RAPTA in SharePoint or your Intranet

• Setting RAPTA up in, or posting responses to, a cloud application like Google Drive, Skydrive, Box.net, iCloud and Dropbox

• Posting responses to a central Mahara or portfolio page

• Posting responses to a wiki, like PB Works or similar

31

How will RAPTA be managed? – some tips• Need ‘buy-in’ from senior leaders.  

• There must be dedicated leads from Quality Improvement and Technology (not IT services) to work on RAPTA together

• Agree a lead reviewer or review team with clear responsibility for co-ordination of RAPTA and analysis of the information it collects, noting the process of transfer of evidence to Self Assessment Review

• Aim for consistent communication of RAPTA guidance and interpretation

32

Indicators of RAPTA implementation

33

Few ideas Lots of ideas Lots of evidence Little evidence

Unstructured approach

Poor insight into activity

Lack of a mechanism to capture the evidence

Weak understanding of the value of technology in learning

Good progression as indicated in the quality of the statements

Under-developed provision

Covert use of technology outside the reach and knowledge of the

organisation

Unfinished work

Poor mechanisms to capture the unique technology contribution to

learning

Gap between aspirations in statements and actuality

What next?Request RSC support for using RAPTA, or an e-progress review

Download the RAPTA tool from RSC EM Moodle and try it in your organisation

http://tinyurl.com/RSCEMRAPTA

Check out the Ofsted resources on effective use of VLEs at http://www.ofsted.gov.uk/resources/virtual-learning-environments-e-portfolio

34

Next In Brief

4th February – What’s Flipping next?

35