Jisc e assess-mar_12

18
Enhancing the e-assessment process in a mobile world: Developments at UCS JISC RSC Eastern, e-assessment Showcase 30 th March, 2012 Andy Ramsden [email protected] http://a.ucs.ac.uk/elevate [email protected] Twitter: ucselevate

description

This session will focus on two projects at UCS around exploring how the mobility of the student and/or the member of staff can enhance various parts of the e-assessment process. The two projects will look at how e-assessment is being made more efficient and enhanced through an appropriate use of technology. The first involves implementing a location aware e-assessment engine (objective testing) based around the use of QR Codes to enable students to submit their answers. The system includes instant formative feedback loops and stores the results for developing learning activities. The second example is based on current pilot study into staff using iPads to enhance the formative feedback process. This uses the iAnnotate and ShowMe applications to enable staff through removing barriers to annotate student work, and provide more effective and efficient individual and generic feedback. Presentation by Andy Ramsden

Transcript of Jisc e assess-mar_12

Page 1: Jisc e assess-mar_12

Enhancing the e-assessment process in a mobile world: Developments at UCS

JISC RSC Eastern, e-assessment Showcase

30th March, 2012

Andy [email protected]

http://a.ucs.ac.uk/elevate

[email protected]

Twitter: ucselevate

Page 2: Jisc e assess-mar_12

What you will hopefully get

Awareness of some small scale pilot studies at UCS

what we are doing what we have learnt where we are going next

Opportunity to try

Page 3: Jisc e assess-mar_12

Context of use @ UCS

Existing studentsCurrent technologies

New studentsCurrent technologies

Existing studentsNew technologies

New studentsNew technologies

• An iPad in the hands of a lecturer

• QR Code Quiz for Field based study

Gartner: Emerging Technologies Hype Cycle

Page 4: Jisc e assess-mar_12

Location aware learning activity: Focus on enhancing Feedback

Page 5: Jisc e assess-mar_12

Why?

A low threshold application is a teaching/learning application of information technology that is reliable, accessible, easy to learn, non-intimidating and inexpensive.

They have observable positive consequences and contributes to important long term changes in teaching and/or learning” Steve Gilbert, http://www.tltgroup.ors.html [accessed: 31/10/11]

Location aware learning at a low cost …

Page 6: Jisc e assess-mar_12

Learning Design Sequence: What they do

Group activity in costal area

Question & Answers in Field study centre

Support support in groups on the technology

Put up posters around the coastal study area

Results from server

Group results uploaded to server

Generate PDF posters

Create questions and youtube feedback

In the field

In the study centre

Page 7: Jisc e assess-mar_12

What do we all get?

Page 8: Jisc e assess-mar_12

Where next with QR Code Formative Quiz (next 3 months)

Software

• Integrate with UCS ShortURL & QR Code Generator • SourceForge and share for feedback

Future pilots

• Recruit more pilot groups

Page 9: Jisc e assess-mar_12

An iPad in the hands of a lecturer: Focus on enhancing Feedback

Page 10: Jisc e assess-mar_12

Why?

http://www.shinyshiny.tv/2010/03/ipad_sofa_gadget.htmlhttp://www.ictcool.com/category/pgce-week-02/

High barriers to entry Low barriers to entry

“marking any more than a handful of papers at a PC gets pretty uncomfortable pretty quickly whereas the tablet is much easier to use” – Lecturer, UCS (March, 2012)

Orthodox Model Media Tablet Model

Page 11: Jisc e assess-mar_12

E-feedback: Generic: ShowMe

Rearranging a 3 variable equation – the triangle rule : http://www.showme.com/sh/?h=87XHDbE - Gavin Devereux (School of Science Technology & Health)

Scenario: mark a large number of scripts, and you wish to feedback to all students some generic issues

Page 12: Jisc e assess-mar_12

The workflow: who does what (ShowMe)?

Page 13: Jisc e assess-mar_12

E-feedback: Individual: iAnnotate

Scenario: making individual e-feedback more effective, and opening up the opportunities of individual audio & visual feedback

Mandy Gault (School of Science Technology & Health)

Page 14: Jisc e assess-mar_12

The workflow: who does what (iAnnotate)?

Page 15: Jisc e assess-mar_12

Staff Feedback

What do we need to do to improve the process?

- A clear process circulated and communicated to all involved (seems to be some ambiguity)- A simple way to prevent documents changing (e.g. figures disappearing) when opened in iAnnotate- Ability to install Dropbox on my computer (probably one for IT...)- Ensuring that the student numbers are visible on file names (e.g. at the start) would be helpful for both the lecturers and me- Ability to batch upload annotated scripts and marks

- Difficult to use your finger as a pen

Do you think it is worth exploring this approach further?

- I think it seems to be the way forward for online assessment and the online feedback

- Definitely worth exploring, I think the tablets have a lot of potential once we get used to integrating them within the marking and feedback process.

- Much easier to use than the alternative on-line marking system, as too many clicks to actually get to the document via the Wolsey gradebook link. In addition, you can annotate the script with iannotate, and cannot do this on the PC laptop. It would be worth exploring further, but the process need to be much quicker to actually be as good as paper marking.

Page 16: Jisc e assess-mar_12

Student Feedback

To what extent would you agree with the following statement – the ability to receive my feedback as an annotated PDF via my Wolsey (LearnUCS) course is absolutely brilliant

Strongly agree - 0Agree – 2Neutral – 5Disagree – 4Strongly Disagree - 0

Good concept of utilising online resources to provide feedback, however, the feedback is very hard to read due to the writing on the PDF looking like it had been written in microsoft paint

Good to get feedback online instead of paper format, but sometimes confusing what parts of my work the speech bubbles where pointing too. Confusing whether it was crosses or ticks through my work

Take time to check which points relate to the feedback at the bottom of the screen. Would be easier to hover over the point and look at the feedback on he same page

Page 17: Jisc e assess-mar_12

Where next with media tablets (next 3 months)

Hardware

• Explore iPad3 • Stylus technology

Software

• Explore software apps which will make cut & paste from comment banks• Staff advice around accurate annotations / writing• Installation and management processes of key software at UCS

Process

• Feed into a recommendations to UCS Exec & LTAG around e-submission and e-feedback policy at UCS

Page 18: Jisc e assess-mar_12

Thanks & Questions

Andy [email protected]

http://a.ucs.ac.uk/elevate

[email protected]

Twitter: ucselevate