ePortfolios: Advantages and Disadvantages for assessment

34
/ http://www.rsc-northwest.ac.uk/acl/eMagArchive/RSCeM ag2008/choosing%20an%20eportfolio/index.html @t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

description

Slides from webinar on 'ePortfolios as Assessmentt' given by Eloise Tan in the 2012 Online Assessment and Feedback Module at Dublin City University.

Transcript of ePortfolios: Advantages and Disadvantages for assessment

Page 1: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

/

http://www.rsc-northwest.ac.uk/acl/eMagArchive/RSCeMag2008/choosing%20an%20eportfolio/index.html

Page 2: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

LI502: Assessment and Feedback in the Online Environment

Page 3: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

ePortfolios: possibilities for self/peer assessment, and

feedback

Page 4: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

JISC: Effective Practice with e-Portfolios (2008)

• Case studies • Multiple perspectives:

learners, practitioners, institution, audience

• 6 steps to ePortfolio based learning

• http://www.jisc.ac.uk/media/documents/publications/effectivepracticeeportfolios.pdf

Page 5: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Work of Dr. Helen BarrettWebsite: http://electronicportfolios.org/Twitter: @eportfoliosCollection of presentations on SlideShare:

http://www.slideshare.net/eportfolios

http://electronicportfolios.org/myportfolio/LecShare/

Page 6: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Research on ePortfolios and Assesment

Cambridge (2010) Jafari & Kaufman, Eds. (2006)

Page 7: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Mason, R., Pegler, C. and Weller, M. (2004), E-portfolios: an assessment tool for online courses. British Journal of Educational Technology, 35: 717–727

ABSTRACT:

This article considers the various uses of e-portfolios in an educational context and looks at the particular characteristics of the electronic version of portfolios. It then focuses on the application of the e-portfolio as an assessment method. A case is made for the use of the e-portfolio as an appropriate end of course assessment process where learning objects are the basis of the course design. Evaluation data from such a course is presented. This is a post-graduate online course run by the Institute of Educational Technology at the Open University. Conclusions are drawn from the evaluation about the appropriateness of e-portfolios as an end of course assessment method.

Page 8: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

OverviewePortfolios: Definition, components,

purposes, challenges, software Case studies: Learner, practitioner,

institutional perspective (JISC pub)ePortfolios and Assessment: self/peer

assessment, reflection,and feedback

Page 9: ePortfolios: Advantages and Disadvantages for assessment

What is an ePortfolio?

What do we want/need them to do? What are your questions about ePortfolios for assessment?

Page 10: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Definition of ePortfolios (JISC, 2008)

“An e-portfolio is the product, created by the learner, a collection of digital artefacts articulating experiences, achievements and learning.” (p.6)

‘The picture has often been a complex one, with confusion over what an e-portfolio is. More recently, consensus is gathering, and clarity is being brought to the discussions, (p.4)

Page 11: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Possible components

ePortfolio

Blog

Evidence of achievemen

ts (c.v., completed projects, awards)

Multimedia (podcasts,

videos, images)

Works in progress

Page 12: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Potential of components

ePortfolio

Blog- Reflection- Peer assessment / feedback from lecturer

Evidence of achievements

(c.v., completed projects, awards)- Digital c.v.

Multimedia (podcasts, videos,

images) - Showcase achievements - Reflection (podcast/videos)

Works in progress- Assessment for Learning / Formative Feedback from peers and lecturer

Page 15: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

http://dailyblogma.com/business/coaching/7-benefits-keeping-success-journal/

Page 16: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

http://www.gilbertglass.com/services

Page 17: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Page 18: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Audience / views (Mahara)

http://www.highenergyforlife.com/articlelist/34-general-health/104-just-say-it-how-to-handle-a-tough-conversation

http://www.batipi.com/conference-call-global-meeting/

http://www.research-in-germany.de/16844/disover-germany,templateId=popup,currentContentId=12764.html

http://lgo.mit.edu/news/articles/clfm_mini_classes/clfm_mini_classes.html

Page 19: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Search ‘Eportfolio examples’ from your own discipline

http://www.blog.qarea.com/news/web-search-requires-shake-up/

Page 20: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Examples of ePortfoliosCompiled from the University of Waterloo

http://cte.uwaterloo.ca/KSU/Sites_with_examples_of_student_eportfolios.pdf

Helen Barrett’s compilation http://electronicportfolios.com/ALI/samples.html

A Thai Digital Collective online http://www.portfolios.net/profile/nontoxic

Page 21: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

(possible) Objectives ePortfolios

Assess

Collect

Reflect

Page 22: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Some opportunities with ePortfolios Lifelong learning (take it with them after

they are finished) Establish a positive digital identityAn accessible repository of student

artefacts over the yearsPaperless markingLearn technical skillsEncourage showcasing of work

(assessments usually a private matter) Visual and digital literacies

Page 23: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

What could be some challenges or unintended consequences of using ePortfolios? Enter into chat or raise hand to use Talk

button

Page 24: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Case studies There are 6 case studies presented in the

JISC publication, two for each perspective: Learner, Practitioner, Institutional

Choose a case study, while reading make note of: Lessons learnedWhat would you want to replicate? What challenges might you face?

We will come back and share

Page 25: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Designing an ePortfolio (JISC, pp.36-37, 2008)

Define Understand Prepare Engage Impleme

nt Review

Page 26: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Some ePortfolio toolsMaharaGoogle SitesCollection of tools http://

www.acenet.edu/Content/NavigationMenu/ProgramsServices/cii/res/assess/eportfolio1.htm

Helen Barrett’s online portfolio adventure (constructs the same portfolio in different tools to show differences) http://electronicportfolios.com/myportfolio/versions.html#18

Page 27: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Assessing ePortfolios What do you want to assess?

The individual artefacts? The ePortfolio as a whole, developed over time? The way the students interact with each other?

(Commenting, reviewing, collaborating) The presentation of the ePortfolio? (Design, navigation,

ease of use)Who do you want to do the assessing?

Students can self assess, peer assess (commenting) When do you want to assess?

Formative assessment: Could provide feedback at timed intervals, asking to students to upload

Page 28: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Keep in mind: You might not want to assess the ePortfolio, it might be used as a file folder for artefacts that are assessed previously… let the pedagogy lead the technology

Institutional pushes for ePortfolios might be looking for a ‘file folder’, ‘showcase’, option. Different from ePortfolios for assessment.

Page 29: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Rubrics for ePortfolios Generic rubric for ePortfolios, adapted from

(Vandervelde, 2004) http://www.danwilton.com/eportfolios/rubric.php

General rubric from Saltlake Community College

http://www.aacu.org/meetings/annualmeeting/AM12/documents/hubertGeneralEducationePortfolioHolisticAssessmentRubric.pdfUniversity of New South Wales explains

issues in assessing ePortfolios http://teaching.unsw.edu.au/printpdf/535

Page 30: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Peer AssessmentNeed to scaffold the practice of

commenting, go beyond the ‘Like’ button phenomenon

Set guidelines: netiquette, how many times you want them to comment, appropriate quality, quantity, and content

Model good ‘commenting’ behaviourTypes of comments: summarising,

critiquing, comparing, continuing the conversation, praising… ‘Comment’ can mean many things!

Page 31: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Feedback Set guidelines for formal and informal

feedback (don’t want to feel like you need to comment on everything and at the same depth). Be wary of Feedback Overload!

Give students notice when you will be dropping in to give formal feedback, give them a chance to tidy up

With Mahara you can control who sees what you write, so feedback can still be one to one

Feedback, feed forward, feed up

Page 32: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Current Featured Resource on Moodle

• JISC: Effective Practice with e-Portfolios (2008)

• Case studies • Multiple perspectives:

learners, practitioners, institution, audience

• 6 steps to ePortfolio based learning

• http://www.jisc.ac.uk/media/documents/publications/effectivepracticeeportfolios.pdf

Page 33: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Excellent collection of ePortfolio resourceshttp://www.scoop.it/t/e-portfolios-in-practice

Page 34: ePortfolios: Advantages and Disadvantages for assessment

@t_eloise Dr. Eloise Tan, Learning Innovation Unit, Dublin City University

Questions?