Sharon J. Hawks, CRNA, DNP The Use of Electronic ... · or the Certified Registered Nurse...

5
www.aana.com/aanajournalonline.aspx AANA Journal April 2012 Vol. 80, No. 2 89 Nurse anesthesia practitioners must attain a variety of competencies in order deal with the complexities of healthcare in the 20th century. Increasing popula- tion size, technological advances and ever-changing healthcare needs will require Certified Registered Nurse Anesthetist (CRNA) competency in not only anesthesia principles and advanced sciences but also in the area of leadership, ethical decision-making, and organizational management, just to name a few. Electronic portfolios provide student registered nurse anesthetists (SRNAs) with a method of stor- ing and viewing documents, which can be used as evidence for meeting learning outcomes and course objectives. Students would use a variety of technolo- gies including video, blogs and wikis. For the CRNA, electronic portfolios are a method of storing and dis- playing achievements over time. Electronic portfolios show both a retrospective and prospective view of the CRNA’s progress such that the transition from new graduate or “novice” CRNA to the experienced and ultimately “expert” practitioner can be observed. Because the CRNA or SRNA can view their achieve- ments, gaps in learning are more easily identified. Keywords: Competency, electronic, learning outcome, portfolio. Sharon J. Hawks, CRNA, DNP The Use of Electronic Portfolios in Nurse Anesthesia Education and Practice EDUCATION NEWS In its 2010 report on the future of nursing, the Institute of Medicine (IOM) reported that the methods used to educate nurses during the 20th century are no longer adequate to prepare nurses for dealing with the complexities of healthcare in the 21st century. 1 Increasing population size, cultural diversity, technologi- cal advances, and soaring healthcare costs have created a chaotic health- care environment, which requires a specific set of nursing competencies, including leadership, health policy, process improvement, research and evidence-based practice, teamwork, and multidisciplinary collabora- tion. The pedagogical foundation of education is student evaluation in order to demonstrate specific learning and terminal program out- comes. When a student receives a passing grade for a particular course or the Certified Registered Nurse Anesthetist (CRNA) meets program objectives for a continuing educa- tion opportunity, competence in the specific area of study is assumed. The IOM report challenges this thinking by emphasizing not only the end result (the learning out- come) but also the skills used to meet the outcome (competencies). Competency is defined as an abil- ity to do something, especially when measured against a standard or core competency. 2 Levels of competency can range from “novice” to “expert” and are based on the range of skills a provider may possess. An example of this range in competencies is demonstrated by comparing the newly graduated or “novice” CRNA with the experienced or “expert” CRNA. Although competency can be inferred from proxy measures, such as years of nurse anesthesia education or years in clinical practice, true competency attainment is based on acquisition and demonstration of a skill-set particular to a specified competency. 3 Student registered nurse anes- thetists (SRNAs) and CRNAs perform skills that can be used to demonstrate competency in a variety of clinical and nonclinical settings. These demonstrations are not always attached to an academic course of study or a continuing education program; however, they should be documented and viewed as contributing toward competency attainment. An important ques- tion to ask is: How will SRNAs and CRNAs document and demon- strate competency attainment and evidence of lifelong learning? An organized and iterative method for documenting initial certification and recertification competency is needed. Electronic portfolios (EPs) provide a means of storing, organiz- ing and showcasing achievements. Student registered nurse anesthetists

Transcript of Sharon J. Hawks, CRNA, DNP The Use of Electronic ... · or the Certified Registered Nurse...

Page 1: Sharon J. Hawks, CRNA, DNP The Use of Electronic ... · or the Certified Registered Nurse Anesthetist (CRNA) meets program objectives for a continuing educa-tion opportunity, competence

www.aana.com/aanajournalonline.aspx AANA Journal April 2012 Vol. 80, No. 2 89

Nurse anesthesia practitioners must attain a variety of competencies in order deal with the complexities of healthcare in the 20th century. Increasing popula-tion size, technological advances and ever-changing healthcare needs will require Certified Registered Nurse Anesthetist (CRNA) competency in not only anesthesia principles and advanced sciences but also in the area of leadership, ethical decision-making, and organizational management, just to name a few.

Electronic portfolios provide student registered nurse anesthetists (SRNAs) with a method of stor-ing and viewing documents, which can be used as evidence for meeting learning outcomes and course

objectives. Students would use a variety of technolo-gies including video, blogs and wikis. For the CRNA, electronic portfolios are a method of storing and dis-playing achievements over time. Electronic portfolios show both a retrospective and prospective view of the CRNA’s progress such that the transition from new graduate or “novice” CRNA to the experienced and ultimately “expert” practitioner can be observed. Because the CRNA or SRNA can view their achieve-ments, gaps in learning are more easily identified.

Keywords: Competency, electronic, learning outcome, portfolio.

Sharon J. Hawks, CRNA, DNP

The Use of Electronic Portfolios in Nurse Anesthesia Education and Practice

Education nEws

In its 2010 report on the future of nursing, the Institute of Medicine (IOM) reported that the methods used to educate nurses during the 20th century are no longer adequate to prepare nurses for dealing with the complexities of healthcare in the 21st century.1 Increasing population size, cultural diversity, technologi-cal advances, and soaring healthcare costs have created a chaotic health-care environment, which requires a specific set of nursing competencies, including leadership, health policy, process improvement, research and evidence-based practice, teamwork, and multidisciplinary collabora-tion. The pedagogical foundation of education is student evaluation in order to demonstrate specific learning and terminal program out-comes. When a student receives a passing grade for a particular course or the Certified Registered Nurse Anesthetist (CRNA) meets program

objectives for a continuing educa-tion opportunity, competence in the specific area of study is assumed. The IOM report challenges this thinking by emphasizing not only the end result (the learning out-come) but also the skills used to meet the outcome (competencies).

Competency is defined as an abil-ity to do something, especially when measured against a standard or core competency.2 Levels of competency can range from “novice” to “expert” and are based on the range of skills a provider may possess. An example of this range in competencies is demonstrated by comparing the newly graduated or “novice” CRNA with the experienced or “expert” CRNA. Although competency can be inferred from proxy measures, such as years of nurse anesthesia education or years in clinical practice, true competency attainment is based on acquisition and demonstration

of a skill-set particular to a specified competency.3

Student registered nurse anes-thetists (SRNAs) and CRNAs perform skills that can be used to demonstrate competency in a variety of clinical and nonclinical settings. These demonstrations are not always attached to an academic course of study or a continuing education program; however, they should be documented and viewed as contributing toward competency attainment. An important ques-tion to ask is: How will SRNAs and CRNAs document and demon-strate competency attainment and evidence of lifelong learning? An organized and iterative method for documenting initial certification and recertification competency is needed. Electronic portfolios (EPs) provide a means of storing, organiz-ing and showcasing achievements. Student registered nurse anesthetists

Page 2: Sharon J. Hawks, CRNA, DNP The Use of Electronic ... · or the Certified Registered Nurse Anesthetist (CRNA) meets program objectives for a continuing educa-tion opportunity, competence

90 AANA Journal April 2012 Vol. 80, No. 2 www.aana.com/aanajournalonline.aspx

and CRNAs should consider using EPs to record and provide evidence of lifelong learning and competency attainment.4,5

Portfolios are defined as collec-tions of evidence used by an individual to document specific achievements, competencies, and learning outcomes.6 This general definition has been extended by developing a more dynamic view of portfolios as being a focused, purposeful collection of traditional and nontraditional work that documents an individual’s progress and achievement over time. Portfolios can be used for learn-ing assessment or for showcasing one’s accomplishments, much like a photographer’s portfolio of pho-tographs.7 An electronic portfolio is a collection of electronic evidence assembled and managed by a user and may contain inputted text, electronic files, images, multimedia, blog entries, and hyperlinks.8

Student registered nurse anesthe-tists and CRNAs can use portfolios to document proof of didactic and clinical achievement, as well as a means of demonstrating role development and personal and pro-fessional growth.9 A portfolio shows evidence of lifelong learning by demonstrating a CRNA’s continu-ing acquisition of skills, knowledge, attitudes, understanding, and achievements.6 Electronic portfolios are dynamic and potentially offer a fuller and richer image of the individual than traditional assess-ments.10 An electronic portfolio is both a retrospective and prospec-tive mechanism for evaluating competencies that may otherwise be difficult to assess, such as leader-ship, use of scientific evidence in practice, professional behavior, and creative endeavors.11

Portfolios originally took the form of a paper file and were used most often by artists, architects and photographers. A typical outline for constructing a hard copy portfo-lio includes: (a) creation of a neat grammatically correct document,

and (b) placement of the document into a 3-inch thick 3-ring binder complete with table of contents, numbered pages, and section divid-ers. One can only imagine how unmanageable hard copy portfolios become due to increased size and complexity after only a few years of development. With today’s available technology, there is no need to cart a 20-pound document from place to place. By serving as a storage and display mode for achievements and unique learning experiences, EPs have the potential to change not only which works are used to measure competencies and learner outcomes but also how the work is viewed.12

• Why Use Portfolios? Few would assume that the knowledge students possess upon graduating from any educational program last a lifetime. Over time, certain competencies a student possessed at graduation may be lost, while other new and different competencies are attained. Although new and critically impor-tant competencies will be achieved throughout a CRNA’s career, it is equally important that fundamental competencies obtained during nurse anesthesia education be maintained. This places special emphasis on the use of EPs in nurse anesthesia as a tool, not only to inform but also to transform a newly graduated CRNA from a “novice” to an “expert” CRNA. Paulson13 found the primary worth of an electronic portfolio is that learners are provided with an opportunity to evaluate their work and identify gaps in existing knowl-edge and competency level.

Portfolios delivered electroni-cally have an added advantage, as work can be shared with a broad audience easily and often. Because EPs are portable and accessible at any time, faculty, students, accredit-ing bodies, and potential employers are able to connect in a way never before possible. Student registered nurse anesthetists and CRNAs can decide which documents to share

based on the viewing audience and the reason for sharing.9,14 For example, SRNAs would provide course faculty with documentation of clinical case reports, academic achievements, publications, presen-tations, service work, certifications, and unique experiences demonstrat-ing competency attainment. Nurse anesthetists seeking recertification or credentialing would provide simi-lar documentation (plus teaching experiences, mentoring opportuni-ties and their level of participation in professional organizations) to potential employers or accrediting bodies.

• Reflective Practice. Reflective practice is the foundational com-petency for effective use of EPs in educational programs.7 Reflection is one of the most important aspects of portfolio use and can be used to facilitate self-evaluation and development of future goals. When students participate in the self-reflection process they are more likely to take charge of their own lifelong learning.13 After a document is added to the portfolio, reflection helps the student determine if learn-ing goals were met. As a result, it is not only the accomplishments but also the actual process of portfolio development that reinforces learn-ing. Through the reflective process, gaps in knowledge, skills and com-petence are identified.

• Components of a Portfolio. Primary components of an EP include carefully selected and docu-mented examples of the individual’s best work. The items selected would differ depending on individual clinical proficiency and expertise, past and current learning experi-ences, and enrichment activities and interests. In an educational portfolio, the SRNA chooses experi-ences that provide documentation of achieved learning and program outcomes. Regardless of the docu-ment presented, students should provide rationale for why a docu-ment was selected for inclusion in

Page 3: Sharon J. Hawks, CRNA, DNP The Use of Electronic ... · or the Certified Registered Nurse Anesthetist (CRNA) meets program objectives for a continuing educa-tion opportunity, competence

www.aana.com/aanajournalonline.aspx AANA Journal April 2012 Vol. 80, No. 2 91

the portfolio and should also reflect on and evaluate the submitted mate-rial.15 Ultimately, portfolio content depends on the viewing audience, EP purpose, creativity of the SRNA or CRNA, applicability of past expe-riences, and depth of self-reflection. Electronic portfolios can be created and shared for a variety of purposes including CRNA recertification, potential employment, evaluation for academic progression and ten-ure, or application to a doctoral program. Each EP would contain unique entries and documents used to demonstrate competencies and outcomes relevant to the specific EP purpose (Table 1).

• Portfolios and Outcome Evaluation. Educational program competencies can be assessed using a variety of assessment methods. When electronic portfolios are used to evaluate learning outcomes, mul-tiple-choice testing will no longer be the sole method for determin-ing whether learning has occurred. Direct observation of clinical perfor-mance, assessments of on-campus class learning activities, and end-of-semester and end-of-program presentations can be used to dem-onstrate the SRNA’s understanding and achievement of national or state competencies and to document progress in competencies difficult to measure such as leadership, men-toring, and ethical behavior. The portfolio could contain evidence of competency achievement, such as clinical preceptor evaluations of a SRNA’s clinical skills and the SRNA’s written reflections on their level of clinical performance.16 The goal is for students to be able to link competency standards and program outcomes to the skills and activities that they performed during clini-cal practice placements or during enrichment activities not attached to a particular course (Table 2).17

• Domains of Learning: Theoretical Basis for Portfolio Use. It is generally agreed that the theoretical basis underpinning the

portfolio approach is Knowles’ set of 5 assumptions regarding adult learners18:

1. The learner is self-directed.2. The student’s past experiences

are a rich resource for learning.3. Readiness to learn develops in

response to life tasks and problems.4. Learning must be relevant and

contribute a better quality of life.5. The more potent motivators

are internal, such as self-esteem, recognition, better quality of life, and self-actualization.

There are 6 levels of cognitive complexity including knowledge, comprehension, application,

analysis, synthesis, and evalua-tion. Through the use of electronic portfolios, students can display “artifacts” demonstrating acquisition of each of these cognitive domain goals. For example, students can attach copies of required assign-ments and reflect on the knowledge gained. They can then apply, syn-thesize, analyze, and evaluate the learning experience in the context of their preexisting knowledge, val-ues and beliefs. Students may also attach “artifacts” that are not the result of a specific assignment, yet have been identified by the student as necessary to meet program out-comes. These include items such as professional involvement, ser-vice learning, cultural immersion, and mentoring events. As students reflect on each of the selected “arti-

Select software

Google sites

Word Press

Mahara

Moodle

Create template as a guide

Align with program outcomes and competencies.

Ensure stakeholder “buy-in”

Faculty, network manager, IT support, clinical sites

Complete a “trial run”

Pilot implementation plan.

Create clear guidelines

Disseminate prior to implementation.

Implement in phases.

Educate students and faculty

Educate faculty first.

Students: During program orientation works well.

Evaluate regularly

Process and product evaluation are needed.

Adapt the process as needed

Model what others have done.

Table 2. Considerations for Imple-

menting Electronic Portfolios in Nurse

Anesthesia Education

Abbreviation: IT, information technology.

Introduction

Biographical overview

Philosophy

Vision statement

Academic background

Academic history

Academic honors and awards

Teaching experiences

Courses taught

Brief course summary and overview

Leadership

Organizational membership

Offices held

Unique leadership opportunities

Work on organizational projects, policy, and procedure development

Practice

Employment history

Licensure, certifications

Competency evaluations

Performance evaluation

Summary of cases, anesthetic, and special techniques performed

Scholarship

Research interests

Current projects

Publications

Grants

Service work

Service history

Professional references

Table 1. The CRNA Career Portfolio

Abbreviation: CRNA, Certified Registered Nurse Anesthetist.

Page 4: Sharon J. Hawks, CRNA, DNP The Use of Electronic ... · or the Certified Registered Nurse Anesthetist (CRNA) meets program objectives for a continuing educa-tion opportunity, competence

92 AANA Journal April 2012 Vol. 80, No. 2 www.aana.com/aanajournalonline.aspx

facts,” they attach meaning to the learning experience and an oppor-tunity for demonstration of affective learning occurs. For instance, a student might reflect on an ethical conflict that was observed in the clinical arena. After reflecting on the event, the student has an opportu-nity to process his or her thoughts and feelings and to obtain faculty assistance if needed (Table 3).19,20

Video recordings of a student’s performance of a specific psycho-motor skill can also be displayed as a student artifact. In addition to presenting a checklist or clinical case record, SRNAs can demonstrate competency in obtaining and main-taining a mask airway by adding a video recording of the skill demon-stration. Portfolios allow students to combine graphics, video, text, sounds, and other digital artifacts into an organized, portable, and Internet-ready format that can be modified and shared with others at any time.16

• Challenges to Portfolio Use. Guidelines and recommendations for “best practice” EP use in nurs-ing and nurse anesthesia education continue to evolve. No common or universally accepted EP creation software has been identified. This may prevent EP dissemination

outside of the parent institution, as the EP may not be accessible to a potential employer unless the employer has compatible software. The development of “open source” access to EP software, such as Google Sites and Word Press, has provided a partial solution to this problem. Institutionally based EP software systems, which integrate specific program outcomes with institutional values and philoso-phy, are currently being developed. An EP component specifically for nurse anesthesia educational pro-grams is currently included with the Typhon (Typhon Group LLC, Metairie, Louisiana) case tracking system. Optional EP development software is also included with cer-tain learning management systems, including Blackboard (Blackboard, Inc, Washington, DC).

Dedicated time for student and faculty orientation and train-ing will be needed. However, if EP development is included as a course assignment, such as in a Role Development course, time would be less of an issue. Because the EP development process is time-consuming, it must be perceived as valuable by students and faculty in order to be successful.

Students will require continuous support by faculty and information

technology staff. Although this is a potential area for concern, most students are “tech-savvy” and can typically find a solution to their own technology issues. Technology support may become an issue when students rotate to clinical sites with-out an Internet connection.

Privacy concerns with respect to institutional policies dealing with student, faculty and patient HIPAA rights are a significant issue. Privacy guidelines for EP develop-ment and dissemination must be developed and vetted through the appropriate institutional chan-nel. For CRNAs, this issue is less threatening, as sharing information with anyone except an employer is done voluntarily. In contrast, SRNAs are required to share elec-tronic information with faculty, compliance departments at multiple clinical sites, and clinical faculty and support personnel for each site. This increases the opportunity for breaches in student confidentiality.

The use of electronic portfolios to document lifelong learning, such as for CRNA recertification, is less complex than the use of EPs in an educational program.21 In this case, the EP’s primary function is to serve as a showcase for the CRNAs accomplishments and to demon-strate continued competency in the practice of nurse anesthesia.

Finally, an important question is: Will employers or potential audi-ences outside of academia view the EP as a viable method of documen-tation, or will the paper portfolio be preferred, regardless of its size or weight? Although there is mount-ing evidence of increasing EP use in academia for content management, intradisciplinary collaboration, and student evaluation, no data indi-cating that EPs improve student outcomes are yet available.

For those students, faculty, and practitioners who would like to learn more about using an elec-tronic portfolio, there are many available websites (Table 4).

What have I mastered and what remains to be learned?

How has my practice changed over the past year or semester?

What would I do differently next time?

When working with a difficult peer or colleague: How I changed the relation-ship.

In the next 5 years, what would I like to accomplish professionally?

What are my major strengths?

In what areas could my clinical perfor-mance be improved?

In what ways can I make a positive impact on my profession and my orga-nization?

Table 3. Nontraditional Events to be

Included in an Electronic Portfolio

Google Sites

https://sites.google.com

Word Press

http://wordpress.org/

MERLOT: Multimedia educational resource for online learning http://www.merlot.org/merlot/index.htm

Mahara: Open source eportfolio and social networking web application http://demo.mahara.org/

Moodle: Open source community-based tools for learning http://moodle.org/

Educause: Advancing higher education through the intelligent use of technology http://www.educause.edu/

Table 4. Websites of Interest

Page 5: Sharon J. Hawks, CRNA, DNP The Use of Electronic ... · or the Certified Registered Nurse Anesthetist (CRNA) meets program objectives for a continuing educa-tion opportunity, competence

www.aana.com/aanajournalonline.aspx AANA Journal April 2012 Vol. 80, No. 2 93

ConclusionCompetency demonstration by both SRNAs and CRNAs has future implications for nurse anesthesia certification and recertification. The National Board of Certification and Recertification for Nurse Anesthetists has defined continu-ing professional competence as an ongoing, multimodal, and progres-sive process that maintains and enhances proficiency in nurse anes-thesia practice from entry level to complete mastery. The determina-tion of what knowledge and skills equate to proficiency at the level required for initial professional cer-tification and recertification ranges from that of the novice to the expe-rienced nurse anesthetist. Certified Registered Nurse Anesthetists will be required to demonstrate com-petency and lifelong learning in various areas of practice to main-tain practice certification. Student registered nurse anesthetists must demonstrate acquisition of novice level competencies in not only air-way management, hemodynamic monitoring, and patient assessment but also in the competencies identi-fied in the IOM report. Electronic portfolios should be considered as a reliable and effective method of storing and displaying the accom-plishments and best work for both SRNAs and CRNAs.

REFERENCES 1. IOM (Institute of Medicine). The Future

of Nursing: Leading Change, Advancing

Health. Washington, DC: The National Academies Press; 2011.

2. Leach DC. Building and assessing com-petence: the potential for evidence-based graduate medical education. Qual Manag Health Care. 2002;11(1):39-44.

3. Leach DC. Competence is a habit. JAMA. 2002;287(2):243-244.

4. Monsen RB. Genetics Nursing Portfolios: A New Model for the Profession. Silver Spring, MD: American Nurses Association and International Society of Nurses in Genet-ics; 2005.

5. Ramey SL, Hay ML. Using electronic port-folios to measure student achievement and assess curricular integrity. Nurse Educ. 2003;28(1):31-36.

6. Brown R. Portfolio Development and Profil-ing for Nurses. 2nd ed. Lancaster, England: Quay Publications; 1995.

7. McCready T. Portfolios and the assessment of competence in nursing: A literature re-view. Int J Nurs Stud. 2007;44(1):143-151.

8. Butler P. A review of the literature on portfolios and electronic portfolios. 2006. http://del2admlit.wordpress.com/ 2007/09/07/butler-p-2006-a-review-of-the-literature-on-portfolios-and-electronic-portfolios-online-available-at-httpsedu forgeorgdocmanviewphp-1761111eportfo lio%20project%20research%20reportpdf/. Accessed February 22, 2012.

9. McMullan M, Endacott R, Gray MA, et al. Portfolios and assessment of competence: a review of the literature. J Adv Nurs. 2003;41(3):283-294.

10. Byrne M, Delarose T, King CA, Leske J, Sapnas KG, Schroeter K. Continued pro-fessional competence and portfolios. J. Trauma Nurs. 2007;14(1):24-31.

11. Dannefer EF, Henson LC. The portfolio approach to competency-based assessment at the Cleveland Clinic Lerner College of Medicine. Acad Med. 2007;82(5):493-502.

12. Reece SM, Pearce CW, Melillo KD, Beaudry M. The faculty portfolio: documenting the scholarship of teaching. J Prof Nurs. 2001;17(4):180-186.

13. Paulson FL, Paulson PR, Meyer CA. What makes a portfolio a portfolio? Educ Leader-ship. 1991;48(5):60-63.

14. Wenzel LS, Briggs, KL, Puryear BL. Port-folio: authentic assessment in the age of the curriculum revolution. J Nurs Educ. 1998;37(5):208-212.

15. Wisker G. Assessment for learning: Encouraging personal development and critical response on a writing module by student-centred assessment and teaching learning strategies. Innov Educ Train Int. 1996;33(1):58-65.

16. Taylor C, Stewart L, Bidewell J. Nursing students’ appraisal of their professional portfolios in demonstrating clinical com-petence. Nurse Educ. 2009;34(5):217-222.

17. Saltman DC, Tavabie A, Kidd MR. The use of reflective and reasoned portfolios by doctors: Reflective and reasoned portfolios. J Eval Clin Pract. 2010;18(1):182-185. (doi: 10.1111/j.1365-2753.2010.01514.x.)

18. Knowles M. Self-Directed Learning: A Guide for Learners and Teachers. New York, NY: Association Press; 1975.

19. Cangelosi PR. Learning portfolios: giv-ing meaning to practice. Nurse Educ. 2008;33(3):125-127.

20. Sorrell JM, Brown HN, Silva MC, Kohlenberg EM. Use of writing portfolios for interdisciplinary assessment of critical thinking outcomes of nursing students. Nurs Forum. 1997;32(4):12-24.

21. Redman W. Portfolios for Development: A Guide for Trainers and Managers. London, England: Kogan Page; 1994.

AUTHORSharon J. Hawks, CRNA, DNP, is an assistant professor of nursing and program director of the Duke University Nurse Anesthesia Program, Durham, North Carolina. One of her primary educational interests is the use of electronic portfolios to document student learning and achievement. She is a member of the AANA Education Committee. Email: [email protected].