Meeting the Challenge of Assessment When The Outcome is Personal Transformation

Annette Becker DNS, RNAssociate ProfessorUtica College

A Little About Me…• No matter what the conversation….• Confusion? Complexity? Competition?• Identifying the outcome creates clarity• I am an outcomes kind of girl….

Transformation• A Buzz Word• Used as an outcome• Mission statements• Business, academics, technology, new age….• “A transformative experience”• I want to know what people mean when they are describing an

experience where people will be transformed.• Thus… the fish

In Nursing

5

Influx of RNs into RN

to BSN programs

High cost of health care

Patient Protection and Affordable Care

Act

IOM80% BSN by

2020(IOM, 2010)

Inc. % of BSN =Improved

Patient Outcomes

BSN in 10

Preferential hiring of BS

RNs(pursuit of Magnet status)

Gap and Question

• Nurses are obtaining bachelor’s degrees which are improving patient outcomes• But what is happening during that transition to bring

about the improvement • What is the personal transformation?

In Higher Education…

Outcomes and Evaluation

• Cognitive outcomes (knowledge and skills) are weaker indicators of sustainable learning than measures reflecting internal change in the individual student

• (Arum& Roska, 2011; Arum, 2013; Astin, 1999; Astin & Lising Antonio, 2012; Buissink-Smith, Mann & Shephard, 2011; Pascarella & Terenzini, 2005; Feldman & Newcomb, 1969; Hanson, 2012)

Student Development

• College as a crossroads opportunity for the development of self-authorship • Self-authorship provides

inner security necessary to navigate complexities of current culture

• (Kegan, 1984, 1994: Baxter Magolda, 2001, 2002, 2004),

7

Historically

• We know that cognitive outcomes measuring knowledge and skills are weaker indicators of sustainable learning, than measures reflecting internal change in the individual student (Arum, 2013; Arum & Roska, 2011; Astin, 1999; Astin & Lising Antonio, 2012; Feldman & Newcomb, 1969; Hanson, 2012; Pascarella & Terenzini, 2005).

• When a student becomes a critical thinker, the change is more lasting than when the student simply describes and demonstrates the critical thinking skill.

Personal Transformation

• “A dynamic, uniquely individualized process of expanding consciousness whereby individuals become critically aware of old and new self-views and choose to integrate these views into a new self-definition” (Wade, 1998, p.716). • Personal transformation is unique to the

individual and their construction of meaning which changes over time

9

Presentation in Three Parts

• The Theoretical Triad• Grounding the definition and study of personal transformation

• The Research • To explore personal transformation in RNs who recently

graduated from an RN to BSN program.

• The Application of a Program Evaluation Tool• To assess experiences of personal transformation in RNs at the

end of an RN-BSN Online Program

THEORETICAL TRIAD

Theoretical Triad

12

Psychology:Constructive-Development (Kegan, 1982)

College Student Development:

Self-Authorship

(Baxter Magolda, 1999)

Personal Transformation

Adult Education:

Transformative Learning

(Mezirow, 1991)

Common Threads• Transformation of Consciousness• Evolution of consciousness based on meaning perspectives (Kegan)• Sense of self is central to the development of self-authorship (Baxter

Magolda)• Transformative Learning encourages the development of sense of self

(Mezirow)

• Meaning• Core of Constructive Development theory (Kegan)• Central to the integration of self and the development of a lasting (self-

authoring) identity (Baxter Magolda)• Transformative learning encourages transformation by changing

meaning perspectives (Mezirow)

• Context• Individuals as the “meaning-making context” (Kegan)• Context reflected in the holism of self-authorship theory (Baxter-

Magolda)• Context as a way to interpret and change meaning perspectives

(Mezirow)

14

THE RESEARCH

The Research• Primarily Qualitative• Snowball sampling• RNs who graduated from NYS BS completion schools within past

year• Exclusion Criteria

• No BSN• BSN > one year prior• Former students at UC

• Semi-Structured interviews• Phenomenological approach (meaning perspectives)• Content analysis

Demographic Data Survey Results

18

Summary of Data• Personal Transformation was described as meaningful change

evident in• Lasting awareness• Increased confidence• Application of new skills into practice

Connection With The Theory• Lasting Awareness• Perspective transformation (Transformative Learning Theory)

• Bigger picture• Increased Confidence • Self-Authorship Theory• Variation was noted according to age and experience

• Application of New Skills into Practice• Meaning perspectives applied in context• Very little variance according to age

Study Limitations• Measurement of transformation• Theoretical framework to offset ambiguity

• Sample• Limited diversity • Age distribution provided a perspective

• Small size

21

PROGRAM EVALUATION

Program Evaluation

• Survey Monkey•Demographics• Survey

questions• 5 Point Likert Scale • Strongly Disagree to

Strongly Agree

Demographics1. Start of program?2. Courses taken?3. Age?4. Gender?5. Years with Nursing License?6. Currently Employed?7. Plan to pursue graduate degree?

Survey Questions

8. Compared to when I began the Utica College RN to BSN program…. (s.dis to s.agree )

I have a “bigger picture” of the nursing profession I have added new skills to my nursing practice I am better equipped to be a nursing leader My nursing practice hasn’t changed much I have a better understanding of what it means to be a

professional Overall, I am a better nurse

Survey Questions

9. Compared to when I began the Utica College RN to BSN program….(s.dis to s.agree )

• I know myself better• I am more capable of meeting challenges• I haven’t changed much• Overall I am more confident

Survey Questions

10. Compared to when I began the Utica College RN to BSN program…. (s.dis to s.agree )

• Write professionally• Search for current research studies• Integrate the evidence in my practice• Be a leader among my peers• Communicate with others• Collaborate with a team• Think critically• Be compassionate• Act professionally

•

Survey Questions

11. After completing the program I can say, • I am a better leader in my nursing practice• I am a better clinician in my nursing practice• I am more professional in my nursing practice• I am more well-rounded in my nursing practice

Survey Questions

12.Overall the Utica College RN to BSN Program was challenging

13.Overall, I would recommend this program to other RNs

14.Overall I am satisfied with my experience in the Utica College RN to BSN program

15.If I were to change anything in the program to make it better, I would ….

ReferencesAiken, L.H., Clarke, S.P., Cheung, R.B., Sloane, D.M., & Silber, J.H. (2003). Educational levels of hospital nurses and

surgical patient mortality, Journal of the American Medical Association, 290, 1617-16.Aiken, L.H., Clarke, S.P., Sloane, D.M., Lake, E.T. & Cheney, T. (2008, May). Effects of hospital care environment on

patient mortality and nurse outcomes. Journal of Nursing Administration, 38(5), 223-229.Aiken, L. H., Sloan, D., Bruyneel, L., Van den Heede, K., Griffiths, P., Busse, R., Diomidous, M., Kinnunen, J., Kozka, M.,

Lesaffre, E., McHugh, M., Moreno-Casbas, M.T., Rafferty, A.M., Schwendimann, R., Scott, P.A., Tishelman,

C., van Achterberg, T., & Sermeus, W. (2014). Nurse staffing and education and hospital mortality in nine

European countries: A retrospective observational study. The Lancet, 26(2). doi:10.1016S0140-6736(08)61345-8

Arum, R. (2013). Stakeholder and public responses to measuring student learning. Society, 50(3), 230.Arum, R. & Roksa, J. (2011). Academically adrift: Limited learning on college campuses. Chicago: University of Chicago

Press.Astin, A. W. (1999). Rethinking academic "excellence". Liberal Education, 85(2), 8. Retrieved from http://search.proquest.com/docview/209814400?accountid=28902 Astin, A.W., Astin, H.S., Boatsman, K.C., Bonous-Hammarth, M., Chambers, T., Goldberg, S. et al. (1996). A social

change model of leadership development: Guidebook (Version III). Los Angeles: University of California, Los Angeles, Higher Education Research Institute.

Astin, A. W. & Lising Antonio, A. (2012). Assessment for excellence: The philosophy and practice of assessment and evaluation in higher education (2nd Ed.). Lanham, MD: Rowman & Littlefield Publishers, Inc. 30

ReferencesBaxter Magolda, M.B. (2001). Making their own way: Narratives for transforming higher education to promote self-

development. Sterling, VA: Stylus.Baxter Magolda, M.B. (2002). Helping students make their way to adulthood: Good company for the journey. About Campus, January-February, 2-9.Baxter Magolda, M.B. (2004). Self-authorship as the common goal of twenty-first-century education. In M.B. Baxter &

P.M. King (Eds), Learning partnerships: Theory and models of practice to educate for self-authorship (pp. 1-36). Sterling, VA:Stylus.

Buissink-Smith, N., Mann, S., & Shephard, K. (2011). How do we measure affective learning in higher education? Journal of Education for Sustainable Development, 5(1), 101-114.

Feldman, K.A. & Newcomb, T.M. (1969). The Impact of College on Students. San Francisco: Jossey-Bass.Hanson, C. (2013). The art of becoming yourself. Academe, January-February, 15-18.Kegan, R. (1994). In over our heads: The mental demands of modern life. Cambridge, MA: Harvard University Press.King, P. M. (2009). Principles of development and developmental change underlying theories of cognitive and moral

development. Journal of College Student Development, 50(6), 597-620. Mezirow, J. (1994). Understanding transformation theory. Adult Education Quarterly, 44, 4. Psacarella, E.T. & Terenzini, P.T. (2005). How college affects students: A third decade of research. San Francisco:

Jossey-Bass.Wade, G.H. (1998). A concept analysis of personal transformation. Journal of Advanced Nursing, 28(4), 713-719.

31

Contact Information

Annette L. Becker DNS, RNAssociate Professor of NursingDirector RN to BS Online ProgramUtica College1600 Burrstone Road, Utica, NY 13502abecker@utica.edu315-792-3078 (w)315-345-3322 (c)

32

Questions?