Introducing the Concept of Learning Outcomes

Raimonda Markeviciene

Zagreb

16/17.06.2008

EQFHelsinki Recommendations

Dublin descriptors

NQF

QACurricula design

LO+student workload

RecognitionLO+student workload

Comparability of cycles(I, II, III)

Periods of studyJoint degrees

ECTS for accumulation and transfer

Bologna process – in a nutshell

ECTS – from transfer to accumulation

Credit was:Relative value – allocated to

each course unit by the institution to reflect its workload as a proportion to the total workload of the academic year.

Credit became a building block:

Absolute value.1 credit – 25-30 hours of

student workload (1500-1800);

Credit remained:Relative value: Conventionally

60 credits measure the workload of a full-time student during one academic year (30 – per semester)

Why Learning Outcomes/Competences?

Credits are (were) insufficient indication for the learning achievement;

Comparability and competitiveness require more transparency (LO);

Based on LO credits are an important tool for curricula design;

Different pathways lead to comparable LO allowing to maintain the diversity of European HE systems;

Credit accumulation and transfer is facilitated by clearly defined LO.

Implicit student:Time

WorkloadLO (Competences)

Teacher’s workload And time

Before Bologna

After Bologna

Study programme in credits

Stud. time + workload = Learning outcomes

Competences

ECTS – two parameters

• WORKLOAD (ECTS Credits)

• LEARNING OUTCOMES (Competences)

The European Credit Transfer and Accumulation System (ECTS) is a student-centred system based on student workload required to achieve the objectives of a programme of study. These objectives should preferably be specified in terms of learning outcomes and competences to be acquired.

  Accumulation Transfer Informal/experiential learning

Recognition Quality assurance

EQF

Elements LO+workload=CreditsNQF level descriptorsInstitutional grading  

1. Credits (LO+ workload)2. Institutional grading3. ECTS grading interpretation scheme

1. LO - credit 

1. Credits (LO+workload2. NQF level descriptors3. Dublin descriptors 

1.LO+workload=credits2. NQF level descriptors

1. Credits’ range 2. Dublin descriptors3. EQF for LLL descriptors 

Documents/Tools

1. IP/CC2. Institutional regulations on credit allocation3. Institutional academic regulations4. Institutional application form5. Institutional agreement6. ToR7. Diploma supplement  

1. IP/CC2. ECTS application3. ECTS LA4. ToR5. Institutional rules on recogn ition6. Diploma Supplement

1. Regional recognition agreements2. Sectoral recognition agreements3. Institutional recognition agreements4. Institutional regulations5. Application form6. Applicant’s portfolio

1. Diploma supplement2. NQF3. EQF4. IP/CC

1. Institutional regulations on credit allocation2. National regulation on degrees3. Institutional regulations on degrees

1. Dublin descriptors2. EQF for LLL descriptors3. NQF descriptors4. Sub-level descriptors

Main implementers

HE institutions Mobility co-ordinators;HE institutions

HE institutions;Other nominated authorities

HE institutions; ENIC/NARICOther nominated authorities

HE institutions;External accreditation bodies

National authorities;HE institutions

DEGREEDegree profile =

Aims + LO

QA:Needs and consultation

LO(competences)Level

Credits and workload ResourcesMonitoringUpdating

ResponsibilityInformation (Info-pack;DS)

NQF and EQF:LO(Competences)

LevelCredits and workload

UpdatingInformation

(Info-pack; DS)

Recognition:Information

LO(Competences)Level

Credits and workload

Learning outcomes and Workload: their relationship

Learning outcomes: Statements of what a learner is expected to know, understand and/or be able to demonstrate after completion of learning. They can refer to a single course unit or module or else to a period of studies, for example, a first or a second cycle programme. Learning outcomes specify the minimum requirements for award of credit.

Workload: The estimated time required to complete the activities foreseen for each course unit / module. Workload includes all learning activities, i.e. lectures, practical work, information retrieval, private study, placements, fieldwork, preparation of examinations, etc.

Learning outcomes defined for a unit / programme should match the available workload required by a typical student.

Factors influencing learning time and level of achievement

Diversity of traditions

Curriculum design and context

Coherence of curriculum

Teaching and learning methods

Methods of assessment

Organization of teaching and teaching process

Ability and diligence of the student

Financial support

Categories of LO

The qualification Descriptor or professional Profile

Programme Descriptor (related to Dublin Descriptors)

Level (sub-level) Descriptors (could be included into cycle)

Course unit descriptor (LO most subject specific)

Classification of types of LO in Dublin Descriptors (DD)

Knowledge and understanding Applying knowledge and understanding Making judgement Communication skills Learning skills

Tuning approach to LO - Generic and Subject Specific

Tuning generic competences - Instrumental

• Capacity for analysis and synthesis• Capacity for organisation and planning• Basic general knowledge• Grounding in basic knowledge of the profession• Oral and written communication in your native

language• Knowledge of a second language• Elementary computing skills• Information management & skills (ability to retrieve and

analyse information from different sources).• Problem solving• Decision-making.

Tuning generic competences -Interpersonal

• Critical and self-critical abilities• Teamwork• Interpersonal skills• Ability to work in an interdisciplinary team• Ability to communicate with experts in other

fields• Appreciation of diversity and multiculturality• Ability to work in an international context• Ethical commitment.

Tuning generic competences -Systemic

• Capacity for applying knowledge in practice• Research skills• Capacity to learn• Capacity to adapt to new situations• Capacity for generating new ideas (creativity)• Leadership• Understanding of cultures and customs of other countries • Ability to work autonomously• Project design and management• Initiative and entrepreneurial spirit• Concern for quality• Will to succeed.

THE TUNING DYNAMIC QUALITY ENHANCEMENT CIRCLE

Definition of academic and professional profiles

Programme design: definition oflearning outcomes / competences

Identification of resources

Construction of curricula: content and structure

Selection of teaching and learning approaches

Selection of types of assessement

Evaluation and improvement (on the basis of feed back and back forward)

Programme quality assurance

Example of DD translated into programme LO – Master degree in Euroculture

Generic competences:Knowledge and understanding – understand and critically

integrate the knowledge and insights from interdisciplinary courses

Judgements - critically judge academic research in the field of Europe and European unification

Communication: 1. give written and oral presentations on European issues (+ organise time); 2. communicate in another foreign language near native level; 3. use IT skills; 4. transfer knowledge to larger audiences

Learning: 1. make efficient use of libraries, bibliographical material and academic research; 2. work in an interdisciplinary team in an international context

Example of DD translated into programme LO – Master degree in Euroculture

Subject specific competences:Knowledge and understanding: 1. use theoretical and methodological

approach used in the programme; 2. interpret and describe identity as a process; 3. demonstrate familiarity with push and pull factors in the process of European identity

Apply knowledge and understanding: 1.identify the European dimension of social problems and distinguish these problems at different levels; 2. manage projects and communicate the results; 3. collect and process relevant information of European institutions; 4. understand and apply European processes

Judgements: 1. identify topics in the public debate in a reflective way and with an eye for cultural sensitive matters; 2. reflect on leading political, scientific and religious discourse in a critical way…

Communication - transfer knowledge related to current problems in European integration process to relevant bodies.

Learning outcomes and competences in study programmes (Tuning)

Course unit LO

Competences

A B C D E F G H I J

Unit 1 X X

Unit 2 X X X

Unit 3 X X X

Unit 4 X X X

Steps for course unit design

I. Find out prerequisites: modularized or non-modularized system, level and level descriptors

II. Write LOIII. Keeping in mind time available and LOs,

develop: modes of instruction, types of learning, types and criteria of assessment

IV Check the estimated workload and LO though student questionnaires

V. Adjust educational activities LO to be compatible within the given time frame

Some Vocabulary for Writing LO: I

Activities giving evidence of knowing:• Define, describe, identify, label, list, name, outline, reproduce, recall, select,

state, present, be aware of, extract, organise, recount, write, recognise, measure, underline, repeat, relate, know, match.

Activities giving evidence of comprehension:• Interpret, translate, estimate, justify, comprehend, convert, clarify, defend,

distinguish, explain, extend, generalise, exemplify, give examples of, infer, paraphrase, predict, rewrite, summarise, discuss, perform, report, present, restate, identify, illustrate, indicate, find , select, understand, represent, name, formulate, judge, contrast, translate, classify, express, compare.

Activities giving evidence of knowledge / understanding• Apply, solve, construct, demonstrate, change, compute, discover, manipulate,

modify, operate, predict, prepare, produce, relate, show, use, give examples, exemplify, draw (up), select, explain how, find, choose, assess, practice, operate, illustrate, verify.

Some Vocabulary for Writing LO: II

Activities giving evidence of analysis• Recognise, distinguish between, evaluate, analyse, break down., differentiate,

identify, illustrate how, infer, outline, point out, relate, select, separate, divide, subdivide, compare, contrast, justify, resolve, devote, examine, conclude, criticise, question, diagnose, identify, categorise, point out, elucidate.

Activities giving evidence of synthesis• Propose, present, structure, integrate, formulate, teach, develop, combine,

compile, compose, create, devise, design, explain, generate, modify, organize, plan, re-arrange, reconstruct, relate, re-organise, revise, write, summarise, tell, account for, restate, report, alter, argue, order, select, manage, generalise, precis, derive, conclude, build up, engender, synthesise, put together, suggest, enlarge.

Activities giving evidence of evaluation• Judge, appraise, assess, conclude, compare, contrast, describe how, criticise,

discriminate, justify, defend, evaluate, rate, determine, choose, value, question.

Example: Aspects of Marital Law and Practice in the 17th Century (by R. de Lavigne)

A student who successfully completes this module will be expected to be able:1. To demonstrate detailed knowledge of both the legal and the social

framework of marriage in Western Europe in this period.2. To analyse the reasons for variations in legal frameworks and of

social practice in both space and time.3. To explore the link between marriage, on the one hand, and natality

and mortality, on the other hand, as determinants of population trends.

4. To display the analytical tools and skills of the socio-legal historian, with particular reference to the selected legal and social texts of the period.

5. To deploy statistical information using information and communication technology where appropriate.

6. To demonstrate an ability to work both independently and in groups in order to propose solutions to problem areas within this field.

7. To work in more than one European language.

Example: Calculation of the workload

The planned third-year tutorial model comprises 10 ECTS (250-300 hours):

Tutorial: 2 hours per week x 14 weeks (25/30 hours = 1 ECTS credit)

Studying a textbook (500 pages) and sitting exam – 6 paged per hour = 83 hours = 3 ECTS credits

Writing a 7-10 page paper (700-1000 pages of literature must be read) = 140 hours = 5 ECTS credits

Reading and commenting on assignments written by group members (critical reflection) – (2 hours per week x 14 weeks = 28 hours = 1 ECTS credit)

1+3+5+1 = 10 ECTS credits

Assessment Methods and Criteria

1. Assessment method should allow to test the acquisition of the LO either directly or indirectly

2. Not all seven LO might be tested (demonstration of at least 5)

3. Devise assessment criteria:a. At threshold levelb. At other grade levels

4. Make sure that the programme enables the student to reach LO

5. Make sure that course unit LOs are comensurate with level descriptors

"When you come to the edge of all the light you have known, and are about to step out into darkness, Faith is knowing one of two things will happen:

here will be something to stand on, or you will be taught to fly."

Richard Bach

Thank you for your attention!