NSS Assessing Student Learning for the

Business, Accounting and Financial Studies

Curriculum Series:

(3) Public Assessment – Assessment Design

and the Implementation of SBA (New)

1 November 2011

Program Rundown

Time Rundown Speaker /

Facilitators

2:00 – 2:15 Registration

2:15 – 3:15 School-based Assessment

– Design and Arrangement

Ms Clarie Chan Manager, Assessment

Development

Break

3:30 – 4:45 School-based Assessment

Implementation

– Strategies in Conducting SBA

Ms Mabel Lee Good Hope School

Mr Vincent Cheung Liu Po Shan Memorial

College

4:45 – 5:00 Q & A

Overview of SBA Implementation in HKDSE

Chinese Lang, English Lang, Liberal Studies, Chinese History, Design & Applied Technology, History, Information & Communication Technology, Visual Arts

Biology, Chemistry, Physics, Science

A

Chinese Literature, Economics, Ethics & Religious Studies, Geography, Health Management & Social Care, Technology & Living, Tourism & Hospitality Studies, Literature in Eng, Physical Education total of 23

Music

subjects have to

Business, Accounting & Financial Studies

2012 Implementation Partial

implementation

(laboratory work)

Deferred implementation submit Deferred

implementation SBA marks Deferred implementation

2013 Implementation Partial

implementation

(laboratory work)

Deferred implementation

Deferred implementation

Deferred implementation

2014 Implementation Implementation Implementation School trial School trial

2015 Implementation Implementation Implementation Implementation School trial

2016 Implementation Implementation Implementation Implementation Implementation

Major ConcernsMajor Concerns

Aggregate workload on students and teachers

Resources and support

5

The SBA Streamlining Proposals

Guiding Principles:

Should not change the design principles of the curriculum

and assessment framework

Uphold the spirit of SBA – integral part of learning &

teaching and essential component of the public

assessment, with due consideration given to the interests and benefit of students

Streamlining through avoiding too much overlapping of SBA (minimising duplication of assessment effort within/across subjects), and reducing administrative work in conducting the assessments and submitting

marks, to make SBA more manageable for students and teachers but not at the expense of essential learning elements

7

Proposal for Streamlining of SBA for 2014 HKDSE BAFS (School Trial)

Key Activities of a SBA Task (existing task requirements)

Key Activity 3: Participation in the assigned business

activity and/or information collection

• Take part in the business event assigned by the

teacher, e.g. actual venture, competition, training

program, visit, talk, etc.

• Collect primary and/or secondary data in accordance

with the decided theme/title

Key Activity 4: Initial analysis of results

• Note major findings and conduct preliminary analysis

• Submit Worksheet 3

Implementation Phase

Key Activity 5: Written presentation

• Apply and integrate business knowledge to the business

scenario under investigation

• Organise and present findings and recommendations

• Submit a written report (max. 3 pages)

Key Activity 6: Oral presentation

• Apply business presentation skills to report on findings

and recommendations

• Present individually to teacher and/or peers

• Respond to questions

Reporting Phase

Key Activity 1: Proposal of a theme/title for the SBA task

• Decide on the scope of work for the SBA task

• Submit Worksheet 1

Key Activity 2: Proposal of a theme/title for the SBA task

• Finalise questions for investigation

• Submit Worksheet 2

Planning Phase

Key Activity 7: Reflection on learning

• Reflect on aspects of knowledge and/or personal growth

• Identify limitations and propose improvements for future

studies

• Submit Worksheet 4

Evaluation Phase

Key Activities of a SBA Task (The streamlining proposal)

Key Activity 3: Participation in the assigned business

activity and/or information collection

•Take part in the business event assigned by the teacher,

e.g. actual venture, competition, training program, visit,

talk, etc.

•Collect primary and/or secondary data in accordance with

the decided theme/title

Key Activity 4: Initial analysis of results

•Note major findings and conduct preliminary analysis

Implementation Phase

Key Activity 5: Preparation of the written report

•Apply and integrate business knowledge to the business

scenario under investigation

•Organise and prepare findings and recommendations

Key Activity 6: Oral presentation

•Apply business presentation skills to report on findings and

recommendations

•Present individually to teacher and/or peers

•Respond to questions

Reporting Phase

Key Activity 1: Proposal of a theme/title for the SBA task

•Decide on the scope of work for the SBA task

Key Activity 2: Proposal of a theme/title for the SBA task

•Finalise questions for investigation

•Submit the Worksheet

Planning Phase

Key Activity 7: Reflection on learning

•Reflect on aspects of knowledge and/or personal growth

•Identify limitations and propose improvements for future

studies

•Submit a written report (max. 3 pages)

Evaluation Phase

g the w rk process, th marks on as clarity, completeness d relevance t

Mark allocation after streamlining

Marks Worksheets Oral

Presentation

Written

Presentation

Record of work process 10 � a

Business presentation skills 30 �

Business knowledge and understanding 25 �

Analytical skills for business decision-making 35 �

100

Note: a. The worksheet is meant to be a record of the planning process. Considering the tentative nature of the ideas alon o e 10 worksheets are awarded for general aspects such an o the curriculum.

Worksheet after streamlining

Teacher assessment form after streamlining

The streamlining proposal (Summary)

Task Requirement

Worksheet 1 worksheet to be completed in class

Assessment weighting = 10%

Written Report 1 written report (max 3 pages)

Assessment weighting = 60%

Oral Presentation

An oral presentation, with a question and

answer session, of about 5 mins

Assessment weighting = 30%

Time Frame (1) May - Aug 2011: Formulating streamlining proposals by CDI and HKEAA

Sep – Oct 2011: Presenting the proposals to Principals’ Liaison Meeting, SBA Advisory Group, CDC-HKEAA Committees and Working Group on Piloting of SBA Sample Tasks for discussion

14 Oct 2011: Briefing sessions for school leaders

Oct – Nov 2011: Sharing the proposals with teachers at SBA subject conferences

Nov - Dec 2011: Consulting schools about the proposals

Jan - Feb 2012: Endorsement sought from the Public Examinations Board

Feb 2012: Informing schools of the finalised arrangements

Administrative Arrangement for 2014 HKDSE SBA (School Trial)

t

Calendar of events (for 2014 HKDSE)

2nd erm 1st term 1st term 2nd term 1st term 2nd term

SBA

Streamlining

Proposal

Finalized

District

Coordinating

System

Established SBA Marks

Submission

2012 (S4)

2012 (S5)

2014 (S6)

2013 (S6)

2013 (S5)

2014

Date of Exam

Samples of

Student

Work

Submission Moderation

and

Sample

Review

Feedbacks

on

Moderation

to Schools

t

Calendar of events (for 2014 HKDSE)

2nd erm 1st term 1st term 2nd term 1st term 2nd term

District

Coordinating

System

Established

2012 (S4)

2012 (S5)

2014 (S6)

2013 (S6)

2013 (S5)

2014

Date of Exam

EDB

District Coordinating System

SCHOOL PRINCIPALS

STUDENTS

HKEAA

SCHOOL COORDINATORS

SBA SUPERVISORS / DISTRICT COORDINATORS

SCHOOL

TEACHERS

EDB

Roles of Coordinators and Supervisors

School

coordinators will:

�Be appointed by the school principal

�Liaise with HKEAA and the district coordinators

�Plan the school assessment schedule

�Coordinate the reporting of marks to HKEAA

�Report to the district coordinators any irregularities

SBA supervisors /

District

coordinators will:

�Monitor SBA and report irregularities to HKEAA

�Write reports on progress of SBA

�Meet with school coordinators / teachers to provide

guidance and receive comments

�Review samples of students’ work

t

Calendar of events (for 2014 HKDSE)

2nd erm 1st term 1st term 2nd term 1st term 2nd term

SBA Marks

Submission

2012 (S4)

2012 (S5)

2014 (S6)

2013 (S6)

2013 (S5)

2014

Date of Exam

SBA Marks Submission

1 mark on worksheet

1 mark on written report

1 mark on oral presentation

(School Trial) All marks submitted in S6

t

Calendar of events (for 2014 HKDSE)

2nd erm 1st term 1st term 2nd term 1st term 2nd term

2012 (S4)

2012 (S5)

2014 (S6)

2013 (S6)

2013 (S5)

2014

Date of Exam

Samples of

Student

Work

Submission

Samples of Student Work Submission

School basis

Stratified sampling

- 6 samples on worksheet

� If possible, schools should request their students to

submit/retain their work in digital format to facilitate easy retrieval/storage of the work

- 6 samples on written report

(HH, HM, MM, ML, LM, LL)

t

Calendar of events (for 2014 HKDSE)

2nd erm 1st term 1st term 2nd term 1st term 2nd term

2012 (S4)

2012 (S5)

2014 (S6)

2013 (S6)

2013 (S5)

2014

Date of Exam

Moderation

and

sample review

WWhhyy MMooddeerraattiioonn –– SSttaannddaarrddiissaattiioonn

bbeettwweeeenn SScchhoooollss

Teachers know their students well and are best placed to judge their relative performance

However, they may not be aware of the standards of performance across all schools

Some schools may be harsher or more lenient in marking and/or use a narrower or wider mark range

Standardisation across schools to ensure fairness

26

MMooddeerraattiioonn MMeetthhooddss Statistical moderation with an element of expert judgment

- Statistical moderation based on school exam results, follow up

with appropriate actions for outliers identified

- Moderation based on exam results appropriate for most schools,

but adjustment based solely on exam results may not fully reflect

students’ actual SBA performance in some schools

- Sample review to help identify outlier schools. For outlier schools,

adjustment will be carried out, if necessary, by considering a

number of factors, such as moderated marks based on exam

results and sample review findings so as to reflect the actual SBA

performance

Schools’ internal ranking remains unchanged

For details of the moderation mechanism, please refer to the booklet Moderation of School-based Assessment Scores in the HKDSE:

http://www.hkeaa.edu.hk/DocLibrary/SBA/HKDSE/HKDSE-SBA-ModerationBooklet_r.pdf 27

SSaammppllee ReRevviieeww

Purpose of sample review in the moderation process:

Outlier detection

• Identifying those schools where the standard of SBA work is significantly better/worse than their exam results suggested

Stratified random sampling

Random sampling:

Each student work in a school has a chance to be selected, which is a necessary condition for obtaining a representative sample (i.e., unbiased estimations)

Stratification:

Student works are divided into a number of strata, in each of which the performances of works are similar with each other (i.e., homogenous)

Some samples are selected from each stratum

Such an arrangement reduces sampling errors

28

t

Calendar of events (for 2014 HKDSE)

2nd erm 1st term 1st term 2nd term 1st term 2nd term

2012 (S4)

2012 (S5)

2014 (S6)

2013 (S6)

2013 (S5)

2014

Date of Exam

Feedbacks

on

Moderation

to Schools

Feedbacks on Moderation

Feedbacks on the outcomes of moderation will be provided at the beginning of the next school year

Public exam results of students will not be altered

t

How to Plan for SBA?

2nd erm 1st term 1st term 2nd term 1st term 2nd term

SBA

Streamlining

Proposal

Finalized

District

Coordinating

System

Established SBA Marks

Submission

2012 (S4)

2012 (S5)

2014 (S6)

2013 (S6)

2013 (S5)

2014

Date of Exam

Samples of

Student

Work

Submission Moderation

and

Sample

Review

Feedbacks

on

Moderation

to Schools

Resources and Support

10 Sample Tasks BAFS SBA

http://www.hkeaa.edu.hk/DocLibrary/SBA/HK

DSE/SampleTasks-BAFS-E-290709.pdf

BAFS SBA Teachers’ Handbook (Trial Version)

http://www.hkeaa.edu.hk/DocLibrary/SBA/HK DSE/SBAhandbook-Trial-BAFS-E-230909.pdf

Information on SBA Booklet

http://www.hkeaa.edu.hk/tc/sba/

Moderation of SBA Scores in the HKDSE Booklet

http://www.hkeaa.edu.hk/tc/sba/

Contact us

Public Examination Information

Tel: (852) 3628 8860

E-mail: dse@hkeaa.edu.hk

Operation of SBA Tel :(852) 3628 8070

E-mail :sba@hkeaa.edu.hk

Thank you!