PAPER SETTINGPRINCIPLES AND

PRACTICES

THE CASE OF THE FOREST SCHOOL

Who passed the exam?

05/03/2023

ROAD MAP

Skills of paper setting Understandi

ng the principles of paper setting

Set a question

paper with Marking scheme

WHICH ARE THE FAMILIAR WORDS WE USE DURING TESTING?

A

E

WHY DO WE WANT TO TEST PEOPLE?

Certifying Qualifying Selecting Eliminating Classifying Searching

WHAT ARE THE DIFFERENT MODES OF TESTING?

CRITERION-REFERENCED EVAL’S Based on a predetermined set of

criteria. For instance,

90% and up = A80% to 89.99% = B70% to 79.99% = C60% to 69.99% = D59.99% and below = F

CRITERION-REFERENCED EVAL’S

Pros:Sets minimum

performance expectations.

Demonstrate what students can and cannot do in relation to important content-area standards (e.g, ILS).

Cons:Some times it’s hard

to know just where to set boundary conditions.

Lack of comparison data with other students and/or schools.

WHAT IS THE POSITION OF THE EVALUATION IN THE LEARNING PYRAMID?

COGNITIVE DOMAIN

TAXONOMY OF AFFECTIVE DOMAIN

PSYCHO-MOTOR DOMAIN

BLOOM’S TAXONOMY

TESTING KNOWLEDGE DIMENSIONS

Factual knowledge Procedural knowledge Conceptual knowledge Meta-cognitive knowledge

QUIZ

Give an example of all the four types of knowledge

THE SALIENT FEATURES OF A GOOD QUESTION PAPER 1

REFLECT…

How do we test the validity and reliability of a question paper?

THE SALIENT FEATURES OF A GOOD QUESTION PAPER 2

REFLECT….

How do you test the Reliability and consistency of a Question paper?

THE DOMAINS OF THE BLUE PRINT OF A QUESTION PAPER

Knowledge Understanding Application Skill Creativity

WHAT IS A BLUE PRINT INDICATE?

Congruence with teaching and learning plan

Content Validity – testing what has been taught

Assist the paper setter Maintain standards of testing

ACTION VERBS TO TEST COMPETENCIES

REMEMBERING.. define, list, recall, repeat, reproduce state narrate

UNDERSTANDING classify, describe, discuss, explain, identify,

locate, recognize, report, select, translate, paraphrase

APPLYING choose, demonstrate, Illustrate interpret, write.

operate, schedule, sketch, solve, use,

ANALYZING appraise, compare, contrast, Critically evaluate differentiate, discriminate

distinguish, examine, experiment, question, test

EVALUATING.. appraise, argue, defend, judge, select, support, value,

CREATING assemble, construct, create, design, develop, formulate, write.

GROUP WORK 1

Each group will create 2 sample questions on each of the competencies identified.

CONTENT ELEMENTS OF A QUESTION

Terms Facts Concepts Principles Processes Themes

TERMS

What is an ‘Valency’? Define the term “Entropy” What do you understand from the term

“Momentum”? Define the term “polymerisation” What is malnutrition?

FACTS

What is Gravitational Force? Why do we need to purify ores before

extraction of metals? How is sugar digested in the body? What is periodic law?

CONCEPTS In a triangle, the square on the

hypotenuse is equal to the sum of the squares on the two adjacent sides. What do you call this triangle?

Why the water in a mud pot is cool? Why does a cycle tube often burst

during a summer? Why do we need to expose ourselves

to sunlight for sometime everyday? What is a sub-routine in a program?

PRINCIPLES Why are able to cook the food faster in a

pressure cooker? Animal charcoal is used as a

decolourizing agent. Why? Hydrogen/Helium balloons are used for

study by weather departments. Why? The electropositive character of

elements decrease along a group in the periodic table. Why?

PROCESSES

Suggest three factors that influence the production of Ammonia in Haber’s process

Describe how fermentation takes place How is the impure blood purified in the

body? Explain the role of messenger- RNA in

genetic processes How does an inverter function?

THEMES

Properties of elements are periodic functions of their atomic numbers – why?

What is Artificial Intelligence? How does it play a significant role in modern computing?

Pollution control needs social priority. Why? Why the plastic bags are banned in certain

hill stations?

GROUP WORK 2

Create 2 questions under each category

MECHANICS OF WRITING A QUESTION PAPER

THE SAME CONCEPT CAN BE USED TO IDENTIFY DIFFERENT COMPETENCIES

Examine the competencies in the following questions:Name three conditions necessary for

germination of a seedWhy air is necessary for germination of a

seed? If seeds are sown very deep, they do not

germinate, why? If there is a heavy rainfall immediately after

sowing the seeds, what would be the effect on the germination of seeds?

THE SAME CONCEPT CAN BE FORMATTED DIFFERENTLY TO TRIGGER DIFFERENTIAL THINKING SKILLS

Why do Sodium and Chlorine have a tendency to form a chemical bond?

Metallic sodium reacts vigourously with water but not a Sodium ion. Why?

Give an example of a highly electropositive and a highly electronegative element which results in the formation of an electrovalent bond?

Sodium chloride is an ionic compound but not Barium Chloride. Explain

QUESTIONS COULD BE USED TO IDENTIFY DIFFERENT ABILITY LEVELS List two chemical properties of Carbon

di oxide gas (lower ability –recall) Describe the details of the digestive

system of a man (medium ability – cognitive outcome)

Why the P – 1/v graph is linear? How would the graph look if it is 1/ P Vs V?

( ability to interpret and explore- higher difficulty)

Prepare Oxygen gas in the laboratory and collect two cylinders. Show two tests for its chemical property

( psychomotor outcome- higher ability)

QUESTIONS COULD BE USED TO TRIGGER THINKING

Why Carbon monoxide is considered as a poisonous gas?

All alcoholic drinks are made of ethyl alcohol and not methyl alcohol. Why?

When water seeps through a wall towards a switch in an electric point, the switch gives a shock when touched?

VERBAL TO NON-VERBAL FORMS See the following questions:

With the help of a diagram describe the internal structure of a dicot system

Draw a labeled diagram of longitudinal section of the petunia flower

In the given diagram of amoeba, label the parts a, b, c and d

(a+b)2 =……………..

WHAT ARE THE FEATURES TO BE TAKEN NOTE OF WHILE WORDING A QUESTION?

Vocabulary Syntax Directional or stimulus words Scoring objectivity Mechanics of writing

VOCABULARY OF A QUESTION

Questions should be direct and simple The vocabulary should be communicative It should ensure correct communication It should not give an implied meaning

SYNTAX OF A QUESTION

The syntax should be correct The syntax should have the correct

positioning of the stimulus word The syntax should be simple and not be a

compounded sentence The syntax should not be long enough to

trigger multiple meanings

DIRECTIONAL STIMULUS OF THE QUESTION

Every word carries a different directional stimulus.

Need to understand the differences between;Name, state, list, and enumerateExplain, discuss, clarify, and describeWhy, what, when and howComment, observe, differentiate and

analyze

SCORING OBJECTIVITY OF A QUESTION

Need to know the target clientele Need to know target objective Need to know the status of the question

in the blue print Need to know the difficulty level Need to know -Is the question a

differentiator or a neutralizer?

MECHANICS OF WRITING A QUESTION

The context of the question The knowledge level of the examinees The locus of the question in the blue

print The nature of the topic The score allotted The possible value point(s)

WHAT IS HOTS?

How do we set questions relating to HOTS?

EXAMPLE OF HOTS QUESTIONS On 26th August Lok sabha cleared the Food security bill. Some

of the features of this bill are:

The food bill will cover 2/3 of the Indian population. It includes 75% of rural and 50% of urban population. Each beneficiary will be entitled to get 5 kg of rice, wheat and

cereals for 5, 3 and 1 per kg.   Solve the following: Write in decimal form. If the population of India is 1.26 billion, find the number of

people who will be covered under this food bill. If 70% of Indians live in rural areas, find the number of rural

people who will be covered under this food bill. Do you think the implementation of the Food Security bill will

improve the condition of malnourished children in India? Give a reason.

HOTS 2 The land acquisition bill was passed by Lok Sabha on Aug 29 and the Rajya Sabha

on Sep 4. Some of the Key features of this bill are: The consent of 80 % of land owners concerned is needed to acquire land for

private projects and of 70 % landowners for public-private projects. The compensation has also been significantly increased under the new law. It

suggests compensation for the owners of the acquired land to be four times the market value in case of rural areas and twice in case of urban areas.

P Using the above information, solve the following: 1400m 1300

Q

1500m

A villager Ranjan was growing wheat in a piece of land, which was triangular in shape as shown in the figure. A private company that wanted to set up a factory acquired his land. The market value of the land was 450 per sq.m. Find the amount he got from the company as compensation. Do you agree with the development happening at the loss of agricultural land in India? Justify your answer.

HOTS 3 Krishna has a triangular plot. The

government decided to take over this land to construct a Health centre. The government said that it would give him another piece of plot in lieu of his plot. In the figure, is Krishna’s plot and would be the plot given by the government, in such a way that side PQ II side AB and PC = BC. Find out whether Krishna would be compensated with less area or more area or equal area of land. Also, find the length of side QC if length of AC = 850 m. Justify your answers with proper reasons.

. A P C B Q

C B Q

WHY DO WE SET A MULTIPLE CHOICE QUESTION?

Is it to ensure higher scoring objectivity? Is it to facilitate guessing competency? Is it to enable analytical thinking? Is it to identify the level of

understanding?

HOW DO WE SET A MULTIPLE CHOICE QUESTION?

The four elements:Visibly incorrectProvocativeApparently correctCorrect

EXAMPLE FROM SCIENCES

Aluminum vessels are frequently used for cooking; not copper vessels?

a. Copper is costly, while Aluminum is cheapa. Aluminium is a good conductor, Copper is a poor

conductorb. Aluminum is easily available, but copper is notc. Copper form poisonous hydroxy complexes, while

Aluminium doesn’t.

EXAMPLE SCIENCES Q.1 Mumbai can not have a large scale

production of wind energy because of a) lack of technology b) very high humidity (90% or more) c) less wind velocity d) lack of space .