Appendix B - Boston CollegeAPPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS...
16
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 379 APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS Appendix B Multiple Comparisons of Average Achievement in Mathematics Content Areas
Transcript of Appendix B - Boston CollegeAPPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS...
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 379
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS
Appendix BMultiple Comparisons of Average Achievement in Mathematics Content Areas
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE380
TIMSS2003
Grade88MATHEMATICS
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
Countries
Singapore h h h h h h h h h h h h h h h h h h h h h h h h h h h h h
Korea, Rep. of I h h h h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR I h h h h h h h h h h h h h h h h h h h h h h h h h h
Chinese Taipei I h h h h h h h h h h h h h h h h h h h h h h h h h h
Japan I I I I h h h h h h h h h h h h h h h h h h h h h h h h h
Belgium (Flemish) I I I I I h h h h h h h h h h h h h h h h h h h h h h h
Netherlands I I I I I h h h h h h h h h h h h h h h h h h h h h h
Hungary I I I I I I h h h h h h h h h h h h h h h h h h h h
Malaysia I I I I I I I h h h h h h h h h h h h h h h h h h h
Estonia I I I I I I I h h h h h h h h h h h h h h h h h h h
Slovak Republic I I I I I I I I h h h h h h h h h h h h h h h h
United States I I I I I I I I I I h h h h h h h h h h h h h
Latvia I I I I I I I I I I h h h h h h h h h h h h h
Russian Federation I I I I I I I I I I h h h h h h h h h h h
Israel I I I I I I I I I I I h h h h h h h h h h h
Lithuania I I I I I I I I I I I h h h h h h h h h h h
Australia I I I I I I I I I I I h h h h h h h h h h h
Slovenia I I I I I I I I I I I I I h h h h h h h h h h h
Sweden I I I I I I I I I I I I I h h h h h h h h h h
England I I I I I I I I I I I I I I I I I I h h h
Scotland I I I I I I I I I I I I I I I I I I I h h h h
New Zealand I I I I I I I I I I I I I I I I I I I h h h
Italy I I I I I I I I I I I I I I I I I I I h h h
Serbia I I I I I I I I I I I I I I I I I I I h h h
Bulgaria I I I I I I I I I I I I I I I I I I I h h h
Romania I I I I I I I I I I I I I I I I I I I h h
Armenia I I I I I I I I I I I I I I I I I I I I h h h
Cyprus I I I I I I I I I I I I I I I I I I I I I I I I I I I h
Moldova, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I
Norway I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Macedonia, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Lebanon I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Indonesia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Egypt I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Jordan I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Chile I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Palestinian Nat'l Auth. I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Botswana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Bahrain I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Saudi Arabia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Ghana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
South Africa I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsBasque Country, Spain I I I I I I I I I I I I I I I I I h h h h h h h h
Indiana State, US I I I I I I I h h h h h h h h h h h h h h h
Ontario Province, Can. I I I I I I I I h h h h h h h h h h h h h h h h h
Quebec Province, Can. I I I I I h h h h h h h h h h h h h h h h h h h h h h h
Sin
gap
ore
Ko
rea,
Rep
. of
Ho
ng
Ko
ng
, SA
R
Ch
ines
e Ta
ipei
Jap
an
Bel
giu
m (
Flem
ish
)
Net
her
lan
ds
Hu
ng
ary
Mal
aysi
a
Esto
nia
Slo
vak
Rep
ub
lic
Un
ited
Sta
tes
Latv
ia
Ru
ssia
n F
eder
atio
n
Isra
el
Lith
uan
ia
Au
stra
lia
Slo
ven
ia
Swed
en
Eng
lan
d
Sco
tlan
d
New
Zea
lan
d
Ital
y
Serb
ia
Bu
lgar
ia
Ro
man
ia
Arm
enia
Cyp
rus
Mo
ldo
va, R
ep. o
f
No
rway
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Exhibit B.1: Multiple Comparisons of Average Achievement in Number
Note: 5% of these comparisons would be statistically signifi cant by chance alone
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS TIMSS2003
GradeMATHEMATICS
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 381
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
Countries
h h h h h h h h h h h h h h h h h h h h Singapore
h h h h h h h h h h h h h h h h h h h h Korea, Rep. of
h h h h h h h h h h h h h h h h h h h h Hong Kong, SAR
h h h h h h h h h h h h h h h h h h h h Chinese Taipei
h h h h h h h h h h h h h h h h h h h h Japan
h h h h h h h h h h h h h h h h h h h Belgium (Flemish)
h h h h h h h h h h h h h h h h h h h Netherlands
h h h h h h h h h h h h h h h h h h I Hungary
h h h h h h h h h h h h h h h h h I Malaysia
h h h h h h h h h h h h h h h h h I Estonia
h h h h h h h h h h h h h h h h h I Slovak Republic
h h h h h h h h h h h h h h h h h I United States
h h h h h h h h h h h h h h h h h I Latvia
h h h h h h h h h h h h h h h h h I I Russian Federation
h h h h h h h h h h h h h h h h h I I Israel
h h h h h h h h h h h h h h h h h I I I Lithuania
h h h h h h h h h h h h h h h h I I I Australia
h h h h h h h h h h h h h h h h h I I I Slovenia
h h h h h h h h h h h h h h h h I I I Sweden
h h h h h h h h h h h h h h h h I I I England
h h h h h h h h h h h h h h h h I I I Scotland
h h h h h h h h h h h h h h h h I I I New Zealand
h h h h h h h h h h h h h h h h I I I I Italy
h h h h h h h h h h h h h h h h I I I I Serbia
h h h h h h h h h h h h h h h h I I I I Bulgaria
h h h h h h h h h h h h h h h h I I I I Romania
h h h h h h h h h h h h h h h h I I I I Armenia
h h h h h h h h h h h h h h h h I I I I Cyprus
h h h h h h h h h h h h h h h h I I I I Moldova, Rep. of
h h h h h h h h h h h h h h h h I I I I Norway
h h h h h h h h h h h h h h I I I I Macedonia, Rep. of
h h h h h h h h h h h h h I I I I Lebanon
I h h h h h h h h h I I I I Indonesia
I I h h h h h h h h h I I I I Egypt
I I h h h h h h h h h I I I I Tunisia
I I h h h h h h h h h I I I I Iran, Islamic Rep. of
I I h h h h h h h h h I I I I Jordan
I I I I I I I h h h h h I I I I Philippines
I I I I I I I h h h h I I I I Chile
I I I I I I I h h h I I I I Palestinian Nat'l Auth.
I I I I I I I h h h I I I I Morocco
I I I I I I I I h h h I I I I Botswana
I I I I I I I I I h h h I I I I Bahrain
I I I I I I I I I I I I I h h I I I I Saudi Arabia
I I I I I I I I I I I I I I h I I I I Ghana
I I I I I I I I I I I I I I I I I I I South Africa
h h h h h h h h h h h h h h h h I I I Basque Country, Spain
h h h h h h h h h h h h h h h h h I Indiana State, US
h h h h h h h h h h h h h h h h h I Ontario Province, Can.
h h h h h h h h h h h h h h h h h h h Quebec Province, Can.
Benchmarking Participants
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Mac
edo
nia
, Rep
. of
Leb
ano
n
Ind
on
esia
Egyp
t
Tun
isia
Iran
, Isl
amic
Rep
. of
Jord
an
Phili
pp
ines
Ch
ile
Pale
stin
ian
Nat
'l A
uth
.
Mo
rocc
o
Bo
tsw
ana
Bah
rain
Sau
di A
rab
ia
Gh
ana
Sou
th A
fric
a
Bas
qu
e C
ou
ntr
y, S
pai
n
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Exhibit B.1: Multiple Comparisons of Average Achievement in Number 88
Note: 5% of these comparisons would be statistically signifi cant by chance alone
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE382
TIMSS2003
Grade88MATHEMATICS
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
Countries
Korea, Rep. of h h h h h h h h h h h h h h h h h h h h h h h h h h h h
Singapore h h h h h h h h h h h h h h h h h h h h h h h h h h h
Chinese Taipei I h h h h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR I I h h h h h h h h h h h h h h h h h h h h h h h h h h
Japan I I I I h h h h h h h h h h h h h h h h h h h h h h h h h
Hungary I I I I I h h h h h h h h h h h h h h h h h h h h h h h
Estonia I I I I I h h h h h h h h h h h h h h h h h h h h h h
Belgium (Flemish) I I I I I I h h h h h h h h h h h h h h h h h h h h
Russian Federation I I I I I I I h h h h h h h h h h h h h h h h h h
Netherlands I I I I I I I h h h h h h h h h h h h h h h h h
United States I I I I I I I I h h h h h h h h h h h h h h h h h
Latvia I I I I I I I I h h h h h h h h h h h h h h h
Slovak Republic I I I I I I I I I h h h h h h h h h h h h h h
Lithuania I I I I I I I I I I I h h h h h h h h h h h h
Australia I I I I I I I I I I I h h h h h h h h h
Israel I I I I I I I I I I I I h h h h h h h h h h
Malaysia I I I I I I I I I I I I I h h h h h h h
England I I I I I I I I I I I I I h h h h h
New Zealand I I I I I I I I I I I I I I h h h h
Armenia I I I I I I I I I I I I I I I h h h h h
Scotland I I I I I I I I I I I I I I h h h h
Serbia I I I I I I I I I I I I I I I I h h h h
Slovenia I I I I I I I I I I I I I I I I h h h h
Bulgaria I I I I I I I I I I I I I I I I I h h h
Romania I I I I I I I I I I I I I I I I I h h h
Sweden I I I I I I I I I I I I I I I I I I I h h h
Italy I I I I I I I I I I I I I I I I I I I I I I I h h h
Moldova, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I h h
Cyprus I I I I I I I I I I I I I I I I I I I I I I I I I I I I h
Lebanon I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Macedonia, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Jordan I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Norway I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Indonesia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Bahrain I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Egypt I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Palestinian Nat'l Auth. I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Chile I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Botswana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Saudi Arabia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Ghana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
South Africa I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsBasque Country, Spain I I I I I I I I I I I I I I h h h h h h
Indiana State, US I I I I I I I I h h h h h h h h h h h h h h h
Ontario Province, Can. I I I I I I I I h h h h h h h h h h h h h h h h h h
Quebec Province, Can. I I I I I h h h h h h h h h h h h h h h h h h h h h h
Ko
rea,
Rep
. of
Sin
gap
ore
Ch
ines
e Ta
ipei
Ho
ng
Ko
ng
, SA
R
Jap
an
Hu
ng
ary
Esto
nia
Bel
giu
m (
Flem
ish
)
Ru
ssia
n F
eder
atio
n
Net
her
lan
ds
Un
ited
Sta
tes
Latv
ia
Slo
vak
Rep
ub
lic
Lith
uan
ia
Au
stra
lia
Isra
el
Mal
aysi
a
Eng
lan
d
New
Zea
lan
d
Arm
enia
Sco
tlan
d
Serb
ia
Slo
ven
ia
Bu
lgar
ia
Ro
man
ia
Swed
en
Ital
y
Mo
ldo
va, R
ep. o
f
Cyp
rus
Leb
ano
n
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Exhibit B.2:
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
Multiple Comparisons of Average Achievement in Algebra
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS TIMSS2003
GradeMATHEMATICS
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 383
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
Countries
h h h h h h h h h h h h h h h h h h h h Korea, Rep. of
h h h h h h h h h h h h h h h h h h h h Singapore
h h h h h h h h h h h h h h h h h h h h Chinese Taipei
h h h h h h h h h h h h h h h h h h h h Hong Kong, SAR
h h h h h h h h h h h h h h h h h h h h Japan
h h h h h h h h h h h h h h h h h h h Hungary
h h h h h h h h h h h h h h h h h h h Estonia
h h h h h h h h h h h h h h h h h h h Belgium (Flemish)
h h h h h h h h h h h h h h h h h I Russian Federation
h h h h h h h h h h h h h h h h h I Netherlands
h h h h h h h h h h h h h h h h h I United States
h h h h h h h h h h h h h h h h h I Latvia
h h h h h h h h h h h h h h h h h I I Slovak Republic
h h h h h h h h h h h h h h h h h I I Lithuania
h h h h h h h h h h h h h h h h I I Australia
h h h h h h h h h h h h h h h h I I I Israel
h h h h h h h h h h h h h h h h I I I Malaysia
h h h h h h h h h h h h h h h h I I I England
h h h h h h h h h h h h h h h h I I I New Zealand
h h h h h h h h h h h h h h h h I I I Armenia
h h h h h h h h h h h h h h h h I I I Scotland
h h h h h h h h h h h h h h h h I I I Serbia
h h h h h h h h h h h h h h h h I I I Slovenia
h h h h h h h h h h h h h h h h I I I I Bulgaria
h h h h h h h h h h h h h h h h I I I Romania
h h h h h h h h h h h h h h h h I I I I Sweden
h h h h h h h h h h h h h h h h I I I I Italy
h h h h h h h h h h h h h h h h I I I I Moldova, Rep. of
h h h h h h h h h h h h h h h h I I I I Cyprus
h h h h h h h h h h h h h h h I I I I Lebanon
h h h h h h h h h h h h h h I I I I Macedonia, Rep. of
h h h h h h h h h h h h h I I I I Jordan
I h h h h h h h h h h h h I I I I Norway
I I h h h h h h h h h I I I I Indonesia
I I I h h h h h h h I I I I Iran, Islamic Rep. of
I I I h h h h h h h I I I I Bahrain
I I I h h h h h h I I I I Egypt
I I I I h h h h h h I I I I Tunisia
I I I I I I h h h h h I I I I Morocco
I I I I h h h h h I I I I Philippines
I I I I I I I I h h h h I I I I Palestinian Nat'l Auth.
I I I I I I I I I I h h h I I I I Chile
I I I I I I I I I I I h h h I I I I Botswana
I I I I I I I I I I I I I h h I I I I Saudi Arabia
I I I I I I I I I I I I I I I I I I Ghana
I I I I I I I I I I I I I I I I I I South Africa
h h h h h h h h h h h h h h h h I I I Basque Country, Spain
h h h h h h h h h h h h h h h h h I Indiana State, US
h h h h h h h h h h h h h h h h h I Ontario Province, Can.
h h h h h h h h h h h h h h h h h h h Quebec Province, Can.
Benchmarking Participants
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Mac
edo
nia
, Rep
. of
Jord
an
No
rway
Ind
on
esia
Iran
, Isl
amic
Rep
. of
Bah
rain
Egyp
t
Tun
isia
Mo
rocc
o
Phili
pp
ines
Pale
stin
ian
Nat
'l A
uth
.
Ch
ile
Bo
tsw
ana
Sau
di A
rab
ia
Gh
ana
Sou
th A
fric
a
Bas
qu
e C
ou
ntr
y, S
pai
n
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Exhibit B.2: 88
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
Multiple Comparisons of Average Achievement in Algebra
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE384
TIMSS2003
GradeMATHEMATICS
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
Countries
Singapore h h h h h h h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR I h h h h h h h h h h h h h h h h h h h h h h h h h h
Korea, Rep. of I h h h h h h h h h h h h h h h h h h h h h h h h h h
Chinese Taipei I h h h h h h h h h h h h h h h h h h h h h h h h h h
Japan I I I I h h h h h h h h h h h h h h h h h h h h h h h h h
Netherlands I I I I I h h h h h h h h h h h h h h h h h h h h h h h h
Belgium (Flemish) I I I I I I h h h h h h h h h h h h h h h h h h h h h h
Estonia I I I I I I h h h h h h h h h h h h h h h h h h h h h
Hungary I I I I I I I h h h h h h h h h h h h h h h h h h h h h
Sweden I I I I I I I I I h h h h h h h h h h h h h h
Australia I I I I I I I I I h h h h h h h h h h h h
Scotland I I I I I I I I I h h h h h h h h h h h
Slovak Republic I I I I I I I I I h h h h h h h h h h h
Russian Federation I I I I I I I I I h h h h h h h h h h h
England I I I I I I I I I h h h h h h h h h
Malaysia I I I I I I I I I h h h h h h h h h
Latvia I I I I I I I I I I h h h h h h h h
New Zealand I I I I I I I I I I h h h h h h h h
Italy I I I I I I I I I I I h h h h h h h h
Slovenia I I I I I I I I I I I I I I h h h h h h h
United States I I I I I I I I I I I I I I h h h h h h
Lithuania I I I I I I I I I I I I I I I I h h h h h h
Armenia I I I I I I I I I I I I I I I I I I I h h h h
Romania I I I I I I I I I I I I I I I I I I I I h h
Norway I I I I I I I I I I I I I I I I I I I I I I h h
Israel I I I I I I I I I I I I I I I I I I I I I I h h
Serbia I I I I I I I I I I I I I I I I I I I I I I I h
Bulgaria I I I I I I I I I I I I I I I I I I I I I I I h
Moldova, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I h
Cyprus I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Macedonia, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Lebanon I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Jordan I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Chile I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Egypt I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Indonesia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Bahrain I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Palestinian Nat'l Auth. I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Botswana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Saudi Arabia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
South Africa I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Ghana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsBasque Country, Spain I I I I I I I I I I I I I I I I I I I I h h h h h
Indiana State, US I I I I I I I I I h h h h h h h h
Ontario Province, Can. I I I I I I I I h h h h h h h h h h h h h h h h h h h h
Quebec Province, Can. I I I I I h h h h h h h h h h h h h h h h h h h h h h h
Sin
gap
ore
Ho
ng
Ko
ng
, SA
R
Ko
rea,
Rep
. of
Ch
ines
e Ta
ipei
Jap
an
Net
her
lan
ds
Bel
giu
m (
Flem
ish
)
Esto
nia
Hu
ng
ary
Swed
en
Au
stra
lia
Sco
tlan
d
Slo
vak
Rep
ub
lic
Ru
ssia
n F
eder
atio
n
Eng
lan
d
Mal
aysi
a
Latv
ia
New
Zea
lan
d
Ital
y
Slo
ven
ia
Un
ited
Sta
tes
Lith
uan
ia
Arm
enia
Ro
man
ia
No
rway
Isra
el
Serb
ia
Bu
lgar
ia
Mo
ldo
va, R
ep. o
f
Cyp
rus
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
88Exhibit B.3: Multiple Comparisons of Average Achievement in Measurement
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS TIMSS2003
GradeMATHEMATICS
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 385
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
Countries
h h h h h h h h h h h h h h h h h h h h Singapore
h h h h h h h h h h h h h h h h h h h h Hong Kong, SAR
h h h h h h h h h h h h h h h h h h h h Korea, Rep. of
h h h h h h h h h h h h h h h h h h h h Chinese Taipei
h h h h h h h h h h h h h h h h h h h h Japan
h h h h h h h h h h h h h h h h h h h Netherlands
h h h h h h h h h h h h h h h h h h h Belgium (Flemish)
h h h h h h h h h h h h h h h h h h h I Estonia
h h h h h h h h h h h h h h h h h h I Hungary
h h h h h h h h h h h h h h h h h I I Sweden
h h h h h h h h h h h h h h h h h I Australia
h h h h h h h h h h h h h h h h h I I Scotland
h h h h h h h h h h h h h h h h h I I Slovak Republic
h h h h h h h h h h h h h h h h h I I Russian Federation
h h h h h h h h h h h h h h h h h I I England
h h h h h h h h h h h h h h h h h I I Malaysia
h h h h h h h h h h h h h h h h h I I Latvia
h h h h h h h h h h h h h h h h h I I New Zealand
h h h h h h h h h h h h h h h h h I I Italy
h h h h h h h h h h h h h h h h h I I Slovenia
h h h h h h h h h h h h h h h h I I United States
h h h h h h h h h h h h h h h h I I Lithuania
h h h h h h h h h h h h h h h h I I I Armenia
h h h h h h h h h h h h h h h h I I I Romania
h h h h h h h h h h h h h h h h I I I I Norway
h h h h h h h h h h h h h h h h I I I Israel
h h h h h h h h h h h h h h h h I I I I Serbia
h h h h h h h h h h h h h h h h I I I I Bulgaria
h h h h h h h h h h h h h h h h I I I I Moldova, Rep. of
h h h h h h h h h h h h h h h h I I I I Cyprus
h h h h h h h h h h h h h h I I I I Macedonia, Rep. of
h h h h h h h h h h h h h h I I I I Lebanon
I I h h h h h h h h h h h h h I I I I Jordan
I I I h h h h h h h h h h I I I I Tunisia
I I I h h h h h h h h I I I I Chile
I I I h h h h h h h h I I I I Egypt
I I I I h h h h h h h h I I I I Iran, Islamic Rep. of
I I I I h h h h h h I I I I Indonesia
I I I I I I I h h h h h h I I I I Bahrain
I I I I I I I h h h h h h I I I I Palestinian Nat'l Auth.
I I I I I I I I I I h h h I I I I Botswana
I I I I I I I I I I h h h I I I I Morocco
I I I I I I I I I I h h h I I I I Philippines
I I I I I I I I I I I I I h h I I I I Saudi Arabia
I I I I I I I I I I I I I I h I I I I South Africa
I I I I I I I I I I I I I I I I I I I Ghana
h h h h h h h h h h h h h h h h I I I Basque Country, Spain
h h h h h h h h h h h h h h h h h I I Indiana State, US
h h h h h h h h h h h h h h h h h h I Ontario Province, Can.
h h h h h h h h h h h h h h h h h h h Quebec Province, Can.
Benchmarking Participants
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Mac
edo
nia
, Rep
. of
Leb
ano
n
Jord
an
Tun
isia
Ch
ile
Egyp
t
Iran
, Isl
amic
Rep
. of
Ind
on
esia
Bah
rain
Pale
stin
ian
Nat
'l A
uth
.
Bo
tsw
ana
Mo
rocc
o
Phili
pp
ines
Sau
di A
rab
ia
Sou
th A
fric
a
Gh
ana
Bas
qu
e C
ou
ntr
y, S
pai
n
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Exhibit B.3: 88Multiple Comparisons of Average Achievement in Measurement
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE386
TIMSS2003
Grade88MATHEMATICS
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
Countries
Korea, Rep. of h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR I h h h h h h h h h h h h h h h h h
Chinese Taipei h h h h h h h h h h h h h h h h h
Japan I h h h h h h h h h h h h h h h h h
Singapore I h h h h h h h h h h h h h h h h h
Estonia I I I I I h h h h h h h h h h h h h h h h
Belgium (Flemish) I I I I I I h h h h h h h h h h h h h h h
Hungary I I I I I I I h h h h h h h h h h h
Latvia I I I I I I I h h h h h h h h h h h
Russian Federation I I I I I I I h h h h h h h h h h
Netherlands I I I I I I I h h h h h h h h h h
Lithuania I I I I I I I I I h h h h h h h h h
Slovak Republic I I I I I I I I I I I h h h h h h
Malaysia I I I I I I I I I I I I h h
England I I I I I I I I I I I I h
Australia I I I I I I I I I I I I
Scotland I I I I I I I I I I I I I h
New Zealand I I I I I I I I I I I I I
Israel I I I I I I I I I I I I I
Bulgaria I I I I I I I I I I I I I
Slovenia I I I I I I I I I I I I I I
Armenia I I I I I I I I I I I I I I I I
Romania I I I I I I I I I I I I I I I I I
United States I I I I I I I I I I I I I I I I I I I I I I
Serbia I I I I I I I I I I I I I I I I I I I I I I
Italy I I I I I I I I I I I I I I I I I I I I I I
Sweden I I I I I I I I I I I I I I I I I I I I I I
Moldova, Rep. of I I I I I I I I I I I I I I I I I I I I I I
Norway I I I I I I I I I I I I I I I I I I I I I I
Lebanon I I I I I I I I I I I I I I I I I I I I I I
Cyprus I I I I I I I I I I I I I I I I I I I I I I
Jordan I I I I I I I I I I I I I I I I I I I I I I
Macedonia, Rep. of I I I I I I I I I I I I I I I I I I I I I I
Bahrain I I I I I I I I I I I I I I I I I I I I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I
Palestinian Nat'l Auth. I I I I I I I I I I I I I I I I I I I I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I
Indonesia I I I I I I I I I I I I I I I I I I I I I I
Egypt I I I I I I I I I I I I I I I I I I I I I I
Saudi Arabia I I I I I I I I I I I I I I I I I I I I I I
Chile I I I I I I I I I I I I I I I I I I I I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I
Botswana I I I I I I I I I I I I I I I I I I I I I I
Ghana I I I I I I I I I I I I I I I I I I I I I I
South Africa I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsBasque Country, Spain I I I I I I I I I I I I I I I I I I I I I I
Indiana State, US I I I I I I I I I I I I I I I I I I I I I I
Ontario Province, Can. I I I I I I I h h h h h h h h h h
Quebec Province, Can. I I I I I h h h h h h h h h h h h h h h h
Ko
rea,
Rep
. of
Ho
ng
Ko
ng
, SA
R
Ch
ines
e Ta
ipei
Jap
an
Sin
gap
ore
Esto
nia
Bel
giu
m (
Flem
ish
)
Hu
ng
ary
Latv
ia
Ru
ssia
n F
eder
atio
n
Net
her
lan
ds
Lith
uan
ia
Slo
vak
Rep
ub
lic
Mal
aysi
a
Eng
lan
d
Au
stra
lia
Sco
tlan
d
New
Zea
lan
d
Isra
el
Bu
lgar
ia
Slo
ven
ia
Arm
enia
Instructions: Read across the row for a country to compare performance with the countries listed along the top of twhether the average achievement of the country in the row is significantly lower than that of the comparison counthat of the comparison country, or if there is no statistically significant difference between the average achievemen
Exhibit B.4: Multiple Comparisons of Average Achievement in Geometry
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS TIMSS2003
GradeMATHEMATICS
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 387
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
Countries
h h h h h h h h h h h h h h h h h h h h Korea, Rep. of
h h h h h h h h h h h h h h h h h h h h Hong Kong, SAR
h h h h h h h h h h h h h h h h h h h h Chinese Taipei
h h h h h h h h h h h h h h h h h h h h Japan
h h h h h h h h h h h h h h h h h h h h Singapore
h h h h h h h h h h h h h h h h h h h Estonia
h h h h h h h h h h h h h h h h h h h I Belgium (Flemish)
h h h h h h h h h h h h h h h h h h I Hungary
h h h h h h h h h h h h h h h h h h I Latvia
h h h h h h h h h h h h h h h h h h I Russian Federation
h h h h h h h h h h h h h h h h h h I Netherlands
h h h h h h h h h h h h h h h h h h I Lithuania
h h h h h h h h h h h h h h h h h h I I Slovak Republic
h h h h h h h h h h h h h h h h h h I I Malaysia
h h h h h h h h h h h h h h h h h h I I England
h h h h h h h h h h h h h h h h h h I I Australia
h h h h h h h h h h h h h h h h h h I I Scotland
h h h h h h h h h h h h h h h h h h I I New Zealand
h h h h h h h h h h h h h h h h h h I I Israel
h h h h h h h h h h h h h h h h h h I I Bulgaria
h h h h h h h h h h h h h h h h h h I I Slovenia
h h h h h h h h h h h h h h h h h h I I Armenia
h h h h h h h h h h h h h h h h h I I Romania
h h h h h h h h h h h h h h h h h I I United States
h h h h h h h h h h h h h h h h h I I Serbia
h h h h h h h h h h h h h h h h h I I Italy
h h h h h h h h h h h h h h h h h I I Sweden
h h h h h h h h h h h h h h h I I Moldova, Rep. of
h h h h h h h h h h h h h h h I I Norway
h h h h h h h h h h h h h h h I I Lebanon
h h h h h h h h h h h h h h h I I I Cyprus
I h h h h h h h h h h h I I I Jordan
I h h h h h h h h h h h I I I I Macedonia, Rep. of
I h h h h h h h h h h h I I I I Bahrain
I h h h h h h h h h h h I I I I Iran, Islamic Rep. of
I I I I I h h h h h h h h h I I I I Tunisia
I I I I I h h h h h h h h I I I I Palestinian Nat'l Auth.
I I I I I I I h h h h h h I I I I Morocco
I I I I I I h h h h h h I I I I Indonesia
I I I I I I I h h h h h h I I I I Egypt
I I I I I I I I I I h h h h I I I I Saudi Arabia
I I I I I I I I I I h h h h I I I I Chile
I I I I I I I I I I I I h h I I I I Philippines
I I I I I I I I I I I I h h I I I I Botswana
I I I I I I I I I I I I I I h I I I I Ghana
I I I I I I I I I I I I I I I I I I I South Africa
h h h h h h h h h h h h h h I I I Basque Country, Spain
h h h h h h h h h h h h h h h h h I I Indiana State, US
h h h h h h h h h h h h h h h h h h I Ontario Province, Can.
h h h h h h h h h h h h h h h h h h h Quebec Province, Can.
Benchmarking Participants
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Cyp
rus
Jord
an
Mac
edo
nia
, Rep
. of
Bah
rain
Iran
, Isl
amic
Rep
. of
Tun
isia
Pale
stin
ian
Nat
'l A
uth
.
Mo
rocc
o
Ind
on
esia
Egyp
t
Sau
di A
rab
ia
Ch
ile
Phili
pp
ines
Bo
tsw
ana
Gh
ana
Sou
th A
fric
a
Bas
qu
e C
ou
ntr
y, S
pai
n
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Exhibit B.4: 88Multiple Comparisons of Average Achievement in Geometry
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE388
TIMSS2003
Grade88MATHEMATICS
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
Countries
Singapore h h h h h h h h h h h h h h h h h h h h h h h h h h h h
Japan h h h h h h h h h h h h h h h h h h h h h h h h h
Korea, Rep. of I h h h h h h h h h h h h h h h h h h h h h h h h h
Chinese Taipei I h h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR I h h h h h h h h h h h h h h h h h h h h h h h h
Netherlands I I I h h h h h h h h h h h h h h h h h h h h h h h h
Belgium (Flemish) I I I I I I h h h h h h h h h h h h h h h h h h h h h h
Sweden I I I I I I h h h h h h h h h h h h h h h h h h
Estonia I I I I I I I h h h h h h h h h h h h h h h h h
England I I I I I I I h h h h h h h h h h h h h h h
Australia I I I I I I I h h h h h h h h h h h h h h h
Scotland I I I I I I I h h h h h h h h h h h h h h h
United States I I I I I I I I I h h h h h h h h h h h h h h h
New Zealand I I I I I I I I h h h h h h h h h h h h h h h
Hungary I I I I I I I I I h h h h h h h h h h h h h h h
Latvia I I I I I I I I I I I I I I I h h h h h h h h h h h
Malaysia I I I I I I I I I I I I I I I h h h h h h h h h h h
Lithuania I I I I I I I I I I I I I I I h h h h h h h h h h
Norway I I I I I I I I I I I I I I I h h h h h h h h
Slovak Republic I I I I I I I I I I I I I I I I I h h h h h h h
Slovenia I I I I I I I I I I I I I I I I I I h h h h h h h
Israel I I I I I I I I I I I I I I I I I I h h h h h h
Italy I I I I I I I I I I I I I I I I I I I h h h h h h
Russian Federation I I I I I I I I I I I I I I I I I I I I I h h h h h h
Bulgaria I I I I I I I I I I I I I I I I I I I I I I I I h h h
Cyprus I I I I I I I I I I I I I I I I I I I I I I I I h h h
Serbia I I I I I I I I I I I I I I I I I I I I I I I I h h h
Romania I I I I I I I I I I I I I I I I I I I I I I I I I I I h h
Jordan I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Moldova, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Macedonia, Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Armenia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Indonesia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Bahrain I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Chile I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Lebanon I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Egypt I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Palestinian Nat'l Auth. I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Botswana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Saudi Arabia I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
South Africa I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Ghana I I I I I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsBasque Country, Spain I I I I I I I I I I I I I I I h h h h h h h h
Indiana State, US I I I I I I I I h h h h h h h h h h h h h h h
Ontario Province, Can. I I I I I I I h h h h h h h h h h h h h h h h h h
Quebec Province, Can. I I I I I I h h h h h h h h h h h h h h h h h h h h h
Sin
gap
ore
Jap
an
Ko
rea,
Rep
. of
Ch
ines
e Ta
ipei
Ho
ng
Ko
ng
, SA
R
Net
her
lan
ds
Bel
giu
m (
Flem
ish
)
Swed
en
Esto
nia
Eng
lan
d
Au
stra
lia
Sco
tlan
d
Un
ited
Sta
tes
New
Zea
lan
d
Hu
ng
ary
Latv
ia
Mal
aysi
a
Lith
uan
ia
No
rway
Slo
vak
Rep
ub
lic
Slo
ven
ia
Isra
el
Ital
y
Ru
ssia
n F
eder
atio
n
Bu
lgar
ia
Cyp
rus
Serb
ia
Ro
man
ia
Jord
an
Mo
ldo
va, R
ep. o
f
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Exhibit B.5: Multiple Comparisons of Average Achievement in Data
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS TIMSS2003
GradeMATHEMATICS
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 389
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
Countries
h h h h h h h h h h h h h h h h h h h h Singapore
h h h h h h h h h h h h h h h h h h h h Japan
h h h h h h h h h h h h h h h h h h h h Korea, Rep. of
h h h h h h h h h h h h h h h h h h h h Chinese Taipei
h h h h h h h h h h h h h h h h h h h h Hong Kong, SAR
h h h h h h h h h h h h h h h h h h h h Netherlands
h h h h h h h h h h h h h h h h h h h Belgium (Flemish)
h h h h h h h h h h h h h h h h h h Sweden
h h h h h h h h h h h h h h h h h I Estonia
h h h h h h h h h h h h h h h h h England
h h h h h h h h h h h h h h h h h I Australia
h h h h h h h h h h h h h h h h h I Scotland
h h h h h h h h h h h h h h h h h I I United States
h h h h h h h h h h h h h h h h h I I New Zealand
h h h h h h h h h h h h h h h h h I I Hungary
h h h h h h h h h h h h h h h h I I I Latvia
h h h h h h h h h h h h h h h h I I I Malaysia
h h h h h h h h h h h h h h h h I I I Lithuania
h h h h h h h h h h h h h h h h I I I Norway
h h h h h h h h h h h h h h h h I I I Slovak Republic
h h h h h h h h h h h h h h h h I I I Slovenia
h h h h h h h h h h h h h h h h I I I Israel
h h h h h h h h h h h h h h h h I I I I Italy
h h h h h h h h h h h h h h h h I I I I Russian Federation
h h h h h h h h h h h h h h h h I I I I Bulgaria
h h h h h h h h h h h h h h h h I I I I Cyprus
h h h h h h h h h h h h h h h h I I I I Serbia
h h h h h h h h h h h h h h h h I I I I Romania
h h h h h h h h h h h h h h h h I I I I Jordan
h h h h h h h h h h h h h h I I I I Moldova, Rep. of
h h h h h h h h h h h I I I I Macedonia, Rep. of
h h h h h h h h h h h I I I I Armenia
h h h h h h h h h h h I I I I Indonesia
h h h h h h h h h h h I I I I Bahrain
h h h h h h h h h h I I I I Chile
I I I I h h h h h h h h h h I I I I Iran, Islamic Rep. of
I I I I I I h h h h h I I I I Lebanon
I I I I I I h h h h h I I I I Egypt
I I I I I I h h h h h I I I I Philippines
I I I I I I h h h h h I I I I Palestinian Nat'l Auth.
I I I I I I h h h h h I I I I Tunisia
I I I I I I I I I I I h h h I I I I Botswana
I I I I I I I I I I I h h h I I I I Morocco
I I I I I I I I I I I I I h h I I I I Saudi Arabia
I I I I I I I I I I I I I I I I I I South Africa
I I I I I I I I I I I I I I I I I I Ghana
h h h h h h h h h h h h h h h h I I I Basque Country, Spain
h h h h h h h h h h h h h h h h h I Indiana State, US
h h h h h h h h h h h h h h h h h Ontario Province, Can.
h h h h h h h h h h h h h h h h h h Quebec Province, Can.
Benchmarking Participants
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Mac
edo
nia
, Rep
. of
Arm
enia
Ind
on
esia
Bah
rain
Ch
ile
Iran
, Isl
amic
Rep
. of
Leb
ano
n
Egyp
t
Phili
pp
ines
Pale
stin
ian
Nat
'l A
uth
.
Tun
isia
Bo
tsw
ana
Mo
rocc
o
Sau
di A
rab
ia
Sou
th A
fric
a
Gh
ana
Bas
qu
e C
ou
ntr
y, S
pai
n
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Exhibit B.5: 88Multiple Comparisons of Average Achievement in Data
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE390
TIMSS2003
GradeMATHEMATICS
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
Exhibit B.6:
Countries
Singapore h h h h h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR I h h h h h h h h h h h h h h h h h h h h h h h h h
Chinese Taipei I h h h h h h h h h h h h h h h h h h h h h h h h h
Japan I I I h h h h h h h h h h h h h h h h h h h h h h h h
Belgium (Flemish) I I I I h h h h h h h h h h h h h h h h h h h h h h h
Netherlands I I I I I h h h h h h h h h h h h h h h h h h
Lithuania I I I I I h h h h h h h h h h h h h h h h h h
Russian Federation I I I I I h h h h h h h h h h h h h h h h h
Latvia I I I I I h h h h h h h h h h h h h h h h h
Hungary I I I I I I I h h h h h h h h h h h h h h h
England I I I I I I I I I h h h h h h h h h h h h I h h
United States I I I I I I I I I h h h h h h h h h h h I h h
Cyprus I I I I I I I I I I h h h h h h h h h h h I h
Moldova, Rep. of I I I I I I I I I I I h h h h h h h h h h I
Italy I I I I I I I I I I I I I h h h h h h h h h h I
Australia I I I I I I I I I I I I I I I h h h h h h I I I
Scotland I I I I I I I I I I I I I I I h h h h h h I I I
New Zealand I I I I I I I I I I I I I I I h h h h h h I I I
Armenia I I I I I I I I I I I I I I I h h h h h h I I I
Slovenia I I I I I I I I I I I I I I I I I I I h h h h h I I I
Norway I I I I I I I I I I I I I I I I I I I I h h h h I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I h h h I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I h h I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsIndiana State, US I I I I I h h h h h h h h h h h h h h h h h
Ontario Province, Can. I I I I I I I I I I I I I h h h h h h h h h h I I
Quebec Province, Can. I I I I I I I I I I I I h h h h h h h h h h I h
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Sin
gap
ore
Ho
ng
Ko
ng
, SA
R
Ch
ines
e Ta
ipei
Jap
an
Bel
giu
m (
Flem
ish
)
Net
her
lan
ds
Lith
uan
ia
Ru
ssia
n F
eder
atio
n
Latv
ia
Hu
ng
ary
Eng
lan
d
Un
ited
Sta
tes
Cyp
rus
Mo
ldo
va, R
ep. o
f
Ital
y
Au
stra
lia
Sco
tlan
d
New
Zea
lan
d
Arm
enia
Slo
ven
ia
No
rway
Iran
, Isl
amic
Rep
. of
Phili
pp
ines
Tun
isia
Mo
rocc
o
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
44Multiple Comparisons of Average Achievement in Number
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS TIMSS2003
GradeMATHEMATICS 44
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 391
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
Exhibit B.7:
Countries
Singapore h h h h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR h h h h h h h h h h h h h h h h h h h h h h h h h h
Chinese Taipei I I h h h h h h h h h h h h h h h h h h h h h h h h
Japan I I h h h h h h h h h h h h h h h h h h h h h h h h
Hungary I I I I h h h h h h h h h h h h h h h h h h h h h
Belgium (Flemish) I I I I h h h h h h h h h h h h h h h h h h h h h
Latvia I I I I I I h h h h h h h h h h h h h h
Lithuania I I I I I I h h h h h h h h h h h h h h
Russian Federation I I I I I I h h h h h h h h h h h h h h
Netherlands I I I I I I h h h h h h h h h h h h h h
United States I I I I I I h h h h h h h h h h h I h h
England I I I I I I h h h h h h h h h h h I h h
Moldova, Rep. of I I I I I I h h h h h h h h h h h I h
Cyprus I I I I I I I I I I h h h h h h h h h h h I h
Italy I I I I I I I I I I I I I I h h h h h h I I
Australia I I I I I I I I I I I I I I h h h h h h I I
Scotland I I I I I I I I I I I I I I h h h h h h I I
New Zealand I I I I I I I I I I I I I I h h h h h h I I
Slovenia I I I I I I I I I I I I I I h h h h h h I I I
Armenia I I I I I I I I I I I I I I I I I I I h h h h h I I I
Norway I I I I I I I I I I I I I I I I I I I I h h h h I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I h h I I I
Philippines I I I I I I I I I I I I I I I I I I I I I h h I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I I h I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsIndiana State, US I I I I h h h h h h h h h h h h h h h h h
Ontario Province, Can. I I I I I I I I I I I I h h h h h h h h h h h I h
Quebec Province, Can. I I I I I I I I I I I I I I h h h h h h h I I
Sin
gap
ore
Ho
ng
Ko
ng
, SA
R
Ch
ines
e Ta
ipei
Jap
an
Hu
ng
ary
Bel
giu
m (
Flem
ish
)
Latv
ia
Lith
uan
ia
Ru
ssia
n F
eder
atio
n
Net
her
lan
ds
Un
ited
Sta
tes
Eng
lan
d
Mo
ldo
va, R
ep. o
f
Cyp
rus
Ital
y
Au
stra
lia
Sco
tlan
d
New
Zea
lan
d
Slo
ven
ia
Arm
enia
No
rway
Iran
, Isl
amic
Rep
. of
Phili
pp
ines
Mo
rocc
o
Tun
isia
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Multiple Comparisons of Average Achievement in Patterns and Relationships
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE392
TIMSS2003
GradeMATHEMATICS
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
Exhibit B.8: 44
Countries
Japan h h h h h h h h h h h h h h h h h h h h h h h h h
Singapore h h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR h h h h h h h h h h h h h h h h h h h h h h h h
Chinese Taipei I h h h h h h h h h h h h h h h h h h h h h h h h
Belgium (Flemish) I I I I h h h h h h h h h h h h h h h h h h h h h h
Latvia I I I I h h h h h h h h h h h h h h h h h h h
Netherlands I I I I I h h h h h h h h h h h h h h h h h h h
Lithuania I I I I I h h h h h h h h h h h h h h h h h h
Russian Federation I I I I I h h h h h h h h h h h h h h h h h
England I I I I I I I h h h h h h h h h h h h h h h h h
Hungary I I I I I I I I h h h h h h h h h h h h h h h h h
Australia I I I I I I I I I I I h h h h h h h h h h h
Cyprus I I I I I I I I I I I h h h h h h h I
Moldova, Rep. of I I I I I I I I I I I h h h h h h I
Italy I I I I I I I I I I I h h h h h h I
New Zealand I I I I I I I I I I I I h h h h h h I I
United States I I I I I I I I I I I I h h h h h h I I
Scotland I I I I I I I I I I I I h h h h h h I I
Slovenia I I I I I I I I I I I I I h h h h h h I I
Norway I I I I I I I I I I I I I I I I I I I h h h h h I I I
Armenia I I I I I I I I I I I I I I I I I I I I h h h h I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I h h h I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I h I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I h I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsIndiana State, US I I I I I I I I I I I h h h h h h h h h h h h h h
Ontario Province, Can. I I I I I I I I I I I h h h h h h h h h h
Quebec Province, Can. I I I I I I I I I I I I h h h h h h I
Jap
an
Sin
gap
ore
Ho
ng
Ko
ng
, SA
R
Ch
ines
e Ta
ipei
Bel
giu
m (
Flem
ish
)
Latv
ia
Net
her
lan
ds
Lith
uan
ia
Ru
ssia
n F
eder
atio
n
Eng
lan
d
Hu
ng
ary
Au
stra
lia
Cyp
rus
Mo
ldo
va, R
ep. o
f
Ital
y
New
Zea
lan
d
Un
ited
Sta
tes
Sco
tlan
d
Slo
ven
ia
No
rway
Arm
enia
Iran
, Isl
amic
Rep
. of
Mo
rocc
o
Phili
pp
ines
Tun
isia
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Multiple Comparisons of Average Achievement in Measurement
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS TIMSS2003
GradeMATHEMATICS 44
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE 393
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
Exhibit B.9:
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Countries
Singapore h h h h h h h h h h h h h h h h h h h h h h h h h h
Japan h h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR I h h h h h h h h h h h h h h h h h h h h h h h h
Chinese Taipei I h h h h h h h h h h h h h h h h h h h h h h h h
England I I I I h h h h h h h h h h h h h h h h h h h h h h
Belgium (Flemish) I I I I I h h h h h h h h h h h h h h h h h h h h
Russian Federation I I I I I h h h h h h h h h h h h h
Lithuania I I I I I I h h h h h h h h h h h h h I
Australia I I I I I I h h h h h h h h h h h I
Latvia I I I I I I h h h h h h h h h h h I
Italy I I I I I I h h h h h h h h h h I
Netherlands I I I I I I h h h h h h h h h h I
United States I I I I I I I I h h h h h h h h h h I
New Zealand I I I I I I I I h h h h h h h h h h I
Hungary I I I I I I I I I I h h h h h h h h h I I I
Scotland I I I I I I I I I I I I I I h h h h h h h I I I
Cyprus I I I I I I I I I I I I I I I h h h h h h h I I I
Moldova, Rep. of I I I I I I I I I I I I I I I h h h h h h I I I
Slovenia I I I I I I I I I I I I I I I I I h h h h h h I I I
Norway I I I I I I I I I I I I I I I I I I I h h h h h I I I
Armenia I I I I I I I I I I I I I I I I I I I I h h h h I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I h h h I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I h h I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I
Philippines I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsIndiana State, US I I I I I I h h h h h h h h h h h
Ontario Province, Can. I I I I h h h h h h h h h h h h h h h h h h h
Quebec Province, Can. I I I I I I h h h h h h h h h h h I
Jap
an
Sin
gap
ore
Ch
ines
e Ta
ipei
Ho
ng
Ko
ng
, SA
R
Net
her
lan
ds
Eng
lan
d
Un
ited
Sta
tes
Bel
giu
m (
Flem
ish
)
Latv
ia
Au
stra
lia
New
Zea
lan
d
Lith
uan
ia
Sco
tlan
d
Hu
ng
ary
Cyp
rus
Ru
ssia
n F
eder
atio
n
Ital
y
Slo
ven
ia
No
rway
Mo
ldo
va, R
ep. o
f
Arm
enia
Phili
pp
ines
Iran
, Isl
amic
Rep
. of
Mo
rocc
o
Tun
isia
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Multiple Comparisons of Average Achievement in Geometry
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
TIMSS & PIRLS INTERNATIONAL STUDY CENTER, LYNCH SCHOOL OF EDUCATION, BOSTON COLLEGE394
TIMSS2003
GradeMATHEMATICS
APPENDIX B: MULTIPLE COMPARISONS OF AVERAGE ACHIEVEMENT IN MATHEMATICS CONTENT AREAS
SOU
RCE:
IEA
's T
rend
s in
Inte
rnat
iona
l Mat
hem
atic
s an
d Sc
ienc
e St
udy
(TIM
SS) 2
003
44Exhibit B.10:
Countries
Japan h h h h h h h h h h h h h h h h h h h h h h h h h h h
Singapore I h h h h h h h h h h h h h h h h h h h h h h h h h h
Chinese Taipei I I h h h h h h h h h h h h h h h h h h h h h h h
Hong Kong, SAR I I h h h h h h h h h h h h h h h h h h h h h h h
Netherlands I I I I h h h h h h h h h h h h h h h h h h h
England I I I I h h h h h h h h h h h h h h h h h h
United States I I I I h h h h h h h h h h h h h h h h h I h
Belgium (Flemish) I I I I h h h h h h h h h h h h h h h h h I h
Latvia I I I I I I I I h h h h h h h h h h h h h h I I h
Australia I I I I I I I I h h h h h h h h h h h h h I I h
New Zealand I I I I I I I I h h h h h h h h h h h h I I h
Lithuania I I I I I I I I I h h h h h h h h h h h I I h
Scotland I I I I I I I I I I h h h h h h h h h h I I h
Hungary I I I I I I I I I I I h h h h h h h h h I I
Cyprus I I I I I I I I I I I I h h h h h h h h h I I
Russian Federation I I I I I I I I I I I I I h h h h h h h h I I
Italy I I I I I I I I I I I I I I I h h h h h h h h I I I
Slovenia I I I I I I I I I I I I I I I I I h h h h h h I I I
Norway I I I I I I I I I I I I I I I I I I h h h h h I I I
Moldova, Rep. of I I I I I I I I I I I I I I I I I h h h h h I I I
Armenia I I I I I I I I I I I I I I I I I I I I h h h h I I I
Philippines I I I I I I I I I I I I I I I I I I I I I h h h I I I
Iran, Islamic Rep. of I I I I I I I I I I I I I I I I I I I I I I h I I I
Morocco I I I I I I I I I I I I I I I I I I I I I I h I I I
Tunisia I I I I I I I I I I I I I I I I I I I I I I I I I I I
Benchmarking ParticipantsIndiana State, US I I h h h h h h h h h h h h h h h h h h h h h
Ontario Province, Can. I I I I I h h h h h h h h h h h h h h h h h I h
Quebec Province, Can. I I I I I I I I I I I I I h h h h h h h h h I I
Instructions: Read across the row for a country to compare performance with the countries listed along the top of the chart. The symbols indicatewhether the average achievement of the country in the row is significantly lower than that of the comparison country, significantly higher thanthat of the comparison country, or if there is no statistically significant difference between the average achievement of the two countries.
Average achievementsignificantly higher thancomparison country
h
Average achievementsignificantly lower thancomparison country
i
Jap
an
Sin
gap
ore
Ch
ines
e Ta
ipei
Ho
ng
Ko
ng
, SA
R
Net
her
lan
ds
Eng
lan
d
Un
ited
Sta
tes
Bel
giu
m (
Flem
ish
)
Latv
ia
Au
stra
lia
New
Zea
lan
d
Lith
uan
ia
Sco
tlan
d
Hu
ng
ary
Cyp
rus
Ru
ssia
n F
eder
atio
n
Ital
y
Slo
ven
ia
No
rway
Mo
ldo
va, R
ep. o
f
Arm
enia
Phili
pp
ines
Iran
, Isl
amic
Rep
. of
Mo
rocc
o
Tun
isia
Ind
ian
a St
ate,
US
On
tari
o P
rovi
nce
, Can
.
Qu
ebec
Pro
vin
ce, C
an.
Multiple Comparisons of Average Achievement in Data
Note: 5% of these comparisons would be statistically signifi cant by chance alone.
