NRICH Feedback Survey 2005

Presentation Outline

1. Introduction and Aims

2. About the Respondents

3. Usage

4. ‘Items 1-10’

5. AskNRICH

6. NRICH Books

7. Content

8. Navigability

9. Best bits, worst bits and general comments.

Introduction and Aims

• To assess the level of navigability and efficacy of site organisation, as perceived by users• To elicit comments and suggestions about how these might be improved

• To compare user satisfaction with past studies

The Surveys

Teachers / Students 34 questions for Teachers, 26 for kids November through Feb Midpoint

Changed phrasing of Q’s 1 – 10Added a few Q’s

About 300 respondents total Binned about 30 reponses

About the Respondents

Teachers129 respondents total (104)

7% brand new to the site

38.5% male, 54.8% female

38.8% Primary57.3% Secondary11.7% Post-16

Students152 respondents total (109)

23.9% brand new to the site

49.5% male, 39.4% female

2.8% 7 or younger17.4 % 8-1128.4% 12-1420.2% 15-1631.2% 17+

7 or younger 2.8%8-11 17.4%12-14 28.4%15-16 20.2%17+ 31.2%

n = 109

Primary 32%Primary & Secondary 5.8%Secondary 27.2 %Seconary & Post-16 23.3%Post-16 10.7%All levels 1%

n = 103

Respondents by country - Teachers

UK 70.2%USA 8.7%Australia 6.7%Other Europe 4.8%Other 3.8%Canada 3.8%India 1.9%

n = 104

Respondents by country – Students

country

UK 70.6%Other Europe 7.3%Australia 3.7%India 3.7%Singapore 3.7%Other Asia 3.7Other 3.7%Canada 2.8%USA 0.9%

n = 109

From where do you most often access NRICH?

Home 50%School 15.4%Home & School equally 33.7%Other - office 1%

n = 104

Teachers Students

Home 56%School 20.2%Home & school equally 12.8%Other 8.3%Other - not specified 2.8%

n = 109

Internet Connection

Teachers Students

n = 109

Modem 21.1%Broadband 54.1%Don't know 24.8%

Modem 28.8%Broadband 52.7%Don't know 5.8%n = 104

How long have you been using NRICH?

Teachers

3+ years 32.7%2-3 years 18.3%1-2 years 17.3%3-5 months 6.7%week or less/new user 6.7%6 mo - a year 5.8%1-2 months 5.8%other - not specified 5.8%two weeks 1%

n = 104

How long have you been using NRICH?

Students

3+ years 8.3%2-3 years 2.8%1-2 years 26.6%6 mo - a year 3.7%3-5 months 9.2%1-2 months 21.1%two weeks 2.8%week or less/new user 23.9%other - not specified 1.8%

n = 109

How often do you use NRICH?

Teachers

> once a week 26.9%@ once a week 27.9%@ once fortnight 20.2%@ once month 15.4%@ once term 4.8%hard to say/don't know 3.8%Other - not specified 1%

n = 104

Use frequency by length of time using NRICH

Teachers

> once a week@ once a week

@ once fortnight@ once month

@ once termdon't know

how often use Nrich

0

5

10

15

20

25

30

Co

un

t

how long been using Nrich3+ years2-3 years1-2 years6 mo - a year3-5 months1-2 monthstwo weeksweek or less/new userother - not specified

How often do you use NRICH?

Students

> once a week 22%@ once a week 22%@ once fortnight 11.9%@ once month 15.6%@ once term 4.6%once or twice a year 1.8%< once a year 3.7%New user 16.5%Other 1.8%n = 109

Use frequency by length of time using NRICH

Students

> once a week

@ once a week

@ once fortnight

@ once month

@ once term

once or twice a year

< once a year

New user

Other

0

5

10

15

20

25

Co

un

t

3+ years2-3 years1-2 years6 mo - a year3-5 months1-2 monthstwo weeksweek or less/new userother - not specified

n = 109

> once a week

@ once a week

@ once fortnight

@ once month

@ once term


Other

0

5

10

15

20

25

Co

un

t

3+ years2-3 years1-2 years6 mo - a year3-5 months1-2 monthsother - not specified

n = 81

How do you most often use NRICH?

Teachers (only)

Problems printed out 41.1%Source of ideas 33.6%Other 8.4%Online - kids on computers 5.6%Online - IWB 6.5%Problems put on blackboard 2.8Online - data projector 1.9%

n = 107

Other – 8.4%

- OHTs (I dream of an interactive whiteboard)- Used it a lot with kids until you changed.- Also online- Offline as a lesson w/supplementary material.- Google- Use it to set homework as well also as well as interactive in computer suite for problem solving morning.- Have only just discovered but am planning to use it on computer.- As a pre-service teacher I find the content etc great for future maths teaching and also to assist currentteachers that there is an extensive range of maths information available.

Do you mention to students when problems come from NRICH?

Teachers (only)

Always 40.6%Usually 30.2%@ 1/2 the time 14.2%Rarely 8.5%Never 6.6%

n = 106

Do you provide students with the URL?

Teachers (only)

Always 38.5%Usually 26%@ 1/2 the time 10.6%Rarely 16.3%Never 6.6%

n = 104

Items 1 – 10 - Teachers

Items 1 – 10 - Students

AskNRICH - Teachers

How often do you use AskNRICH?

Often 15.2%Occasionally 21.9%Never 58.1%New user/1st time 1%'Only just discovered' 1%'Tell me how to' 1%Not yet 2%

n = 105

AskNRICH - Students


Often 11.9%Occasionally 31.2%Don't use it 41.3%Hadn't heard of it 6.4%1st time user 7.3 %'it is a good help to me' 0.9%Other - not specified 0.9%

n = 109

AskNRICH - Students

Do you know about AskNRICH?

yes 32.6%know a little 17.4%heard of, not sure what is 15.2%not heard of 32.6%'it is weird' 2.2%

n = 46

AskNRICH – Students who have been using NRICH for at least 6 months.

Do you know about AskNRICH?

yes 45.5%know a little 31.8%heard of, not sure what is 13.6%not heard of 6.8%

n = 44 (users of 6 months or more)

AskNRICH – Students who reported knowing about it.


Often 21.7%Occasionally 52.2%Don't use it 21.7%1st time user 4.3%

n = 23

NRICH Books (Teachers only)

If you would be interested, how would you prefer the books be organised?

curriculum topic 48.6%year group 28.6%other - both 8.6%other - difficulty/challenge level 5.7%other 8.6%

n = 35

also themed would be good for small children..e.g this week we are looking at money!

Specific years for Maths

by curriculum order and national curriculum level

mixed topic


Yes 61.5%No 10.3%Would be if low cost 12.8%Would be if...other 15.4%

n = 39

Would you be interested in purchasing books containing NRICH resources (e.g. problems, games, and articles), along with hints and notes where appropriate?

Would be interested if…

it's reasonably priced and problems were printable

one could be geared at the very youngest children

we've not already got one lurking in the department!

they were available in French or if I could have the right to translate them for use in my classroom

they were laid out in a photocopiable way. Although I would prefer to have in an easier to print format on the website.

it adds something to the website, not just a reproduction of the problems featured on the site.

they were written in spanish and have low cost in shipping & handling

when I complete my teaching degree.

Content

Excellent

GoodSatisfactory

PoorVery poor

rate quality problems

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

Per

cen

t

TeachersStudents

How would you rate the problems on the NRICH site?


Would the inclusion of CD-ROMs, containing interactivities and electronic copies of problems, be useful to you?

Yes 71.8%No 12.8%It would be if... 15.4%

n = 39

Would be if…

The current arrangement is suitable

VERY MUCH!!!!!!!!!!!!!!!!!

Could use them on IWs which do not have internet access.

they were developed in such a way to make them easier to print out. Although I would prefer to have in an easier to print format on the website

the interactive software was not available on the web

links to website for interactive resources would be useful

Content

Do you find there is enough material on the site?

Yes No Comment only

0.0%

20.0%

40.0%

60.0%

80.0%

Per

cen

t

TeachersStudents

Teachers who said ‘no’ added:

It would be good to have activities that were linked to the KS3 Strategy, so you could quickly find suitable activities

More accessable problems for low ability Y7&8

More articles needed

more pls

more problems

Sometimes there are some easy and closed problems, or repeats of previous problems. Also, there is always room for more mathematics!

would like more long-term projects

Teachers who said ‘yes’ added:

More than enough for my tiny brain

Although navigating the archive to find some of the material requires a great deal of knowledge of the site. Not a bad thing in itself, but could put others off using the site.

Teachers who commented only said:

i only use it to find interesting problme

if you can find it

Is there ever enough?

some areas are better served than others

Usually

When I can find it!!

Selected comments from students who said ‘yes’:

But more always welcome!

But more is better

Could add some prizes to winners giving in best solutions maybe.

good enough to find stuff

i strongly love the site

Large source bank which convers a large age range

the games could be more maths oriented

Selected comments from students who said ‘no’:

i can not find what i want

I was actually looking for activities that can be done with KS2 children, but could not find much.

i would like to see different difficulties of maths problems for people in higher education etc.

I would like to see techniques on learning Maths and prooving proofs.

id prefer if there were more problems added every month

is either 2 easy or 2 hard

Links?

More Problems

more puzzels

More questions!

some is boring need more fun stuff!

There ar enot enough links on the home page.

There should be more challenging questions.

too many games

Navigability - Teachers

I find it ___________ to find what I am looking for on the NRICH site:

Very easy 8.4%Easy 39.3%Neither 29.9%Difficult 18.7%Very difficult 3.7%

n = 107


Very easy 8.4%Easy 39.3%Neither 29.9%Difficult 18.7%Very difficult 3.7%

n = 107

Strongly agree 10%Agree 38.2%Neutral 19.1%Disagree 22.7%Strongly disagree 10%

n = 110

It is easy to find what I want on the NRICH site:



How would you rate the way the NRICH site is organised?

Excellently 9.3%Well 47.7%Satisfactorily 32.7%Poorly 8.4%Very poorly 1.9%

n = 107

How would you rate the way the NRICH site is organised?

The NRICH site is easy to use.


Strongly agree 17.7%Agree 46.9%Neutral 19.5%Disagree 11.5%Strongly disagree 7.8%

n = 113

Excellently 9.3%Well 47.7%Satisfactorily 32.7%Poorly 8.4%Very poorly 1.9%

n = 107


Do you think there is enough information provided about how to use the NRICH site on the site itself?

Yes 77.4%No 20.8%Comment only 1.9%

n = 106

Selected ‘yes’ comments:

an overview site tree would be nice

However, home page could have CLEAR link to someone who is not sure what to do.

With some clarification...Using this in the USA I find it interesting to see the students' reaction to the monetary system, some spelling differences and the words that we are not use to. Keeps them guessing!

Yes, although it is not immediately obvious as to where this information can be found


I like the design of the NRICH site.


n = 113

Comments re: LEVELSA better explanation of the age ranges the problems are directed at is needed, possibly linking to stages in the NCit would be useful to be able to cross-match NC levels with problemslevels are a bit strange. Would it not be better if they were leveled to the National Curriculumis there a simple way to describe what to find in each tier other than tier 1 - easiest; tier 2, a bit harder, etc? How does content level relate to year group expectations?

needs a key to tiers and content levelsAs someone outside the British school system (in my case, a homeschooling mother in the U.S.), I wish there were some explanation of what the different tiers and challenge levels mean -- how the categorizations are made, what expectations of prior knowledge there are, approximately what ages the different tiers are aimed at. Having explored the site every month since August, I now have a pretty good idea where to find the problems best suited to my sons' abilities, but it took some exploring at first and I would still love a clear definition of the tiers.My children you r Smith and Mr Jones but I cannot find what ability it is at. They are 13 years old and solved it but was the problem for a 10 year old?

re: Search It is not clear how to search on particular topics More "maths finder" style help would be useful

re: Help Guide Need a clear help guide. I am not sure what each section is for and don't really know how to use it best. as a parent I don't have loads of time to explore more than just the basics, maybe a mugs guide for newcomers as to the extent of what is on offer

Misc. The branches graphic is difficult to understand and get to work correctly sometim too much to read we found it quite difficult to submit solutions. I sent a problem to a collegue to do with their class in the form of the web address. They asked me for instructions as to how to find heir way aroound.

Navigability - Students


Very easy 7.3%Easy 34.9%Neither 33%Difficult 12.8Very difficult 11.9%

n = 109


It is easy to find what I want on the NRICH site:


Very easy 7.3%Easy 34.9%Neither 33%Difficult 12.8Very difficult 11.9%

n = 109

Strongly agree 15.6%Agree 31.9%Neutral 18.4%Disagree 17%Strongly disagree 17%

n = 141

The NRICH site is easy to use.


Strongly agree 21.5%Agree 38.9%Neutral 16%Disagree 13.9%Strongly disagree 9.7%

n = 144


I like the design of the NRICH site.


n = 142

What do you think are the best features of the NRICH site?

The Problems (23) Variety (9) Ability for students to submit solutions (5) Interactivities (5) That content is updated (4) Investigations (4) Motivating / Inspiring nature (4) Monthly (3) and Weekly (2) problems

Teachers

What do you think are the best features of the NRICH site?

AskNRICH (18) Games (12) Problems (11) Design (4) Tiers (4) Puzzles (3) Weekly problems (3) Maths (3)

Students

If you could change one thing about the NRICH site what would it be?

Design (11) ( 7 of these front-page specific) Navigability / Search (9) Levels (5)

Teachers

Design (14) Navigability / Search (5) Levels (3) More problems (3)

Students

Comments relating to design generally - Teachers

its graphical design and its graphical content. (IRAN)

the decoration (NEW ZEALAND) The design, it was better when it was simple, and

fitted on my screen with having to scroll down. The way the problems appear at the bottom of

the page so you have to scroll down to them - it took me ages to realise the problem was there!

Comments relating to design - front page - Teachers

Dislike the flash front page, takes up too much space.

I would make the home page simpler. Jungle picture on home page (SPAIN) The graphic link at the top of the homepage.

(USA) the home page the Homepage is not too friendly to read

(USA) the parrots!

Comments relating to design generally - Students

Design, and overall organization of problems (17+) (PORTUGAL)

i think i will change the green colour (17+)

I use Nrich on 2 different computors and on one, the display is great, it is easy to use etc. but on the other one, the display really isn't good. For some reason the text on the left side is too big, so it continues down the page way beyond where the col(17+)

Simpler (but still stylish) layout on front page, and unified look and feel across all pages on the site. (17+)

The appearance of it. It is one big long page with large text, I would condense it into smaller text and a smaller space (15-16)

the appearances of pages (8-11)

the colours and layout (17+)

The design could be improved. It's good, but it could be better. (15-16)

The design of the website - maybe more structure and less of animated graphics - these do not load some times. (17+) (UNITED ARAB EMIRATES)

The navigational system, get rid of the Flash interface for finding problems, just use a simple HTML version. (15-16)

the layout (8-11)

the setup (12-14)

Comments relating to Search

Easier to find problems by topic / difficulty (that really are of that topic or difficulty) and suitable for adaptation to classrooms. This is already quite good but it could be amazing!

Easier to find what I'm looking for. I would return to the old system of searching while you rethink

the layout - I think people are being put off using the site - at least the old system was familiar to anyone who saves anything on a computer.

More refined search engine when I am thinking 'I want a problem on ...' for 'this group'

search engine for problems listed under topics Whilst trying to search for a problem by name we had no luck -

is there a way to do this, if not can there be? make the site more easily navigable so I can find appropriate

puzzles the ease of finding what you need

Teachers

Comments relating to Search

Being able to find things easier. (8-11) easier to find the solutions to the maths

problems on the postcards (15-16) make finding resourses easy (17+) (INDIA) TOPIC SEARCH (17+) Provide better general resources on higher

level topics and make it easier to search the articles etc that are already available. (15-16)

Students

Comments relating to Levels

different levels of problems It could be split into Year Groups to save time looking through

problems aimed at the wrong level. Make it more immediatle yobvious on the main page what the

different tiers mean so students can access the correct level of work more easily.

slightly confused over tiers and levels it does not correspond to the levels i am used to using in teaching (BELGIUM)

to tell parents teachers the level (ITALY)

I would make the rating system of the difficulty of problems clearer. (12-14)

Sometimes I'm not sure where I fit on the tiers (17+) the way things are catogrised (15-16)

Teachers

Students

Thank you

> once a week

@ once a week

@ once fortnight

@ once m

onth

@ once term


< once a year

New user

Other

how often use NRICH

0

5

10

15

20

25C

ou

nt

7 or younger8-1112-1415-1617+

Frequency of use by age group - Students

Frequency of use by teaching level - Teachers

> once a week

@ once a week

@ once fortnight

@ once month

@ once term

hard to say/don't

know

Other - not specified

how often use Nrich

0

5

10

15

20

25

30

Co

un

tTeaching Level

PrimaryPrim & SecSecondarySec & Post-16Post-16all

Frequency of NRICH use by frequency of AskNRICH use - Students

> once a week

@ once a week

@ once fortnight

@ once month

@ once term

once or twice a

year

< once a year

New user

Other

how often use NRICH

0

5

10

15

20

25

Co

un

t

how often use AskN

OftenOccasionallyDon't use itHadn't heard of it1st time user'it is a good help to me'Other - not specified

NRICH Feedback Survey 2005

Documents

Transcript of NRICH Feedback Survey 2005