1 March 2019

MY ASSESSMENT AND REPORTING KIT

Guide to PiRA, PUMA, PUMA

6 Extension and GaPS online

analysis and reports

Before you can use the analysis and reports, your school’s Access Co-ordinator will need to

set up your school on the platform and grant you access. For a simple set-up guide, visit

http://rsassessment.com/mark-online-support.

2 March 2019

Contents Using the marksheets .............................................................................................................................. 3

Export test mark input file / CSV export and import ........................................................................... 4

Navigating between marksheets ......................................................................................................... 6

Gap Analysis ............................................................................................................................................ 7

Gap analysis for a single paper and class ............................................................................................. 7

Performance indicators ........................................................................................................................ 8

Gap analysis export for the whole school ............................................................................................ 8

Generating reports ................................................................................................................................ 10

Pupil Reporting ...................................................................................................................................... 11

Individual Pupil Report .......................................................................................................................11

Pupil Progress Report (PIRA, PUMA and GaPS) .................................................................................12

Academic Year, Class or Group Reporting ............................................................................................ 13

Academic Year, Class or Group Comparison Report ..........................................................................13

Academic Year, Class or Group Analysis Report (PIRA, PUMA and GaPS) .........................................14

Academic Year, Class or Group Listing ...............................................................................................15

Academic Year, Class or Group Progress Report (PIRA, PUMA and GaPS) ........................................16

3 March 2019

Using the marksheets To generate your reports, you first need to record the marks that your pupils have

scored in the PUMA/PUMA 6 extension/PiRA/GAPS paper-based standardised tests.

This can be done either by importing a CSV file containing their results, or by manually

entering their scores via the marking forms.

To start, click on Marksheets and Gap Analysis in the left-hand menu.

To input the marks manually, click on the PUMA, PUMA 6 Extension, PiRA or GaPS logo

and then select the paper and class or group who have taken the test – then click

Mark/Gap Analysis.

4 March 2019

Your screen will be populated with a list of the pupils that are included in the selected

class or group and a marking form that can be completed with their results in the

selected test.

Input the date that the class or group took the test and then each pupil’s results,

question-by question. If the pupil did not attempt a question, record this with an ‘n’. To

edit any entry, just click the number and re-enter it.

If you are using our interactive tests the marksheet is populated automatically.

However, if you have the Access Co-ordinator or Teacher Admin roles there is now the

ability to amend an interactive mark where required and in line with the paper mark

scheme.

Export test mark input file / CSV export and import Alternatively, you can download a file to your computer that will allow you to enter the

marks for your class or group via a spreadsheet. To do this, click the CSV export button.

5 March 2019

Click on 1. Export template CSV to download the file. The file is a comma separated

value (or CSV) file that can be opened in any spreadsheet program such as Microsoft

Excel. When you've downloaded and opened it you may want to resize the columns so

that you can see all the data. When you save the file, you can save it as a CSV or as an

Excel spreadsheet (.xls, .xlsx).

• The first row contains text that will be used by the importer and should not be

changed.

• The second row contains the column headings and the questions to be marked.

The subsequent rows are where you enter the pupils' marks. You should enter

the date that the pupil took the test and the mark (1 or 0) that was achieved for

each question or question part, or 'n' if the question was not attempted.

The completed CSV should look like this:

6 March 2019

To import the file for processing once you've completed it return to the Marksheets

you wish to import data for and open the CSV export dialogue. From here you have the

option to Upload CSV directly by clicking 2. Choose file, selecting your completed CSV,

then 3. Upload CSV.

Alternatively, return to the Marksheets homepage and click CSV import.

Navigating between marksheets

This is an easy process with multiple options from within the marksheet area.

To change the marksheet for the paper you are viewing and maintain the same group of pupils just

click on the paper name and a drop down menu will open to make your selection from.

If you want to change the class or group your are viewing, but retain the same paper just click on the

class/ group name and a drop down menu will open to make a different selection.

7 March 2019

Gap Analysis

Gap analysis for a single paper and class By clicking Show Gap Analysis/Export, you can view extra detail such as question facility and your

pupils’ average scores on each question or strand. You can switch between the Questions and

Strands view using the tabs at the top right of the marksheet.

You can also download a spreadsheet view of the marksheet by clicking Gap Analysis export. This

includes the marksheet as well as the following information:

- Question facility - Percentage of the class that successfully answered each question - Average total raw score and percentage the class achieved on the test - Strand breakdown:

o Score per pupil per strand o National average score per strand o Class average per strand o Total available marks per strand

- Per pupil scores:

8 March 2019

o Standardised score o Age-standardised score o Hodder Scale Score o Performance Indicator

We have added a UPN column to the Gap analysis class and whole school export for as an additional

method of identifying pupils when comparing their MARK data with other platforms. UPN can be

added to MARK using the pupil import CSV template, manually, or from your MIS.

Performance indicators The thresholds used for performance indicators for PIRA, PUMA and GAPS are as

follows. These are not applicable for PUMA 6 Extension.

Performance indicator Standardised score

Working towards <94

Working at 94-114

Working at greater depth >114

Gap analysis export for the whole school For PUMA, PiRA and GAPS, you can export all of a term’s results for your whole school

in one spreadsheet (GAPS coming soon). Not available for PUMA 6 Extension.

To do this, select Gap Analysis – School Export from the Marksheets screen:

Then select the product, term and academic year from the dropdowns and click

Generate.

9 March 2019

The spreadsheet will then be created and downloaded to your computer. Please note -

each year group’s data will be displayed on a different tab.

Please note that the Whole School Gap analysis export considers all attempts of a given

pupil for the selected paper. This means that multiple attempts will have an effect on

the class average displayed.

Furthermore, students attempting a paper outside of the test cycle, e.g. taking an

Autumn paper in the Summer term, will not be represented in the Whole school Gap

analysis export. This is because the test taken dates for each paper is a set value that

must fall within a specific date range, attempts of a paper outside of this data range

may skew the class average and are therefore not included.

Unlike our other MARK reports, the whole school export looks for both the data range

and the test paper (Autumn, Spring or Summer), so when you select ‘Autumn’ it

ensures it only shows Autumn test papers taken in the autumn date range. Students

who have taken papers outside of the date range will still show in the correct

marksheet in MARK.

The term dates for each paper are:

Paper Start Date End Date

Autumn 15-08-2018 31-12-2018

Spring 01-01-2019 31-03-2019

Summer* 01-04-2019 31-07-2019

*Tests taken between 31/07 and 15/08 will not be included in the Whole School Gap

analysis.

10 March 2019

Generating reports Click on Reports in the left-hand menu to access the full suite of reports available. To

run your report, use the Report Picker to select either PiRA, PUMA, PUMA 6 Extension

or GaPS in the Product name dropdown menu, and then the Report type that you

require. Select the combinations of classes, groups or individual pupils and papers you

want to report on and run your report.

New contextual groups are available in MARK as part of the group reports drop down and can be

used to compare attainment.

11 March 2019

Pupil Reporting

Individual Pupil Report This report shows the performance of an individual

pupil on their most recently taken test.

Use for

✓ Analysis of specific areas of strengths and

weakness, by national curriculum strand

✓ Fine monitoring of predicted progress over the

coming year

✓ Parents’ evening reporting

The first page features an overall performance graph showing the Standardised Score on the test,

allowing a quick visual representation of how the pupil is performing against the national average

for his or her year group.

The summary data shows:

• The date the test was taken

• The pupil’s age at the time of the test

• Raw score

• The average score of the standardisation cohort for

the gender of the child

• Standardised score

• Age-standardised score (not for PUMA 6 extension)

• Age-standardised Percentile (not for PUMA 6

extension)

• Hodder Scale score

• Reading/Mathematics/GPS age

• Yes/No flag - identifying if the pupil’s Maths/Reading

Age is more than a year below their chronological age

(not on GAPS or PUMA 6 Extension reports)

The second section shows the pupil’s performance by strand.

The summary data shows:

• The date the test was taken

• The pupil’s raw score by strand out of maximum number of marks

The final information shown is the pupil’s predicted Hodder Scale score for the next three terms.

12 March 2019

Pupil Progress Report (PIRA, PUMA and GaPS)

Please note this report is not currently

available for PUMA 6 Extension.

This report compares the performance of an

individual pupil across several tests (up to a

maximum of 6).

Use for

✓ Tracking progress, term-by-term

✓ Looking for patterns of strengths and

weakness

✓ Demonstrating the impact of

interventions

✓ Parents’ evening reporting

The first section features a graph showing the

pupil’s performance across a series of tests.

These are shown as standardised scores against the National Average standardised

scores.

The summary data shows:

• The date each test was taken

• The pupil’s age at the time of each test

• Their total raw score

• National average standardised score

• Standardised score

• Age-standardised score

• Hodder Scale score

• Age-standardised Percentile

• Reading/Mathematics/ GPS age

The second section shows the pupil’s performance by strand across up to 6 tests.

The summary data shows:

• The date the test was taken

• The pupil’s raw score by strand out of maximum number of marks

13 March 2019

Academic Year, Class or Group Reporting

Academic Year, Class or Group Comparison Report This report shows the performance of different groups on a specific test.

Use for:

✓ Analysis of the performance of specific

groups against the class/year as a

whole, e.g. Pupil Premium, ethnicity

etc.

✓ SLT, governor and Ofsted reporting

The graph compares the standardised scores for

each group, split into boys and girls.

The summary data for each group shows:

• The number of pupils in that group

• Minimum standardised scores of the group

• Maximum standardised scores of the group

• Mean standardised scores of the group

• Mean Hodder Scale score of the group

The national average standardised scores are also shown for all children.

14 March 2019

Academic Year, Class or Group Analysis Report (PIRA, PUMA

and GaPS)

Please note this report is not currently available for PUMA 6 Extension.

This report shows the performance one group on a specific test, their

average score and the national average standardised score.

Use for:

✓ Analysis of individual pupil performance

against class and national averages

✓ A quick visual representation of the

standardised scores across the class or group

– flagging pupils who may need more support

The graph shows the performance of members of a

group, their average score and the national average

standardised score.

The summary data for each group for boys, girls and all

students show the:

• Number of pupils in each group

• Average age of the group

• Minimum scores of the group

• Maximum scores of the group

• Median standardised of the group

• Standard deviation of the group

• Average score of the group

• The national average

15 March 2019

Academic Year, Class or Group Listing

This report shows the performance of one group on a specific test, the proportion matching expectations and their average performance by strand. Use for:

✓ Planning ✓ Pinpointing areas of the curriculum that might need more in-depth teaching or

practice, across the class or group

Summary data includes

• The date the test was taken

• The pupil’s age at the time of

the test

• Reading/Mathematics/GPS

age

• Raw score

• Standardised score

• Age-standardised score (not

for PUMA 6 Extension)

• Age-SS Percentile (not for

PUMA 6 Extension)

• Yes/No flag - identifying if the

pupil’s Maths/Reading/GPS

Age is more than a year below

their chronological age (not for

PUMA 6 Extension)

• The pupil’s raw score by strand out of maximum number of marks

• Group averages across all the above

The charts on the second page show the percentage of pupils in each performance

indicator band across the class or group (not for PUMA 6 Extension) and the average

strand performance against the average score received by the standardisation cohort

(the national average).

16 March 2019

Academic Year, Class or Group Progress Report (PIRA, PUMA

and GaPS)

Please note this report is not currently available for PUMA 6 Extension.

This report shows the performance of one group across several tests (up

to a maximum of 6).

Use for:

✓ Analysis of the progress of

specific groups, e.g. Pupil

Premium, intervention groups,

More Able etc.

✓ SLT, governor and Ofsted

reporting

The graph compares the standardised

scores for the group across each test, split

into boys and girls.

The summary data for each group shows:

• The number of pupils in that group

• Minimum standardised scores of

the group

• Maximum standardised scores of

the group

• Mean standardised scores of the group

• Mean Hodder Scale score of the group

• The national average standardised score

If you have any difficulties getting your school set up on MARK, or

using the online analysis and reports – please send an email to

onlinesupport@rsassessment.com containing your questions, contact

details and a good time to contact you, and we will call you to help you

through the process.