Module E-Boxes

Martyn Atkins

Module E-Boxes

2

Table of contents

Module E-Boxes ................................................................................................. 3Overview & Content ....................................................................................... 3

Getting Started .................................................................................................. 7Logging-In .................................................................................................... 7Module List .................................................................................................... 9Module Data Summary .................................................................................. 10External Examiners ....................................................................................... 12Module Leaders ............................................................................................ 12Administrators ............................................................................................. 12Additional Help ............................................................................................ 13

Module E-Box Page ........................................................................................... 13External Examiners View ............................................................................... 13

Header .................................................................................................... 13Module Files ............................................................................................ 14Assignments / Assessments ....................................................................... 14Assignment Options ................................................................................. 15Component & Component Files .................................................................. 16Component Marking / Moderation .............................................................. 17

Admin & Module Leader View ........................................................................ 18Header .................................................................................................... 18Module Files ............................................................................................ 19Assignments / Assessments ....................................................................... 20Assignment Options ................................................................................. 20Component & Component Files .................................................................. 23Component Marking / Moderation .............................................................. 25

Uploading DLE Marking Information ....................................................... 25Marking / Moderation Statistics Display ................................................... 26Marking Moderation and Export ............................................................. 27

Module E-Boxes

3

Module E-Boxes

Module E-Boxes

The Module E-Box system has been developed to provide summary electronic information about teachingmodules within the School of Psychology at Plymouth University. This information is made available toexternal examiners via module E-Boxes - collections of electronic documentation and summary informationconcerning each module within the department which can be viewed on-line.

System Permissions / Access

The E-Boxes web site provides different levels of access/permissions depending on who you are:

· External Examiners - Read-only access to view module information

· Module co-ordinators/leaders - Read and write access to their own modules plus read-only view accessfor other modules

· Local administrators - Full read-write access for all modules

Overview & Content

Module E-Box (Overview & Content)Typical information included in a Module's E-Box include the following.

Module Header Information

o Module code (e.g. PSY247)o A brief module descriptiono The module leader's nameo The academic yearo Which stage the module is targeted at

Module Files

Module E-Boxes

4

o Module Outlineo Assignment / Assessment Requirementso Any other associated files

Module AssignmentsFor each module, assignment information is listed in blocks (if available from via the local CourseworkManager System) - otherwise, specific assignment information is typically available as file uploadsunder module files. Each assignment section typically includes:

o A statistical summary of marks for the assignmento A histogram of marking / grade information for the assignmento A list of assignment options and their specific details

Assignment OptionsDetailed assignment option information (if available from Coursework manager) typically includes:

Module E-Boxes

5

o Assignment leadero Assignment moderatoro Assignment marking teamo A statistical summary of marks for the optiono A histogram of marking or grade information for the optiono A summary of moderation markingo Final moderated scripts from the sampleo Moderation report (if available)o Option report from the module leader (if available)o Generic feedback (if available)

Module Exams (Components)Components / exams are listed by name in sections. Within each section, exam-related files can beuploaded such as:

Module E-Boxes

6

o Component / exam paper questionso Component / exam marking summarieso Component / exam moderation summarieso Component / exam moderation scripts

Component Marking / ModerationThis new functionality allows the integration of DLE / Moodle marking data into module box and allowson the fly moderation by module leaders / admins. More details can be found here:

External examiners

o Component Marking / Moderation

Module leaders and administrators

o Uploading DLE Marking Informationo Marking / Moderation Statistics Displayo Marking Moderation and Export

Module E-Boxes

7

Logging-In

Module E-Boxes

8

Logging-In

If you are an external examiner, you will have been issued with a login. Local administrators and moduleleaders log in using their normal University log in credentials and are granted the correct level of access asset by the Psychology Technical Office.

To access E-Boxes, go to www.psy.plymouth.ac.uk/admin4/ModuleBox in your preferred web browser. Youwill be presented with a brief introductory screen. Click on continue to get to the login screen where you canlogin using your login credentials.

Module E-Boxes

9

After you've logged in successfully, you will be presented with a list of the current academic year's modules to choose from. If your login fails repeatedly, check with the Psychology Technical Office tech.psy@plymouth.ac.uk that you have permissions to use Module E-Boxes.

Module List

Module List / Module SelectionAfter login, the default screen is a list of all modules for the current academic year or it can be selected bythe quick menu button called "Module List"). The module list includes undergraduate modules (Stages 1, 2and 4) plus postgraduate MSc / MPsych modules (stage 5).

Quick Menu Buttons:

Module E-Boxes

10

Module List Page:

Change academic yearIf you wish to see modules from a different academic year, use the drop-down year choice control as shownbelow.

Select a module to view its E-Box pageChoose a module from the list to view its E-Box page by clicking on the module title (shown in blue). If youare the module's administrator or a Module E-Box administrator, you will open the E-Box in a combined view& edit mode. If you are an external examiner or are a leader of other modules but not the one selected, yourdefault E-Box view will be a read-only view mode.

Module Data Summary

Module Data SummaryThis screen is only available to module leaders and administrators.It shows a summary (by module andacademic year) of all data uploaded to module box. This helps MLs to determine "gaps" in the uploadeddata and rectify them. The page can be accessed by the new menu button item at the top of every pagecalled "Data Summary (by module)". There are two views of the data available - a simple summary view in atable and a more detailed hierarchical view showing file names as well as counts.

Module E-Boxes

11

New Data Summary Menu Button:

Change academic yearIf you wish to see modules from a different academic year, use the drop-down year choice control as shownbelow.

Module Data Summary Page

Summary View

Module E-Boxes

12

Detail View

Select a module to view its E-Box pageTo view a module's E-Box page, click on the module title (shown in blue). If you are the module'sadministrator or a Module E-Box administrator, you will open the E-Box in a combined view & edit mode. Ifyou are an external examiner or are a leader of other modules but not the one selected, your default E-Boxview will be a read-only view mode.

External Examiners

Help for External ExaminersAfter logging in and choosing a module from the module list, as an external examiner, you are granted read-only view access on each module's E-Box page. Click on the link below

· Module E-Box read-only view (external examiners)

Module Leaders

Help for Module LeadersAfter logging in and choosing a module from the module list, if you are the module leader, you are grantedadmin view access to the module's E-Box page. If you are not the module's leader, you will be able to view itin the read-only external examiner's mode.

· Module E-Box admin view (module leaders and administrators)

· Module E-Box read-only view (external examiners)

Administrators

Help for Module E-Box AdministratorsAfter logging in and choosing a module from the module list, you are granted admin view access to the

Module E-Boxes

13

module's E-Box page.

· Module E-Box admin view (module leaders and administrators)

Additional Help

Getting Additional Help

To get additional help and/or to report any bugs, please contact:

The Psychology Technical Office, Room Link 109 (in person)

Email: tech.psy@plymouth.ac.uk

Telephone: 01752 (5)84853

External Examiners View

Module E-Box Examiner View (read-only)This view applies to module leaders viewing modules for which they aren't the module leader and to externalexaminers. Module E-Box pages are arranged in clearly defined sections from the top-down in the ordershown below. Please click a section heading below to view more information on each.

· Module Header Sections

· Module Files

· Assignments (Assessments)

· Assignment Options

· Exams and Exam Files

Header

E-Box HeaderThe module E-Box page header area shows the following module information.

Module E-Boxes

14

Module Header Information

Contents· Module code (e.g. PSY247)

· A brief module description

· The module leader's name

· The academic year

· Which stage the module is targeted at

Module Files

Module FilesThe module files section shows any files that have been uploaded by the module leader and/or Module E-Box administrators. Click on a file name to view the file in a separate browser window/tab.

Typical Module Files· The module outline

· Module assessment requirements

· Any other module-related documents (excluding exam-related files which are shown in a separatesection)

Assignments / Assessments

Module Assignments (Assessments)For each module, assignment information is listed in blocks for academic years prior to 2015/16 (datacomes from from pre- Moodle / DLE Coursework Manager data) - otherwise, specific assignment informationis typically available as files under the component files section.

Module E-Boxes

15

Typical Contents· A statistical summary of marks for the assignment

· A histogram of marking / grade information for the assignment

· A list of assignment options and their specific details

Assignment Options

Assignment OptionsDetailed assignment option information is shown if available from legacy data sources (academic years priorto 2015/16 and prior to Moodle / DLE)

Contents· Assignment leader

Module E-Boxes

16

· Assignment moderator

· Assignment marking team

· A statistical summary of marks for the option

· A histogram of marking or grade information for the option

· A summary of moderation marking in a moderation marking table

· Final moderated scripts from the moderation sample in a final marking table:You can click on the blue links within this table to view either the final moderated script and/orfeedback on that script (if available)

· Moderation report - shown as a click-able blue link if available

· Option report from the module leader - shown as a click-able blue link if available

· Generic feedback - shown as a click-able blue link if available

Component & Component Files

Component & Component FilesExams are listed by exam name in sections. Within each section, exam-related files are displayed. Click ona file name to view the file in a separate browser window/tab.

Module E-Boxes

17

Typical exam-related files include:

· Exam paper questions

· Exam marking summaries

· Exam moderation summaries

· Exam moderation scripts

Component Marking / Moderation

Marking / Moderation Statistics DisplayIf marking (and optionally moderated marking) data is present in Module Box, you will see the markingstatistics panel. The statistics panel consists of a histogram of the marking distribution, a box-plot bymarker of the marking data and some simple summary statistics (number of scripts, average mark, mode,standard deviation and marking variance). If present, the effects of moderation are shown for comparison inthe lower section as shown below.

Module E-Boxes

18

Marking Statistics Panel:

Admin & Module Leader View

Module E-Box Admin View (module leaders andadministrators)This view applies to module leaders and to E-Box administrators. Module E-Box pages are arranged inclearly defined sections from the top-down in the order shown below. Please click a section heading belowto view more information on each.

· Module Header Sections

· Module Files

· Assignments (Assessments)

· Assignment Options

· Exams and Exam Files

Header

E-Box HeaderThe module E-Box page header area shows the following module information.

Module E-Boxes

19

Module Header Information

Contents· Module code (e.g. PSY247)

· A brief module description

· The module leader's name

· The academic year

· Which stage the module is targeted at

Module Files

Module FilesThe module files section shows any files that have been uploaded by administrators or a module leader.Click on a file name to view the file in a separate browser window/tab.

Typical Module Files· The module outline

· Module assessment requirements

· Any other module-related documents (excluding exam-related files which are shown in a separatesection)

Uploading new filesAs and administrator or module leader, you have the ability to upload new module-related files (not exam-related as these have their own section). Simply click the browse button to look for the file on your PC andthen click the Upload button to upload the files you've selected (hold CTRL on the keyboard when selectingfiles to choose more than one). It is best to ensure the document is in Adobe Acrobat (PDF) format prior toupload and that the file has a meaningful and descriptive name e.g. PSY157 Module Outline 13-14.pdf.The files listing is ordered by name, so sorting can be imposed by prefixing names with 1, 2, 3, ... or A, B,C, ... and so on.

File uploads are limited to a 20MB maximum size to prevent massive file uploads, so please ensure your fileis less than 20MB in size prior to upload.

Deleting Existing FilesTo delete a file upload, click on "Delete this file". This is useful if you've accidentally uploaded an incorrect

Module E-Boxes

20

file or a file with a file-name you'd like changed.

Assignments / Assessments

Module Assignments (Assessments)For each module, assignment information is listed in blocks for academic years prior to 2015/16 (datacomes from from pre- Moodle / DLE Coursework Manager data) - otherwise, specific assignment informationis typically available as files under the component files section.

Typical Contents· A statistical summary of marks for the assignment

· A histogram of marking / grade information for the assignment

· A list of assignment options and their specific details

Removing uploaded CSV marksTo remove any manually uploaded CSV marking information, simply click on the blue link below the markinghistogram for the assignment.

Assignment Options

Module E-Boxes

21

Assignment OptionsDetailed assignment option information is shown if available from legacy data sources (academic years priorto 2015/16 and prior to Moodle / DLE)

Contents· Assignment leader

· Assignment moderator

· Assignment marking team

· A statistical summary of marks for the option

· A histogram of marking or grade information for the option

· A summary of moderation marking in a moderation marking table

· Final moderated scripts from the moderation sample in a final marking table:You can click on the blue links within this table to view either the final moderated script and/orfeedback on that script (if available)

· Moderation report - shown as a click-able blue link if available

· Option report from the module leader - shown as a click-able blue link if available

· Generic feedback - shown as a click-able blue link if available

Uploading CSV marking information per-option (when there is no existingmarking data)If there is no marking data available for an option in Coursework Manager, you have the opportunity to uploadbasic CSV (comma separated values) marking data for the option manually. To do this, first ensure that your CSV file is in the correct format (you can click on the blue (i) for moreinformation on the correct format as shown below.

Module E-Boxes

22

Once you have a correctly formatted CSV text file for the option, you can upload the data using the fileupload control (browse for the file and then click Upload). Incorrectly formatted files are rejected.

Removing uploaded CSV marksTo remove any previously uploaded CSV marking information, simply click on the blue link below themarking histogram for the option.

Module E-Boxes

23

Component & Component Files

Component & Component FilesModule components (exams, coursework, reports) are listed by component names in sections. Within eachsection, component-related files are displayed. Click on a file name to view the file in a separate browserwindow/tab.

Module E-Boxes

24

Adding a new exam (by name)To add an exam by name, click on the "+ Add an Exam by Name" link and give the exam a meaningfulname. Be careful doing this since exam names, once created cannot be deleted except byPsychology Technical Office staff members. Once a new exam name is added, an additional examsection is added where exam-related files can be uploaded.

Uploading new exam-related filesAs and administrator or module leader, you have the ability to upload new exam-related files under eachexam's section. Simply click the browse button to look for the file on your PC and then click the Uploadbutton to upload the file under that exam's section (hold CTRL on the keyboard when selecting files tochoose more than one). It is best to ensure the document is in Adobe Acrobat (PDF) format prior to uploadand that the file has a meaningful and descriptive name e.g. Paper 1 Q2 mod sample 43545986 CW.pdf.The files listing is ordered by name, so sorting can be imposed by prefixing names with 1, 2, 3, ... or A, B,C, ... and so on.

File uploads are limited to a 20MB maximum size to prevent massive file uploads, so please ensure your fileis less than 20MB in size prior to upload.

Module E-Boxes

25

Deleting Existing FilesTo delete a file upload, click on "Delete this file". This is useful if you've accidentally uploaded an incorrectfile or a file with a file-name you'd like changed.

Typical exam-related files· Exam paper questions:

File names like Paper 2 Questions.pdf please.

· Exam paper marking guidelines:File names like Paper 2 marking guidelines.pdf please.

· Exam marking summaries:File names like Paper 2 marks histogram.pdf please.

· Exam moderation summaries:File names like Paper 1 Q1-Q3 mod summary MR-YH.pdf please, where the marker initials arearranged marker-moderator (e.g. MR-YH).

· Exam moderation scripts:File names like Paper 1 Q31-Q33 mod sample 10290647 CB.pdf please, where the end of the filename is SRN for the script + the marker initials (e.g. ...10290647 CB.pdf).

Uploading DLE Marking Information

Uploading Component Marking Data (exported from the DLE/Moodle)For any component with marking information held in the DLE / Moodle, it is possible to Import DLE/Moodlemarks which have been exported from the DLE in CSV format. The CSV import file must contain thefollowing fields as an absolute minimum as well as a header line on line 1 followed by one mark per linethereafter. Other fields can be included, but will be ignored.

NOTE: Uploaded marks overwrite any existing marking data previously imported for this component.

DLE/Moodle marking import panel:

If there are any errors or warnings to view when importing the DLE marks, you can view them by expandingthe "Show Warnings" or "Show Errors" sections shown above to reveal the error/warning details as shownbelow.

Module E-Boxes

26

Sample Import Warnings:

Typical warnings concern "N" grades which are imported but always excluded from statistical analyses.

Sample Import Errors:

Typical errors concern malformed data lines and lines missing key data such as a marker name. Errorsmust be fixed and addressed before the file can be imported to module box successfully.

Successful Marking Import:If the import completes successfully with no errors (warnings are allowed), the marks will be imported andoverwrite any existing marking data, you'll see summary statistics (histogram and box plot) by marker forthe imported marks and you'll be able to perform live, interactive moderation on those marks just below theDLE/Moodle marking import panel. For more information on these functions, use the links below.

· Marking / Moderation Statistics Display

· Marking Moderation and Export

Marking / Moderation Statistics Display

Marking / Moderation Statistics DisplayIf DLE/Moodle marks have previously been uploaded successfully to Module Box, you will see the markingstatistics panel (optionally with a moderated comparison below if you've applied marker moderation). Thestatistics panel consists of a histogram of the marking distribution, a box-plot by marker of the marking dataand some simple summary statistics (number of scripts, average mark, mode, standard deviation andmarking variance).

Module E-Boxes

27

Marking Statistics Panel:

If you are applying moderation using the Moderation Panel, then the post-moderation display (lower section)will reflect those changes dynamically as they are applied, allowing a quick comparison "on-the-fly" of theeffect of the moderation compared to the original marking (top section).

Marking Moderation and Export

Marking Moderation and ExportIf DLE/Moodle marks have previously been uploaded successfully to Module Box, you will see moderationpanel in addition to the marking statistics panel This panel allows you to apply marker moderation of -2, -1,0, +1 or +2 grades.

Notes on the moderation algorithm used:· Moderation that causes passes to become fails is not allowed and a grade is capped at the "lowest

pass" level of "D-" (42%)

· Moderation that causes a fail to become a pass is not allowed and a grade is capped at the highest"fail" mark/grade of "F+" (38%)

· Moderation up (+1 or +2 steps) does not alter "N" grades (0%)

· Moderation down (-1 or -2 steps) does not alter "F-" (15%) grades - this prevents an F- (15%) becomingan "N" (0%)

Module E-Boxes

28

Marker / marking moderation panel:

If you apply a new moderation, the marking statistics panel updates immediately so you can easily see theeffects of moderation visually in comparison to the original marks. If you need more detail (the entire tablemarking showing pre- and post- moderation marks and grades), click on "Show Moderated Marking Details".This detailed table can be sorted based on a column by click ing on the column header once (ascendingsort) or twice (reverse sort) e.g. click on "Mark" to sort by marks.

Moderated marking details table:

Moderated marks can be exported in CSV format for re-import into the DLE/Moodle once you're happy withthe moderation steps you've set. Simply click the "Export Moderated Marks" button. This file can then bere-imported to the correct module & component area of the DLE / Moodle.