Ivan Pribela, Mirjana Ivanović

Table of contents Overview of Svetovid The first Svetovid version The second Svetovid version Extension of the second version Overview of Testovid Integration of Svetovid and Testovid Overview of Mag The MILE environment Conclusions Further work

2

Table of contents

3

The Svetovid system Special environment for development and

submission of student programming assignments

Implemented purely in Java

4

Background Before reforms, students were assessed

based on their solutions written on paper After reforms, we concentrate on practical

exercises as a form of continual assessment

5

Motivation Now instructors have to much work

Compile each programRun it with some test casesExamine all of the output

Not all students are producing their own solutionsSolutions are easily sharedAwareness and honesty is on a poor level

6

The goals of Svetovid Allow students to comfortably develop their programs Allow access to support literature Disallow students to share programs and solutions,

intentionally or unintentionally Keep a detailed log of student efforts Help instructors to mark student solutions Allow students to test their programs before

submission Be flexible enough and usable for different courses

Wide range of programming languages Different project stages: coding, documenting…

7

Table of contents

8

The first version Command line based Set of command line tools for assignment

retrieval and solution submission Used virtual student directories for

assignment and solution storage

9

Virtual directories

John Smith

Marc Tyler

Fred Carlen

Joanna Blue

Lazar Hans

Lucy May

Peter White

Assignment 1

Assignment 2

Assignment 3

All students

Root directory

Assignment 1

Assignment 2

Assignment 3

All students

John Smith

Marc Tyler

Peter White

10

Usage Students used favorite development tools

and submitted solutions at the end Command line tools are cumbersome

Had to type name and password every time Deemed uncool by the students Easy to cheat

11

Table of contents

12

The second version GUI based Introduced integrated development

environment as student client Introduced instructor control client

13

The student client IDE allowing the student comfortable work Prompts a login dialog The files owned by a student are contained

in virtual directory Content of virtual directories can be saved

to local file system or sent via e-mail only after assessment

14

The student client

15

The instructor client Set of configuration dialogs

Setting up coursesManaging students

Prompts a login dialog Full control over the conduction of practical

exercisesGroupsOrderTiming

16

The instructor client

17

Table of contents

18

Encountered problems The text editor component should

accommodate all programming needs A third party component was built in

Syntax highlight, parenthesis matching… Main problems

No keyboard shortcuts while editing textNo automatic indention

19

Goals of the extension Create a new text editor component Use of java.swing.text package Keep all of the previous features and add

new ones

20

CodeEditorPane New textual component Extends JEditorPane Main features

Syntax highlightingMarking parenthesis pairsLine numberingIndent preservationMeasures against cheatingConvenience methods for applications

21

Syntax highlighting Done in a separate

object representing the language

Supported languagesJavaSchemeModula2TeX

22

Marking parenthesis pairs Pairs of parenthesis

usually have meaning in program code

23

Line numbering Provides useful

information during debugging

24

Indent preservation Indentation helps to

make code more readable

On line breaks, the indent from the previous line is copied

25

Measures against cheating Usage of the system clipboard is forbidden Overriding cut, copy and paste methods Using a local static clipboard

26

Convenience methods Status bar

Caret row and column Active language Toolbar

Language selectionManual syntax highlight refresh

Line numbering component Fully set up JPanel with the component

27

Table of contents

28

The Testovid system Interactive and batch testing system

Framework for testing systems Implemented using Apache Ant

29

Niklaus Wirth

30

The goals of Testovid Allow students to check their solutions

directly form their environment Allow assessment of all collected solutions

after the assignment deadline Be flexible enough and usable for different

coursesWide range of programming languagesDiverse set of testable aspects

31

Testing modes Students can test their solutions at any time Instructor can test all submitted

assignments at once In both cases detailed reports are generated

32

Interactive test mode reportPredmet: Operativni sistemi 1Zadatak: Obilazak direktorijumaStudent: Pera Perić

Provera: Direktorijum bez poddirektorijumaUspeh: 1 poen.

Provera: Direktorijum sa poddirektorijumimaNeuspeh: Rezultat izvrsavanja se ne slaze sa ocekivanim.

Provera: Opsti slucaj direktorijumaNeuspeh: Rezultat izvrsavanja se ne slaze sa ocekivanim.

-+-+-+-+-+-+-+-+-+-+-+-+-Ukupno: 1 poen.

33

Batch test mode reportPredmet: Operativni sistemi 1Zadatak: Obilazak direktorijuma

Bajcetic Vladimir 3 poenaBaranovski Nenad 0 poenaBarjaktarovic Marko 1 poenBlagojevic Katarina 2 poenaDamjanovic Jelena 0 poenaDjurkovic Velimir 3 poenaJovanovic Jelena 1 poenKovacevic Miroslav 2 poenaKrickovic Valentina 1 poen.........

34

Table of contents

35

Integration One of Svetovid goals was automatic

assessmentNot implemented directlyDelegated to another system

Testovid was designed with integration in mindInternal logic is the sameDirectory structure is compatible

Integration was straightforward

36

Table of contents

37

The Mag system Tutoring system for distance learning Provides three types of activities

TutoringQuiz and feedbackOnline programming

38

The goals of Mag Be platform independent Create useful reports for instructors Have rapid development tools for creating

basic elements of tutoring system

39

The user interface

40

Table of contents

41

The MILE Multifunctional Integrated Learning

Environment Modular design

Learning environment (Mag)Submission system (Svetovid)Testing system (Testovid)

42

The goals of MILE Provide adequate tutorials to students Allow students to test their understanding

of new material Provide online programming support Provide students with automated feedback Allow final exams via internet or in

computer laboratory

43

The environment provides Communication

Student-studentStudent-instructor

Tools to simplify maintenance Student web pages

44

Main problems Mag was designed as a Java programming

tutor Svetovid and Testovid are designed for

computer laboratories Great difference between structures of

student modeling

45

Table of contents

46

Svetovid Svetovid goals are fulfilled

Less time spent on submissionLess effort spent on assessment

Has been successfully used in many coursesOperating systemsProgramming languagesComputer graphicsCompiler construction

47

Text editor component Goals are fulfilled

Support for all existing featuresAdded new featuresFlexible syntax highlight systemSimple to build in into existing applications

Should be used from this yearAll courses using Svetovid

48

Testovid Testovid goals are fulfilled

Less effort spent on assessmentAssessment available at any time

Has been successfully usedOperating systems

49

MILE MILE goals are fulfilled

Showed itself as a modern learning toolStudent satisfaction was the same as with the

manual methodLess effort spent on assessment

Has been used by first year studentsAs a complement to classroom teaching

50

Published work Svetovid – Special submission environment for student’s assessment

Ivan Pribela, Nataša Ibrajter, Mirjana IvanovićProceedings of 2nd Balkan Conference in Informatics, BCI’2006Ohrid, Macedonia, November 17-19, 2005, pages 228-237

Testing almost any aspect of student’s assignmentsIvan Pribela, Mirjana Ivanović, Zoran BudimacProceedings of 3rd Balkan Conference in Informatics, BCI’2007Sofia, Bulgaria, September 27-29, 2007, pages 173-182

Svetovid—Interactive development and submission system with prevention of academic collusion in computer programming

Ivan Pribela, Mirjana Ivanović, Zoran BudimacBritish Journal of Educational Technology (in print)

MILE – Multifunctional Integrated Learning EnvironmentBoban Vesin, Mirjana Ivanović, Zoran Budimac, Ivan PribelaProceedings of e-learning 2008, IADIS Multi Conference on Computer Science and Information SystemsAmsterdam, Netherlands, July 22-27, 2008, pages 104-108

51

Table of contents

52

Continual improvement Continue to improve usability and user

experience of GUI clientsAdding new features and toolsAdding support documentation and manuals

Leveraging effort of test creationCreating a solid base of reusable test modules

for multitude of aspectsCreation of a test module generator

Adding plagiarism detectionJust in case

53

54

55