SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

13
ISSN 2185-3762 Studies in Self-Access Learning Journal http://sisaljournal.org A Two Year CrossSection of Student Use of SelfAccess ELearning Richard S. Pinner Corresponding author: [email protected] Publication date: September, 2011. To cite this article Pinner, R. S. (2011). A two year cross-section of student use of self-access elearning. Studies in Self-Access Learning Journal, 2(3), 170-181. To link to this article http://sisaljournal.org/archives/sep11/pinner This article may be used for research, teaching and private study purposes. Please contact the author for permission to re-print elsewhere. Scroll down for article

description

Over a two year period of using a Moodle based self-access resource, student loginswere measured against student numbers in schools in order to evaluate the percentageof students’ usage. Peaks in student use seemed to correspond with teacher traininginitiatives. This paper outlines these initiatives and the relationship between student use of self-access ICT resources and teacher training. It also details the types of training and incentives offered to both teachers and students to improve the usage figures of self-access.

Transcript of SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

Page 1: SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

ISSN 2185-3762

Studies in Self-Access Learning Journal http://sisaljournal.org A  Two  Year  Cross-­‐Section  of  Student  Use  of  Self-­‐Access  ELearning  

Richard S. Pinner Corresponding author: [email protected] Publication date: September, 2011.

To cite this article Pinner, R. S. (2011). A two year cross-section of student use of self-access elearning. Studies in Self-Access Learning Journal, 2(3), 170-181. To link to this article http://sisaljournal.org/archives/sep11/pinner This article may be used for research, teaching and private study purposes. Please contact the author for permission to re-print elsewhere. Scroll down for article

Page 2: SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

SiSAL Journal Vol. 2, No. 3, September 2011, 170-181

170

A Two Year Cross-Section of Student Use of Self-Access eLearning Richard S. Pinner, Engnet Education

Abstract Over a two year period of using a Moodle based self-access resource, student logins were measured against student numbers in schools in order to evaluate the percentage of students’ usage. Peaks in student use seemed to correspond with teacher training initiatives. This paper outlines these initiatives and the relationship between student use of self-access ICT resources and teacher training. It also details the types of training and incentives offered to both teachers and students to improve the usage figures of self-access.

Keywords: self-access; training, computer-aided language learning, CALL, Moodle

Many institutions are offering additional resources to learners in the form of

eLearning content hosted on virtual learning environments (VLEs), thus providing

enhanced opportunities for collaboration and access to a rich variety of multimedia

materials. However, these resources are often underused and neglected by both

students and teaching staff. The UK’s official body for inspecting schools, Ofsted,

found in a survey of VLE usage that “the use of VLEs to enhance learning was not

widespread and that the exploitation of VLEs at curriculum level resembled more of a

cottage industry than a national technological revolution” (Halies, 2009, p. 1). There

could be many reasons behind this lack of VLE usage, one of which might be the lack

of proper teacher training. The present paper will examine some of the initiatives

implemented in a chain of private language schools in the UK and Ireland which

observed trends in student usage in relation to teacher training sessions.

This study documents the design, implementation and development of a

program of self-access with teacher-guided study. In particular, a VLE was used to

host a wide range of online self-access materials. The program was implemented in a

large chain of private language schools in the UK and Ireland. Throughout the

implementation of the program, student use of the online self-access centre (OSAC)

was measured and plotted into a graph. It was found that student use increased after

teacher training and development sessions, which suggests teacher training and

institutional support is an important factor in increasing the use of OSAC resources.

This paper outlines the types of initiatives used to encourage teachers and how

these possibly filtered back to students in order to promote increased use of the OSAC

Page 3: SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

SiSAL Journal Vol. 2, No. 3, September 2011, 170-181

171

facilities. In particular, training emphasised practical ideas for implementing the VLE

in class, as well as ideas for blended learning. Another focus of the training was

general use of technology and Computer-Aided Language Learning (CALL) in class

and ways of reducing the administrative strain placed on teachers by the VLE. Few

teachers had used the VLE system previously and as those teachers who were

responsible for the OSAC in their schools also had a lot of other duties including

teaching, it was felt that spending a lot of time marking students work and running

reports from Moodle might seem impractical without the proper training.

The study attempts to illustrate that students are more likely to use OSAC

resources if the teachers have been trained and given ideas about how to incorporate

them into class. It also highlights the connection between teacher training and student

OSAC uptake.

Literature  Review  

Computer-based resources and learner autonomy have a close relationship.

CALL can be utilised to provide increased access to a wide range of rich resources.

For example, Benson (2001) cites the huge variety of media which allow students

authentic and rich linguistic input. Computers feature heavily in many people’s lives,

and as such language learners are likely to look to computers and the internet for

resources. Figura & Jarvis (2007) talk about the long perceived relationship between

CALL and autonomy, in their study they reported that students viewed computers as a

useful part of their autonomous learning, with 62% if the subjects using the computer

for between 1 and 2 hours per day for language practise.

Self-access centres have featured heavily in language programs for several

decades (Sturtridge, 1997) and OSACs are a logical development in that they enable

greater access to a wider range of rich multimedia resources. As they are online they

can also be tracked, monitored and edited by both students and teachers. However, the

administration and navigation of VLEs are not always easy tasks, and training can all

too often be inadequate for both teaching staff and students. This may be due to time

constraints or inadequate follow-up training. These problems of teacher and student

OSAC usage are additional to the task of encouraging students to be more

autonomous. Autonomy is not the same as working completely without a teacher. A

student who completes a pedagogic grammar course book without reflection or

Page 4: SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

SiSAL Journal Vol. 2, No. 3, September 2011, 170-181

172

analysis is not working autonomously. Little (1991) equates total detachment to

severe autism rather than autonomy. He states that “because we are social beings our

independence is always balanced by dependence; our essential condition is one of

interdependence” (Little, 1991, p. 5).

For advocates, autonomy is a “precondition for effective learning” (Benson,

2001, p. 1). Autonomy is what we wish to encourage across schools because it

empowers learners and enables them to embark upon life-long learning, thus meaning

the likelihood of becoming successful in terms of communicative competence will be

higher. Issues arising around the concept of autonomy are often voiced in terms of its

cultural compatibility (Pennycook, 1997, see Palfreyman & Smith, 2003 for a

collected volume), and some of the initial scepticism around autonomy arose over the

perception of it being used to justify having less contact time between student and

teacher, (McDevitt, 1997) or simply as an economical way of getting students to do

more work without the need to pay the teachers. Surprisingly, despite agreement

amongst practitioners and empirical evidence to support the fact that autonomy is of

great benefit to learners, ways of fostering autonomy and encouraging self-access

remain conspicuously absent from teacher education and training programs (Reinders

& Balcikanli, 2011). From my experience as both a teacher trainer and consultant, I

have observed that many schools and institutions have been guilty of simply opening

a self-access centre and assuming that students are now autonomous. Simply leaving

students alone surrounded by books and study materials does not make them

autonomous. With the added flexibility and all-hours access provided by an OSAC

these issues become even more prevalent. If students are working in an OSAC from

their homes or outside school hours, how can they be supported and how can their

activities be tracked? In order to provide the necessary support for this ‘all hours’ type

of self-access learning teachers need to play an active role in the virtual learning

environment as Minshull (2004) notes in the following quotation:

It is now recognised that the teacher’s role in terms of constructing,

monitoring and facilitating the learning process [in e-learning] is vital; for

example, just setting up a discussion board and hoping students will engage

with it doesn’t work. (Minshull, 2004, p. 5)

Page 5: SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

SiSAL Journal Vol. 2, No. 3, September 2011, 170-181

173

For this reason, the present study attempts to examine any potential link

between the support structures in place for teachers and students; in other words

teacher training initiatives aimed at allowing teachers to support their learners’ self-

access opportunities.

Background  to  the  Study  

A program of self-access with teacher-guidance was implemented as part of an

initiative by Kaplan International Colleges to provide better support and autonomy to

students who were studying in private sector language schools located in target

language (English) speaking countries. The program featured a Moodle based OSAC

with over twenty different quiz type activities per week over a ten week course with

different levels of difficulty for Elementary, Pre-Intermediate, Intermediate, Upper-

Intermediate and Advanced level students. All students were tested using an in-house

test and placed into levels, once they began at the schools they were given access to

the OSAC and shown how to login and navigate to the activities. There were also

weekly written and spoken assignments which were based on the language content

being practised that week in the OSAC. Each week had a theme, such as “The World

of Work” or “Future Plans” and these themes formed the basis of any language work.

The OSAC content did not relate directly to the work students were doing in class, so

the OSAC work was to be treated as entirely supplementary study. In addition to the

10 weeks of activities on the OSAC, each school had a dedicated library of self-access

resources ranging from graded readers to DVDs, with grammar books and other self-

study materials. Each of these ‘study centres’ was managed by a study centre manager

who was available to answer students’ questions and support them with their self-

access learning. These study centre managers also provided any immediate technical

support for the OSAC and were responsible for marking the online written and spoken

assignments.

The schools that participated in this study were located in the UK and Ireland.

There were eleven participating institutions in total. The number of students who used

the OSAC over the course of the two years (May 2008 – May 2010) in which data

were collected numbered over 20,000. Data were compiled using reports which came

directly from the Moodle VLE as well as student numbers from the student

management system.

Page 6: SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

SiSAL Journal Vol. 2, No. 3, September 2011, 170-181

174

The overall usage spanning the two-year period was plotted into a graph

(Figure 1) using an equation to measure unique student logins to the OSAC against

student numbers in the schools. The graph, which shows holistic uptake throughout all

schools, shows peaks in site use around dates in which teacher training was carried

out. A more detailed discussion of the findings will follow the presentation of the

results.

Methodology  

The data for this study were collected using a range of applications which

were combined in a spreadsheet to produce a graph which gave an approximate figure

for the number of students who were using the site. Reports on the number of unique

logins to the site were used, rather than total logins. Therefore, a user who logs in

three times in one day counts as one unique login, and a user who logs in only once in

a day also counts as one unique login. This gives a better idea of the actual number of

students who access the OSAC resource. Unfortunately, time spent on the OSAC was

not measured by the Moodle system and activity reports can only be viewed one

student at a time, making it impractical to examine what the students were doing

while they were logged in as part of a holistic report on site usage due to the large

number of users involved. In this way the data is one-sided and tells us little about

how the OSAC was actually being used, however we do know that the written and

speaking assignments were hardly used at all. Some weeks, the speaking resource

received no submissions at all from eleven institutions and usually only between five

and ten submissions even during busy periods when potentially between two and three

thousand students were eligible to submit assignments. In other words, students were

not logging in to the OSAC in order to do academic writing assignments. Looking at

separate activity reports from Moodle, it is clear that the most popular OSAC

resources were activities which had listening practise and also flash based game

activities. At this stage it would be useful to have some more qualitative data about

the students’ use of the OSAC, but despite this lack of data, having an idea of the

percentage of students who actually log into the system is useful in allowing us to

calculate a usage percentage. The number of eligible students (students with OSAC

access) in the schools overall was collected through the central student management

system database, and the number of unique logins was collected from a Moodle

Page 7: SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

SiSAL Journal Vol. 2, No. 3, September 2011, 170-181

175

report. These two systems’ results were then plotted into a spreadsheet, and uptake

was calculated by dividing the number of unique logins (UL) by the number of

students (N) to create a percentage:

A graph was plotted from the results, which shows the student uptake of the

OSAC and spans a two-year period with almost 20,000 students. The average uptake

of the OSAC was 26.91% of the eligible student body, ie. those students who could

have accessed the OSAC if they had wanted to.

Subjects

The subjects were students from a large number of different cultural and

linguistic backgrounds. The ages of the students varied from sixteen to sixty, with the

majority of students in their mid-twenties. Every student had different start dates and

different course lengths, as the schools operate a weekly enrolment schedule and

course lengths can be anywhere from four weeks to a year long. The disadvantages of

having such a large variety of subjects and different enrolment periods will be

discussed in more detail in the discussion section of this paper.

Procedure

The two types of training sessions which were conducted with the teachers can

be broadly categorised as either general technology and OSAC class implementation

training or specific OSAC administration training. The specific OSAC training was

given initially to study centre managers whose role incorporated responsibility for the

SAC and marking work on the OSAC, as well as student orientation and training to

use both the SAC and OSAC. These study centre managers had a reduced teaching

load and were scheduled to be in the SAC so that students could come and consult

with them face to face if they needed any help or guidance. They were also

responsible for running study clubs and workshops. A large part of these teachers’

jobs was connected with the SAC and its resources and events. Although the study

centre managers had less engagement with the OSAC except for conducting weekly

Page 8: SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

SiSAL Journal Vol. 2, No. 3, September 2011, 170-181

176

marking of online assignments, they were the only teachers in each school who would

come into contact with the OSAC as a formal part of their job description.

Training, which was specifically designed for study centre mangers, involved

showing them how to run reports within Moodle so that they could view the amount

of usage from students in their school. Unfortunately, this was problematic as the

version of Moodle used did not support site-wide groups so a special hack had been

implemented which was not always reliable. For this reason the training also featured

an element of how to get around this limitation and how to gain more useful

information specific to the school, making the training very focussed on technology

and reports. Another important aspect of this training was that it attempted to justify

why running these reports could benefit both the students and teachers. To illustrate

this, the specific example used was that of students who ask to be moved up to a

higher level class after a certain period of time. The schools all conduct summative

level tests every five weeks to decide if students are ready to move up, but often when

students fail the test they request to move up despite their results. It was suggested

that students’ level of commitment and usage of the SAC and OSAC be a deciding

factor in whether these students be allowed to move up to a higher class. Also, if the

students’ requests to move up were denied, it was suggested that the students be

encouraged to utilise the SAC and OSAC more to improve their language level in

order to move to a higher level. Incorporating this directly into the training made the

administrative aspect of the site more relevant to the study centre manager’s role.

The second type of training focused on general CALL usage and was targeted

at all teachers in the schools, even those with no dealings with the SAC or OSAC. The

training was not specific to the OSAC although there were continual references to

encouraging OSAC usage outside of class and also ideas about how to use the

integrative features of the OSAC (such as the forums and blogs) as part of a class.

Previous to these training sessions, most of the teachers had never had any contact

with Moodle nor had they been fully informed about the features of the OSAC

available to the students. Many were unclear in general about the self-access

resources, and this was also incorporated into the training. In this way, the training

featured heavily in both technology usage, SAC and OSAC resources and ways to

encourage students to use these resources and to attempt to foster more autonomy

with their classes by promoting the self-access resources.

Page 9: SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

SiSAL Journal Vol. 2, No. 3, September 2011, 170-181

177

Data  Analysis  

Results  

Figure 1 is the graph which was produced from the spreadsheet to show the

percentage of student uptake of the OSAC. Training dates are indicated by thick

arrows for centralised OSAC specific training and thin arrows for Technology

training at individual schools.

Figure 1. Percentage of student body using the OSAC

Page 10: SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

SiSAL Journal Vol. 2, No. 3, September 2011, 170-181

178

Training dates

There was a high concentration of the second type of training sessions

between August and October 2009 because the training session was very popular with

teachers and other schools started specifically requesting the training. Table 1 shows

the training dates from 2009 to 2010.

Table 1. Training sessions 2009-2010

Specific OSAC Training for self-access manager at each school

Technology and autonomy training for a single school

03-Sep-08 06-Aug-08 11-Mar-09 14-Aug-09 03-Sep-09 22-Sep-09 25-Sep-09 23-Oct-09 18-Feb-10

The average level of OSAC uptake was 26.9% of the eligible student body

(Table 2). This means that throughout the two-year period, roughly 27% of students

with OSAC access were logging into the site to practise and make use of the learning

materials on a daily basis.

Table 2. Total uptake over a two-year period

Average High Median Low Average Deviation

26.91 44.11 26.7 2.13 5.91

However, this figure is based only on unique logins and does not account for

the time spent in the OSAC or the number of activities being attempted. In other

words, we only know that students logged in, we do not know how much they used

the resources. This would hopefully be incorporated into future studies providing

improved reporting facilities in Moodle and better data collection methods could be

used. The highest period of uptake was in September 2008, which was three weeks

after the first OSAC specific training session in which all schools took part. Part of

the training given at this session involved changing the way students were inducted on

Page 11: SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

SiSAL Journal Vol. 2, No. 3, September 2011, 170-181

179

the first day so that they were given an OSAC orientation whereas previously they

had only been informed about it. The lowest period of uptake occurred during the

winter holidays, during which many students returned to their home countries and the

schools were closed for two weeks. It is important to note here that because the study

was conducted in private language schools, summer is the busiest period and there are

no school closures in summer. Results over the two-year period (May 2008 – May

2010) are shown in Table 1.

To represent the difference teacher training made to student OSAC usage

visually, a twelve-week period was selected in which no training was conducted and

plotted against another twelve week period in which five separate types of training

were given across the different institutions (Figure 2).

Figure 2. Teacher training and student OSAC use over a twelve-week period

Discussion  and  Limitations  

From these results it seems that students use the OSAC resources more if the

teachers have been given training on the use of these resources, the types of activity

available and the way the students can utilise them for self-study. One of the

limitations of this study is the lack of qualitative data into the students’ and teachers’

Page 12: SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

SiSAL Journal Vol. 2, No. 3, September 2011, 170-181

180

perceptions of the OSAC resources, and this will have to be addressed with further

research. Because of the large data set in this study, it is only possible to make very

preliminary assumptions which would need the backing of more detailed empirical

evidence to make more definitive observations.

The main finding behind this study was that teacher training led to increased

student OSAC usage. However, in order to test the link between teacher training and

OSAC uptake more directly, qualitative data would contribute further insights into

these findings. Also, using a smaller group with the same students throughout the

study would make it possible to conduct statistical reliability tests to ensure there was

a significant difference. Because every week each school had a new intake, it is not

possible to statistically check the results from this study using ordinary tests for

statistical significance. Therefore, for future studies it would be recommended to use a

smaller scale data set and feature more qualitative data for information relating to

student motivation and autonomy. Another limitation is the range of subjects. It would

have been very interesting to be able to see whether students on shorter courses used

the OSAC more than students on longer courses, or to measure peaks in longer term

students’ OSAC usage. This is one of the main limitations of this study, as most of the

data were collected after the student’s courses had finished and the study was put

together retrospectively based on observed trends in a graph. Further studies could

address this limitation by conducting interviews with participants and using a smaller

sample so as to be more manageable and trends in students with similar length courses

could be observed.

Conclusion  

Although this study is limited in that it only shows rough quantitative data

relating to the number of OSAC logins, there does seem to be an indication that the

more teachers know about OSACs and how to incorporate them into class and to

make recommendations to the students for self-study, the more likely they are to

encourage their students to use them. It also shows that the students are more likely to

study using self-access resources if they are informed about them by their teachers.

Continued teacher training and support would seem to be highly important to student

self-access usage.

Page 13: SiSAL Journal: A Two Year Cross-Section of Student Use of Self-Access eLearning - R Pinner

SiSAL Journal Vol. 2, No. 3, September 2011, 170-181

181

Notes on the contributor

Richard Pinner is a part-time teacher at Sophia University and an eLearning

consultant for engnet-education.

References  

Benson, P. (2001). Teaching and researching autonomy in language learning London: Longman.

Figura, K., & Jarvis, H. (2007). Computer-based materials: A study of learner

autonomy and strategies. System 35, 448–468 Hailes, N. (2009). Ofsted roundup in Further Education News. Retrieved 5th August

2011 from http://www.fenews.co.uk/ofsted/ofsted-round-up-this-week-vles-come-under-the-eye-of-inspectors

Little, D. (1991). Learner autonomy. 1: Definitions, issues and problems. Dublin:

Authentik. McDevitt, B. (1997). Learner autonomy and the need for learner training. Language

Learning Journal 16, 34-39 Minshull, G. (2004). VLEs: Beyond the fringe and into the mainstream: Guidance on

the mainstreaming of Virtual Learning Environments, drawn from the proceedings of the 2004 online conference from Becta's Ferl service’ Retreived 5th August 2011 from http://ferl.becta.org.uk

Palfreyman, D., & Smith, R.C. (Eds.) (2003). Learner autonomy across cultures:

Language education perspectives. New York: Palgrave MacMillan Pennycook, A. (1997). Cultural alternatives and autonomy. In P. Benson & P.Voller,

(Eds.), Autonomy and Independence in Language Learning (pp. 35-53). London: Longman

Reinders, H., & Balcikanli, C. (2011). Learning to foster autonomy: The role of

teacher education materials. Studies in Self-Access Learning Journal, 2(1), 15-25.

Sturtridge, G. (1997). Teaching and language learning in self-access centres:

Changing roles? In P. Benson & P. Voller (Eds.), Autonomy and Independence in Language Learning (pp. 66-78). London: Longman