Re-imagining the Learning EcosystemTime for New Approaches, Cultures, Tools & Metrics

Sheila Jagannathan World Bank Group

Washington DC

“.....Thus, to understand how countries grow and develop, it is essential to know how they learn and become more productive and what government can do to promote learning.” Joseph E Stiglitz

Agenda

Global Shifts in Capacity Development

Achieving Reach and Impact Through E-learning

Emerging Trends in Learning Ecosystems

1 2 3

Agenda

Global Shifts in Capacity Development

Achieving Reach and Impact Through E-learning

Emerging Trends in Learning Ecosystems

1 2 3

A. Yes…

Is there a tectonic shift in learning today?

Question?

B. No…

YES - More Change in the Last 5 Years than in the 100 Years

MOOC

assivepen

nlineourse

Learning today• Not sitting in classroom, listening to lectures

• Available at our finger tips, just-in-time and just enough

• Create an action learning cycle of learning and

immediate applying with feedback loops

THEN… NOW…

(Classrooms / Lectures / Reading Materials) Golden Age of Education

(Codecademy / Coursera / Khan Academy…) Interactive / Online / Accessible by

Anyone Anywhere Anytime

Source: Kleiner Perkins Caufield Byers

Knowledge News Education

Visible in our daily lives…

India is changing too…More Governance and Less Government

Capacity Challenges Are Multiplying

Build cutting edge knowledge & skills

Citizen centric

Connect and learn from innovative

platforms

Strengthen participative

planning

Raise awareness & accountability

Best practices

Innovative ApproachesFor new competencies

Challenge - Requires innovative approaches

Building capacity to effectively deliver on these new ideas, requires a different type of learning: multi-sectoral, self-directed, collaborative, dialog and discussion with peers, real-time, action learning – learning labs, citizen centric learning, co-creating solutions, learning from global best practices, learning from failure.

The way we consume knowledge and learning is changing…

Mix of formal and informal Facilitated and self-directed Video based and mobile Collaborative, interactive,

networked…..

Leverage Global Shift

The good news is that….

New pedagogy

New Technologies

New Delivery Methods

New ways to measure results…

New Solution Sets to Build Competencies

Agenda

Achieving Reach and Impact Through E-learning

Emerging Trends in Learning Ecosystems

2 3Global Shifts in Capacity Development

1

The use of electronic technologies to deliver, facilitate, & enhance both formal & informal learning at any time, any place & at any pace.

A Common Language for e-Learning

MultimediaTutorials

PodcastsInteractive Simulations Digital collaboration

E-discussionsBlogs, wikis, CoPs..

E-booksCD-

ROM/DVD

Games Webinars Virtual classrooms

Computer, Internet & their applications including CD-ROM, E-mail, Web sites, & multimedia,

social media…

Facilitatedcourses

Self pacedmodules

MassiveOpen

Onlinecourses

E-learning Experiences – Brazil, Mexico and China

• Large populations of slum dwellers need better services• $80 billion allocation available from Federal Govt to implement national housing policy.• Planners and City officials need training on the ‘how to’ aspects of upgrading • 3 tier structure - feedback loop to policy makers at municipal, state and Federal

• 10 week, facilitated fully on-line course (Week1 Orient; 9 weeks core themes)

• Blends theory and “how-to”• Goes beyond public officials to also include

civil society and private contractors • 1st piloted in 1 region (NE); then scaled up

10,000 participants trained.• Certificates issued at end of course • Drop out rates reduced from first to

second offering (17.7% to 10.99)

Why: Massive unmet demand from individuals & institutions in public & private sector, civil society in a rapidly changing economy• Comprehensive pedagogical Model that

focuses on application.• Quality education and training that

transcends time and space barriers• Participants welcomed from all walks of life • Establish learning communities encouraged

to share knowledge and innovate• Build capacity for accountable institutions

• 18,500 graduated students since 1989• 1.14 million continuing education• 1.5 million practitioners interacting through CoPs• 24 countries have benefited

• Large scale urbanization has led to growth in demand for urban planners• Urban Planning Society of China interested in building a National E- learning Hub • Responding to concerns at the NDRC (Planning Commission) level about unplanned urbanization• Continuing education needs of planners

• 100,000 participants in this program and other e-courses organized by Chinese Academy of Governance• Creative Knowledge sharing and delivery participants increase from 610 in 2001 to 3800 in 2011• Partnerships established for sharing data, research through papers and virtual workshops• Gateway to Chinese Planning community

Why E-learning? Why E-learning? Why E-learning?

Results Results Results

• Scale up disaster education in India• 10 courses customized from LLI global modules; delivered as facilitated e-learning.• Feedback to assignments and project work provided by virtual experts.

• Over 5,000 peole trained nationally (certified) •Training of trainers, cadre of facilitated and community has emerged.

Need to scale and disseminate urban land use planning skills to large groups of mid-career planning professionals, urban practitioners, policymakers and city managers from various city and state government departmentsGoals: Working with NIUA to ensure that participants have a functional and integrated understanding of the dynamics of urban land use in India; and demonstrate how to effectively utilize policies and planning instruments available.

Global WBG Modules are being customized to Indian context:

• Understanding How Land Use Planning Contributes to Sustainable Urban Development

• Institutions, Policies and Tools for Effective Land Use Planning

• How to Integrate Land Use Planning and Infrastructure

• How to Manage Growth in Peri-Urban Areas

• How to Promote Local Economic Development

E-learning Experiences - India

Why E-learning? Why E-learning?

Results

Flexible

Learners can selectlevel of

participation– a la carte

Open

Mostly free andaccessible to ALL

Learning Analytics

Track howlearners learn

Life-long learning

Ongoing CoPs,support

& feedback

Participatory

Conversational andcollaborativeopportunities

Massive

10,000-150,000

Global & Distributed

Rich diversity ofideas from manyregions, culturesand perspectives

MOOC

assive

pen

nline

ourse

MOOC Characteristics Support Access, Cost and Quality

Cost-efficiency, Reusability & scalability, Consistent Quality, Bridging of distances

Benefits of E-learning

Cost-efficiency/Scalability• Low cost delivery (travel, no time out)• Flexible & convenience

Quality• Improved learning• Apply while you learn• Consistent quality of engagement Reuse/Customization• Customized to local languages, stakeholders• Customization and replication

Networking & Learning communities• Continuous learning• Just-in-time• Expanded participant reach

Audience limitations: not

everywhere a “culture” of online

interaction. Support &training

Infrastructure limitations: Low bandwidth,

off-line, blending

Time limitations: Participants availability on

a continued basis over, e.g. 2-4 weeks

Pedagogical Limitations: 30-40% drop-outs;

multimedia, facilitation, relevance and making it

required

Financial limitations: High initial investment

(time & money) focus on scale and shelf

life

Low

High

Mindset & low acceptability

Quality Content

Poor connectivity

Lack of favorable policies

Limitations for E-learning: Some Surprises!

Agenda

Emerging Trends in Learning Ecosystems

3Global Shifts in Capacity Development

Achieving Reach and Impact Through E-learning

1 2

#1 – Understand the Mid-Career Learner

#2 – Reimagining Learning for Development

• Building applied problem-solving skills

• Multi-sectoral (everything is linked to everything else)

• Results focused (evidence-based solutions translated into practical, accessible learning)

• Evaluating what worked and did not worked

• Helping us unlearn and let go what is not on the critical path

• South-South knowledge exchange allows crucial exchange of tacit knowledge

• Networking & and participating in e-community

• GLOCAL – Local + Global

• F2F alone. It’s multi-channel and connected, using technology to achieve scale while promoting interactivity and collaboration

• Not one off, but CONTINUOUS

LEARNING IS ABOUT LEARNING IS NOT ABOUT

Learning for Development – Beyond “Transfer of Knowledge”

Create a ‘Lean’ Learning

Environment

#3 – Focus on Results – A Systematic Design Approach

Define Outcomes &

Objectives

Identify Learning Methods

Select tools

Assemble program

Monitor and evaluate the program

• Identify the audience• Set the learning

objectives

• Choose the appropriate methods to reach the objectives

• Pick the appropriate delivery modes

• Select the tools that best facilitate the identified methods

• Group and organize methods in a series of events

• Assemble the events to a program

• Determine what level of evaluation is appropriate

• Compare actual with desired outcomes

Source: Next Learning Unwrapped, Nick van Dam (2011)

#4 – Rebalance Informal with Formal LearningLearning Technology is used to support both formal and informal learning modalitiesEncourage learning without walls – rise of social learning.

E-Learning as one component of the continuous learning environment

#5 – Move from One-Off to Continuous Learning

Source: Bersin by Deloitte, 2013

1

2

3

4

5

6

7 Teach others/Immediate Use

Practice by Doing

Discussion Group

Demonstration

Audio-Visual

Reading

Lecture

90%

75%

50%

30%

20%

10%

5%

AverageRetention Rate

Learning Pyramid

Activ

e

Pass

ive Active learning produces 70-80%

retention rates

Best practices Storytelling Conceptual map Wild glossary Collaborative writing

Case-based learningDiscussions Role play Learning contracts Listening teams

Keeping journals Simulation Group work Game-based learning Problem-based learning

TestsBrainstorming Discussion forum Follow up Interview

Source: National Training Laboratories, Bethel, Maine

#6 – Immersive Learning Produces can be Designed for Best Results

Interactive tools ensure a collaborative, impact-focused, educational experience that allows for tailored learning for students/ participants

Apply concepts to a learning

scenario

Share experiences via the community

dashboard as part of knowledge building

Collaborate with others

Audience: Health and Financial policy makers at the national and district level

Example: Engaging Health Professionals through Game Infused E-Learning

Blend of an 8 week facilitated e-learning course with a 3D Immersive Game around the theme of

Results Based Financing (RBF)

Participants learn in an engaging

matter about RBF

F2FE-

InstituteLearning

Labs

Dialogues

# 7 – Social Learning Matters

City-to-city dialogue series• Municipal finance (e.g. revenue improvement, expenditure mgmt, public asset mgmt, performance measurement)• Urban planning & land management• Urban service delivery

E-learning• Global curriculum: e-Institute• Regional Partner: CEU• Local Partners: NALAS + NLGA

*for marketing, dissemination, translation

Hands-on capacity building• Direct link with challenges on the ground• LGs to engage in self- assessments

Example: Strengthening Local Government Capacity in South-East Europe

Technical

Thematic Community

Process Facilitated

Learner

Peer

FacilitatorContent

Learner ContentServerSelf-paced

Blended Courses

Facilitation by virtual experts improves learning effectiveness

#8 – Enhancing Facilitation by Virtual Experts

• Mobile learning provides learners with anytime/anywhere access to learning and continuous support (18% mobile users among 3.6 global users)

• Popular delivery mode but under used

• But use creatively – not about dumping as is

• Responsive design

• Allows for customization via location-specific tools for tracking and collaboration

• Allows learners to create apps to share knowledge

Source: Nick van Dam, Next Learning, Unwrapped 2011

Recording Information

Assessment

Images

Apps

Collaboration

Context/Location Support and Coordination

Searching

Polling

Audio

Reading

Games/Simulations

Mobile learning through

#9 – The Future of Learning is Mobile

Learning analytics can help educators identify students who are initially slow but surge ahead later, proceeding from the appearance of struggling to gifted in a couple of weeks

Learning analytics allows for online peer grading and self-grading because educators can monitor correlations between current vs. past performance and teacher vs. peer/self-grading

Learning analytics can identify common wrong answers and create custom responses crafted to help address the specifics of each particular wrong answer

Unlike a classroom setting every student in a course using learning analytics answers every question, ensuring they interact with all course material

Learning analytics can be customized to student needs, allowing students to get a better, faster picture of their performance

#10 – Leveraging Learning Analytics to Continually Improve Performance

Desktop

Notebook

Tablet

Smartphone

Training

Database

Presentations

Calendar Collaboration

Finance

Storage

SpreadsheetsContactsEmail

Forums

ReadingsAssignments

VideosQuiz

#11 – The Cloud Provides a Common Learning Platform for Training Institutions

#12 – Metrics Holds the Key to a Continual Improvement Process

Satisfaction

Learning

AdoptionDid you reach the

desired audience? Did they complete or comply as desired? Who did not comply

and why?

UtilityHow well do the

programs solve the workforce's particular

problems? How well did it align to the specific job related problems and issues?

Would learners recommend this

program to their peers?

EfficiencyHow efficient and cost-

effective was it? How did it compare to other similar programs

or competitive programs?

How well did it use the learner's time?

AlignmentHow well were program

business priorities defined?

How well did business units buy in on the

value of this program relative to other

investments?

Attainment How well did you meet

specifically defined client (business user or customer) objectives? These may be revenue,

time to market, compliance, time to

complete, etc.,

Activity

Individual Performance Organizational Performance

CAPTURE DATA TO IMPROVE, ROI, BENCH MARK AGAINST INDUSTRY NORMS

• Approach technology pragmatically.• Extend the classroom. • Extend the discussion. • Extend ways to measure success• Increase the scale & impact.

Take Aways

C A R E E R L O N G L E A R N I N G

Welcome Your Questions