MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air...

56
MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009

Transcript of MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air...

Page 1: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

MessageGrid Replay Ink: Pinpointing Student

Misconceptions

Roy P. PargasClemson University

US Air Force AcademyColorado Springs, CO

October 15, 2009

Page 2: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Where is Clemson University?

October 15, 2009 2Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 3: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Where is Clemson University?

US Air Force Academy, Colorado Springs, CO

October 15, 2009 3Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 4: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Where is Clemson University?Clemson UniversityClemson, South Carolina

October 15, 2009 4Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

US Air Force Academy Colorado Springs, CO

Page 5: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Outline Advances in Technology: Tablet PCs Interactivity in the Classroom Tool: MessageGrid Replay Ink Features

• Assign, Collect, Evaluate• Replay, Tag, Analyze

Current and Future Work Acknowledgements

October 15, 2009 5Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 8: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

2002 Clemson Laptop Mandate

Every student is required to have a laptop computer with wireless access to the Internet

October 15, 2009 8Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 9: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

The Challenge

How can instructors use the laptop computers to advantage in and out of the classroom?

October 15, 2009 9Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 10: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Web-based software tool to help promote interactivity in the classroom

Clemson’s Proposed Solution: MessageGrid

October 15, 2009 10Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 11: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Web-based Basic grid: rows and columns Instructor designs grid Students post original submissions or

replies to submissions Anything displayed by a browser

• Text, image, audio, video, animation, Ink, maps Why use such a tool?

• Student responses to in-class exercises, presentations, online discussions, student questions, feedback from students, …

Proposed Solution: MessageGrid

October 15, 2009 11Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 12: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

12

MessageGrid Evolution

Every semester since January

2004, more instructors use MessageGrid

At semester’s end, instructors discuss possible improvements

Suggestions with most instructor

support are implemented

Page 13: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Current MessageGrid Features

MessageGrid

October 15, 2009 13Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 14: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Current MessageGrid Features

MessageGrid

Basic Grid: Feedback/submissions from students

October 15, 2009 14Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 15: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Current MessageGrid Features

Clickers:Assessment/Polling

MessageGrid

Basic Grid: Feedback/submissions from students

October 15, 2009 15Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 16: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Current MessageGrid Features

Clickers:Assessment/Polling

MessageGrid

Basic Grid: Feedback/submissions from students

Ink: Submitting diagrams and equations, rather than text

October 15, 2009 16Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 17: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Current MessageGrid Features

Clickers:Assessment/Polling

Ink: Submitting diagrams and equations, rather than text

Mobile: Images, video, audio, GPS, and text in a portable, handheld grid

MessageGrid

Basic Grid: Feedback/submissions from students

October 15, 2009 17Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 18: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Current MessageGrid FeaturesBasic Grid: Feedback/submissions from students

Clickers:Assessment/Polling

Simple Upload/Evaluate: Rubric to facilitate evaluation of Freshman Eng’g labs

MessageGrid

Ink: Submitting diagrams and equations, rather than text

Mobile: Images, video, audio, GPS, and text in a portable, handheld grid

October 15, 2009 18Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 19: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Current MessageGrid FeaturesBasic Grid: Feedback/submissions from students(FIE 2005, ITiCSE 2006)

Clickers:Assessment/Polling(SIGCSE 2006)

MessageGrid

New!New!

New!New!

Ink: Submitting diagrams and equations, rather than text (PLT 2007, FIE 2007,

FIE 2008)

Mobile: Images, video, audio, GPS, and text in a portable, handheld grid

Simple Upload/Evaluate: Rubric to facilitate evaluation of Freshman Eng’g labs

October 15, 2009 19Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 20: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

MessageGrid

Ink: Submitting diagrams and equations, rather than text October 15, 2009 20Roy Pargas, Current Research

USAFA 2009, Colorado Springs, CO

Current MessageGrid Features

Page 21: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

21

MessageGrid

Ink: Pinpointing student misconceptions

MessageGrid Replay Ink

Page 22: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Has MessageGrid Changed Teaching?

Page 23: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Teaching Style

Studio Format (aka Mentoring, Coaching)• Reduced lecture• More classroom activity/interactivity

October 15, 2009 23Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 24: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Teaching Style

Studio Format (aka Mentoring, Coaching)• Reduced lecture• More classroom activity/interactivity

Typical 75-minute lecture period• Data structures and algorithms• 20-minute lecture, 5-minute exercise,

repeated 3 times Typical 110-minute lab period

• 15-minute lecture, 95-minute lab exercises

October 15, 2009 24Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 25: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

The Sandbox

October 15, 2009 25Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 26: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Checking Out a Tablet

October 15, 2009 26Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 27: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Working Individually

October 15, 2009 27Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 28: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Working Individually

October 15, 2009 28Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 29: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Teams of Three

October 15, 2009 29Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 30: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Teams of Two

October 15, 2009 30Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 31: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

31

Tablet Use at Clemson

HP Tablet PC Video

Page 32: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Tablet PCs can provide• Final Inked solutions• Intermediate Ink stroke sequences

Ink strokes can be• Collected• Played and replayed• Tagged and analyzed

Key Observation

October 15, 2009 32Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 33: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

33

For example: Can provide interactivity in a data structures class (drawing graphs)• Instructor assigns exercises• Students submit solutions• Evaluation of solutions• Tagging of solutions• Analysis of tags

MessageGrid Replay Ink

Page 34: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

34

Student solutions can be• Reviewed: Played and replayed• Tagged • Analyzed

MessageGrid Replay Ink

Page 35: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

March 5, 2009 Pargas and Bryfczynsski SIGCSE 2009, Chattanooga, TN

35March 5, 2009 Pargas and Bryfczynsski SIGCSE 2009, Chattanooga, TN

35March 5, 2009 Pargas and Bryfczynsski SIGCSE 2009, Chattanooga, TN

35

Solutions include:• Linked lists• Stacks• Queues• Trees of all types (BST, AVL, Splay,

B-Tree, binary heap, leftist heap, skew hap, binomial queue, etc.)

• Generic graphs

MessageGrid Replay Ink

October 15, 2009 35Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 36: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

36

Goals

Immediate goal• Deliver CS2/CS7 course content more

effectively

Long term goal• Understand thought process of CS2/CS7

student• Early identification of students at risk

Page 37: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

37

MessageGrid Replay Ink

Page 38: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Problem Specifications

October 15, 2009 38Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 39: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Sample Ink Solutions

October 15, 2009 39Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 40: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Sample Ink Solutions

All submissions attributed

October 15, 2009 40Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 41: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Sample Ink Solutions

All submissions date/time stamped

October 15, 2009 41Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 42: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Student Submissions

October 15, 2009 42Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 43: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Replaying Student Ink

Demo1. Expression tree (correct)2. Expression tree (incorrect)3. Gallivanting AVL

Tagging Analysis

October 15, 2009 43Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 44: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Student Evaluation

October 15, 2009 44Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Feedback generally positive on MG1. Students like immediate feedback2. Pinpointing mistakes helpful3. Anonymous evaluation of student

submissions Tagging has begun (SIGCSE 2010) Analysis of tags has begin

Page 45: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Four Current Projects

Page 46: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Algebra and Calculus

October 15, 2009 46Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

1. “Transitioning through Technology:  Using Digital Learning Environments in Calculus as a Collaborative Model to Advance STEM Students through Four-year Institutions”, (with Marilyn Reba, Calvin Williams), 2009 Hewlett-Packard Innovations in Education Grant

2. “Mathematics Partnering with Computer Science to Improve Calculus Instruction and Learning”, (with Calvin L. Williams, Marilyn Reba, National Science Foundation CCLI Type 2 (2008 NSF CCLI-2)

3. Mobile Instructional Technology for Integrating Classroom and Laboratory Activities for STEM Students (MITICLASS)”, (with Marilyn Reba, Calvin Williams, and Lisa Benson), 2007 Hewlett-Packard Technology for Teaching Leadership Grant

Page 47: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

47

1. “CU Thinking”, (with Lisa C. Benson, David Bowman, Michelle P. Cook), National Science Foundation Innovations in Engineering Education Curriculum, and Infrastructure (NSF IEECI)

2. Mobile Instructional Technology for Integrating Classroom and Laboratory Activities for STEM Students (MITICLASS)”, (with Marilyn Reba, Calvin Williams, and Lisa Benson), 2007 Hewlett-Packard Technology for Teaching Leadership Grant

Freshman Engineering

Page 48: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

October 15, 2009 Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

48

1. “OrganicPad: A Tablet PC-Based Interactivity Tool for Organic Chemistry”, (with Melanie M. Cooper and Calvin L. Williams), National Science Foundation Alternative Learning Technologies (NSF ALT).

2. “OrganicPad: A Tablet PC-Based Interactivity Tool for Teaching Chemistry”, Camille and Henry Dreyfus Foundation 2009 Special Grant Program in the Chemical Science, (with Melanie M. Cooper).

Organic Chemistry

Page 49: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Generic Tools: Nursing, English, Psychology, etc.

October 15, 2009 49Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

1. "Mobile Instructional Technology for Integrating Classroom and Laboratory Activities for STEM Students (MITICLASS)”, (with Marilyn Reba, Calvin Williams, and Lisa Benson), 2007 Hewlett-Packard Technology for Teaching Leadership Grant

2. “Development of a Targeted Tablet PC Software Development Course”, 2004 Microsoft Research Tablet PC and Computing Curriculum Grant

3. “Development of a Network Applications Course Using Microsoft .NET, SQL Server, and IIS”, 2003 Microsoft Curriculum and Content Development Grant

Page 50: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Current / Future Work Fall 2009, Spring 2010

• Tagging existing student submissions• Collecting and tagging additional

solutions• Analysis of tags

Summer 2010• Continuing analysis of tags

Fall 2010• Reports, reports, reports!

October 15, 2009 50Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 51: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Thank You for Your Kind Attention!

Go Falcons!

October 15, 2009 51Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 52: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Where is Clemson University?Clemson UniversityClemson, South Carolina

October 15, 2009 52Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

US Air Force Academy Colorado Springs, CO

Page 53: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

Extra Slides

Page 54: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

October 15, 2009 54Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 55: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

October 15, 2009 55Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO

Page 56: MessageGrid Replay Ink: Pinpointing Student Misconceptions Roy P. Pargas Clemson University US Air Force Academy Colorado Springs, CO October 15, 2009.

October 15, 2009 56Roy Pargas, Current Research USAFA 2009, Colorado Springs, CO