Episode-2 Episode-5 Episode-3 Episode-6 Episode-I Episode ...
Commonsense computing: What do students know before we teach? Episode 1. Sorting
-
Upload
priscilla-vazquez -
Category
Documents
-
view
26 -
download
1
description
Transcript of Commonsense computing: What do students know before we teach? Episode 1. Sorting
![Page 1: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/1.jpg)
Commonsense computing: What do students know before we
teach?
Episode 1. Sorting
Beth SimonUniv. of California
San Diego
Tzu-Yi ChenPomona College
Kate SandersRhode Island College
Robert McCartneyUniv. of Connecticut
Gary LewandowskiXavier University
![Page 2: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/2.jpg)
Student performance studies
![Page 3: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/3.jpg)
Student performance studies
• McCracken et al., 2001:
Can students write code?
![Page 4: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/4.jpg)
Student performance studies
• McCracken et al., 2001:
Can students write code? (No)
![Page 5: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/5.jpg)
Student performance studies
• McCracken et al., 2001:
Can students write code? (No)
• Lister et al., 2004:
Can students read and trace code?
![Page 6: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/6.jpg)
Student performance studies
• McCracken et al., 2001:
Can students write code? (No)
• Lister et al., 2004:
Can students read and trace code? (No)
![Page 7: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/7.jpg)
Student performance studies
• McCracken et al., 2001:
Can students write code? (No)
• Lister et al., 2004:
Can students read and trace code? (No)
• Eckerdal et al., 2005:
Can students design code?
![Page 8: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/8.jpg)
Student performance studies
• McCracken et al., 2001:
Can students write code? (No)
• Lister et al., 2004:
Can students read and trace code? (No)
• Eckerdal et al., 2005:
Can students design code? (No)
![Page 9: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/9.jpg)
Student performance studies
• Simon et al., 2006:
Can students do anything?
![Page 10: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/10.jpg)
Student performance studies
• Simon et al., 2006:
Can students do anything?
YES!
![Page 11: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/11.jpg)
Overview
• Why commonsense knowledge?
• Related work
• Methods (who, what, how)
• Analysis: what can they do?
• Effects of instruction
• Conclusions and future work
![Page 12: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/12.jpg)
Why commonsense knowledge?
Why sorting?
![Page 13: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/13.jpg)
Specific questions
• Can students provide an algorithm?
• How do students approach the task?
• Do students use control structures?
• Can we use these results in teaching?
![Page 14: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/14.jpg)
Key observations: entering students
• Most students described a correct algorithm to sort numbers
• Most students used length and individual-digit comparisons to compare numbers
• In iteration, preference given to post-loop tests.
![Page 15: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/15.jpg)
Related work
• Onoroto & Shvaneveldt (differences between naive/beginner/experts)
• Miller (natural language descriptions of programming task)
• Bonar and Soloway (natural language pre-programming knowledge vs. Pascal)
![Page 16: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/16.jpg)
Related work• Ben-David Kolikant (student
preconceptions about concurrency from real-life experiences => synch mechanisms)
• Gibson & O’Kelly (algorithmic understanding in precollege and beginners)
• BRACE (Simon et al) (various tasks with beginners: paper folding, giving directions, telephone-directory searching)
![Page 17: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/17.jpg)
Methods (who)
409 subjects:– 118 students in CS 1 (2 institutions)– 274 students in a non-CS course with no CS
experience– 17 students in CS 1.5, with either CS 1 or other
background– (49 students in CS 1.5 who had been part of
118 above)
![Page 18: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/18.jpg)
Methods (what) Write a paragraph in complete English sentences
describing how you would arrange a set of 10 numbers in “ascending sorted order” – that is, from smallest to largest. You might consider the following list of numbers, but make sure that your paragraph describes how to do it with any 10 numbers.
33 14 275 326 213 190 205 4 428 254
![Page 19: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/19.jpg)
Methods (how)Develop categorization along various
dimensions from a subset of 20 CS1’s:– Is it correct? In general, or only for this case?– What approach? Strings or numbers? What did
they focus on?– Did they use control structures, specifically
iteration and conditionals?– Other content: length, use of example, use of
CS “terminology”
![Page 20: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/20.jpg)
Categorization
Correctness: Does it make sense and “work”? In general, or only for this case?
Approach: Strings or numbers? What did they focus on (main task)?
Control structures: Did they use iteration? Did they use conditionals?
Other content: How long? Included example? How much use of CS “terminology”?
![Page 21: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/21.jpg)
Correctness
Correct (specific)
Correct (general)
Beginner CS 69% 57%
Naïve non-CS 31% 25%
![Page 22: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/22.jpg)
Approach: string vs. number
Numerical String Other
beginner 35% 63% 3%
naive 36% 53% 12%
![Page 23: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/23.jpg)
Approach: focusBeginner Naïve non-CS
Digit/length based 50% 47%
Choose 19% 20%
Find smallest 8% 3%
Define 7% 5%
Programming statements 0% 0%
Put number in correct place 8% 14%
Other 9% 10%
![Page 24: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/24.jpg)
Control structure
Expresses Iteration
Expresses conditional
Beginner CS 65% 43%
Naïve non-CS 56% 25%
![Page 25: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/25.jpg)
Effect of instruction: CS 1 considered harmful?
CS 1 CS 1.5 (paired)
Correct (specific) 71% 53%
Correct (general) 57% 45%
Numeric sorts 35% 92%
Length 169.4 74.0
CS terms used 1.61 4.39
![Page 26: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/26.jpg)
CS 1.5 paired vs. different CS 1.5?
CS 1.5 (paired) CS 1.5 (other)
Correct (specific) 53% 88%
Correct (general) 45% 76%
Numeric sorts 92% 72%
Length 74.0 184.8
CS terms used 4.39 6.6
![Page 27: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/27.jpg)
Conclusions
Students can express sorting algorithms, although may be different than instructor
CS students do this better than non-CS, given same experience
CS 1 has some negative effects on performance
![Page 28: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/28.jpg)
Future work
There are other potential skills to examine that are based in commonsense understandings: troubleshooting; evaluating interfaces; concurrency; discrete probabilities;…
Currently:– Collecting new data, more varied schools– Piloting other questions
![Page 29: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/29.jpg)
Thank you!
My collaborators:
Tzu-Yi Chen, Pomona College
Gary Lewandowski, Xavier University
Kate Sanders, Rhode Island College
Beth Simon, Univ. of California, San Diego
![Page 30: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/30.jpg)
Thank you!
Other collaborators who are currently collecting preconception data.
![Page 31: Commonsense computing: What do students know before we teach? Episode 1. Sorting](https://reader038.fdocuments.net/reader038/viewer/2022103100/56813238550346895d989f27/html5/thumbnails/31.jpg)
Thank you!