NAEP Questions Tool Bobbie Bable Georgia Department of Education NAEP State Coordinator.
NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22,...
-
Upload
ashlynn-charleen-lindsey -
Category
Documents
-
view
222 -
download
3
Transcript of NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22,...
![Page 1: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/1.jpg)
NAEP Alliance
NAEP Technology Based AssessmentsNational Conference on Student Assessment
June 22, 2015 2:00-3:30
![Page 2: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/2.jpg)
2
NAEP Alliance
Introduction to eNAEP
![Page 3: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/3.jpg)
3
NAEP Alliance
NAEP Model (2014 & beyond)
• Administration on NAEP-provided touch-enabled devices
• 2 sessions of 25 students per school• eNAEP delivery system
Web application Compatible across various devices, operating systems, and web
browsers (i.e., future-proofed) Can run on virtually any resolution (flexible layout)
![Page 4: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/4.jpg)
4
NAEP Alliance
eNAEP Development
• eNAEP is built to support all NAEP subjects.• Provides a consistent user experience across all
subjects. • Planning for a progressive rollout of functionality
over the next few years:– 2014: Initial version (subset of item types & tools) – 2015: Enhanced version (more tools, features &
item types)– 2016: Additional item types – 2017: Additional interactive item types
![Page 5: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/5.jpg)
5
NAEP Alliance
Summary of Planned eNAEP System Features
Features 2014 Proof of Concept 2015 TBA Startups & Pilots
Volume Yes Yes
Tutorials No Yes
In-System Help Yes Yes
Text-to-Speech No Yes
Zoom No Yes
Highlighter N/A* Yes
Elimination Tool N/A* Yes
Change Color Theme No TBD**
*There are no discrete or questionnaire items in 2014 POC, so these tools are not applicable.
**Some accommodations and potential universal design features require discussion by the AICC.
![Page 6: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/6.jpg)
6
NAEP Alliance
Additional Features2015 & Beyond
Additional Features 2015 & beyond
Accommodations, e.g., bilingual, magnification
Universal Design features, e.g., text-to-speech, zoom
508 compliance
Observable data capture
Discrete item types and survey questions
Disconnected mode
Updates in the field supported
Subject-specific tools, e.g. calculator, equation editor
Adaptive testing TBD
Dynamic distribution of forms TBD
Automated scoring TBD
![Page 7: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/7.jpg)
7
NAEP Alliance
NAEP 2015 TBA Start Up January 26 – March 6, 2015 132,000 students Administered on tablets Mathematics, reading, and science Grades 4, 8, and 12 Interactive computer tasks (ICTs) and hands-on
tasks (HOTs) in science
![Page 8: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/8.jpg)
8
NAEP Alliance
Equipment Surface Pro 3 tablets Laptop server Routers and Ethernet cables MiFi device Extension cords, power strips, and tape Earbuds and headphones Styluses Flash drives Antibacterial wipes
![Page 9: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/9.jpg)
9
NAEP Alliance
Surface Pro 3 Tablets
– 27 Tablets 25 Student tablets 2 Monitor tablets
![Page 10: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/10.jpg)
10
NAEP Alliance
eNAEP Network Equipment Laptop server Router Blue Ethernet
cable
![Page 11: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/11.jpg)
11
NAEP Alliance
MiFi Device Wireless device to send student response files from
the laptop server to the central server
![Page 12: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/12.jpg)
12
NAEP Alliance
NAEP Earbuds NAEP students keep earbuds Headphones available when requested
![Page 13: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/13.jpg)
13
NAEP Alliance
Styluses 30 Styluses Re-use for all assessments
![Page 14: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/14.jpg)
14
NAEP Alliance
Flash Drives 2 Flash drives Used for disconnected mode assessments
![Page 15: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/15.jpg)
15
NAEP Alliance
2015 Feedback
Choice Number of schools Percentage of schools
1 = Touchscreen (specify) 117 3.5%
2 = Touchpad (specify) 22 0.7%
3 = Stylus (specify) 363 10.8%
4 = Keyboard (specify) 52 1.5%
5 = None of the above 2811 83.5%
Did students report (or did you observe) any problems with using any of the following?
Source: Field Staff Session Debriefing Form
![Page 16: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/16.jpg)
16
NAEP Alliance
2015 Feedback
In your observations, did more students use the touchscreen, touchpad, or stylus?
Source: Field Staff Session Debriefing Form
Choice Number of schools Percentage of schools
1 = Yes 2322 67.1%
2 = No – How many did you have to plug in?
1136 32.9%
![Page 17: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/17.jpg)
17
NAEP Alliance
2015 Feedback
Did all the tablet batteries last the entire group?
ChoiceNumber of
schoolsPercentage of
schools
1 = Touchscreen 130 3.7%
2 = Touchpad 201 5.8%
3 = Stylus 1839 52.9%
4 – Used equally 1307 37.6%
Source: Field Staff Session Debriefing Form
![Page 18: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/18.jpg)
18
NAEP Alliance
2015 Feedback
Overall, how would you rate the students' engagement in the TBA Assessment?
Source: Field Staff Session Debriefing Form
ResponseNumber of
schoolsPercentage of
schools
1 = Very engaged 3152 89.8%
2 = Somewhat engaged 349 9.9%
3 = Not at all engaged 10 0.3%
![Page 19: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/19.jpg)
19
NAEP Alliance
eNAEP System Demonstration
![Page 20: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/20.jpg)
20
NAEP Alliance
Demonstration Features
• Supervisor interface• Student login• Tutorial Demonstration• Monitoring Demonstration• Tools Demonstration
NAEP Alliance
![Page 21: NAEP Alliance NAEP Technology Based Assessments National Conference on Student Assessment June 22, 2015 2:00-3:30.](https://reader035.fdocuments.net/reader035/viewer/2022062407/56649e5e5503460f94b575ae/html5/thumbnails/21.jpg)
21
NAEP Alliance
Questions?