1

Phillips Andover Academy

2/22/2006 - 11:30 – 1:00

Darek Sady

Blackboard Learning System (Release 6.3)

Assessments,Surveys,

and Pools

2

Introductions

Darek Sady Education

– Utica College of Syracuse University– University of North Carolina Greensboro

Professional Experience– 6 Years in Academia– Faculty Development Trainer– College instructor for 3 Years– Director of IT

2 Years with Blackboard

3

Introductions and Expectations

Please introduce yourself…Name, Position/Title, Courses that you teachExperience using BlackboardPlanned use or current use of BlackboardExpectation(s) for this workshop Interesting tidbit about yourself or a local

favorite restaurant

4

Workshop Objectives and Agenda

Test/Survey Managers– Understanding Creation Settings– Developing assessment questions– Deploying, retrieving, and grading assessments.

Questions Pools– Building, categorizing, and searching for questions in

a pool

5

Assessments

6

Assessment Lifecycle

Creation– Using Pools or building from scratch

Delivery– Options, feedback, and availability

Completion by StudentGrading - “!” in Gradebook

– Automatic vs. Manual Item grading

Student Review– Viewing feedback and grades

7

Tests and Surveys

Question types include: Multiple Choice

(answers can be randomized) True/False Multiple Answer Ordering Matching Fill-in-the-Blank Essay Short Answer Calculated Formula Calculated Numeric Hotspot Opinion Scale/Likert File Upload Jumbled Sentence Either/Or

6.3

8

Advanced Question Types

Calculated FormulaCalculated NumericEither/OrFile ResponseFill in Multiple Blanks

HotspotJumbled SentenceOpinion Scale/LikertQuiz BowlShort Answer

6.3

9

Advanced Assessment Questions

Additional questions types within assessments. Calculated Formula – Include calculations within the

question. The calculations can have changing values within them for each exam.

Calculated Numeric – Answer is a number or within a certain range of numbers.

Either/Or – Answer is Yes/No, Agree/Disagree, Right/Wrong.

File Response – Student answers the question by uploading a file.

Fill in Multiple Blanks – Type in free-form answers to multiple blanks within a sentence.

10

Advanced Assessment Questions continued

Hotspot – Student designates a “hotspot” on an image that was previously uploaded by the instructor.

Jumbled Sentence – Select from a drop-down of answers to fill in multiple blanks within a sentence.

Opinion Scale/Likert – Answer is selection based on a scale such as Strongly Agree, Agree, Disagree, etc.

Quiz Bowl – Students must provide their answers in a question format.

Short Answer – Answer is typed into a free-form text box with a set limit.

11

Calculated Formula – Student Perspective

12

Calculated Formula

Create variable-based questions by using brackets [ ]

Create an answer formula using the WebEQ tool – provide method for Blackboard to solve the problem

Partial Credit and Unit requirements can be specified

Instructor-defined variables can be used on both sides of the equation

Answer formula is solved for missing variable

Variable ranges and decimal places can be defined

Blackboard will calculate variable answer results

13

Calculated Formula – Instructor Perspective

14

Calculated Formula – Instructor Perspective

15

Calculated Numeric

Accepts numeric answers in a blank fieldAnswer range can be specifiedDoes not allow for partial credit

Student Perspective

16

Calculated Numeric – Instructor Perspective

17

Either/Or

Similar to a True/False question

Several answer choice options

Can change answer orientation

18

Either/Or – Student Perspective

19

Either/Or – Instructor Perspective

20

File Response

Similar to an Assignment – allows instructor to collect file from students

Students can upload file from local computer or Content System (if available)

21

File Response – Perspectives

Student View

Instructor View

22

Fill In Multiple Blanks

Create variable-based fill in questions

Students can be provided with a text based list of potential answers

Instructor must devise potential student answers for each variable

Similar to single fill in blank question

Partial Credit Option

23

Fill in Multiple Blanks –Perspectives

Student View

Instructor View

24

Hot Spot

Image is uploaded, and select portion of the image is marked as correct

Student clicks on image to mark answer

Automatically graded

25

Hot Spot – Student Perspective

26

Hot Spot – Instructor Perspective

27

Jumbled Sentence

Create variable-based questions by using brackets [ ]

Create list of potential answers that will appear throughout the sentence

Partial Credit can be specified

28

Jumbled Sentence – Student Perspective

29

Jumbled Sentence – Instructor Perspective

30

Jumbled Sentence – Instructor Perspective

31

Opinion Scale/Likert

Similar to a multiple choice question

Answer numbering, orientation, and partial credit can be configured

Answers can be displayed in random order

Often used for assessing opinions in a survey

32

Opinion Scale/Likert – Student Perspective

Similar to a multiple choice questionAnswer numbering, orientation, and partial

credit can be configuredAnswers can be displayed in random orderOften used for assessing opinions in a survey

33

Opinion Scale/Likert – Instructor Perspective

34

Quiz Bowl

Jeopardy-like questions – answer presented first

Partial credit can be partially based on included interrogatives

Similar to a “fill in the blank” question

35

Quiz Bowl – Student Perspective

36

Quiz Bowl – Instructor Perspective

37

Short Answer – Student Perspective

38

Short Answer – Instructor Perspective

39

Assessment Question Completion Status

Students may skip questions that they may wish to come back to in a question-by-question assessment.

This feature allows students to clearly identify which questions they have actually completed from the ones that they have skipped as they progress through the assessment.

6.3

40

Test Manager

Test Canvas– Build and edit assessments, and then deploy them anywhere,

anytime– Use the Creation Settings feature to set default point values for

questions– Attach images and links to questions and to feedback– Built-in math and science notation

Test Manager– Change the properties for specific assessments– Choose the method for deploying assessments (e.g., question

by question or all at once)– Edit deployed assessments without clearing existing grades

41

Survey Manager

Uses include polling, evaluations, and random checks of knowledge

Surveys differ from Tests in the following ways:– Questions cannot be assigned points– Surveys cannot include Random Blocks of questions– Instructors cannot give students feedback– Surveys cannot be graded– Surveys questions cannot be categorized– Questions may be imported into a Survey; however, they

cannot include correct and incorrect answers

Survey results may be viewed on the Assessment Statistics page (by percentage)

42

Assessment Survey Results Download

Instructors can download the results from the attempts of a test or survey to an outside application such as MS Excel.

Supported question types: True/False and Multiple Choice. This allows further statistical analysis of the test/survey

results outside of Blackboard

43

Question Pools

44

Why Use Question Pools?

Easily transfer questions from Course to Course by importing and exporting Question Pools

Share and exchange Question Pools with colleagues

Search Question Pools to locate questions quickly

Randomize the order of questions presented to students in an Assessment

45

From Question Pools to Deploying a Test

After creating a Question Pool… You must create a Test using the Question Pool as a

source of test questions. CONTROL PANEL > TEST MANAGER

You must deploy the Test from a Content Area. CONTROL PANEL > CONTENT AREA

You must make the Test link visible to make the Test available to students. CONTENT AREA > (Test Name) > MODIFY > MODIFY THE TEST OPTIONS

46

Resources and Materials

47

Tutorials

http://www.blackboard.com/quicktutorials/

48

The Blackboard Community

Users Conference

Client Advisory Boards

Email Listserve

Behind the Blackboard for Administrators

Regional User Groups

Developer Community