CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and...

34
CS 5306 INFO 5306: Crowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh

Transcript of CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and...

Page 1: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

CS 5306INFO 5306:

Crowdsourcing andHuman Computation

Lecture 1610/26/17

Haym Hirsh

Page 2: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Can a crowd be creative?

Page 3: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

What does “creative” mean?

Page 4: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Creativity

Page 5: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Creativity

(Robert Sternberg)

the production of "something original and worthwhile"

Page 6: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Creativity

(Wikipedia)

Creativity is a phenomenon whereby something new and somehow valuable is formed.

Page 7: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Creativity

(Wikipedia)

Creativity is a phenomenon whereby something new and somehow valuable is formed.

Page 8: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Creativity

(Wikipedia)

Creativity is a phenomenon whereby something new and somehow valuable is formed.

The created item may be intangible (such as an idea, a scientific theory, a musical composition, or a joke) or a

physical object (such as an invention, a literary work, or a painting).

Page 9: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Creativity

(Wikipedia)

Scholarly interest in creativity involves many definitions and concepts pertaining to a number of disciplines: engineering, psychology,

cognitive science, education, philosophy (particularly philosophy of science), technology, theology, sociology, linguistics, business studies, songwriting, and economics, covering the relations between creativity

and general intelligence, mental and neurological processes, personality type and creative ability, creativity and mental health; the

potential for fostering creativity through education and training, especially as augmented by technology; the maximization of creativity

for national economic benefit, and the application of creative resources to improve the effectiveness of teaching and learning.

Page 10: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Creativity

(Wikipedia)

Scholarly interest in creativity involves many definitions and concepts pertaining to a number of disciplines: engineering, psychology,

cognitive science, education, philosophy (particularly philosophy of science), technology, theology, sociology, linguistics, business studies, songwriting, and economics, covering the relations between creativity

and general intelligence, mental and neurological processes, personality type and creative ability, creativity and mental health; the

potential for fostering creativity through education and training, especially as augmented by technology; the maximization of creativity

for national economic benefit, and the application of creative resources to improve the effectiveness of teaching and learning.

Page 11: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Creativity

(Wikipedia)

Scholarly interest in creativity involves many definitions and concepts pertaining to a number of disciplines: engineering, psychology,

cognitive science, education, philosophy (particularly philosophy of science), technology, theology, sociology, linguistics, business studies, songwriting, and economics, covering the relations between creativity

and general intelligence, mental and neurological processes, personality type and creative ability, creativity and mental health; the

potential for fostering creativity through education and training, especially as augmented by technology; the maximization of creativity

for national economic benefit, and the application of creative resources to improve the effectiveness of teaching and learning.

Page 12: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Creativity

(Wikipedia)

Scholarly interest in creativity involves many definitions and concepts pertaining to a number of disciplines: engineering, psychology,

cognitive science, education, philosophy (particularly philosophy of science), technology, theology, sociology, linguistics, business studies, songwriting, and economics, covering the relations between creativity

and general intelligence, mental and neurological processes, personality type and creative ability, creativity and mental health; the

potential for fostering creativity through education and training, especially as augmented by technology; the maximization of creativity

for national economic benefit, and the application of creative resources to improve the effectiveness of teaching and learning.

Page 13: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Creativity

(Wikipedia)

Scholarly interest in creativity involves many definitions and concepts pertaining to a number of disciplines: engineering, psychology,

cognitive science, education, philosophy (particularly philosophy of science), technology, theology, sociology, linguistics, business studies, songwriting, and economics, covering the relations between creativity

and general intelligence, mental and neurological processes, personality type and creative ability, creativity and mental health; the

potential for fostering creativity through education and training, especially as augmented by technology; the maximization of creativity

for national economic benefit, and the application of creative resources to improve the effectiveness of teaching and learning.

Page 14: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Creativity

(Wikipedia)

Scholarly interest in creativity involves many definitions and concepts pertaining to a number of disciplines: engineering, psychology,

cognitive science, education, philosophy (particularly philosophy of science), technology, theology, sociology, linguistics, business studies, songwriting, and economics, covering the relations between creativity

and general intelligence, mental and neurological processes, personality type and creative ability, creativity and mental health; the

potential for fostering creativity through education and training, especially as augmented by technology; the maximization of creativity

for national economic benefit, and the application of creative resources to improve the effectiveness of teaching and learning.

Page 15: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Creativity

Related concepts:

• Brainstorming

• Discovery

• Innovation

• Invention

• Lateral thinking

Page 16: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

Page 17: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

Page 18: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

reduces the effects of production blocking and evaluation apprehension on group performance, particularly for larger groups.

Page 19: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

Page 20: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

1: Self-Organizing Communities (think open source software)2: Blending Community and Commerce (think Threadless)3: Getting outsiders to innovate (think Innocentive)

Page 21: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

Page 22: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

We classify and describe four types of online creative consumer communities —Crowds, Hives, Mobs, and Swarms

Page 23: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

Page 24: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

Page 25: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

Page 26: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

This sketch combination system is a variant of a human-based genetic algorithm: one crowd creates a first generation of sketches, and then successive crowds create additional generations by combining the sketches made by the previous crowds.

Page 27: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

Page 28: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

- seeing particularly creative or diverse ideas from others can inspire you

- scalable crowd-powered method for evaluating the diversity of sets of ideas

Page 29: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

Page 30: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

We propose a crowdsourcing process that helps people navigate a large dataset to find analogies.

Page 31: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

Evaluating translation quality through reading comprehension, which is rarely done, can be easily accomplished through creative use of Mechanical Turk.

Page 32: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

Crowds and Creativity

Evaluating translation quality through reading comprehension, which is rarely done, can be easily accomplished through creative use of Mechanical Turk.

Page 33: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

"The Effect of Peripheral Micro-tasks on Crowd Ideation", Girotto V, Walker E, Burleson W. In Proceedings of the 2017 CHI Conference on

Human Factors in Computing Systems

Page 34: CS 5306 INFO 5306: Crowdsourcing and Human Computation ...hirsh/5306/Lecture16.pdfCrowdsourcing and Human Computation Lecture 16 10/26/17 Haym Hirsh. Can a crowd be creative? What

"The Effect of Peripheral Micro-tasks on Crowd Ideation", Girotto V, Walker E, Burleson W. In Proceedings of the 2017 CHI Conference on

Human Factors in Computing Systems

• Ideation: The process of coming up with ideas, typically in some design setting

• Example from paper:“Mechanical Turk currently lacks a dedicated mobile app for performing HITs on smartphones (iPhone, Androids, etc.) or tablets (e.g., the iPad). Brainstorm N features for a mobile app to Mechanical Turk that would improve the worker's experience when performing HITs on mobile devices. Be as specific as possible in your responses.”