Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

21
Trusting Differently: Diversity-aware search for people, content, events Judith Simon, Institut Nicod, CNRS Aliaksandr Birukou , University of Trento, Italy [Insert header here] [Insert footer] 1

description

My presentation at the LiquidPub Trust workshop http://interdisciplines.org/conferences/Workshop-on-Trust-and-Reputation

Transcript of Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Page 1: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Trusting Differently: Diversity-aware search for people, content, events

Trusting Differently: Diversity-aware search for people, content, events

Judith Simon, Institut Nicod, CNRS

Aliaksandr Birukou, University of Trento, Italy

[Insert header here][Insert footer]

1

Page 2: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Motivation

o Information overload

o Paradoxically - Narrowing the scope

o People tend to (implicitly) trust known content, people, events

“See only what you want to see, hear only what you want to hear, read only what you want to read” Cass Sunstein

"It's what you don't know that can kill you” J. Mullins

“The scarce resource now is the attention” Bernardo Huberman

[Insert header here][Insert footer]

2

Page 3: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Question 1 - What is your discipline?

o Computer Science: 24

o Social sciences: 2

o Philosophy: 3

o Sociology of science: 1

o Physical systems: 1

o Unknown: 2

[Insert header here][Insert footer]

3

Page 4: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Question 2

o How many of you met people from another discipline working on trust before?

[Insert header here][Insert footer]

4

Page 5: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Scientific entities

o People: researchers, readers

o Content: papers, articles, datasets, blogs,

o Events: conferences, workshops, summer schools

o …plus publication venues: journals, newspapers, magazines, open repositories

[Insert header here][Insert footer]

5/13

Page 6: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Dimensions of content

oRelevance

oReputation

o…

[Insert header here][Insert footer]

6/13

Page 7: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

One more dimension - diversity

[Insert header here][Insert footer]

7

Page 8: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Roadmap

o Fix two out of three dimensions: o Relevance – metrics from information retrievalo Reputation – based on links or citations

o Design diversity metrics:o Existing research on diversity in web searcho Community network of scientific entities

o Apply resultso To discover hidden links between scientific entitieso To analyze and avoid conflicts of interest

[Insert header here][Insert footer]

8

Page 9: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Desired outcome

o A recommender system thato Recommends content, events, people to researchers

o Matches papers with reviewerso To get diverse viewpoints on the same paper

o Assigns papers to panels/sessions with different degrees of similarity/diversityo To increase homogeneity or have more vivid discussion

[Insert header here][Insert footer]

9/13

Page 10: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

What we need

o Topic discoveryo … e.g., by keyphrase extraction

o Trust and reputation metricso … but we are probably in the right place

[Insert header here][Insert footer]

10/13

Page 11: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Thanks for your attentionThanks for your attention

Contact me at [email protected]

[Insert header here][Insert footer]

11

Page 12: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Diversity-aware hiring in scienceDiversity-aware hiring in science

Aliaksandr Birukou, University of Trento, Italy

Fabio Casati, University of Trento, Italy

[Insert header here][Insert footer]

12

Page 13: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Motivation

o You’ve seen that already…

o Now, consider hiring committees

o Same problems – select people similar to you/group/department

[Insert header here][Insert footer]

13/13

Page 14: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Argument

o Hiring people different from the ones already working in the research group, department, or university can bring new contacts, viewpoints and communitieso But only if the person has all required competences

[Insert header here][Insert footer]

14/13

Page 15: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

o Culture includes:o experienceo [patterns of] behavioro knowledgeo beliefso normso …

o Culture is:o sharedo accummulated o learned o socially transmittedo socially acquiredo …

Defining culture. Content vs. its properties

Aliaksandr Birukou - Implicit Culture Framework for behavior transfer

15

that are

and

TraitsTraits

transmittedtransmitted

sharedshared

CultureCultureCultureCulture

=

Page 16: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Metrics on scientific/cultural difference

o Scientific traits: where publish, research interests, …

o Culture traits: experience, patterns of behaviors, beliefs, knowledge, …

o Metrics can be based on the differences between “the culture” of an individual and the research group/department:o Common culture (culture overlap) is the set of traits that is present in

both cultureso Culture similarity is the degree to which two cultures are similar, i.e.

how much they have in commono Culture fit is the ratio between the culture overlap and the number of

traits in the other culture

[Insert header here][Insert footer]

16/13

Page 17: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Judging people from other communities

o Improve the reputation of a stranger by showing where she stays in her community (top 5%/bottom 10%)

[Insert header here][Insert footer]

17/13

Page 18: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

But…

o How do you define “top 5%” or “bottom 10%”?

[Insert header here][Insert footer]

18/13

Page 19: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

uCount

o Community-defined index

o The goal is to put in place a merit-based, objective, transparent system for assessing people, contributions, and events, one that does not simply focus on "impact" but focuses on the wide range of contributions that can be made

o Will be maintained by ICST and EAI

o Please volunteer to become a member of the uCount council

[Insert header here][Insert footer]

19/13

Page 20: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

Call for members of uCount council

o What is requiredo Willingness to help your community to design better metrics,

metrics that mattero Some spare time to define selection procedures, tools for

community interactiono Some spare time for involving your community in finding what

matters for them (see Dumas et al – correlation between metrics)

o Timelineo Expression of interest: by January 4th

o Involving your community: by January 30th

[Insert header here][Insert footer]

20/13

Page 21: Diversity-aware search for people, content, events AND Diversity-aware hiring and evaluation

More

o The LiquidPub project. http://project.liquidpub.org

o Google liquidpub-announce and subscribe if you are interested (VERY low traffic): http://disi.unitn.it/mailman/listinfo/liquidpub-announce

o Or, subscribe to our blog: http://liquidpub.wordpress.com

o Or, follow us on twitter: http://twitter.com/liquidpub