Fairness, Accountabilityand Transparency(FAT) in ...
Transcript of Fairness, Accountabilityand Transparency(FAT) in ...
![Page 1: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/1.jpg)
Fairness, Accountability and Transparency (FAT) in
Recommender SystemsDenis Parra
PUC Chile & IMFD
denisparra
Latin American School on Recommender SystemsFortaleza, Brasil
October 10th, 2019
![Page 2: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/2.jpg)
Presents …• Associate Professor, CS Department, PUC Chile• Teaching
– Undergraduate: • Information Visualization and Introduction to Computer Science
– Graduate:• Recommender Systems, Data Mining
• Research: SocVis Lab ⊂ IA Lab– Machine learning applications (RecSys), information visualization, information retrieval,
intelligent user interfaces.– Students: 3 PhD, 10 Master, 4 Undergraduate
• Researcher of the Millenium Institute Foundational Research on Data (IMFD, Chile)
D.Parra ~ LARS 201910/10/19 2
![Page 3: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/3.jpg)
Millennium Institute Foundational Research on Data
(IMFD.cl)
10/10/19 D.Parra ~ LARS 2019 3
![Page 4: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/4.jpg)
IMFD - Millennium Initiative Chile
10/10/19 D.Parra ~ LARS 2019 4
Funding for 10 years (~1.2M dollars per year)
Four main institutions:PUC, UChile, USM, UdeC
15 associate researchers+
15 young and adjunct researchers
![Page 5: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/5.jpg)
Upcoming related conferences
• ACM RecSys 2020: Rio de Janeiro, Brasil– Deadline: April 2020
• ACM IUI 2021: Santiago, Chile– Deadline: October 2020
10/10/19 D.Parra ~ LARS 2019 5
![Page 6: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/6.jpg)
We are living incredible days…
• Technology is showing results which resemble science fiction, specially in the area called Artificial Intelligence
10/10/19 D.Parra ~ LARS 2019 6
![Page 7: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/7.jpg)
We are living incredible days…
• Technology is showing results which resemble science fiction, specially in the area called Artificial Intelligence.
10/10/19 D.Parra ~ LARS 2019 7
![Page 8: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/8.jpg)
Natural Language Processing• (2010-2011) IBM Watson beats humans in Jeopardy.
<< ... With all of its processing CPU power, Watson can scan two million pages of data in three seconds.>>
E. Nyberg, CMU professor
http://www.aaai.org/Magazine/Watson/watson.php
10/10/19 D.Parra ~ LARS 2019 8
![Page 9: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/9.jpg)
Self-Driving Cars
10/10/19 D.Parra ~ LARS 2019 9
![Page 10: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/10.jpg)
Mastering Go
10/10/19 D.Parra ~ LARS 2019 10
![Page 11: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/11.jpg)
Zero Shot Learning: Picture to Movie
10/10/19 D.Parra ~ LARS 2019 11
Zakharov, E., Shysheya, A., Burkov, E., & Lempitsky, V. (2019). Few-Shot Adversarial Learning of Realistic Neural Talking Head Models. arXiv preprint arXiv:1905.08233.
![Page 12: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/12.jpg)
But there are some problems
10/10/19 D.Parra ~ LARS 2019 12
https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing
• The COMPAS system is used in the USA to predict recidivism
![Page 13: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/13.jpg)
But there are some problems
10/10/19 D.Parra ~ LARS 2019 13
https://www.propublica.org/article/how-we-analyzed-the-compas-recidivism-algorithm
• When the COMPAS system correctly predicts recidivism, it does it similarly to black and white,
• But, when it fails to predict correctly:
![Page 14: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/14.jpg)
Other case: Gender Shades• A Project by Joy Buolamwini, researcher at MIT Media Lab• Examination of facial-analysis software shows error rate of 0.8 percent
for light-skinned men, 34.7 percent for dark-skinned women.
10/10/19 D.Parra ~ LARS 2019 14
https://news.mit.edu/2018/study-finds-gender-skin-type-bias-artificial-intelligence-systems-0212https://www.media.mit.edu/projects/gender-shades/overview/
http://gendershades.org/overview.html
![Page 15: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/15.jpg)
Some voices call for deeper discussion
10/10/19 D.Parra ~ LARS 2019 15
https://medium.com/@mijordan3/artificial-intelligence-the-revolution-hasnt-happened-yet-5e1d5812e1e7
Thus, just as humans built buildings and bridges before there was civil engineering, humans are proceeding with the building of societal-scale, inference-and-decision-making systems that involve machines, humans and the environment.
Just as early buildings and bridges sometimes fell to the ground — in unforeseen ways and with tragic consequences — many of our early societal-scale inference-and-decision-making systems are already exposing serious conceptual flaws.
![Page 16: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/16.jpg)
Can Recommender Systems be affected?
10/10/19 D.Parra ~ LARS 2019 16
![Page 17: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/17.jpg)
Can Recommender Systems be affected?
• Yes
10/10/19 D.Parra ~ LARS 2019 17
![Page 18: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/18.jpg)
Can Recommender Systems be affected?
• Yes, RecSys are socio-technical systems !
• RecSys help people on filtering noise, identifying relevant items from a large information space. They are usually optimized on accuracy and ranking metrics, not on fairness.
10/10/19 D.Parra ~ LARS 2019 18
![Page 19: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/19.jpg)
Can Recommender Systems be affected?
• Yes, RecSys are socio-technical systems !
• RecSys help people on filtering noise, identifying relevant items from a large information space. They are usually optimized on accuracy and ranking metrics, not fairness.
• The actual effects on user experience due to optimizing an accuracy/ranking metric are hard to predict.
10/10/19 D.Parra ~ LARS 2019 19
![Page 20: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/20.jpg)
YouTube Deep Recommender System
• YouTube, ACM RecSys (2016)
2019 D.Parra ~ Mojito al Dato 20
Covington, P., Adams, J., & Sargin, E. (2016, September). Deep neural networks for youtube recommendations. In Proceedings of the 10th ACM conference on recommender systems (pp. 191-198). ACM.
![Page 21: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/21.jpg)
Neural Networks
2019 D.Parra ~ Mojito al Dato 21
Candidate Generation Ranking
![Page 22: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/22.jpg)
What does YouTube RecSys try to learn ?
• Artificial Intelligence systems still do not decide what to learn: a human tells them the task(s).
2019 D.Parra ~ Mojito al Dato 22
![Page 23: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/23.jpg)
What does YouTube try to learn ?
• Artificial Intelligence systems still do not decide what to learn: a human tells them
• In the case of YouTube, tasks are: 1) predict the next video watched, and 2) predict the time the user spent watching the next coming video.
2019 D.Parra ~ Mojito al Dato 23
![Page 24: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/24.jpg)
What does YouTube try to learn ?
• Artificial Intelligence systems still do not decide what to learn: a human tells them
• In the case of YouTube, tasks are: 1) predict the next video watch, and 2) predict the time the user spent watching the next coming
• The system is never told to distinguish good from bad content quality (fake news, violence, etc.)
2019 D.Parra ~ Mojito al Dato 24
![Page 25: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/25.jpg)
What Does YouTube RecSys recommends the most?
• Guillaume Chaslot
• He worked developing the first recommender system of YouTube.
2019 D.Parra ~ Mojito al Dato 25
![Page 26: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/26.jpg)
What Does YouTube RecSys recommends the most?
• Guillaume Chaslot
• After resigning from YouTube, he created a system to estimate what was being recommended
2019 D.Parra ~ Mojito al Dato 26
https://www.theguardian.com/technology/2018/feb/02/youtube-algorithm-election-clinton-trump-guillaume-chaslot
![Page 30: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/30.jpg)
Do people consume YouTube Recommendations ?
2019 D.Parra ~ Mojito al Dato 30
https://www.pewinternet.org/2018/11/07/many-turn-to-youtube-for-childrens-content-news-how-to-lessons
![Page 31: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/31.jpg)
People do follow recommendations, indeed.
• Study by Pew Research Center
2019 D.Parra ~ Mojito al Dato 31
![Page 32: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/32.jpg)
Methodology (Pew Research Internet)
2019 D.Parra ~ Mojito al Dato 32
174,117 random walks resulted in
696,468 total encounters with
346,086 unique recommended videos
![Page 33: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/33.jpg)
Are there trends in terms of Video length ?
• Data from Pew Research Center
2019 D.Parra ~ Mojito al Dato 33
![Page 34: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/34.jpg)
Are there trends in terms of Video Popularity ?
• Data from Pew Research Center
2019 D.Parra ~ Mojito al Dato 34
![Page 35: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/35.jpg)
New YouTube Recommender
• Presented in RecSys 2019, main change: multitask learning• Still not addressing the issue of video quality / fake news
10/10/19 D.Parra ~ LARS 2019 35
![Page 36: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/36.jpg)
Should I care about this ?
• How can this affect my regular practice as professional developing or evaluating recommender systems ?
10/10/19 D.Parra ~ LARS 2019 36
![Page 37: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/37.jpg)
Law: What happened in May 25th, 2018 ?
• The EU General Data Protection Regulation (GDPR) becomes enforceable.
D.Parra ~ LARS 201910/10/19 37
![Page 38: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/38.jpg)
And why do we care in this room ?• The GDPR not only applies to organisations located within the
EU but it will also apply to organisations located outside of the EUif they offer goods or services to, or monitor the behaviour of, EU data subjects.
• It applies to all companies processing and holding the personal data of data subjects residing in the European Union, regardless of the company’s location.
D.Parra ~ LARS 201910/10/19 38
![Page 39: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/39.jpg)
Which is the effect on my current practice ?
Right to explanation
• Article 15 “Right of access by the data subject”
• Article 22 “Automated individual decision-making, including profiling”
• Recital 71 (linked to art. 22)
D.Parra ~ LARS 201910/10/19 39
![Page 40: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/40.jpg)
Recital 71
D.Parra ~ LARS 201910/10/19 40
![Page 41: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/41.jpg)
Recital 71
D.Parra ~ LARS 2019
In order to ensure fair and transparent processing in respect of the data subject, taking into account the specific circumstances and context in which the personal data are processed, the controller should use appropriate mathematical or statistical procedures for the profiling …
10/10/19 41
![Page 42: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/42.jpg)
Human Interpretability in ML
D.Parra ~ LARS 2019
• https://arxiv.org/abs/1606.08813
10/10/19 42
![Page 43: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/43.jpg)
Other Initiatives
10/10/19 D.Parra ~ LARS 2019 43
This bill would require the creation of a task force that provides recommendations on how information on agency automated decision systems may be shared with the public and how agencies may address instances where people are harmed by agency automated decision systems.
![Page 44: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/44.jpg)
Potential Harms on algorithmic Decision Making
10/10/19 D.Parra ~ LARS 2019 44
http://gendershades.org/overview.html
![Page 45: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/45.jpg)
•How are researchers and practitioners addressing these issues ?
10/10/19 D.Parra ~ LARS 2019 45
![Page 46: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/46.jpg)
The FAT* Conference
• https://fatconference.org• A computer science conference with a cross-disciplinary focus that
brings together researchers and practitioners interested in fairness, accountability, and transparency in socio-technical systems.
10/10/19 D.Parra ~ LARS 2019 46
![Page 47: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/47.jpg)
The FATML group
• The FATML group suggests best practices:• https://www.fatml.org/resources/principles-and-best-practices
10/10/19 D.Parra ~ LARS 2019 47
![Page 48: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/48.jpg)
Workshops & Tutorials
• Tutorial on Fairness & Discrimination in Retrieval & Recommendation: M. Ekstrand, F. Diaz, R. Burke (SIGIR & RecSys2019) https://boi.st/FairIRTutorial
• Tutorial on ExplainAble Recommendation and Search: Y. Zhang, Q. Ai, J. Mao, X. Chen (SIGIR 2019)
• Tutorial on Fairness and Transparency in Ranking: Carlos Castillo (LA-Web 2019, DAB 2018)
10/10/19 D.Parra ~ LARS 2019 48
![Page 49: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/49.jpg)
How to Measure, Study and Prevent Bias in RecSys?• Some definitions
• Explainability and transparency in RecSys
• Fairness in RecSys
• Open challenges
• Summary and conclusions
10/10/19 D.Parra ~ LARS 2019 49
![Page 50: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/50.jpg)
FAT definitions
• Fairness
• Accountability
• Transparency
10/10/19 D.Parra ~ LARS 2019 50
![Page 51: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/51.jpg)
FAT definitions• Fairness: The property of being fair or equitable
vs. Bias: inclination towards something; predisposition, partiality, prejudice, preference, predilection, discrimination.
• Accountability:
• Transparency
10/10/19 D.Parra ~ LARS 2019 51
![Page 52: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/52.jpg)
FAT definitions• Fairness: The property of being fair or equitable
vs. Bias: inclination towards something; predisposition, partiality, prejudice, preference, predilection, discrimination.
• According to Friedman and Nissembaum (1994) a computer system is biased “if it systematically and unfairly discriminate[s] against certain individuals or groups of individuals in favor of others.”
10/10/19 D.Parra ~ LARS 2019 52
Batya Friedman and Helen Nissenbaum. 1996. Bias in computer systems. ACM Transactions on Information Systems 14, 3 (1996), 330–347.
![Page 53: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/53.jpg)
FAT definitions• Fairness: The property of being fair or equitable
vs. Bias: inclination towards something; predisposition, partiality, prejudice, preference, predilection, discrimination.
• According to Friedman and Nissembaum (1994) a computer system is biased “if it systematically and unfairly discriminate[s] against certain individuals or groups of individuals in favor of others.”– “… a system discriminates unfairly if it denies an opportunity or a good or if it
assigns an undesirable outcome to an individual or a group of individuals on grounds that are unreasonable or inappropriate.”
10/10/19 D.Parra ~ LARS 2019 53
Batya Friedman and Helen Nissenbaum. 1996. Bias in computer systems. ACM Transactions on Information Systems 14, 3 (1996), 330–347.
![Page 54: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/54.jpg)
FAT Definitions
• Fairness
• (Algorithmic) Accountability: To be accountable means to be subject to giving an account or having the obligation to report, explain or justify something -> explainable AI (XAI).
• Transparency
10/10/19 D.Parra ~ LARS 2019 54
![Page 55: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/55.jpg)
FAT Definitions
• Fairness
• Accountability
• (Algorithmic) Transparency: is the principle that the factors that influence the decisions made by algorithms should be visible, or transparent, to the people who use, regulate, and are affected by systems that employ those algorithms.
10/10/19 D.Parra ~ LARS 2019 55
![Page 56: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/56.jpg)
Important Distinction
• Algorithmic accountability vs algorithmic transparency: Some people use it interchangeably, but a system can be accountable (provide explanations, justifications) without necessarily being transparent (completely opening the complexity of a black-box)
• From the DARPA XAI Program
10/10/19 D.Parra ~ LARS 2019 56
Image from Zhang et al. (2019) Tutorial on ExplainAble Recommendation and Search
![Page 57: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/57.jpg)
Other relevant terms
• Interpretability, in the context of AI/ML:– “the degree to which a human can understand the cause of a decision” (T.
Miller, et al. AI 2018)– “the degree to which a human can consistently predict the model’s result” (B.
Kim, et al. NIPS 2016)– “the ability to explain or to present in understandable terms to a human”
(Doshi-Velez and Kim, 2017)
10/10/19 D.Parra ~ LARS 2019 57
![Page 58: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/58.jpg)
1. EXPLAINABILITY & TRANSPARENCY
10/10/19 D.Parra ~ LARS 2019 58
![Page 59: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/59.jpg)
FAT in Recommender Systems
• Herlocker, J. L., Konstan, J. A., & Riedl, J. (2000). Explaining collaborative filtering recommendations. In Proceedings of the 2000 ACM conference on Computer supported cooperative work (pp. 241-250). ACM.
• Sinha, R., & Swearingen, K. (2002). The role of transparency in recommender systems. In CHI'02 extended abstracts on Human factors in computing systems (pp. 830-831). ACM.
10/10/19 D.Parra ~ LARS 2019 59
![Page 60: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/60.jpg)
FAT in Recommender Systems (movies)• Herlocker, J. L., Konstan, J. A., & Riedl, J. (2000). Explaining collaborative filtering recommendations.
In Proceedings of the 2000 ACM conference on Computer supported cooperative work (pp. 241-250). ACM.
10/10/19 D.Parra ~ LARS 2019 60
![Page 61: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/61.jpg)
FAT in Recommender Systems (music)• Sinha, R., & Swearingen, K. (2002). The role of transparency in recommender systems.
In CHI'02 extended abstracts on Human factors in computing systems (pp. 830-831). ACM.
10/10/19 D.Parra ~ LARS 2019 61
![Page 62: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/62.jpg)
FAT in Recommender Systems II
• Tintarev, N., & Masthoff, J. (2007). A survey of explanations in recommender systems. In 2007 IEEE 23rd international conference on data engineering workshop (pp. 801-810). IEEE.
• Tintarev, N., & Masthoff, J. (2012). Evaluating the effectiveness of explanations for recommender systems. User Modeling and User-Adapted Interaction, 22(4-5), 399-439.
• Tintarev, N., & Masthoff, J. (2015). Explaining recommendations: Design and evaluation. In Recommender systems handbook (pp. 353-382). Springer, Boston, MA.
10/10/19 D.Parra ~ LARS 2019 62
![Page 63: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/63.jpg)
FAT in Recommender Systems II
• Tintarev, N., & Masthoff, J. (2007). A survey of explanations in recommender systems. In 2007 IEEE 23rd international conference on data engineering workshop (pp. 801-810). IEEE.
• Tintarev, N., & Masthoff, J. (2012). Evaluating the effectiveness of explanations for recommender systems. User Modeling and User-Adapted Interaction, 22(4-5), 399-439.
• Tintarev, N., & Masthoff, J. (2015). Explaining recommendations: Design and evaluation. In Recommender systems handbook (pp. 353-382). Springer, Boston, MA.
10/10/19 D.Parra ~ LARS 2019 63
![Page 64: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/64.jpg)
RecSys: Explanatory Goals and Definitions
10/10/19 D.Parra ~ LARS 2019 64
Tintarev, N., & Masthoff, J. (2007). A survey of explanations in recommender systems. In 2007 IEEE 23rd international conference on data engineering workshop (pp. 801-810). IEEE.
![Page 65: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/65.jpg)
XAI (2017)
• XAI is a term coined by David Gunning, program manager at DARPA
10/10/19 D.Parra ~ LARS 2019 65
![Page 66: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/66.jpg)
XAI for Recommender Systems
• First generation of approaches for Recommender Systems were easily to explain: User and Item based CF, Content-based, Rule-based
• The Second generation of RecSys, based on Matrix Factorization made the process more difficult: latent user and item representation
• The Third generation based on Deep Learning makes accountability and transparency even more difficult !
10/10/19 D.Parra ~ LARS 2019 66
![Page 67: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/67.jpg)
1st generation of RecSys
• Algorithms were simple and intuitive (User-based KNN, Item-Based KNN, Content-based, Case-based)
• Provide explanations for items recommended would not require a big engineering effort
10/10/19 D.Parra ~ LARS 2019 67
![Page 68: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/68.jpg)
1st generation of RecSys
• User Based KNN
10/10/19 D.Parra ~ LARS 2019 68
Explanation: Users who have similar ratings with you highly rated this item
5
4
4
2
1
5
4
4
Active user
User_1
User_2
2
3
4
2
Item 1
Item 2
Item 3
![Page 69: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/69.jpg)
1st generation of RecSys
• Content Based
10/10/19 D.Parra ~ LARS 2019 69
Explanation: This items has similar content (features: description, actors, director, genre) to what you have liked in the past
Active user
![Page 70: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/70.jpg)
XAI for Recommender Systems
• First generation of approaches for Recommender Systems were easily to explain: User and Item based CF, Content-based, Rule-based
• The Second generation of RecSys, based on Matrix Factorization made the process more difficult: latent user and item representation
• The Third generation based on Deep Learning makes accountability and transparency even more difficult !
10/10/19 D.Parra ~ LARS 2019 70
![Page 71: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/71.jpg)
2nd generation of RecSys
• Matrix Factorization - latent factor models: difficult to explain
10/10/19 D.Parra ~ LARS 2019 71
?
![Page 72: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/72.jpg)
2nd generation of RecSys• Alternatives: try to assign explicit meaning to latent factor models:
– Zhang, Y., Lai, G., Zhang, M., Zhang, Y., Liu, Y., & Ma, S. (2014). Explicit factor models for explainable recommendation based on phrase-level sentiment analysis. In Proceedings of the 37th international ACM SIGIR conference on Research & development in information retrieval (pp. 83-92). ACM.
– Chen, X., Qin, Z., Zhang, Y., & Xu, T. (2016). Learning to rank features for recommendation over multiple categories. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval (pp. 305-314). ACM.
– Wang, N., Wang, H., Jia, Y., & Yin, Y. (2018). Explainable recommendation via multi-task learning in opinionated text data. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval (pp. 165-174). ACM.
10/10/19 D.Parra ~ LARS 2019 72
![Page 73: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/73.jpg)
2nd generation of RecSys
• Zhang et al (2014) “Explicit factor models for explainable recommendation based on phrase-level sentiment analysis”
10/10/19 D.Parra ~ LARS 2019 73
![Page 74: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/74.jpg)
XAI for Recommender Systems
• First generation of approaches for Recommender Systems were easily to explain: User and Item based CF, Content-based, Rule-based
• The Second generation of RecSys, based on Matrix Factorization made the process more difficult: latent user and item representation
• The Third generation based on Deep Learning makes accountability and transparency even more difficult !
10/10/19 D.Parra ~ LARS 2019 74
![Page 75: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/75.jpg)
3rd Generation of RecSys
• In Matrix factorization we had one level of interactions, with deep learning we can have many! Making explanations more complex
10/10/19 D.Parra ~ LARS 2019 75
Image from Zhang et al. (2019) Tutorial on ExplainAble Recommendation and Search
![Page 76: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/76.jpg)
3rd Generation of RecSys• Alternatives: use attention mechanism within the neural architecture
(over text or images)
• Generate explanations directly (Natural Language Generation)
• Use a model agnostic approach: generate explanations after recommendation (LIME, SHAP, etc.)
10/10/19 D.Parra ~ LARS 2019 76
![Page 77: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/77.jpg)
Neural Attention
• Attention in neural networks is a mechanism which allows the model to focus selectively during the learning process.
• Eventually, we can observe where the network was attending to in order to make a prediction.
10/10/19 D.Parra ~ LARS 2019 77
Olah, C., & Carter, S. (2016). Attention and augmented recurrent neural networks. Distill, 1(9), e1. http://doi.org/10.23915/distill.00001
![Page 78: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/78.jpg)
Neural Attention
• Example of document classification: Does the model attends to reasonable words ?
10/10/19 D.Parra ~ LARS 2019 78
![Page 79: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/79.jpg)
3rd Generation of RecSys• Seo, S., Huang, J., Yang, H., & Liu, Y. (2017). Interpretable
convolutional neural networks with dual local and global attention for review rating prediction. RecSys 2017.
10/10/19 D.Parra ~ LARS 2019 79
![Page 80: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/80.jpg)
3rd Generation of RecSys
• Chen, J., Zhang, H., He, X., Nie, L., Liu, W., & Chua, T. S. (2017). Attentive collaborative filtering: Multimedia recommendation with item-and component-level attention. SIGIR 2017.
10/10/19 D.Parra ~ LARS 2019 80
![Page 81: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/81.jpg)
3rd Generation of RecSys
• Li, P., Wang, Z., Ren, Z., Bing, L., & Lam, W. (2017,). Neural rating regression with abstractive tips generation for recommendation. SIGIR 2017
10/10/19 D.Parra ~ LARS 2019 81
![Page 82: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/82.jpg)
Adapting current XAI approaches to RecSys
• LIME: Ribeiro, M. T., Singh, S., & Guestrin, C. (2016). Why should itrust you?: Explaining the predictions of any classifier. KDD 2016.
10/10/19 D.Parra ~ LARS 2019 82
![Page 83: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/83.jpg)
Adapting current XAI approaches to RecSys
• Adapting LIME to recommendation: Nóbrega, C., & Marinho, L. (2019). Towards explaining recommendations through local surrogate models. ACM/SIGAPP Symposium on Applied Computing.
10/10/19 D.Parra ~ LARS 2019 83
![Page 84: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/84.jpg)
This survey is not exhaustive
• I strongly recommend visiting • https://sites.google.com/view/ears-tutorial/
10/10/19 D.Parra ~ LARS 2019 84
![Page 85: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/85.jpg)
Accountability: the Role of Interactive Visualization
• PeerChooser (O’Donovan et al, 2008)• SmallWorlds (Gretarsson et al, 2010)• TasteWeights (Bostandjev et al. 2012, Knijnenburg et al. 2012)• TalkExplorer/Aduna (Verbert et al. 2013)• SetFusion (Parra et al., 2014)• Moodplay (Andjelkovic et al., 2016)• 3D Inspector (Loepp et al, 2017)
10/10/19 D.Parra ~ LARS 2019 85
![Page 86: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/86.jpg)
Peerchooser - 1
• PeerChooser (CHI 2008)
• John O’Donovan, Barry Smyth, BrynjarGretarsson, SvetlinBostandjiev, Tobias Hollerer
![Page 87: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/87.jpg)
Smallworlds – 2 • SmallWorlds:
Visualizing Social Recommendations (IEEE-TVCG 2010)
• Brynjar Gretarsson, John O'Donovan , Svetlin Bostandjiev, Christopher Hall, Tobias Höllerer
• User study with 17 users
![Page 88: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/88.jpg)
TasteWeights - 3Controllability: Sliders that let users control the importance of preferences and contexts
Inspectability: lines that connect recommended items with contexts and user preferences
• TasteWeights: a visual interactive hybrid recommender system (RecSys 2012)
• Bostandjiev, S., O'Donovan, J., & Höllerer, T.
Also : Knijnenburg, B. P., Bostandjiev, S., O'Donovan, J., & Kobsa, A. (2012). Inspectability and control in social recommenders. In Proceedings of ACM RecSys.
![Page 89: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/89.jpg)
TalkExplorer - 4
• Visualizing recommendations to support exploration, transparency and controllability (IUI 2014)
• Verbert, K., Parra, D., Brusilovsky, P., & Duval, E.
![Page 90: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/90.jpg)
SetFusion - 5• See what you want to
see: visual user-driven approach for hybrid recommendation (IUI 2014)
• Denis Parra, Peter Brusilovsky, and Christoph Trattner.
![Page 91: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/91.jpg)
Moodplay - 6
• Moodplay: Interactive Mood-based Music Discovery and Recommendation. (UMAP 2016)
• Ivana Andjelkovic, Denis Parra, and John O'Donovan.
http://moodplay.pythonanywhere.com/
![Page 92: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/92.jpg)
3D Landscape - 7
• A 3D item space visualization for presenting and manipulating user preferences in collaborative filtering (IUI 2017)
• Kunkel, J., Loepp, B., & Ziegler, J.
![Page 93: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/93.jpg)
Open Challenges• Recent advance in NLP models, neural attention architectures (the
transformer), and generative models provide a big potential for this area. Notice that interpretable != transparent.
• Visualization has not been deeply explored for supporting transparency and explainability in recommender systems, and it is and open field for further research.
• For a glimpse of what can be done combining the aforementioned points, check https://distill.pub as well as https://visxai.io
10/10/19 D.Parra ~ LARS 2019 93
![Page 94: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/94.jpg)
The Effect of Explanations and Algorithmic Accuracy on
Visual Recommender Systems of Artistic Images
Pontificia Universidad Católica de Chile (PUC Chile)
Vicente Domínguez
Pablo Messina
IvaniaDonoso-Guzmán
Denis Parra
![Page 95: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/95.jpg)
Open Questions
• We learned that visual features from DNNs perform better than attractiveness visual features.
10/10/19 D.Parra ~ LARS 2019 95
Average brightness SaturationSharpness
Entropy RGB-contrastColorfulnessNaturalness
Predictive Accuracy
Attractiveness visual features
Deep Learningvisual features
![Page 96: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/96.jpg)
Open Questions from Content-Based RecSys
• We learned that visual features from DNNs perform better than attractiveness visual features, but they are harder to explain.
10/10/19 D.Parra ~ LARS 2019 96
Predictive Accuracy
Explainability
Average brightness SaturationSharpness
Entropy RGB-contrastColorfulnessNaturalness
Attractiveness visual features
Deep Learningvisual features
![Page 97: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/97.jpg)
Data: UGallery
• Online Artwork Store, based on CA, USA.
• Mostly sales one-of-a-kind physical artwork.
10/10/19 D.Parra ~ LARS 2019 97
![Page 98: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/98.jpg)
CB RecSys algorithm: Visual Features
• (DNN) Deep Neural Networks
• (AVF) Attractiveness-based
10/10/19 D.Parra ~ LARS 2019 98
![Page 99: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/99.jpg)
White-box Explanation (AVF)
10/10/19 D.Parra ~ LARS 2019 99
![Page 100: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/100.jpg)
Black-box explanation
10/10/19 D.Parra ~ LARS 2019 100
![Page 101: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/101.jpg)
Study Procedure
10/10/19 D.Parra ~ LARS 2019 101
![Page 102: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/102.jpg)
Preference Elicitation
• We collect user preferences from a Pinterest-like interface
10/10/19 D.Parra ~ LARS 2019 102
![Page 103: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/103.jpg)
Study Procedure
10/10/19 D.Parra ~ LARS 2019 103
![Page 104: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/104.jpg)
Interface 1: no explanation
10/10/19 D.Parra ~ LARS 2019 104
![Page 105: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/105.jpg)
Study Procedure
10/10/19 D.Parra ~ LARS 2019 105
![Page 106: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/106.jpg)
Int. 2: explainable, no transparency
10/10/19 D.Parra ~ LARS 2019 106
![Page 107: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/107.jpg)
Study Procedure
10/10/19 D.Parra ~ LARS 2019 107
![Page 108: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/108.jpg)
Interface 3: explainable & transparent
10/10/19 D.Parra ~ LARS 2019 108
![Page 109: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/109.jpg)
Evaluation & ResultsStudy on Amazon Mechanical Turk:
● 121 valid users completed correctly the study.
● Task took them around 10 minutes to complete.
● ~56% female, 44% male.
● 80% attended to 1 or more art classes at high school level or above.
● 80% visited museums or art galleries at least once a year.
10/10/19 D.Parra ~ LARS 2019 109
![Page 110: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/110.jpg)
Results
10/10/19 D.Parra ~ LARS 2019 110
Interface 1: UI without explanationInterface 2: UI with example-based explanationInterface 3: UI with transparent explanation (AVF)
![Page 111: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/111.jpg)
Results
10/10/19 D.Parra ~ LARS 2019 111
7 dimensions evaluated, for DNN and AVF (scale 1-100):
Perception of:- Explainability- Relevance- Diversity
- Satisfaction w/UI- Intention of use- Trust on RecSys
- Avg. Rating
![Page 112: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/112.jpg)
Results• Result : Explainable interfaces increase perception of explainability.
10/10/19 D.Parra ~ LARS 2019 112
- Result expected: people perceive the system as more explainable using the explainable interfaces than non explainable.
![Page 113: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/113.jpg)
Evaluation & Results• Result 2: Perception of relevance changes just by adding
explanations -> User Interface really matters!!
10/10/19 D.Parra ~ LARS 2019 113
- Algorithm is the same (DNN), but by adding explanations people perceive recommendations as more relevant,
- Result is significant only with DNN.
![Page 114: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/114.jpg)
Evaluation & Results• Result 3: No difference in Trust between DNN and AVF in I1
(without explanations)
10/10/19 D.Parra ~ LARS 2019 114
- The difference in Trust between DNN and AVF becomes significant onlywhen using explainable interfaces.
![Page 115: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/115.jpg)
Take-away
• From the tutorial on XAI for IR and RecSys by Zhang, Ai, Mao, Chen:
• What is interpretability in the context of ML/AI?– “the degree to which a human can understand the cause of a decision” (T.
Miller, et al. AI 2018)– “the degree to which a human can consistently predict the model’s result” (B.
Kim, et al. NIPS 2016)– “the ability to explain or to present in understandable terms to a human”
(Doshi-Velez and Kim, 2017)
10/10/19 D.Parra ~ LARS 2019 115
![Page 116: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/116.jpg)
2. FAIRNESS IN RECSYS
10/10/19 D.Parra ~ LARS 2019 116
![Page 117: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/117.jpg)
Where does Unfairness come from ?
10/10/19 D.Parra ~ LARS 2019 117
From tutorial by Diaz, Ekstrand & Burke (SIGIR and RecSys 2019): https://fair-ia.ekstrandom.net/sigir2019
World Model and Training
Source Data
ResultsEvaluation
![Page 118: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/118.jpg)
World & Data Bias
10/10/19 D.Parra ~ LARS 2019 118
Wagner, C., Graells-Garrido, E., Garcia, D., & Menczer, F. (2016). Women through the glass ceiling: gender asymmetries in Wikipedia. EPJ Data Science, 5(1), 5.
![Page 119: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/119.jpg)
Consumer vs. Producer Bias
• The figure, from Ekstrand, Diaz, Burke (2019) show different stakeholders on Information Access Systems
10/10/19 D.Parra ~ LARS 2019 119
From tutorial by Diaz, Ekstrand & Burke (SIGIR and RecSys 2019): https://fair-ia.ekstrandom.net/sigir2019
Items’Inventory
ProducersConsumers
![Page 120: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/120.jpg)
Consumer Bias in RecSys
10/10/19 D.Parra ~ LARS 2019 120
![Page 121: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/121.jpg)
Biases in RecSys
10/10/19 D.Parra ~ LARS 2019 121
![Page 122: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/122.jpg)
Biases in RecSys
10/10/19 D.Parra ~ LARS 2019 122
![Page 123: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/123.jpg)
Language models (word2vec, Glove, etc.)
10/10/19 D.Parra ~ LARS 2019 123
https://blog.acolyer.org/2016/04/21/the-amazing-power-of-word-vectors/
![Page 124: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/124.jpg)
Bias in Language Models
• In addition to their ability to learn word meaning from text, embeddings, alas, also reproduce the implicit biases and stereotypes that were latent in the text.
• Bolukbasi et al. (2016) found that the closest occupation to ‘man’ -‘computer programmer’ + ‘woman’ in word2vec embeddings trained on news text is ‘homemaker’
• https://web.stanford.edu/~jurafsky/slp3/6.pdf
10/10/19 D.Parra ~ LARS 2019 124
![Page 125: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/125.jpg)
Debiasing in Language Models
• Recent research focuses on ways to try to remove these kinds of biases• By developing a transformation of the embedding space that removes
gender stereotypes but preserves definitional gender (Bolukbasi et al. 2016, Zhao et al. 2017) or changing the training procedure (Zhao et al., 2018).
• However, although these sorts of debiasing may reduce bias in embeddings, they do not eliminate it (Gonen and Goldberg, 2019), and this remains an open problem
10/10/19 D.Parra ~ LARS 2019 125
![Page 126: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/126.jpg)
Producer Bias
• Ekstrand, M. D., Tian, M., Kazi, M. R. I., Mehrpouyan, H., & Kluver, D. (2018). Exploring author gender in book rating and recommendation. ACM RecSys 2018.
10/10/19 D.Parra ~ LARS 2019 126
![Page 127: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/127.jpg)
Producer Bias
• Ekstrand, M. D., Tian, M., Kazi, M. R. I., Mehrpouyan, H., & Kluver, D. (2018). Exploring author gender in book rating and recommendation. ACM RecSys 2018.
10/10/19 D.Parra ~ LARS 2019 127
![Page 128: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/128.jpg)
Filter Bubble
• The term filter bubble was popularized by Eli Pariser in his book “The filter bubble: What the Internet is hiding from you”.
• It refers to echo chambers and feedback loops: people gets stacked into a bubble without much option to escape and consume more diverse content.
• Chaney, A. J., Stewart, B. M., & Engelhardt, B. E. (2018). How algorithmic confounding in recommendation systems increases homogeneity and decreases utility. ACM RecSys.
10/10/19 D.Parra ~ LARS 2019 128
![Page 129: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/129.jpg)
Fairness methods in Ranking
• From Tutorial on Algorithmic Bias in Rankings (Carlos Castillo, 2019)
10/10/19 D.Parra ~ LARS 2019 129
Yang, K., & Stoyanovich, J. (2017, June). Measuring fairness in ranked outputs. In Proceedings of the 29th International Conference on Scientific and Statistical Database Management (p. 22). ACM.
![Page 130: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/130.jpg)
Open Challenges for Fairness in RecSys• DATA: Most datasets do not have information to investigate these
issues, identifying biases is an open area of research.
• There is no one-size-fits-all solution for fairness: What accurately represents the world? What accurately represents the world as it could or should be?
• We should consider both consumer and producer forms of bias: recommending most popular might be easy to implement and effective, but we are not promoting new producers.
10/10/19 D.Parra ~ LARS 2019 130
![Page 131: Fairness, Accountabilityand Transparency(FAT) in ...](https://reader031.fdocuments.net/reader031/viewer/2022020701/61f76a4771256367af72a241/html5/thumbnails/131.jpg)
Summary
• In this talk, I have presented, motivated, and defined several aspects of FAT, with a focus on the context of RecSys.
• I have also surveyed several works and areas of research related to FAT and XAI. There are many open research questions to address, and decisions to make in order to progress making RecSys useful but also fair.
10/10/19 D.Parra ~ LARS 2019 131