Crime Prevention - Feedzai · The fictional example of Tyler and Xmusic: The False Positive Rate...
Transcript of Crime Prevention - Feedzai · The fictional example of Tyler and Xmusic: The False Positive Rate...
© 2019 Feedzai© 2019 Feedzai
The FATE of Financial Crime PreventionPedro Saleiro
Money2020 - Las Vegas, October 2019
Pedro SaleiroData Science Manager
The FATE ofFinancial Crime Prevention:Fairness, Accountability,Transparency and Ethics in AI
© 2019 Feedzai
The 3 main ethical problems of AI today(not adequately addressed by regulation, yet)
© 2019 Feedzai
1. Bias and Fairness
© 2019 Feedzai
What about the online payments industry?
The fictional example of Tyler and Xmusic:The False Positive Rate for Tyler’s zip code is
5X higher than average
Xmusic is not aware of the biases ofits fraud prevention AI solution
© 2019 Feedzai
2. Transparency
© 2019 Feedzai
State-of-the-Art in Explainable AI
Transaction: 23132Score: 875
Fraud Non-fraud
© 2019 Feedzai
3. Accountability
© 2019 Feedzai
Companies must use AI that is compliantand tied to their values!
But...
Increasing complexity (e.g., deep learning) and automation (e.g., AutoML) makes it hard
to understand AI and its impact.
© 2019 Feedzai
FATE to the rescue!(let’s talk about a few research projects)
© 2019 Feedzai
1. Bias and Fairness Audits
© 2019 Feedzai
What do you need to audit an AI system?
1. Fraud predictions 2. The true outcome
(fraud/not fraud)3. Protected attributes
you care about4. Select bias metrics5. Bias audit toolkit (e.g. Aequitas)
© 2019 Feedzai
The Awareness Effect
© 2019 Feedzai
2. Human-Interpretable Explanations(and adequate evaluation)
© 2019 Feedzai
How a great explanation looks like
Transaction: 23132Model Score: 875
Explanation:Suspicious because it's an
high-speed ordering from a bot
Fraud Non-fraud
© 2019 Feedzai
Semantic Layer for Explanations
Linking low-level model-based explanations with semantic
concepts from a fraud ontology
© 2019 Feedzai
Systematic Evaluation of Explanations
© 2019 Feedzai
3. Robust and Multi-Objective Model Selection
© 2019 Feedzai
The Awareness Effect (again!)
© 2019 Feedzai
Multi-Objective Model Selection
From all the compliant models optimize:
1. Overall performance (e.g., Recall)2. Fairness (e.g., FPR disparity nationality)3. Performance Stability4. Quality of Explanations5. Energy consumption (!!)
© 2019 Feedzai
OutlookFairness, Transparency and Accountability arecurrent ethical issues in AI
FATE research at Feedzai is working on:1. Fairness Awareness through audits2. Human-Interpretable and useful explanations3. Robust and multi-objective model selection
We are empowering our clients with control to develop AI that is compliant, tied to their values and function as intended!
© 2019 Feedzai
THANK YOU