CASA: Context Aware Scalable Authentication, at SOUPS 2013

67
CASA: Context-Aware Scalable Authentication Eiji Hayashi, Sauvik Das, Shahriyar Amini Jason Hong, Ian Oakery Human-Computer Interaction Institute Carnegie Mellon University

description

We introduce context-aware scalable authentication (CASA) as a way of balancing security and usability for authentication. Our core idea is to choose an appropriate form of active authentication (e.g., typing a PIN) based on the combination of multiple passive factors (e.g., a user’s current location) for authentication. We provide a probabilistic framework for dynamically selecting an active authentication scheme that satisfies a specified security requirement given passive factors. We also present the results of three user studies evaluating the feasibility and users’ receptiveness of our concept. Our results suggest that location data has good potential as a passive factor, and that users can reduce up to 68% of active authentications when using an implementation of CASA, compared to always using fixed active authentication. Furthermore, our participants, including those who do not using any security mechanisms on their phones, were very positive about CASA and amenable to using it on their phones.

Transcript of CASA: Context Aware Scalable Authentication, at SOUPS 2013

Page 1: CASA: Context Aware Scalable Authentication, at SOUPS 2013

CASA: Context-Aware Scalable Authentication

Eiji Hayashi, Sauvik Das, Shahriyar Amini

Jason Hong, Ian Oakery

Human-Computer Interaction InstituteCarnegie Mellon University

Human-Computer Interaction InstituteCarnegie Mellon University

Page 2: CASA: Context Aware Scalable Authentication, at SOUPS 2013

One Fits All?

Devices require the same user authentication regardless of contexts

Page 3: CASA: Context Aware Scalable Authentication, at SOUPS 2013

If Cost Too Much

Stop using authentication system

Page 4: CASA: Context Aware Scalable Authentication, at SOUPS 2013

A Few Could Fit All

How can we choose security lock system for different situations?

Do they provide better security and usability from users’ perspectives?

Page 5: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Context-Aware

Scalable Authentication

•Authenticate users using active factors and passive factors

•Adjust an active factor based on passive factors

•Quantitative way to choose an active factor

Page 6: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Prototype

Page 7: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Outline

• Underlying Model

• Feasibility Analysis (Field Study #1)

• Prototype Evaluation (Field Study #2)

• Security Analysis

• Design Iteration (Field Study #3)

• Conclusion

Page 8: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Outline

• CASA Framework

• Feasibility Analysis (Field Study #1)

• Prototype Evaluation (Field Study #2)

• Security Analysis

• Design Iteration (Field Study #3)

• Conclusion

Page 9: CASA: Context Aware Scalable Authentication, at SOUPS 2013

CASA Framework

Page 10: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Combining Multiple Factors

Page 11: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Combining Multiple Factors

The probability that a person is a legitimate user given a set of signals

Page 12: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Combining Multiple Factors

The probability that a person is NOT a legitimate user given a set of signals

Page 13: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Combining Multiple Factors

Weight that balances false positives and false negatives

Page 14: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Combining Multiple Factors

Authenticate: A user is more likely to be a legitimate user

Page 15: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Combining Multiple Factors

Reject: A user is less likely to be a legitimate user

Page 16: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Naive Bayes Model

Page 17: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Prototype Evaluation(Field Study #2)

Page 18: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Field Study #2

Test system that changes authentication schemes based on location

Page 19: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Choosing an Authentication Scheme

Location Active Factor

Home ?

Workplace PIN

Other Places ?

Page 20: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Naive Bayes Model

Page 21: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Compare Confidence

Type PIN Be at workplace

Type PIN Be at other place

Page 22: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Compare Confidence

Page 23: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Compare Confidence

Page 24: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Compare Confidence

Type PIN Be at workplace

Type Password Be at other place

Page 25: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Compare Confidence

Page 26: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Chosen Authentication Scheme

Location Active Factor

Home ?

Workplace PIN

Other Places Password

Page 27: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Two Conditions

Location w/ PIN w/o PIN

Home PIN None

Workplace PIN None

Other Places Password PIN

Page 28: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Screenshots

Page 29: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Field Study #2

• 32 participants

• 18 to 40 years old (mean=24)

• On their phones

• For 2 weeks

Page 30: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Result: # of Activations

Condition Home Workplace Other Places

w/o PINNone

13.1 (1.4)None

2.5 (0.4)PIN

8.1 (1.1)

w/ PINPIN

24.5 (3.2)PIN

7.1 (1.0)Password15.7 (2.0)

Page 31: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Result: # of Activations

Condition Home Workplace Other Places

w/o PIN 65.8% 34.2%

w/ PIN 66.8% 33.2%

Page 32: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Result: User Feedback

ConditionEasy to

understandSecure Prefer to use

w/o PIN 5 4 3.5

w/ PIN 4 4 3

Page 33: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Quotes

P3 said, “I don't normally use a security lock, but I would be much more inclined to use one if it didn't require constant unlocking.”

Page 34: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Quotes

P5 said, “I like the system. It’s a great pain to type pin at home, because the nature of the phone, it goes to sleep quickly, then I have to type pin again, which is super annoying.”

Page 35: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Quotes

P12 said, “Typing passwords to check text was annoying. I don't think I will use it.”

Page 36: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Appropriate Security Level

Location Using PIN No Security Locks

Home None

Workplace

Other Places PIN

Page 37: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Appropriate Security Level

Location Using PIN No Security Locks

Home PIN

Workplace PIN

Other Places PIN

Page 38: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Appropriate Security Level

Location Using PIN No Security Locks

Home PIN None

Workplace PIN

Other Places PIN

Page 39: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Appropriate Security Level

Location Using PIN No Security Locks

Home PIN None

Workplace PIN None

Other Places PIN None

Page 40: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Design Iteration(Field Study #3)

Page 41: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Design Iteration

• Appropriate security level

• Workplace is not as safe as home

Page 42: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Appropriate Security Level

Location Active Factor

Home None

Workplace

Other Places

Page 43: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Appropriate Security Level

Location Active Factor

Home None

Workplace

Other Places PIN

Page 44: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Workplace is not safe

No Active Factor Be at Home

No Active Factor Be at Workplace

+

+

Page 45: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Workplace is not safe

No Active Factor Be at Home

Type PIN Be at Workplace

+

+

Page 46: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Workplace is not safe

No Active Factor Be at Home

Using Computer Be at Workplace

+

+No Active Factor +

Page 47: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Active Factor Selection

Location Active Factor

Home None

Workplace when using computers None

Workplace when not using computers

PIN

Others PIN

Page 48: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Notification

Page 49: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Field Study #3

• 18 participants

• 21 to 40 years old (mean=26.3)

• On their phones and laptops

• For 10 to 14 days

Page 50: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Result: At Workplace

Grey: Computer not usedBlack: Computer used

Page 51: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Result: User Feedback

FeatureEasy to

understandUseful Secure

Prefer to use

Location-based

5 4.5 4 4

Comp-based

4.5 4 3.5 3.5

Notification - 4 - 4

Page 52: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Quote

• P17 said, “It is annoying to use security locks all the time, but whereas if I had such a system which requires pin only at unsecure places its usefulness adds more value when compared to the annoyance caused by it. So, I will definitely use it.”

Page 53: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Conclusion

• Proposed a Naive Bayes framework to combine multiple factors to adjust active authentication schemes

• The framework allowed us to choose active factor in a quantitative way

• Field studies indicated that users preferred the proposed system

Page 54: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Backup

Page 55: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Feasibility Analysis(Field Study #1)

Page 56: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Location as a Signal

• People have their own mobility patterns

• Random people don’t have access to certain places

Page 57: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Field Study #1

• Where do people log in to their phones?

• 32 participants

• 7 to 140 days

PlacePlace Mean Time [%]Mean Time [%] Mean Activation [%]Mean Activation [%]

1 (Home) 38.9 31.9

2 (Workplace) 18.7 28.9

Others 42.4 39.2

Page 58: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Security Analysis

Page 59: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Security Analysis

ConditionKnowledge about target users

Uninformed Informed

Technical expertise

Novice Uninformed Novice Informed Novice

Expert Uninformed Expert Informed Expert

Page 60: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Security Analysis

ConditionKnowledge about target users

Uninformed Informed

Technical expertise

Novice Uninformed Novice Informed Novice

Expert Uninformed Expert Informed Expert

Strangers•CASA is as strong as PIN/password

Page 61: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Security Analysis

ConditionKnowledge about target users

Uninformed Informed

Technical expertise

Novice Uninformed Novice Informed Novice

Expert Uninformed Expert Informed Expert

Family members, Friends, Co-workers•Trusted people•However, users trust co-workers less

Page 62: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Security Analysis

ConditionKnowledge about target users

Uninformed Informed

Technical expertise

Novice Uninformed Novice Informed Novice

Expert Uninformed Expert Informed Expert

Dedicated attackers•Rare, but difficult to prevent•Detection rather than prevention

Page 63: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Adjusting Security Levels

Page 64: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Results: # of Activations

Gray: w/ PINBlack: w/o PIN

Page 65: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Compare Confidence

Page 66: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Result: User Feedback

ConditionEasy to

understandSecure Prefer to use

w/o PIN 5 4 3.5

w/ PIN

4 4 3

3 4

Page 67: CASA: Context Aware Scalable Authentication, at SOUPS 2013

Compare Confidence