Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021....

41
Characterizing Harms of Incentivized Advertising on Google Play Zubair Shafiq [email protected] | WEB.CS.UCDAVIS.EDU/~ZUBAIR/

Transcript of Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021....

Page 1: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Characterizing Harms of Incentivized Advertising on Google Play

Zubair Shafiq

[email protected] | WEB.CS.UCDAVIS.EDU/~ZUBAIR/

Page 2: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Third-party Apps

Platform

Online Social Networks Smartphones

2

User

Third-party App

Developer

Page 3: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Third-party Apps

Platform

Third-party App

User Developer

Millions of third-party apps

3

Online Social Networks Smartphones

Page 4: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Abuse of Third-party Apps

Platform

Third-party App

User Developer

4

Online Social Networks Smartphones

Page 5: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Abuse of Third-party Apps

Reputation fraud

Privacy/Data breaches

5

Page 6: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Today’s Talk

Platform

Third-party App

User Developer

6

Online Social Networks Smartphones

Page 7: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Understanding Incentivized Mobile App Installs on

Google Play Store

7

Shehroze Farooqi Damon McCoyÁlvaro Feal Tobias Lauinger Narseo Vallina-Rodriguez

ACM Internet Measurement Conference (IMC 2020)

Page 8: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Mobile App Ecosystem

Developers create a variety of engaging mobile apps

Popular app stores

App store metrics

User engagement metrics

Monetization/Revenue In-app ads In-app purchases

8

Investor funding

Install counts Visibility in top charts

Registrations Session lengths

Stock trading

Page 9: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Mobile App Ecosystem

Developers create a variety of engaging mobile apps

Popular app stores

App store metrics

User engagement metrics

Monetization/Revenue In-app ads In-app purchases

9

Investor funding

Install counts Visibility in top charts

Registrations Session lengths

Public stocks

Increasing competition

Mobile app install advertising campaigns

Page 10: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Mobile App Install Campaigns

Traditional (non-incentivized) mobile app install campaigns

Find interested users

Incentivized mobile app install campaigns

Pay users to install the app

Users may not be really interested in the app

Cost of install is high

10

Considerably cheaper than non-incentivized

Page 11: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Incentivized Mobile App Install Campaigns

Install Counts

User Registrations

Usage metrics

Revenue metrics

“Install App &Open only.”

“Install App & Register an Account.”

“Install App & Reach Level 13.”

“Install App & make any purchase of $1.”

11

Manipulate app store’s metrics (e.g., Install counts, visibility in top charts)

Deceive investors to raise funding

Monetize artificial user engagement through ads

Page 12: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Incentivized Installs have a bad reputation

Potentially fake engagement from uninterested users

Violation of app store policies

Manipulation of app store metrics

Apple App Store banned them

Google Play Store does not completely ban them

12

“We've observed instances where incentivized installs are utilized solely to manipulate the placement of apps […] we also recognize that incentivized installs can be a legitimate user acquisition channel for some developers”

Page 13: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

13

Page 14: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Understanding the ecosystem of Incentivized mobile app Installs

Effectiveness of existing Google Play Store’s defensesPurchase incentivized installs

Impact of incentivized installsMonitoring infrastructure to identify incentivized install campaigns Characterize incentivized install campaignsMeasuring Impact

Outline

14

Page 15: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Understanding the ecosystem of Incentivized mobile app Installs

Effectiveness of existing Google Play Store’s defensesPurchase incentivized installs

Impact of incentivized installsMonitoring infrastructure to identify incentivized install campaigns Characterize incentivized install campaignsMeasuring Impact

Outline

15

Page 16: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Incentivized Install Ecosystem

16

Developer IIP Affiliate App

User Third-Party Mediator

Install and run app

(1)Advertise offerfor app installs

(6)Pay $$$ for

offer completion

(2)Push app install

offer

(3)Accept offer to

install app

(4)User completes

the offer

(7)Pay $$ after

offer completion

(8)Pay $ for

completing offer

(5)Notify offer completion

Page 17: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Incentivized Install Ecosystem - Developer

17

Developer IIP Affiliate App

User Third-Party Mediator

Install and run app

(1)Advertise offerfor app installs

(6)Pay $$$ for

offer completion

(2)Push app install

offer

(3)Accept offer to

install app

(4)User completes

the offer

(7)Pay $$ after

offer completion

(8)Pay $ for

completing offer

(5)Notify offer completion

Activity

No Activity Only install an app

Perform additional tasks

Page 18: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Incentivized Install Ecosystem - IIP

Developer IIP Affiliate App

User Third-Party Mediator

Install and run app

(1)Advertise offerfor app installs

(6)Pay $$$ for

offer completion

(2)Push app install

offer

(3)Accept offer to

install app

(4)User completes

the offer

(7)Pay $$ after

offer completion

(8)Pay $ for

completing offer

(5)Notify offer completion

Incentivized Install Platform (IIP)

Observe a spectrum of IIPs based on our interactions

Unvetted IIPs

Vetted IIPs More established developers

Less established developers

18

Page 19: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Incentivized Install Ecosystem - IIP

19

Developer IIP Affiliate App

User Third-Party Mediator

Install and run app

(1)Advertise offerfor app installs

(6)Pay $$$ for

offer completion

(2)Push app install

offer

(3)Accept offer to

install app

(4)User completes

the offer

(7)Pay $$ after

offer completion

(8)Pay $ for

completing offer

(5)Notify offer completion

Incentivized Install Platform (IIP)

Aggregate offers from developers

Display list of offers in an offer wall

19

Offer wall

Page 20: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Incentivized Install Ecosystem

20

Developer IIP Affiliate App

User Third-Party Mediator

Install and run app

(1)Advertise offerfor app installs

(6)Pay $$$ for

offer completion

(2)Push app install

offer

(3)Accept offer to

install app

(4)User completes

the offer

(7)Pay $$ after

offer completion

(8)Pay $ for

completing offer

(5)Notify offer completion

Affiliate App

Large user base

Accessed by users of affiliate apps

Page 21: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Incentivized Install Ecosystem

21

Developer IIP Affiliate App

User Third-Party Mediator

Install and run app

(1)Advertise offerfor app installs

(6)Pay $$$ for

offer completion

(2)Push app install

offer

(3)Accept offer to

install app

(4)User completes

the offer

(7)Pay $$ after

offer completion

(8)Pay $ for

completing offer

(5)Notify offer completion

User

Likely crowd workers

Page 22: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Understanding the ecosystem of Incentivized mobile app Installs

Effectiveness of existing Google Play Store’s defensesPurchase incentivized installs

Impact of incentivized installsMonitoring infrastructure to identify incentivized install campaigns Characterize incentivized install campaignsMeasuring Impact

Outline

22

Page 23: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Purchase Incentivized Installs

Developed and published a honey mobile app on Google Play Store

Purchased 500 incentivized installs from three IIPs

Increased the public install count of our honey app

Google Play Store’s defenses failed to detect incentivized installs

23Users who installed these apps looked like bots or crowd workers

Page 24: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Understanding the ecosystem of Incentivized mobile app Installs

Effectiveness of existing Google Play Store’s defensesPurchase incentivized installs

Impact of incentivized installsMonitoring infrastructure to identify incentivized install campaigns Characterize incentivized install campaignsMeasuring Impact

Outline

24

Page 25: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Monitoring Infrastructure

Affiliate App Automation

AutomationScript

AndroidPhone

Offer Wall Traffic Interception

MITMProxy Server

IIPServers

Incentivized InstallOffers

25

Page 26: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Monitoring Infrastructure

Affiliate App Automation

AutomationScript

AndroidPhone

Offer Wall Traffic Interception

MITMProxy Server

IIPServers

Incentivized InstallOffers

Filter HTTP responses that contain offer walls

Typically JSON format

26

Page 27: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Monitoring Infrastructure

Affiliate App Automation

AutomationScript

AndroidPhone

Offer Wall Traffic Interception

MITMProxy Server

IIPServers

Incentivized InstallOffers

Offer’s Metadata

Offer payout

Offer description

App's name

27

Page 28: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Monitoring Infrastructure

Affiliate App Automation

AutomationScript

AndroidPhone

Offer Wall Traffic Interception

IIPServers

Incentivized InstallOffers

Google Play Store Crawler

Top charts Developer info # Installs

Apps

28

MITMProxy Server

Page 29: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Monitoring Infrastructure

Monitored from March 2019 to June 2019

Automated 8 affiliate apps

5 vetted IIPs

2 unvetted IIPs

2,126 unique incentivized installs offers from 922 unique apps

Most popular affiliate app had 10M+ install counts

29

Page 30: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Characterizing Incentivized Install Campaigns

30

Characteristic Vetted Unvetted

Median Install Count 1,000,000+ 1,000+

Median Payout $0.45 $0.04

“No activity” offers 29% 91%

“Activity” offers 71% 9%

dichotomy between vetted & unvetted IIPs

Page 31: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Measuring Impact

Impact on app store metrics

Increase in install counts

Appearance in top charts

31

Top Grossing Chart

Page 32: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Measuring Impact

Impact on app store metrics

Increase in install counts

Appearance in top charts

Impact on investor funding

Crunchase.com database

32

Incentivized install campaign from 12th March to 27th March

Incentivized install campaign from 7th May to 14th May

Page 33: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Measuring Impact

Impact on app store metrics

Increase in Install Counts

Appearance in top charts

Impact on investor funding

Crunchase.com database

Monetization strategies

Arbitrage

Advertisement

33

Page 34: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Experimental Setup

Baseline apps

Lumen Privacy Monitor App [Razaghpanah ‘15 ]

Sampled 300 apps

Apps from all types of popularities

Chi-squared test of independence

Statistical significance level of 0.05

Perform two separate tests i.e., [Vetted vs. Baseline] and [Unvetted vs. Baseline]

34

Page 35: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Results

Vetted Unvetted

Increase in install counts 𝜒2 = 26.0 , 𝑝 = 3.378𝑒−7 𝜒2 = 39.9 , 𝑝 = 0.000

Appearance in top charts 𝜒2 = 5.43, 𝑝 = 0.02 𝜒2 = 0.22, 𝑝 = 0.64

Investor funding 𝜒2 = 4.7, 𝑝 = 0.03 𝜒2 = 2.8, 𝑝 = 0.10

35

* Green box indicates statistically significant correlation exists ** Red box indicates failure to establish statistically significant correlation

Page 36: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Understanding the ecosystem of Incentivized mobile app Installs

Effectiveness of existing Google Play Store’s defensesPurchase incentivized installs

Impact of incentivized installsMonitoring infrastructure to identify incentivized install campaigns Characterize incentivized install campaignsMeasuring Impact

Responsible disclosure

Outline

36

Page 37: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Responsible Disclosure

Developers could be deceived/defrauded

Disclosed our findings to 137 popular apps with 5M+ installs

37

’’We aren’t aware of an incentivized install campaign for the [..] Incentivized install campaigns contradict our policy [..].’’

’’ Agencies sometimes misuse our company logo and links to our landing pages to create fraudulent ads [..] Most are abusing their roles in the affiliate advertising marketplace to make quick sales[..] Our team is always monitoring these types of practices to be able to block this type of campaign as soon as possible’’

Page 38: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Responsible Disclosure

Disclosed our findings to Google

38

Page 39: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Summary

Incentivized installs can have negative impacts on app store and beyond

Investor funding

Potential violations of Google Play Store’s policies

Lack of enforcement of existing Google Play Store’s defenses

39

Page 40: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Concluding Remarks

Our measurements and infrastructure can help:Google Play Store to identify policy violations App developers to determine if they are being deceivedInvestors to determine if app developers are misleading themConsumer protection agencies to audit systemic fraud

Other harms of incentivized advertisingPrivacy of users

Emerging use of incentivized advertisingIn response to ad-blocking

40

Page 41: Characterizing Harms of Incentivized Advertising on Google Playzubair/files/FTC-2021.pdf · 2021. 2. 12. · Usage metrics Revenue metrics “Install App &Open only.” “Install

Characterizing Harms of Incentivized Advertising on Google Play

Zubair Shafiq

[email protected] | WEB.CS.UCDAVIS.EDU/~ZUBAIR/