Dealing with pain points of recommenders in the real world fileTaylor Swift Pulp The Smiths Joy...
Transcript of Dealing with pain points of recommenders in the real world fileTaylor Swift Pulp The Smiths Joy...
Dealing with pain points of recommenders in the real world
Sophie Watson @sophwats [email protected]
Dealing with pain points of recommenders in the real world
Sophie Watson @sophwats [email protected]
Alternating Least Squares
1 5 3
1
5
3
3
· · ·
?
· · ·
1
1
3 3
3
· · ·
· · ·
· · ·
· · ·
· · ·· · ·
· · ·· · ·
· · ·· · ·· · ·
4
4
45 5
5? ?
?2
?
?
?
? ?
1
?
≈ · · ·
≈ · · ·
?
1
≈ · · ·
1
A
B
C
1 play
10 plays
100 plays
1
1 play
10 plays
100 plays
A
B
C
Plays
Confidence
1
A
B
C
1 play
10 plays
100 plays
· · ·
1 5 3
Pain Points of ALS
???
?
???
?
time
Solutions
· · ·
· · ·
≈ · · ·
Recommendations returned to users
· ·
≈ · Data
· ·
≈ · DataRecommendations returned to users
Post-processing
· ·
≈ · DataRecommendations returned to users
Post-processing
· ·
≈ · DataRecommendations returned to users
Post-processing
NEW!
· ·
≈ · DataRecommendations returned to users
Post-processing
NEW!
time
Composable signatures for Recommendation
1 2 3
Taylor Swift Pulp
The Smiths Joy Division Billy Bragg
Taylor Swift Pulp
The Smiths Joy Division New Order
Taylor Swift Miley Cyrus
Little Mix Billie Eillish Spice Girls
1 2 3
Taylor Swift Pulp
The Smiths Joy Division Billy Bragg
Taylor Swift Pulp
The Smiths Joy Division New Order
Taylor Swift Miley Cyrus
Little Mix Billie Eillish Spice Girls
Jaccard 1 2,( (= Artist listened to Artist listened to
Artist listened to Artist listened to
1
1
2
2
∩∩
1
Taylor Swift Pulp
The Smiths Joy Division Billy Bragg
Jaccard 1 2,( (= Artist listened to Artist listened to
Artist listened to Artist listened to
1
1
2
2
=4
6
2 3
Taylor Swift Pulp
The Smiths Joy Division New Order
Taylor Swift Miley Cyrus
Little Mix Billie Eillish Spice Girls
∩∩
1
Taylor Swift Pulp
The Smiths Joy Division Billy Bragg
Jaccard 1 2,( (
=Artist listened to Artist listened to
Artist listened to Artist listened to
1
1
3
3
=1
9
2 3
Taylor Swift Pulp
The Smiths Joy Division New Order
Taylor Swift Miley Cyrus
Little Mix Billie Eillish Spice Girls
=4
6
Jaccard 1 3,( ( ∩∩
Jaccard 1 5,( (=
Jaccard 1 3,( (= 0.5
Jaccard 1 4,( (= 0.1
0.1
Jaccard 1 6,( (= 0.6
Jaccard 1 ,( (= 0.32
Jaccard 1 5,( (=
Jaccard 1 3,( (= 0.5
Jaccard 1 4,( (= 0.1
0.1
Jaccard 1 6,( (= 0.6
Jaccard 1 ,( (= 0.32
Artist id Date-timeTaylor Swift
Pulp The Smiths Joy Division Billy Bragg
1
2
1
2
Jaccard 1 2,( (=∩∩
1
2
Jaccard 1 2,( (=∩∩
1
2
Jaccard 1 2,( (= =3
10
∩∩
1
1
1
1
1
+
=
Artist id Date-time
Summer
Winter
1
2
1
2
Jaccard 1 2,( (=∩∩
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
1 ,( (.
MinHash for recommendation
1
1
Min-hash signature
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists.
∞∞∞∞∞
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists.
∞∞∞∞∞
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists.
∞∞∞∞∞
1
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists.
∞∞∞∞∞
1
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists. 11111
∞∞∞∞∞
1
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists. 11111
612,048
9856471
∞∞∞∞
1
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists. 11111
612,048
9856471
1
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists. 11111
612,048
9856471
1
4
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists. 4 612,048
9856471
4
4
44
1711,09743,861
93111,123
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from # artists to # artists. 4 6
98
71
4
4
44
11,097
93
4
1
Min-hash signature
6
91
43
1,987
93
1
Min-hash signature
6
91
43
1,987
93
2
9,872
486
43
1,987
32,821
1
Min-hash signature
6
91
43
1,987
93
2
9,872
486
43
1,987
32,821
1
2
1
2
1
Min-hash signature
6
91
43
1,987
93
1
9,872
486
43
12
84
1
Min-hash signature
6
91
43
1,987
93
1
+ =
6
91
43
12
84
9,872
486
43
12
84
1
h1( (h2( (h3( (h4( (h5( (Min-hash signature
Map from ARTIST NAMES to # artists.
Artist Date
Locality sensitive MinHash
1 2 3 4
1 2 3 4
}Band 1
}Band 2
}Band 3
}Band 4
}Band 5
1 2 3 4
}Band 1
}Band 2
}Band 3
}Band 4
}Band 5
h ( (Map from vecs of band size to large numbers.
1 2 3 4
}Band 1
}Band 2
}Band 3
}Band 4
}Band 5
h ( (Map from vecs of band size to large numbers.
Things we didn’t have time for
1
A
B
C
1 play
10 plays
100 plays
1 5 3
Things we have talked about
[email protected] @sophwats
[email protected] @sophwats
[email protected] @sophwats
[email protected] @sophwats