Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Netflix Prize'm£�

��

¥I�Æ�gÄzïĤxlvector@gmail.com

August 20, 2009

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

�SN

▶ Netflix Prize�0�

▶ Ì��.

▶ �.KÜ

▶ 'm��30U��¯

▶ éNetflix Prize�o(

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Netflix Prize�0�

Netflix32006cJø480K^ré18K>K�1·õ^µ©êâ§Ó�Jøü�ÿÁ8ProbeÚQuiz§¯K�?Ö´3Ôö8þÔö�.§Ó�3Quizþ�Ñýÿ§¿òýÿ�RMSEJp�0.8563£�'Cinematch�(JJp10%¤.

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

��.

▶ Ý©)Úü�

▶ BoltzmannÅÚRBM

▶ KNNÚ���.

▶ �m�'��.

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

Ý©)Úü�

·��z��^rÚ>K½Â���þ§éu��^ru§½Â���'�f��þpu§éu��>Ki§½Â���'�f��þqi"@o^rué>Ki�µ©�:

r̂ui = � + pTu qi

ù��.�ëêÏL|^FÝeü{��zXeUþ¼ê��µ∑

(u,i)

(rui − �− pTu qi)2 + �(∣∣pu∣∣2 + ∣∣qi ∣∣2)

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

Ý©)Úü�

ÄuFÝ{§�±��S�úª

pu,k = �(eui ⋅ qi ,k − �pu,k)

qi ,k = �(eui ⋅ pu,k − �qi ,k)

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

Ý©)Úü�

3¢S��{¥§ ��\\ü� ��§�±���Ð�(J

r̂ui = � + bu + bi + pTu qi

ùpbu¡�user bias§bi¡�item bias

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

À�[ùÅÚRBM

ù�Ü©d��7�¬�Ìù

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

KNN���.

KNN´í�XÚ¥��P��{§��@�k±eü«KNN

▶ user-based KNN : ^r�UU�Ú¦kÓ¿,��^rU��Ô¬

▶ item-based KNN : ^r�UU�Ú¦±cU��Ô¬�q�Ô¬

3Netflix¥§Ï�^rê8��ã�£48�^r¤§¤±é�k<¦^user-based KNN"�´item-based �{3'm¥��¿©A^

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

�ÆS�KNN�{

KNN�¡��C�§ù´��Ͷ��ÆS�{"¦�Ä�Ú½Ò´ÄkO��qݧ,�ÏL�qÝ5�ýÿ"~^��qÝ�{:

▶ Cosine �qÝ

▶ Pearson �5�'Xê

▶ Inverse User Frequency

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

�ÆS�KNN�{

KNN�ýÿúª�é{ü:

r̂ui = r̄i +

∑j∈N(u)(ruj − r̄j)wij∑

j∈N(u) ∣wij ∣

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

ÄuÆS�KNN�{

�qÝÙ¢��±ÏLÆSÔöÑ5

r̂ui = bui + ∣N(u)∣−1/2∑

j∈N(u)

wij(ruj − buj)

þ¡�úª¥§��±��òruj − bujKÜ�wij¥�§��Xe�ýÿì

r̂ui = bui + ∣N(u)∣−1/2∑

j∈N(u)

wij

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

ÄuÆS�KNN�{

wijÒ´ëê§�±ÏL��zXe�Uþ¼ê�Ñ5 ∑

(u,i)

(rui − r̂ui)2 + �w 2

ij

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

ÄuÆS�KNN�{

�~�ëê�êþ£~�ëê�±��L[ܤ§��±éwij�Ý©)§-

wij = qTi yj

l �±��Xe�ýÿì(NSVD)

r̂ui = bui + ∣N(u)∣−1/2qTi∑

j∈N(u)

yj

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

KÜÝ©)Ú���.

·�òc¡�Ý©)�.Úþ¡����.KܧÒ��Ͷ�SVD++�."ù��.´Ø|^�mÏ���.¥§°Ý�p����.

r̂ui = � + bu + bi + ∣N(u)∣−1/2qTi (pu +∑

j∈N(u)

yj)

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

�m�'��.

�m&E�¦^Ì�´l2008cm©�"¦^�m&EéJ,í�XÚ�ýÿ°Ýk�����^§��@�§í�XÚ¥ko�Ï�´��mCz�"

▶ ��¬�UÐ��mCz

▶ z�ØÓ^r� Ð��mCz

▶ z�ØÓ>K�É�H§Ý��mCz

▶ ��^réu,�a>K�UÐ��mCz

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

��¬�UÐ��mCz

Figure: Distribution of r̄t in Netflix data.

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

^r� Ð��mCz

Figure: Example of three users’ average rating varying withtime.

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

>K�É�H§Ý��mCz

Figure: Example of three items’ average rating varying withtime.

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Matrix FactorizationBoltzmann Machine and RBMKNN and Neighborhood ModelsTemporal Models

G!�.

Figure: �Ôa>K3ØÓFf�61§Ý.

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Linear BlendingLinear Blending on User BinNNBlending

�.KÜ

��.Kܧ·�I�òêâ8y©¤3°§A,B ,C§,�3AþÔöýÿì§3BþKÜýÿì§�ª3Cþ�ýÿ"

▶ �5KÜ

▶ éØÓa^r^�5KÜ

▶ ²�äKÜ

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Linear BlendingLinear Blending on User BinNNBlending

�5KÜ

b�k��ýÿì8Ü{Pk : k = 1, 2, . . . }§·��¦Ñ��KÜ��ýÿì

P =∑k

�kPk

U��zXeUþ¼ê∑(u,i)∈B

(rui − P(u, i))2 + �∑k

�2k

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Linear BlendingLinear Blending on User BinNNBlending

éØÓa^r^�5KÜ

ØÓ«a�^r�U¬·AØÓa.�ýÿ짤±�±Äké^ràa§,�éØÓa�^r?1�5KÜ"

^ràa��{éõ§3Netflix Prize¥~^��{´�â^rµ©�>Kê5y©"

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Linear BlendingLinear Blending on User BinNNBlending

éØÓa^r^�5KÜ

KÜ(JL²§RBM·Ü^u�¹�^r£µ©ê'���^r¤§SVD�.·Ü^u¹�^r£µ©ê'�õ�^r¤

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

Linear BlendingLinear Blending on User BinNNBlending

²�äKÜ

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

'm��30U��¯

▶ \\Vandelay Industries|

▶ ÚGrand Prize Team��>

▶ ݦ¤áThe Ensemble|

▶ Ü��ª±9�ª(J�J�

������ Netflix Prize'''mmm£££���

Main ContentIntroduction of Netflix Prize

Models in Netflix PrizeModel Blending

Last 30 days in Netflix PrizeConclusion of Netflix Prize

éNetflix Prize�o(

▶ vk���.´�Ð�

▶ ìè��

������ Netflix Prize'''mmm£££���