Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… ·...

36
Spamming Botnets: Signatures and Characteris5cs Xie et al. Presented by Kyle Mar5n <[email protected]>

Transcript of Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… ·...

Page 1: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Spamming  Botnets:  Signatures  and  Characteris5cs  

Xie  et  al.    

Presented  by    

Kyle  Mar5n  <[email protected]>  

Page 2: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

The  Problems  

•  Botnets  

Page 3: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

The  Problems  

•  Botnets  •  Spam  

Page 4: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

The  Problems  

•  Botnets  •  Spam  •  Botnets  +  Spam  

Page 5: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

AutoRE  

•  Generates  botnet  spam  signatures  •  No  labeled  data  or  external  sources  required  •  Regular  Expressions  for  embedded  URL  •  Organizes  spam  into  groups  by  campaign  •  Iden5fy  characteris5cs  of  spam  botnets  

 

Page 6: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

URLs  and  Spam  •  Spam  messages  can  contain  mul5ple  URLs  

•  Generic  URLs  usually  included  

•  Polymorphic  URLs  

Page 7: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Workflow  

Page 8: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Grouping  URLs  

•  URLs  grouped  by  domain  •  Select  groups  characterizing  a  campaign  – Temporal  correla5on  – Dis5nct  IPs  ac5ve  in  a  span  of  5me  – Sharp  spikes  indicate  strong  correla5on  

Page 9: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Genera5ng  Signatures  

•  Distributed  –  Number  of  Autonomous  Systems  

Page 10: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Genera5ng  Signatures  

•  Distributed  –  Number  of  Autonomous  Systems  

•  Bursty  –  Long-­‐term  campaign  dura5ons  (over  days)  

Page 11: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Genera5ng  Signatures  

•  Distributed  –  Number  of  Autonomous  Systems  

•  Bursty  –  Long-­‐term  campaign  dura5ons  (over  days)  

•  Specificity  –  Probability  of  a  random  URL  matching  

Page 12: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Regular  Expression  Genera5on  

•  Signature  Trees  •  Detailing  

Page 13: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Regular  Expression  Genera5on  

•  Signature  Trees  •  Detailing  •  Generalizing  •  Quality  Evalua5on  

Page 14: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Results  

Page 15: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Valida5on  

•  Quality  of  Signatures  –  False  posi5ve  rate  

Page 16: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Valida5on  

•  Quality  of  Signatures  –  False  posi5ve  rate  –  Over  5me  

Page 17: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Valida5on  

•  Quality  of  Signatures  –  False  posi5ve  rate  –  Over  5me  –  REs  vs.  Conjuga5on  

Page 18: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Valida5on  

•  Quality  of  Signatures  –  False  posi5ve  rate  –  Over  5me  –  REs  vs.  Conjuga5on  –  Effect  of  generaliza5on  

Page 19: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Valida5on  

•  Quality  of  Signatures  –  False  posi5ve  rate  –  Over  5me  –  REs  vs.  Conjuga5on  –  Effect  of  generaliza5on  

•  Host  Iden5fica5on  –  Based  on  long-­‐term  spamming  history  

Page 20: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Valida5on  

•  Quality  of  Signatures  –  False  posi5ve  rate  –  Over  5me  –  REs  vs.  Conjuga5on  –  Effect  of  generaliza5on  

•  Host  Iden5fica5on  –  Based  on  long-­‐term  spamming  history  

Page 21: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Valida5on  •  Quality  of  Signatures  –  False  posi5ve  rate  –  Over  5me  –  REs  vs.  Conjuga5on  –  Effect  of  generaliza5on  

•  Host  Iden5fica5on  –  Based  on  long-­‐term  spamming  history  

•  Campaign  Iden5fica5on  –  Based  on  similarity  of  URL  des5na5ons  

Page 22: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Valida5on  •  Quality  of  Signatures  –  False  posi5ve  rate  –  Over  5me  –  REs  vs.  Conjuga5on  –  Effect  of  generaliza5on  

•  Host  Iden5fica5on  –  Based  on  long-­‐term  spamming  history  

•  Campaign  Iden5fica5on  –  Based  on  similarity  of  URL  des5na5ons  

Page 23: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Campaign  Characteris5cs  

•  IP  Distribu5on  

Page 24: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Campaign  Characteris5cs  

•  IP  Distribu5on  

Page 25: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Campaign  Characteris5cs  

•  IP  Distribu5on  

Page 26: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Campaign  Characteris5cs  

•  IP  Distribu5on  •  Per  Campaign  –  Similarity  of  content  

Page 27: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Campaign  Characteris5cs  

•  IP  Distribu5on  •  Per  Campaign  –  Similarity  of  content  –  Similarity  of  5me  

Page 28: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Campaign  Characteris5cs  

•  IP  Distribu5on  •  Per  Campaign  –  Similarity  of  content  –  Similarity  of  5me  –  Similarity  of  behavior  

Page 29: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Campaign  Characteris5cs  

•  IP  Distribu5on  •  Per  Campaign  –  Similarity  of  content  –  Similarity  of  5me  –  Similarity  of  behavior  

•  Different  Campaigns  –  Botnets  with  similar  signatures  

Page 30: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Campaign  Characteris5cs  

•  IP  Distribu5on  •  Per  Campaign  –  Similarity  of  content  –  Similarity  of  5me  –  Similarity  of  behavior  

•  Different  Campaigns  –  Botnets  with  similar  signatures  

–  Sending  pa`ern  clusters  

Page 31: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Campaign  Characteris5cs  •  IP  Distribu5on  •  Per  Campaign  –  Similarity  of  content  –  Similarity  of  5me  –  Similarity  of  behavior  

•  Different  Campaigns  –  Botnets  with  similar  signatures  

–  Sending  pa`ern  clusters  •  Scanning  traffic  

Page 32: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Strengths  

•  Generates  botnet  signatures  without  labeling  •  No  external  services  required  •  Signatures  have  a  low  false  posi5ve  rate  •  Signatures  useful  for  characterizing  botnet  spamming  behaviors  

Page 33: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Weaknesses  

•  Only  based  on  URLs,  not  effec5ve  against  text,  images,  and  other  content  in  spam.  

•  Only  considers  spam  observed  by  a  single  ISP,  could  be  more  effec5ve  with  collabora5on.  

•  Intra-­‐message  Polymorphic  URLs  

Page 34: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Extensions  

•  Non-­‐botnet  RE  signatures  •  A  centralized/distributed  signature  repository  (like  Spamhaus)  

•  Forming  RE  signatures  over  non-­‐URL  content  •  Composite  signatures  based  on  mul5ple  content  types  (URLs,  text,  images,  a`achments,  etc.)  

Page 35: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

Ques5ons  ?  

Page 36: Spamming(Botnets:(Signatures(and( Characteris5cs(czou/CAP6135-12/presentation/cap6135-present… · Spamming(Botnets:(Signatures(and(Characteris5cs(Xie(etal. ((Presented(by((Kyle(Mar5n(

References  •  [1]“62445.jpg  (JPEG  Image,  542  ×  330  pixels).”  [Online].  Available:  h`p://

www.cisco.com/en/US/i/000001-­‐100000/60001-­‐65000/62001-­‐63000/62445.jpg.  [Accessed:  16-­‐Apr-­‐2012].  

•  [2]“botnet1.jpg  (JPEG  Image,  589  ×  584  pixels)  -­‐  Scaled  (94%).”  [Online].  Available:  h`p://ritcyberselfdefense.files.wordpress.com/2011/09/botnet1.jpg.  [Accessed:  15-­‐Apr-­‐2012].  

•  [3]“spam-­‐can-­‐collec5on-­‐2009-­‐09-­‐med.jpg  (JPEG  Image,  1582  ×  1070  pixels)  -­‐  Scaled  (51%).”  [Online].  Available:  h`p://www.alaska.net/~royce/spam/spam-­‐can-­‐collec5on-­‐2009-­‐09-­‐med.jpg.  [Accessed:  15-­‐Apr-­‐2012].  

•  [4]“spam.jpg  (JPEG  Image,  990  ×  660  pixels)  -­‐  Scaled  (83%).”  [Online].  Available:  h`p://owni.fr/files/2010/05/spam.jpg.  [Accessed:  15-­‐Apr-­‐2012].  

•  [5]  Y.  Xie,  F.  Yu,  K.  Achan,  R.  Panigrahy,  G.  Hulten,  and  I.  Osipkov,  “Spamming  botnets:  signatures  and  characteris5cs,”  SIGCOMM  Comput.  Commun.  Rev.,  vol.  38,  no.  4,  pp.  171–182,  Aug.  2008.