Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly...

39
Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI

Transcript of Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly...

Page 1: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Prediction of Crime/Terrorist Event Locations

National Defense and Homeland Security: Anomaly Detection

Francisco Vera, SAMSI

Page 2: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Outline

• Introduction

• Location space and feature space

• The model

• Feature selection

• Examples

• Evaluation/comparison of models

• Discussion

Page 3: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Introduction

• Talk based on two papers– “Criminal incident prediction using a point-

pattern-based density model”• By Hua Liu and Donald Brown

– “Spatial forecast methods for terrorist events in urban environments”

• By Donald Brown, Jason Dalton, and Heidi Hoyle

• Same modeling approach in both papers

Page 4: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Introduction

• Hot spots: Criminal events tend to cluster in space.

• Traditional methods look for clusters in space– Only coordinates, dates and times are used– Poor performance– Unable to predict new hot spots

• Terrorist events are rare, do not cluster in space

Page 5: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Introduction

• Proposed method look for offender’s preferences in crime site selection– Instead of looking at the coordinates, look at

the features of crime locations• Demographic, social, economic• Distance to key features

– Closest police station– Closest highway– Closest convenience store

Page 6: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Location Space

North

East

Cops

I-40

I-85

Page 7: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Feature Space

Highway

Cops

Page 8: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Location Space and Feature Space

• Transform observations from location space to feature space

• Look for clusters in the feature space

• Fit a density in feature space

• For each coordinate, the likelihood of an event is the density of the transformed coordinate (from location to feature)

Page 9: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Advantages

• Better performance (issues with comparison)

• Ability to predict new hot spots

• Terrorist events do not cluster in location space, but they do in feature space

Page 10: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

The Model

• Times:• Locations:• Features:• Transition density:

Page 11: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

The Model

• Spatial transition density• Temporal transition density• Assumption: Temporal transition does not

depend on spatial transition

Page 12: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

The Model

Page 13: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

The Model

Page 14: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

The Model

Page 15: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Feature Selection

Page 16: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Feature Selection

Page 17: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Feature Selection• Second paper mentions:

– Use of the correlation structure to drop variables– Principal Components

Page 18: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.
Page 19: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.
Page 20: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.
Page 21: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Features Selected

Page 22: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Example

Page 23: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Gaussian Mixture Model

Page 24: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Weighted Product Kernel

Page 25: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Filter Product Kernel

Page 26: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Terrorist Events Example

Page 27: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Features Selected

Page 28: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Distance Features Only

Page 29: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Logistic Regression

Page 30: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Logistic Regression

Page 31: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Combination

Page 32: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Evaluation/Comparison of Models

Page 33: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Evaluation/Comparison of Models

• The reasoning: Percentile scores should be larger at event points

• Evaluate percentile scores at all event point and average.

• Best model has highest average percentile score• Is this good?

)else everywherean greater th is at density ()()()(

sPdxxfpsfxf

s

Page 34: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Crime Example

Page 35: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Crime Example

Page 36: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Crime Example

Page 37: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Crime Example

Page 38: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Terrorist Example

Page 39: Prediction of Crime/Terrorist Event Locations National Defense and Homeland Security: Anomaly Detection Francisco Vera, SAMSI.

Discussion

• Feature space has advantages over location space

• The Model: Decomposition of the transition density

• Feature selection: Correlations, principal components, Gini index

• Evaluation/comparison of models: Percentile score

• Paper: Detecting local regions of change in high-dimensional or terrorist point processes, by Michael Porter and Donald Brown