LPP-HOG: A New Local Image Descriptor for Fast Human Detection

Andy {andy@ulsan.islab.ac.kr}

Qing Jun Wang and Ru Bo Zhang

IEEE International Symposium on Knowledge Acquisition and Modeling Workshop, 2008.pp.640-643 21-22 Dec. 2008, Wuhan

2Intelligent Systems

Problem settingGoal: design algorithm for human detection able to perform in real-time

Proposed solution:-Use a combination of Histogram of Oriented Gradients (HOG) as a feature vector.- Decrease feature-space dimensionality using Locality Preserving Projection (LPP)- Use Support Vector Machine (SVM) algorithm in reduced feature space to train the classifier

HOGgeneral scheme

Typical person detection scheme using SVM

In practice, effect is very small (about 1%) while some computational time is required*

*Navneet Dalal and Bill Triggs. Histograms of Oriented Gradients for Human Detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, SanDiego, USA, June 2005. Vol. II, pp. 886-893.

Computing gradients

Mask Type

1D centered

1D uncentered

1D cubic‑corrected 2x2 diagonal 3x3 Sobel

Operator [-1, 0, 1] [-1, 1] [1, -8, 0, 8, -1]

Miss rateat 10−4 FPPW

11% 12.5% 12% 12.5% 14%

121000121

101202101

Accumulate weight votes over spatial cells• How many bins should be in histogram?

• Should we use oriented or non-oriented gradients?

• How to select weights?

• Should we use overlapped blocks or not? If yes, then how big should be the overlap?

• What block size should we use?

Contrast normalization

1vvnormL

1vvsqrtL

vnormL

HysL 2 - L2-norm followed by clipping (limiting the maximum values of v to 0.2) and renormalising

Making feature vector

Variants of HOG descriptors. (a) A rectangular HOG (R-HOG) descriptor with 3 × 3 blocks of cells. (b) Circular HOG (C-HOG) descriptor with the central cell divided into angular sectors as in shape

contexts. (c) A C-HOG descriptor with a single central cell.

HOG feature vector for one block

1201019747

1101019545

30251510

2525150

80707050

40303020

510105

1020205

Angle Magnitude

0-19 20-39 40-59 60-79 80-99 100-119 120-139 140-159 160-1790

0-19 20-39 40-59 60-79 80-99 100-119 120-139 140-159 160-179

Binary voting Magnitude voting

11 ,...,,,...,,,...,,,..., hhhhhhhhf

Feature vector extends while window moves

HOG example

In each triplet: (1) the input image, (2) the corresponding R-HOG feature vector (only the dominant orientation of each cell is shown), (3) the dominant orientations selected by the SVM (obtained by multiplying the feature vector by the

corresponding weights from the linear SVM).

Support Vector Machine (SVM)

Problem setting for SVM

wT x + b = 0

wT x + b < 0

wT x + b > 0

A hyper-plane in the feature space

(Unit-length) normal vector of the hyper-plane:

0xwT b

denotes +1denotes -1

x2How would you classify these points using a linear discriminant function in order to minimize the error rate?

Infinite number of answers!

Which one is the best?

Problem setting for SVM

Large Margin Linear Classifier

We know that

The margin width is:

w xw x

Margin

wT x + b = 0

wT x + b = -1wT x + b = 1

( )2 ( )

x x nwx xw w

Support Vectors

Formulation:

Margin

wT x + b = 0

wT x + b = -1wT x + b = 1

such that

2maximize w

For 1, 1

Formulation:

Margin

wT x + b = 0

wT x + b = -1wT x + b = 1

21minimize 2

such that

For 1, 1

Formulation:

Margin

wT x + b = 0

wT x + b = -1wT x + b = 1

x-n( ) 1T

i iy b w x

21minimize 2

such that

Solving the Optimization Problem

( ) 1Ti iy b w x

21minimize 2

Quadratic programming

with linear constraints

1minimize ( , , ) ( ) 12

p i i i ii

L b y b

w w w x

Lagrangian Function

1minimize ( , , ) ( ) 12

p i i i ii

L b y b

w w w x

s.t. 0i

i i ii

x-ww iiip yL

-b iip yL

1minimize ( , , ) ( ) 12

p i i i ii

L b y b

w w w x

s.t. 0i

1maximize 2

n n nT

i i j i j i ji i j

s.t. 0i 1

Lagrangian Dual Problem

The solution has the form:

( ) 1 0Ti i iy b w x

From KKT condition, we know:

Thus, only support vectors have 0i

i i i i i ii i

get from ( ) 1 0, where is support vector

b y b w xx

wT x + b = 0

wT x + b = -1wT x + b = 1

Support Vectors

( ) T Ti i

x w x x x

The linear discriminant function is:

Notice it relies on a dot product between the test point x and the support vectors xi

Also keep in mind that solving the optimization problem involved computing the dot products xi

Txj between all pairs of training points

What if data is not linear separable? (noisy data, outliers, etc.)

Slack variables ξi can be added to allow miss-classification of difficult or noisy data points

wT x + b = 0

wT x + b = -1wT x + b = 1 12

Formulation:

( ) 1Ti i iy b w x

1minimize 2

such that

Parameter C can be viewed as a way to control over-fitting.

Formulation: (Lagrangian Dual Problem)

1maximize 2

n n nT

i i j i j i ji i j

such that

Datasets that are linearly separable with noise work out great:

But what are we going to do if the dataset is just too hard?

How about… mapping data to a higher-dimensional space:

Non-linear SVMs

General idea: the original input space can be mapped to some higher-dimensional feature space where the training set is separable:

Φ: x → φ(x)

Non-linear SVMs: Feature Space

With this mapping, our discriminant function is now:

( ) ( ) ( ) ( )T Ti i

x w x x x

No need to know this mapping explicitly, because we only use the dot product of feature vectors in both the training and test.

A kernel function is defined as a function that corresponds to a dot product of two feature vectors in some expanded feature space:

( , ) ( ) ( )Ti j i jK x x x x

Non-linear SVMs: The Kernel Trick

Linear kernel:

2( , ) exp( )2i j

x xx x

( , ) Ti j i jK x x x x

( , ) (1 )T pi j i jK x x x x

Examples of commonly-used kernel functions:

Polynomial kernel:

Gaussian (Radial-Basis Function (RBF) ) kernel:

Non-linear SVMs: The Kernel Trick

Nonlinear SVM: Optimization

Formulation: (Lagrangian Dual Problem)

1maximize ( , )2

i i j i j i ji i j

such that 0 i C

The solution of the discriminant function is

( ) ( , )i ii

The optimization technique is the same.

Support Vector Machine: Algorithm

1. Choose a kernel function

2. Choose a value for C

3. Solve the quadratic programming problem (many algorithms and software packages available)

4. Construct the discriminant function from the support vectors

Summary: Support Vector Machine1. Large Margin Classifier

Better generalization ability & less over-fitting

2. The Kernel TrickMap data points to higher dimensional space in order to make them linearly separable.Since only dot product is used, we do not need to represent the mapping explicitly.

Back to the proposed paper

Proposed algorithm parameters

- Bins in histogram: 8- Cell size: 4x4 pixels- Block size: 2x2 cells (8x8 pixels)- Image size: 64x128 pixels (8x16 blocks)- Feature vector size: 2x2x8x8x16=4096

yxGyxGG

yxIyxG

,*101,

hwyxBhwyxC

,,,,,,

otherwisebinyxifyxG

yxkBCf

LPP AlgorithmMain idea: find matrix which will project original data into a space with lower dimensionality while preserving similarity between data (data which are close to each other in original space should be close after projection)

ijjiWSyy 2min

ij xorxofodneighborho

nearestkamongisxorxt

LPP Algorithm

SxWxWSyyW

WijijjiWopt

minarg

minargminarg22

jijii SD

minarg

WXDXWts

WXLXWTT

1WXDXW TT

Is it correct?

Add constraints Can be represented as a generalized eigenvalue problem

wXDXXLX TT Is it correct?

By selecting d smallest eigenvalues and corresponding eigenvectors dimensionality reduction is achieved

Solving different scale problem

Some results

Dimension dD

PCA-HOG features (labeled’ *’) vs LPP-HOG features (labeled ˅’)

Detection example

Conclusions- Fast human detection algorithm based on HOG features is presented

- no information about computational speed is given

- Proposed method is similar to PCA-HOG- feature space dimensionality decreased using LPP- why do we need to make LPP instead of finding eigenvectors from original feature space?- some equations seems to be wrong

- Reference papers are very few

Navneet Dalal “Finding People in Images and Videos” PhD Thesis. Institut National Polytechnique de Grenoble / INRIA Grenoble , Grenoble, July 2006.

Navneet Dalal and Bill Triggs, “Histograms of Oriented Gradients for Human Detection”. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, SanDiego, USA, June 2005. Vol. II, pp. 886-893.

Paisitkriangkrai, S., Shen, C. and Zhang, J. “Performance evaluation of local features in human classification and detection”, IET Computer Vision, vol.2, issue 4, pp.236-246,December 2008

LPP-HOG: A New Local Image Descriptor for Fast Human Detection

Documents

Transcript of LPP-HOG: A New Local Image Descriptor for Fast Human Detection

2. lpp. 5. lpp. 6.–7. lpp. 12. lpp. Rudens ražas laiks Inčukalna novadā Vestis... · 2017-10-19 · №10 (857) 13. oktobris, 2017 Domes lēmumi septembrī 2. lpp. Intervija

Informe_laboratorio_2_ LPP

T-HOG An effective gradient-based descriptor for single line text …cedric.cnam.fr/~thomen/papers/Minetto_PR_T-HOG_final.pdf · 2017-03-24 · T-HOG: An effective gradient-based

Formulation Lpp

Lpp Theory

Manual lpp

Report of the Head of Planning, Sport and Green Spaces › documents › s27916... · LPP 4.4 LPP 5.11 LPP 5.13 LPP 5.17 LPP 5.7 LPP 6.13 LPP 7.6 OE1 OE11 OE3 OE7 New development

Bedienungs-Anleitung Operang Manual€¦ · Kalibrier-Handpumpen LPP 700 / LPP 1000 MANUAL Pressure Test Pumps LPP 700 / LPP 1000 7 Behandlung von Noällen (bei Verwendung des Mineralöls

LPP Formulation

gada balva” 7. lpp. Valsts prezidents viesojas Kuldîgâ · 2016-07-12 · > 3. lpp. Gada skolotâjas > 5. lpp. Nr. 97 Anketa „Uzòçmçju gada balva” > 7. lpp. No septembra

lpp logement

High Level Computer Vision Sliding Window Detection: Viola ...€¦ · - Viola Jones Face Detector - Haar Features - Boosting (cascade) - HOG Pedestrian Detector - HOG descriptor

Manual - LPP

Midwifery Pre-Programme Information - University of Web viewModule Descriptor. Module Descriptor. Module Descriptor. Module Descriptor. Module Descriptor. For AQS use only. Record

Interacción persona-computador basada en el reconocimiento ...€¦ · un descriptor de HOG se deberá comprender antes qué es el gradiente de un píxel y, entonces, se podrá explicar

NOVADA OVADA V...NOVADA OVADA V LAIKRAKSTS PAR IZMAKSĀTAJIEM PABALSTIEM 3.lpp VANGAŽU KULTŪRAS NAMS 4.lpp KARATE ZIŅAS 4.lpp GALDA HOKEJA TRIUMFS 5.lpp DOMES LĒMUMI 3.lpp ŠŠAJAJĀ

LPP Project

2. lpp. 3. lpp. 5. lpp. Jūrmala staro Latvijai · 2. lpp. Pilsētsaimniecība Asfaltē grantētās ielas, atjauno ielu segumu 3. lpp. Latvijas simtgadei “Latvijas Goda aplis”

Transportaion lpp

A Performance Evaluation of Gradient Field HOG Descriptor for Sketch Based