Behavior Detection System VibraImage -...

Behavior Detection System

VibraImage

Manual

Version 10.1

ELSYS Corp.

WWW.ELSYS.RU

WWW.PSYMAKER.COM

Saint-Petersburg

2017

http://www.elsys.ru/

http://www.psymaker.ru/

VibraImage10 Copyright © 2017 by Elsys Corp. All rights reserved.

2

Content

Introduction ................................................................................................................. 5

1 Useful information .................................................................................................... 8

1.1 Basic applications ...................................................................................................................... 8

1.2 System specifications ................................................................................................................ 8 1.2.1 VibraImage system parameters ............................................................................................ 8 1.2.2 Digital (web) camera requirements ...................................................................................... 8 1.2.3 System requirements............................................................................................................. 9

1.3 Package content ....................................................................................................................... 10

1.4 Software specification ............................................................................................................. 10

2. Before you begin .................................................................................................... 11

2.1 Operating limits ...................................................................................................................... 11

2.2 Software installation ............................................................................................................... 14 2.2.1 Digital camera driver installation (*).................................................................................. 14 2.2.2 Guardant dongles driver installation ................................................................................... 14 2.2.3 VibraImage installation ...................................................................................................... 15

2.3 First start of VibraImage system ........................................................................................... 16 2.3.1 Video quality auto checking function ................................................................................. 17

2.3.2 Video Camera’s setting ...................................................................................................... 20

3 VibraImage. Users manual. Basic function. ........................................................ 23

3.1 Multifunction window ............................................................................................................ 23 3.1.1 Basic window design .......................................................................................................... 24

3.1.2 Windows position control ................................................................................................... 28

3.2 Main menu ............................................................................................................................... 30 3.2.1 Menu «File» ........................................................................................................................ 30 3.2.2 Menu «View» ..................................................................................................................... 31 3.2.3 Menu «Settings» ................................................................................................................. 33 3.2.4 Menu «Action» ................................................................................................................... 36

3.2.5 Menu «Help» ...................................................................................................................... 37

3.3 Image area control .................................................................................................................. 38 3.3.1 Choice of the main display mode ....................................................................................... 38

3.3.2 Submenu «Mode» ............................................................................................................... 41 3.3.3 Graph display ...................................................................................................................... 45 3.3.4 Graph analyze ..................................................................................................................... 48

3.4 Toolbar ..................................................................................................................................... 49

3.5 Vibraimage parameters .......................................................................................................... 50 3.5.1 Т1-Т10 parameters ............................................................................................................. 54


3

3.6 Information panel ................................................................................................................... 54 3.6.1 Information panel. VI mode. .............................................................................................. 56 3.6.2 Information panel. M mode. ............................................................................................... 58

3.6.3 Information panel. LD mode. ............................................................................................. 60 3.6.4 Information panel. GR mode. ............................................................................................. 62 3.6.5 Information panel. С mode. ................................................................................................ 65 3.6.6 Information panel. S mode. ............................................................................................... 67 3.6.7 Information panel. DB mode. ............................................................................................ 76

3.7 Saving of measurement results .............................................................................................. 77 3.7.1 Saving of current images .................................................................................................... 77 3.7.2 Saving of video file............................................................................................................. 78 3.7.3 Saving of results and settings files ..................................................................................... 79

3.8 Saving of suspicious person photos and data ....................................................................... 80

3.9 Sending images to a remote server ........................................................................................ 81

3.10 Example of getting images on mobile phone ...................................................................... 82

4 The basic modes of the VibraImage system ......................................................... 84

4.1 Micro mode. Emotions (personality traits) definition ......................................................... 85 4.1.1 «M» mode of information panel ......................................................................................... 92 4.1.2 Psychophysiological state analysis results ......................................................................... 94

4.2 Macro mode. The suspicious people detection in crowd. .................................................... 99 4.2.1 «Macro» mode parameters ................................................................................................. 99 4.2.2 Face detection mode ......................................................................................................... 104 4.2.3 First start and settings selection for Macro mode ............................................................. 106

4.3 LD mode. Lie detection ......................................................................................................... 108 4.3.1 Before starting LD mode .................................................................................................. 108

4.3.2 Switch on LD mode .......................................................................................................... 109 4.3.3 LD working mode ............................................................................................................. 112 4.3.4 Additional settings in «S» information panel ................................................................... 113 4.3.5 Settings in «LD» information panel ................................................................................. 116

4.3.6 Backster’s test ................................................................................................................... 118 4.3.7 Lie detector with questionnaires ....................................................................................... 119 4.3.8 Questionnaires stucture ..................................................................................................... 123

4.3.9 Create new questionnaires ................................................................................................ 125 4.3.10 Psychophysiological detection of deception in semi-automatic mode without

questionnaires ............................................................................................................................ 125 4.3.11 Psychophysiological detection of deception in semi-automatic mode, random questions

................................................................................................................................................... 126 4.3.12 Recording the main test LD results ................................................................................ 127

4.3.12.1 Graphics of psychophysiological state changes ................................................................... 128 4.3.12.2 Recording the main test results .............................................................................................. 131

4.3.13 Ranking mode of reactions to questions ......................................................................... 135


4

5 Operation with external devices ......................................................................... 138

5.1 Operation with EEG ............................................................................................................. 138

5.2 Operation with a fingerprint scanner and registration of the pulse wave ....................... 140

6 Vibraimage. General information ...................................................................... 142

7 Warranty ............................................................................................................... 144

7.1 Disclaimer of Warranties ..................................................................................................... 144

7.2 Limitation of Liability .......................................................................................................... 145


5

Introduction

Welcome to the VibraImage World! Thank you for your purchase of VibraImage

system. This Manual is written to help you enjoy vibraimaging and open new features in well-

known objects!

VibraImage technology measures micromovement (micro motion, vibration) of person by

standard digital, web or television cameras and image processing. Human head microvibration is

linked with the vestibular-emotional reflex (VER) of a person and reflects emotion status and

personality traits. VibraImage system detects human emotions by the control of three dimensional

(3D) head-neck movements and fluctuations, accumulated as frame difference in several video

frames.

Fig.1. Frequency vibraimage of the person Fig.2. External vibraimage around

the frequency vibraimage

VibraImage is a new image type and so primary, as original color image, thermo image or x-

ray image. Each image type gives new and unique information about the object. Every pixel of

vibraimage reflects vibration parameters - frequency or amplitude (fig. 1) of vibration. One frame

visualization of vibration frequency and amplitude named external vibraimage and looks like aura

(vibra-aura) of person (fig. 2). Typically, external vibraimage colors linked with vibration

frequency and external vibraimage dimension linked with vibration amplitude.

The method, system and the device of said VibraImage technology are protected by

the patents of Russian Federation RU 2187904 (fig.3), RU2289310 (fig. 4), RU 2510238 (fig. 5),

RU 2515149 (fig. 6), Software Registration N2006614137 (fig. 7), United States Patent

US 7346227, Korean patent KR 10-1500888 and awarded with Gold medal on the international

exhibition of inventions and innovations Brussels - Eureka 2002 (fig.8)


6

Fig.3. Patent of Russian Federation

RU 2187904


RU 2289310


RU 2510238


RU 2515149


7

Fig.7. Diploma of international exhibition of

inventions and innovations Brussels - Eureka

2002

Fig.8. Certificate on official registrations

Software VibraImage in Russian software

database


8

1 Useful information

1.1 Basic applications

Human emotions control system (further - VibraImage) intends for registration, analysis,

control and research of human emotion, functional and psychophysiological states for different

applications in the fields of security, biometrics, psychology, medicine, electronics and human life.

VibraImage software solves the following targets:

Psychophysiological parameters monitoring and detection;

Emotion recognition;

Lie detection;

Monitoring of person physiological parameters;

Video surveillance in real time by vibraimage and suspicios person detection;

Psychological testing and interview.

1.2 System specifications

1.2.1 VibraImage system parameters

Resolution, TVL, not less 400

Noise level of VibraImage, bit, less than 0,1

Frame rate, f/s, not less 25

Frequency range, Hz, more than 0,1 10

1.2.2 Digital (web) camera requirements

Sensor CMOS/CCD

Resolution, pixel, not less 640 х 480

USB compatible USB 1.0; USB 2.0, USB 3.0, IP

Frame speed, f/s, not less 25

Microphone external (not built-in camera)

Exposition control auto and manual

Color mode color and B/W switch


9

Flicker mode Flicker 50 Hz and 60 Hz

1.2.3 System requirements

Operation System Microsoft Windows better then Windows 7, only 64-

bit version!!!

Processor PC with Pentium Core Duo2 2400 or better

RAM 4096 Мbyte or better

HDD 100 GB or more free space

DVD-ROM DVDRW

USB port 2 free USB ports version USB 2.0

Software DirectX 9.0 or later, Microsoft.NET Framework 1.1,

2.х, 3.5 and better, MS VS 2008 Redistributable

Video capture WDM-compatible video device

Audio audio capture device (support 16-bit data and 44100Hz

stream frequency)

Network LAN 100Mb/s or better

https://www.microsoft.com/en-US/download/details.aspx?id=29


10

1.3 Package content

1. VibraImage DVD disc with software and Guardant

dongle

- 1

2. User’s Guide - 1

3. Digital USB camera (option) - 1

4. Microphone (option) - 1

5. Personal computer (option) - 1

1.4 Software specification

Video source

In directory \Soft\VideoCam utilities to test the functionality of a digital camera (provided it

supplies with a complex) are located. Detailed installation instructions of drivers of a digital video

camera are located on a CD disk of the camera software delivered together with the camera.

VibraImage

In directory \Soft\ the installation package of the VibraImage10.exe program is located. For

start of the program it is necessary to study recommendations about the installation, specified in

the section «VibraImage Program Installation» (see below). Also, the installation kit can be

downloaded from the website http://www.psymaker.com/downloads/Vibraimage10.exe.

Guardant drivers

Before starting VibraImage 10.x, you must install a device driver hardware lock (dongle). In

the catalog \Soft\ Guardant2eng the installation package dongle drivers is located. To run

the program should be read the recommendations for installation specified in the «Guardant dongles

driver installation» (see below).

Note, To install the driver in NT/2000/XP/W7/W8/W10 administrator rights are required!

http://www.psymaker.com/downloads/Vibraimage10.exe


11

2. Before you begin

2.1 Operating limits

Power supplies requirements for hardware

1. Power supply must be 220 V in 50 Hz via an uninterruptible power supply (UPS) with

feedback. UPS capacity should be sufficient for the functioning of the system for at least

20 minutes needed to save the results of analyzing and processing.

2. For low noise and reliable system action the monitor, power units of cameras should be

connected to an electric network through the special sockets having additional ground

contact (the socket of a class 1).

3. For reliable maintenance system the equipment included in complex and the equipment,

taking place in direct near should be certificated on electromagnetic compatibility according

to requirements.

Light exposure requirements

1. Natural illumination of object can be used only if speed of natural light exposure changes of

object does not exceed 1 Lx/s.

2. Illumination of object by fluorescent lamps with illumination in a range 400 - 600 Lx in a

plane of object is preferable.

3. When the system operated in continuous mode the lighting in indoor all time should be

from 400 to 600 lux.

Camera vibration requirements

1. The television camera used for surveillance and-or object on which the camera is

established, should be motionless.

2. Allowable vibration speed of television camera not more than 0,1 mm/sec in the range (0,1-

50) Hz.

Settings VibraImage recommendations

For correct results, you must minimize:

Light sources, fixtures and bright surfaces, windows, etc.

Window, which gets the image from the streets.

Glass surfaces such as walls, which change with the lighting system in the room or on

the street lighting can act as «mirrors».

Light sources with variable lighting (flickering, flashing, etc.) or lighting systems,

which are moved mechanically (subject to vibrations from external factors).


12

Light sources with a unidirectional light, i.e, a person must uniform illuminated from all

sides.

Outside people influence,

The moving objects, sliding doors, people passing by, etc.

Hardware Requirements

1. The resolution of the TV camera should be at least 640x480 pixels, and the rate of input

video frames to a computer for at least (25-30) f/s.

2. Is recommended to use the TV cameras with low noise.

3. After starting the program VibraImage CPU load should not exceed 80 %.

4. The computer's hardware must provide performance rate for real time processing at least 25

f/s captured from the television camera.

Factors affecting the quality of vibraimage

The following factors are taken into account for the correct vibraimage processing:

1. An object (person) has to be well and evenly lit, and normal (black and white or color)

image of a man should be clear and contrasting human face in the frame should be no

smaller than 200 pixels.

2. The person must be in its natural state, when unconscious processes, especially the

vestibular system, determine its movements. It is necessary to exclude the presence of

additional mechanical contact sources (for example, a man leaned against a certain subject,

leaned on the table and leaned his head by hand).

3. Vibraimage Micro mode is designed for the visualization of vibration only one object in the

frame, so the live objects that are close to the main object of study, can significantly affect

and distort the vibraimage of the main subject.

4. There is a certain delay between the current psychophysiological state and vibraimage. The

value of this delay is mainly determined by the selected accumulation time. For example,

when the real system performance 25 f/s and the selected time N=100 frame, the objective

vibration aura of a person can be displayed on the screen is not earlier than 4 seconds after

the person in front of the camera. Therefore, a person must remain in the field of system

camera view for at least 10 seconds.

Note


13

The correct analysis of person emotion levels and lie detection is possible only at detail

execution of the recommendations stated in the given document, and by processing of high

quality vibraimage.

It is recommended to system users to be trained and certification of the user on special

courses and to use of VibraImage, certificated by ELSYS corp.

User of VibraImage system should use the system for research and monitoring of the

psychophysiological state in accordance with the common law and in accordance with the

legislation of the country in which the system is used without violating the rights of the

investigated person.


14

2.2 Software installation

2.2.1 Digital camera driver installation (*)

(*) – Available on request

If the user uses own USB camera, it is need to install drivers for video capture device like

web cam according to it manual.

Note. Restart the system after camera driver installation.

2.2.2 Guardant dongles driver installation

Note, to install the driver in NT/2000/XP/W7/W8/W10 administrator rights are required!

Perform the following steps to install the dongle Guardant driver for NT/2000/XP.

1. Close all other applications to avoid file sharing errors.

2. Run INSTDRV.EXE application from «Guardant drivers» folder «\Soft\Guardant2eng\».

3. When the utility is started, it will check the presence of Guardant driver in the system. If

the driver is not found, only [Install driver] button will be available in the main window. To

install or update Guardant driver click on [Install driver] or [Reinstall driver] button. If

installation is completed successfully, INSTDRV will display a corresponding message and

then return to the main window.

4. If the driver installation is successful, a message box is displayed.

5. Click [OK] to continue.

6. Close INSTDRV application.

7. Restart the system.

8. Connect video capture device and dongle to PC.

9. Run VibraImage.exe

Note

By default the system are installing the driver for 64-bit Windows 7. If necessary, you can

manually install the required driver of folders «\Soft\32\» or «\Soft\64\».


15

2.2.3 VibraImage installation

It is necessary to execute the following actions for installation of VibraImage program on

your computer:

1. Check «System Requirements». NOTE, check the version of DirectX software on your

computer; check installed on your computer MS VS 2008 Redistributable and FrameWork

software.

2. Run Vibraimage10.exe file.

3. Choose language of installation in appeared window.

4. Press button «Next» in the appeared window.

5. Accept the license agreement and to press button «Next» in the appeared window.

6. In the appeared window specify a way to the catalogue where files of the program will be

written down, then to press button «Next».

7. The next two screens allow the creation of a shortcut in the Windows menu «Start» and

VibraImageEx icons on your desktop computer.

8. Press button «Next» in the appeared window, allows installation of software files on your

computer;

9. Press button «Close» at the end of installation.

10. VibraImage program pictograms appears after the end of installation in system menu and

on desktop of your computer

11. Connect dongle to USB port of computer and start. VibraImageEx.exe.

https://www.microsoft.com/en-US/download/details.aspx?id=29


16

2.3 First start of VibraImage system

1. After the first start of the program you will see the program window shown in fig. 2.1.

Fig. 2.1. First program start

2. In menu «Settings» => «Language» select interface language (fig. 2.2).

Fig. 2.2. Select language

3. Once connected to the computer camera in the menu «Settings» = > «Video » (fig 2.3) you

need to select the camera to work (in fig 2.3 − Microsoft Lifecam Cinema camera).


17

Fig. 2.3. Video camera connecting

4. After correct connecting of camera, the image appears on the screen.

5. Perform video camera settings (see. Fig 2.3).

6. Perform quality control of videoimage (see. Fig 2.4) and, if it necessary, eliminate the causes

of low-quality video.

7. Select the directories for recording video information and log files.

8. Get started in accordance with the program description.

2.3.1 Video quality auto checking function

The VibraImage program has built-in automatic quality control function image quality

control during the test. Since the calculation of human reaction using the video image, the quality

control for the processed video is necessary to obtain a correct test result. Error message and the

low quality of video will appear on top of the QT windows (fig. 2.4), but only if the «Quality test»

mode in «S» information panel is switch on.

Program gives error indication if the image quality is lower than standard vibraimage

requests:

Error 1 – indicates when facial image is lower than necessary. For cancel this error is need

to move checked person near to camera or start zoom function on camera.

Error 2 – indicates when camera noise level is higher than necessary. The reason of this

error could be low illumination, incorrect camera settings or camera vibration.

Error 3 – indicates when computer input frame rate is lower than necessary. Requested norm

for processed frame rate is more than 24 f/s. This errors indication was done for deleting

unqualified staff influence during results control.


18

Fig. 2.4. Error message 1 – low quality of image

The size of the person's head image in the picture elements (pixels), which determines the

accuracy of recorded vibrations, requires constant monitoring during testing. When tested with a

video image analysis there are no severe restrictions on the movement of the test person, as required

by the contact method. This person feels natural, which increases the accuracy of test results.

However, the natural behavior can lead to the fact that during the test response deviates

from the camera and the size of the human head image becomes less than required. To resolve this

issue vibraimage system constantly monitors a person's head size of the image and displays an error

message (1) in the window «QT» in the case of reducing the size below the limit. In addition,

vibraimage program includes a permanent face detection algorithm, which ensures elimination of

errors from a lack of a real image of the person in the frame during testing.


19

Fig. 2.5. Error message 2 – low illumination

Temporary noise signal from the video camera includes a video camera noise and

illumination instability and can significantly affect the test results. In this case, at the slightest noise

level exceeds the specified threshold, the system automatically displays an error message (2) in

«QT» window (see. Fig. 2.5).

Despite the fact that the television camera may transmit to 30 f/s with the set resolution, it

does not guarantee that the computer receives and processes the incoming video data in real time.

And any deviation from the information processing in real time resulting in a loss of information

and hence reduce the reliability of the test. By reducing the actual input frames frequencies and

processing frequencies below the set limit, the system automatically displays a warning error (3).

Window «Quality Test» (QT) indicates the time in %, for which the image quality of

100 %. When the quality test indicates 43 % means that only 43 % of the testing time have no

errors, and the 57 % of test time the image quality contained 1, 2 or 3 errors.

Note, before the start of the test should ensure that the program processed the image of a

human without errors.


20

2.3.2 Video Camera’s setting

It is necessary to select in the main menu «Settings» => «Video => «.../name used

camera/...». In figure 2.6 the process of selecting camera «Microsoft LifeCam Cinema» is shown.

If the camera is connected, selected and operated, then on the left of the name there will be an icon

«» (fig. 2.6), and the menu will be extended with the «Video capture filter» and «Video capture

format».

Select «Video capture filter...» in the submenu «Video (fig. 2.7) for open menu of the

camera settings. Item «Video capture filter appears in the menu only in case of the correct

installation of camera drivers and correct choice of operating camera.

Fig. 2.6. Select camera «Microsoft LifeCam Cinema»


21

After a choice of the «Video capture filter...» the window «Settings» will open. Settings

window differs depends on camera type. When adjusting the camera settings, you must fulfill the

following general requirements:

The «Brightness», « Contrast » and others parameters should be configured so that

the image of the object was the maximum contrast.

Switch on «Flicker» mode for setting lighting power line frequency (repayment

flicker), in most countries it is 50 Hz.

If your camera supports, then switch on the black-and- white image «B / W mode».

If the camera works only in color mode, is recommended to set «Saturation»

parameter to minimum value.

Depending on the experimental conditions and light to use automatic or manual

setting «Exposure» parameter. If constant lighting, it is recommended to use the

manual adjustment. If changes (for example, an object depends on the lighting street

lighting), it is better to use the automatic adjustment mode setting.

Parameters «Zoom» and «Focus» is recommended to use in the manual mode and

change their values not due to electronic image processing, but by approaching/

removing the camera from the object.

Fig. 2.7. Open «Video Capture Format» window


22

To open the video recording settings window must be in the submenu «Video» select

«Video Capture format...» (Fig. 2.7). The frame rate is necessary to set 30 as the frame size

(«output size») of not less than 640 x 480 elements. When using larger frames size in the program

need to constantly monitor the speed of the frame to the computer and the processing speed of your

computer.

Note, use free program CamIP for the IP network camera connection

(http://www.psymaker.com/downloads/CamIP_installer.msi). Parameter setting procedure is

described in the CamIp manual http://www.psymaker.com/downloads/CamIP_eng.pdf

http://www.psymaker.com/downloads/CamIP_installer.msi

http://www.psymaker.com/downloads/CamIP_eng.pdf


23

3 VibraImage. Users manual. Basic function.

VibraImage software gathers, records, processes and analyzes electronic images of humans,

biological and mechanical moving objects with various frequency and amplitude of vibration

(fluctuations).

After starting the VibraImage program video images from camera or video file are displayed

in multifunction (basic) window.

3.1 Multifunction window

In heading of the basic window the following information is indicated (see fig. 3.1):

type of video source: Video camera or AVI file;

model of video source: Video camera model or AVI file name;

name of running VibraImage module;

name of the current database record to which there is an operation.

Fig. 3.1. Multifunction window of VibraImage with style «Windows XP»

The program for the user’s convenience have the ability to change the style of the main

elements of the working window. To change the style, use the submenu «View» - «Application

styles» (fig. 3.2.).


24

Fig. 3.2. Style «Office 2003»

3.1.1 Basic window design

In total in the main window of the program in addition to the video area, you can see an

additional 16 windows that display information about the parameters of mental and emotional state

of a person, and program settings (on fig 3.3 the windows labeled corresponding numbers):

1. Toolbar – main toolbar.

2. Toolbar VI – toolbar for different vibraimages mode.

3. VI, M, LD, C, GR, S, DB – information panel windows.

4. Histogram – window for vibraimages parameters histogram in real time mode.

5. LD Question – questionnaire window for lie detector mode.

6. Suspect – human suspect level window

7. Graph – window for parameters graph.

8. QT – image quality window.

9. Image capture – window for «danger» person photo.

10. LDr – lie level window.


25

(2) (4) (3) (1) (10) (5) (6) (7) (9) (8)

Fig. 3.3. Example of all type windows

The user can add or remove the window on the screen using the submenu «View» -

«Toolbar» (fig 3.4.). But for different modes of program operation uses a different set of windows

and the simultaneous presence of all the windows on the screen is redundant.

When select one of the basic operation modes (micro, macro or lie detection) and load its

default settings, the system automatically displays only the necessary for that mode window (fig.

3.5-3.7). Loading of the basic modes setting is performed using the sub menu «Settings» - «Preset».


26

Fig. 3.4. Submenu for windows control

Fig.3.5. «Micro» mode set


27

Fig.3.6. «Macro» mode set

Fig. 3.7. «Lie detector» mode set


28

3.1.2 Windows position control

The user can control the placement of additional windows on the screen and the size using

the controls elements on the left side of each window title. For each window it is available control

menu (fig. 3.8). This menu also appears when you click the left mouse button in finding the mouse

pointer in the desired window. In «Docking» mode, window position and size are fixed, and when

opening/closing the window will open in a given position. The mode «Floating» window position

and size can be changed by the user.

If the window is in a random location on the screen, then double-click the left mouse button

on the window, the window will move on the screen in the «default» position.

Fig. 3.8. Window control element

Each window can be closed, or by using the window menu or by using a separate control

element (fig. 3.9).

Fig. 3.9. Control element «close window»

Each window can be temporarily minimized and moved to the border of the main program

window (fig. 3.10). Figure 3.11 additional windows hided and moved to the border of the main

window and they icons are highlighted in orange color.


29

Fig. 3.10. Control element «hide window»

Fig. 3.11. All additional windows are hide.


30

3.2 Main menu

The main menu contains the following items:

«File»

«View»

«Settings»

«Action»

«Help»

3.2.1 Menu «File»

Menu «File» (Fig. 3.12) contains following items:

Fig. 3.12. Menu «File»

Item «Open…» - is intended for loading new face detection algorithms.

Item «Save settings as …» is intended for saving of the current system settings to

the external file.

Item «Load settings …» is intended for loading before saved the system settings from an

external file.

Item « LD Load text… » it is use in LD mode for loading new LD questionnaire from an

external file.

Item «AVI: Start Capture» - start record AVI-file. If the database folder isn’t specified,

record of AVI files is blocked.

Item «Image capture …» it is intended for saving current frame from area of images in a

folder of archive as BMP a file.


31

Item «Exit» - exit from program.

3.2.2 Menu «View»

Menu «View» (fig. 3.13) defines visible in the basic window information and contains

the following items.

Fig. 3.13. Menu «View»

Item «Toolbar» (Fig. 3.14.)- switches on/off the toolbars and additional functional

windows.

Fig. 3.14. Menu «View», submenu for windows selected


32

Item « Application Look » is applied to change style of working window and its

components (fig. 3.15).

Fig. 3.15. Menu «View», submenu for windows style

Submenu «Mode» defines additional configuration and number of windows with an image

displayed in the image area. Images also can be selected using the corresponding buttons on

the toolbar «Toolbar VI» (on fig. 3.6 at left side).

Fig. 3.16. Windows that appear to the image area.

Submenu «Preset» defines the type of the display image: the real image (mode LD),

vibraimage (mode VI), the aura on the real image (mode AR), the aura on vibraimage (mode AV).

Also, you can configure the corresponding buttons on the Toolbar (fig. 3.7).


33

Fig. 3.17. Buttons and menu items defining type of displayed image

3.2.3 Menu «Settings»

Menu «Settings» (fig. 3.18) contains the following items:

The submenu «Language » contains the list of supported languages (see Fig. 3.19).

Fig. 3.18. Menu «Settings». Submenu «Defaults»

Submenu of «Preset» [Defaults] it is intended for set of system in one of an operating

conditions mode (micro, macro or ld) with set parameters to default value (see Fig. 3.18). Files of

default settings of the basic modes are stored in the catalogue \VibraImage10\defaults\

Fig. 3.19. Menu «Settings». Submenu «Video»


34

Submenu «Video» contains options of video modes. Its can differ depending on connected

devices. For example, this menu contains the following items (fig.3.19). You can choose as video

source one from many installing in PC video-devices or load external video file.

Note, for connection to system of network IP cameras (for example, in figure 3.19 CamIP

RTSP Example) and adjustments of their parameters the additional software CamIP.exe

http://www.psymaker.com/downloads/CamIP_installer.msi is used.

Subitem «Video Capture Filter…» - by pressing the window of video device setting

(contrast, exposition, and brightness) opens. Each device has the especial window of settings.

Subitem «Video Capture Format…» - change video capture format.

The subitem «RGB8 compressor» is intended for management of a video file record

format. If this item chosen, for economy of a space on a hard disk, the video file saved in a black-

and-white format.

The subitem «Disconnect» allows disconnecting all video camera or video file.

Subitems «AVI File…» and «AVI File (no sound)…» are intended for selecting for

the analysis of an external video file. The file can be loaded with a sound and without sound.

The operation mode without sound is used for VibraSound creation.

Submenu «Video mask» (in development) (Fig. 3.20) allows to edit video data. If in

the field of supervision there is an additional mobile object which prevents measurements of

the basic object. In «Edit mode», you can cover «black» mask on addition object image. Also you

can reset current mask («Reset Video mask» mode), save mask in external picture file in BMP

format («Export Video mask» mode) and load external mask («Load Video mask» mode).

Note. Don’t forget turn off «Edit mode» after masking. Otherwise, any click of the mouse

in the image will continue masking!

http://www.psymaker.com/downloads/CamIP_installer.msi


35

Fig. 3.20 Mask mode using

The item «Mitsar EEG» (in development) used in case of connection of the Mitsar-EEG

electroencephalograph. Then there is a possibility to display graphs of change in time of signals

from electrodes (EEG-x) (details in the point 5.1).

The item «DC21» (in development) used for work with fingerprint scanner. Thus, data from

the fingerprint device displayed in graphs (details in the point 5.2).

Item «Lock system» (in development) used to lock of all toolbar buttons from stray

keystroke. To unlock the system, press the icon VibraImage « » in the top left corner of the

screen.


36

3.2.4 Menu «Action»

Menu «Action» (Fig. 3.21) contains following items:

Fig. 3.21. Menu «Action»

Item «Pause» - stop last accepted frame of data in image area of windows.

Item «Reset» - reset all saved up information and statistics about frames and start new cycle

collection of information.

At work the program fixes an operating time with object of research, and in case of work

with AVI a file - time from the beginning of record. Having chosen item «Reset timers» (or

corresponding toolbar button), it is possible to reset in 0 counter of the current operating time, and

at work with AVI a file - to begin viewing record with the beginning.

At a choice of item «Measurement» (or corresponding toolbar button) the system makes

accumulation, averaging and a display of parameters for the specified time period. The results

display is made in the information panel in a mode «M». In the same place in seconds value of

the averaging period «Duration» is set.

Item «Start H 10s » are intended for accumulation and viewing of the frequency

information about psycho-emotional condition of person for 10 seconds. For viewing results it is

necessary to open sheets «H» in the basic window.

Item «Start LD block» (or corresponding toolbar button) begin calculation of parameters of

a lie level in a «manual mode». It is necessary to press this button again to stop calculation in a

manual mode. The moment of start calculation in a manual mode noted on graphs by a vertical

green line, the moment of stop calculation - by red line).

The item «Markers» used at work with graphs and intended for draw on graphs the markers

(0-9) and markers of questions (RQ, CQ, GQ).


37

3.2.5 Menu «Help»

Menu «Help» (fig. 3.22) is in the main menu contains following items:

Fig. 3.22. Menu «Help»

Item «About VibraImage…» is intended to view the software version, the registered user

name (Owner), the key number protection (Serial) and expiry date of the license (Limited)

(fig. 3.23).

Fig. 3.23. Information about VibraImage and its users


38

3.3 Image area control

VibraImage system allows the processing of a «live» (online) video signal from the camera,

and the video data previously recorded and stored as AVI- file. By default, the system works with

the signal from your video camera. Switching between modes are doing through a toolbar buttons or

through the system menu « Settings - Video... »

Selecting an external video file via the file selection window, caused by using the command

« AVI file... » submenu « Settings - Video...». Additionally, an external video file can be loaded

without sound using «AVI file (without sound)... » command. This mode recommended for

working with VibraSound.

The main window of the basic VibraImage.exe module configured for observations in

several operating modes. The choice of an operating mode made in the item «View» of the main

menu (fig. 3.24).

Fig. 3.24. Menu «View» for set working mode

Pause/start output of the current image is performed using the « Pause » command menu

«Action», or by using the corresponding toolbar buttons.

3.3.1 Choice of the main display mode

In the field of the image area (see fig. 3.25 – 3.27), depending on the chosen mode, the user

can see the «real» video image, vibraimage, external vibraimage (aura), or external vibraimage on

real image.


39

Item «Presets» menu «View» (Fig. 3.26) intended to choice one basic mode in image area.

In «VI» mode[«VibraImage mode»] displays vibraimage of person. Color for every

image pixel depends on its amplitude or frequency of vibrations (fig. 3.25, 3.26).

In «AV» mode[«Aura - Vibraimage mode»] the contour of the object allocated

around the vibraimage. Vibra-aura line size depends on medium line vibration

amplitude. Vibra-aura line color depends on maximum line vibration frequency inside

vibraimage contour (fig. 3.26, 3.27).

In «AR» mode[«Aura on the Real image»] the vibra-aura of the person is shown

around his real image (fig. 3.27).

In «LD» mode[«Lie Detector mode»] image area shows real object image.

Fig. 3.25 VI mode.


40

Fig. 3.26 AV mode.

Fig. 3.27 AR mode.


41

3.3.2 Submenu «Mode»

Item «Mode» (fig. 3.28) selects additional settings of information in image area. All items in

this submenu also duplicated in the additional toolbar (see fig. 3.28, left panel). Disabling the menu

item «Toolbar VI», the user can remove the screen that extra toolbar.

Fig. 3.28. Submenu «Mode»

Note

Pressed buttons in toolbar correlated with windows in the area of images (fig. 3.29).

The maximum number of windows equal 13. To delete a window with the set image processing it is

enough to let off the corresponding button the of « Toolbar VI » panel.

Note, when approaching the mouse pointer to one of the images on the screen may be

displayed help list indicating the display mode of the window. Enable/disable output tips made in

the menu « View » - « Mode» in item « Tooltips » (see fig 3.29.). If you switch on the « Title »

menu item than in the upper left corner of each image window will display the name of his mode.


42

Fig. 3.29. Display concurrently multiple images windows with different processing methods

In «SRC» mode (the button ) shows source video from camera without processing

(fig. 3.30). It is additional possibility to display the aura on the real image of person

constructed on the analysis of pixels vibration amplitude (the button ) or frequency

or pixels vibration frequencies (the button ). The length of the beam vibra-aura in

this case will be determined by the average value of the points parameter in a row, and

the color of the beam vibra-aura – by the maximum value.

In «VI (2 Am)» (the button ) and «VI (2 F)» (the button ) modes display

vibraimage, processed during 2 frames and constructed on the basis of amplitude Am

and frequency F analysis of vibration. It is additional possibility to change color of

background image and to add vibra-aura to vibraimage (fig. 3.31).


43

Fig. 3.30. Select mode of processing image

In «VI (10 Am)»(the button of the toolbar) and«VI (10 F)»(the button of

the toolbar) modes display vibraimage, processed during 10 frames and constructed on

the basis of amplitude Am and frequency F vibration analysis. It is the additional

possibility to change color of a background image and to add aura to vibraimage. The

same result is possible to receive if to bring the mouse pointer to a window of the

chosen image and to press the right button of a mouse (fig. 3.31).


44

Fig. 3.31. Example, three type of images display. Switch on mode AR(F) and VI (10 F).

In «VI (N Am)»(the button of the toolbar) and«VI (N F)»(the button of

the toolbar) modes display vibraimage, processed during N frames and constructed on

the basis of amplitude Am and frequency F vibration analysis. The number of frames,

corresponding to parameter N, is set in «VI» information panel. It is additional

possibility to change color of background image and to add aura to vibraimage.

In «Delta Am»(the button ) and«Delta F»(the button ) display frame

difference on the basis of amplitude Am and frequency F vibration analysis in base

processing mode without filter preprocessing. It is additional possibility to change color

of background image.

Note. In this mode the vibra-aura will be based on the vibraimage which has been

accumulated for N frames!

In «View mode Delta FA»(the button ) and «View mode Delta FA»(the button

) modes display frame difference on the basis of amplitude Am and frequency F

vibration analysis in fast processing mode without filter preprocessing. It is additional

possibility to change color of background image.


45

In «mode Am» visualization and calculation of object parameters processed by pixel

vibration amplitude.

In «mode F» visualization and calculation of object parameters processed by pixel

vibration frequency.

3.3.3 Graph display

Selecting item «Graphs» submenu « View » - « Toolbar » switch on/off graph windows with

display changes in time vibraimages parameters (see fig 3.32).

Fig. 3.32. Graph windows display

Selecting, changing of some parameters will be displayed in the graphs make in the

information panel in the «GR» mode. To display the graph of the parameter in the graph window

you want to switch on the item « Display » = YES (see Fig. 3.33).

The number at the beginning of each graph shows the current value, and the two digits at the

end of the current graph show minimum and maximum value for the interval over which the

automatic adjustment scale on the Y-axis (vertical) is done.

Scale the output of the X-axis plots (horizontal) given in the «Graph»:


46

Parameter «Period (s)» sets in seconds time of display of a graph part on the screen.

Note, At viewing video file double click by mouse on the button changes value

«Period» so that on the screen the time axis corresponded to full length of video file.

Scale output on Y-axis (vertical) is determined for each graph separately in one of two

modes:

If using mode «Auto» = YES, the vertical scale is automatically calculated.

If using the manual mode «Auto» = NO, the scale of the output of each individual graph

on the Y-axis set parameters gMin (minimum value displayed on the screen) and gMax

(maximum value displayed on the screen), which the user must set yourself.

Fig. 3.33 Example, graph parameters for A1(fast).

Note (in development)


47

It is possible to playback recorded information (from AVI files) with graphs on the screen in

image area. For this purpose, it is necessary to execute the following actions:

Switch on «Graphs»;

To bring the mouse pointer to interesting time on a time axis and twice to click the left

mouse button.

When you select a show mode of plots «Diff. mode» = YES on the graph will be displayed

not the absolute value of the parameter (mode «Diff. mode» = NO), and the difference between the

current value of the parameter and its average level in the previous measurement. The

«Averaging (s)» parameter in this case sets the number of seconds for the interval by which

averaging parameter values change.

In the draw, the parameter values changes on the screen, the user can use two display modes:

No pre-filtering values («Graph2» mode = NO).

With advanced filtering parameter («Graph2» mode = YES). In this case, the parameters

«HF.flt.» and «LF.flt.» is set in% of the incoming frequency the filter cutoff frequency

for high (low) frequency for Battervort.

At the same time for easy viewing in the Histogram window displays three windows with

the results of the frequency analysis (see fig. 3.34). The first screen displays the frequency analysis

vibraimage across the frame (red - amplitude, green - frequency of points vibration). In the second

window displays the traditional frequency analysis in 1 second human vibraimage, and the third -

the results of frequency analysis (with the use of the Fast Fourier transform) to change in time of the

two options that are selected in the «GR» information panel. Each parameter has the following

settings:

«Green» - Spectrum Fourier parameter changes in time displaying graphs of green

color in the third window;

«Red» - Spectrum Fourier parameter changes in time displaying graphics red color

in the third window.

Fig. 3.34. Histogram window


48

3.3.4 Graph analyze

Item «Start H 10s » are intended for accumulation and viewing of the frequency

information about psycho-emotional condition of person for 10 seconds. For viewing results it is

necessary to open sheets « H » in the basic window (see fig. 3.35).

Fig. 3.35. Frequency analyses results

Note, the results of frequency analysis are automatically saved in the selected file folder in

the file Data_histH.png.


49

3.4 Toolbar

All toolbar buttons (fig. 3.36) duplicated the corresponding items in the menu system. When

the tool tip determines the assignment of toolbar buttons. Note, the selected toolbar button is

highlighted in color or volume, depending on the main window style.

Fig. 3.36. Toolbar.

- «Save current image» (Menu «File»);

- «AVI: Start Capture» (Menu «File»). For stop AVI files recording needs push on

this button again;

- «Open AVI file» (Menu «Settings»);

- Camera – image from camera;

- «Stop/Start» (Menu «Action»);

- «VI» mode (Menu «View»);

- «AV» mode (Menu «View»);

- «AR» mode (Menu «View»);

- «LD» mode (Menu «View»);

- Reset timer of video files to «0» (Menu «Action»);

- Reset all accumulated information about frame difference. Start accumulation

again after reset (Menu «Action»);

- «Measurement» mode of accumulation and averaging of parameters for the

certain period (Menu «Action»);


50

- «Start LD mode» to begin/stop data processing for a «Lie detector» mode (Menu

«Action»);

- «Markers RQ, CQ, GQ» are used in Lie detection mode and serve

for installation markers on graphs at the time of «certain» type questions;

- button which allows to open the database folder where you saved the images and

all results.

3.5 Vibraimage parameters

During the work VibraImage program calculates the following parameters:

The group of parameters A1-A4 registers amplitude of vibrations:

А1 – Frame difference between two consecutive frames

А2 – Frame difference accumulated in 10 consecutive frames

А3 – Frame difference accumulated in N consecutive frames

А4 – Value of parameter A1 filtered on 10 frames

The group of parameters F1-F9 registers frequency of vibrations (amount of changing points):

F1 – Calculated value of changed signal pixels amount in 2 consecutive frames:

F1 (fast) Calculated value of changed signal pixels amount in frames

difference in fast processing mode

dF1 (fast) The average value of changes in the quantity of elements (the

increment) for F1 (fast) parameter

F2 – Averaged value of changed signal pixels amount in 10 consecutive frames

F3 – Average value of elements quantity which have changed for the period of N frames

F4 – Changed pixels maximum frequency during N processed frames

F5 – Current tension level (%). Ratio of «high» frequency density to «low» frequency

for parameter F1. Its speed of element changing in frames difference.

F5

(fast)

The average value of the rate of elements change in the fast processing mode

calculation

F6 – Inhibition parameter. Average value of the F1 parameter period (in seconds),

determined during period F6N. Value of parameter F6N is set in section [Filters]

an «S» information panel and defines quantity of the frame processed in Fast

Processing mode


51

F7 - Root-mean-square deviation for F6 parameter

F8 - Not average (current) value of F6 parameter (in seconds), showing the current time

period of F1 parameter changing

F9 - Neuroticism parameter

The group of parameters S1-S7 registers symmetry of vibrations between left and right parts of

person body:

S1 – Ratio (symmetry) of amplitude left to the right changed pixels inside the object in

2 consecutive frames

S2 – Difference between the left and right average amplitude of object vibration in

10 frames

S3 – Difference between the left and right average amplitude of object vibration in

N frames

S4 – Ratio of the changed pixels quantity in the left part of object to the changed pixels

in the right part in 2 consecutive frames

S5 – Ratio of the changed pixels quantity in the left object part to the changed pixels

quantity in the right object part calculated in 10 frames

S6 – Ratio of the changed pixels quantity in the left object part to the changed pixels

quantity in the right object part calculated in N frames

S7 – Difference between the maximal frequency of vibrations of the left and right object

parts in N frames

The group of parameters P1-P28 registers features of mathematical Processing of vibrations:

P1 – Dispersion of vibration density for frequency distribution at 10 processing frames

P2 – Dispersion of vibration density for frequency distribution at N processing frames

P3 – Center density distribution displacement of frequency at 10 processing frames

P4 – Center density distribution displacement of frequency at N processing frames

Р5 – Level of lie

Р6 – Level of stress. P6A – calculation of parameter is executed on vibration amplitude,

P6F – on vibration frequency.

Р7 – Level of aggression.

P7A – calculation of parameter is executed on points vibration amplitude,

P7F – on points vibration frequency.


52

Р8 – Level of energetic.


P8F – points vibration frequency.

Р9 – Level of information entropy (on base of Shannon theory).



Р10 – Entropy index.



P11 – Antikurtosis (æ). Information theory parameter characterized density distribution

form.

Р12 – Level of classic thermodynamics entropy (on base of Helmholtz theory).



P13 – Characterizes shift of the histogram in the right part (high frequencies). Thus,

parameters define color of active vibraimage pointer. Vibraimage pointer is active

if its brightness move than «Level L» value.

P14 – Control parameter. Define relation between area of active vibraimage pointer for

install threshold of active vibraimage pointer («Level S» parameters). Thus if the

number of active points grows, than the parameter value increases and danger level

also increases.

P15 – Control parameter. Define relation between area of active vibraimage pointer for

full frame square. Vibraimage pointer is active if its brightness move than

«Level L» value.


53

P16 – Compatibility for 2 person. Calculated on frequency histogram analysis

(concurrence with normal distribution) (fig. 3.37, 3.38). If the frame one person - it

parameter «Balance».

P17 – Compatibility for 2 person. Calculated on aura symmetry analysis. If the frame one

person - it parameter «Charm».

Fig. 3.37. Correct position of people at

check of compatibility.

Fig. 3.38. Incorrect position of people at

check of compatibility.

P18 – Average compatibility by P16 and P17 parameters. 5 gradations are distinguished:

love, sympathy, indifference, hostility, hatred. If the frame one person - it

parameter «Selfregulation».

Р19 – Suspect level

Р20 – Quantity indicator of a degree of change psycho physiology parameters in view of

various factors of the measured parameters importance since the part of parameters

is accelerated, and others are slowed down during one reaction.

Р21 – Parameter «Health» (Health level for general oncology).

Р22 – Parameter «Health» (Health level for prostate oncology).

Р23 – The average of the «Health» (Mean value of health level).

Р24 – Parameter «Sleepiness» is normalized value of the P17 to the parameter F3.

Р25 – Characterizes a sleepiness state of a person on variability of parameter P17.

Р26 – Extraversion level

Р27 – Stability level

Parameters X1-X5. In VibraImage program, the user can form itself formulas for

calculation of new parameters of vibraimage, using any vibraimage parameters listing

above.


54

3.5.1 Т1-Т10 parameters

For improvement of calculation, analysis and data compatibility vibraimage includes

additional complex T1 - T10 parameters having psychophysiological sense. Complex vibraimage

parameters represent psychophysiological information about a person and informative component

of these options depends not only on calculation algorithms, but also depends on targets and

conditions of vibraimage system applications. For example, under different test conditions (state of

rest, stress, movement…), the same parameters can provide information about the physiological and

psychological state of a person, as well as the suspicious level of person.

The set of parameters T1-T10 is selected so that a maximum information records all

micromotion human head. In this case, the name of each parameter Ti characterizes various

physiological characteristics depending on the vibraimage system application. The name is not

primary characteristics for said vibraimage parameter, it can be considered as suppositive and the

formula by which this parameter is determined has more correct sense. Despite the suppositive

names, given description uses the following (historically developed) range of parameters:

Т1 – Aggression (Р7);

Т2 – Stress (Р6);

Т3 – Tension/Anxiety (F5X);

Т4 – Suspect (Р19);

Т5 – Balance (Р16);

Т6 – Charm (Р17);

Т7 – Energy (Р8);

Т8 – Selfregulation (Р18);

Т9 – Inhibition (F6);

Т10 – Neuroticism (F9).

3.6 Information panel

Indication of information panel (fig. 3.39) depends on using mode:

Fig. 3.39. Information panel tables menu

In the mode information about adjustments of system and results of data

vibraimage processing is displayed;

In the mode settings for LD the mode parameters are displayed;


55

In the mode the average values of vibraimage parameters which have been

calculated and are average for the certain period are displayed;

In the mode the correlation parameters are configured;

In the mode vibraimage parameters selected for graphs are displayed and stood;

In the mode settings of basic parameters for work with VibraImage are configured;

In the mode input and selection of the demographic information and a folder for

archive storage is configured;

Note, Values of parameters in fields which are allocated by a green font, can be changed by

the user (Fig. 3.40, parameters N, K, L - it is possible to change in Information table). For this

purpose, it is necessary to bring the mouse pointer to the chosen field and twice to click the left

button of a mouse.


56

3.6.1 Information panel. VI mode.

In the «VI» mode, information panel (fig. 3.40) displays following information:

Frame rate:

«In» – Number of the frames per second, received from the video source;

«Fast processing» – Maximum number of the processed frames per second used for

calculation. Selected by user;

«Base processing» – Number of the processed frames per second used in base algorithm.

Selected by user;

«Video Timer» – For camera mode- displays time of supervision. For recorded video - time

of current video-file record. For viewing a video-file - time from the file beginning);

«Stream errors» – The counter of mistakes which increases if time between the next

accepted frame astably. This mistake can arise, if productivity of a computer suffices or

poor-quality video is loaded;

Info:

N - Number of the frames for accumulation. Selected by user;

L – Palette Threshold. Defines a threshold in the displayed image, value of brightness less

threshold is considered «black». Selected by user;

Width and Height – Displays the current video camera or AVI file resolution;

Statistics:

IntegratedN(Am) – Average frame amplitude vibraimage intensity processed for the

N frames;

IntegratedN(f) – Average frame frequency vibraimage intensity processed for the N

frames;

«Critical level %» – Threshold of a psychoemotional status of the person exposed in % in

case of which exceeding on the remote terminal the warning message will be issued;

«Suspect» – Calculated level of suspect for object in frame;

«Aggression» – Calculated level of anger for object in frame;

«Stress» – Calculated level of stress for object in frame;

«Tension» – Calculated level of tension for object in frame.

Audio:

«Level» – current level of audio signal.


57

Fig. 3.40. Information panel in the VI mode.


58

3.6.2 Information panel. M mode.

In «M» mode an information panel (fig. 3.41) detects current and average for the period

values of psychophysiological parameters and their deviation from the established norm. The basic

targets of the given mode are use of vibraimage system for medical (physiology) diagnostics and

psychological researches and testing.

a) current info b) detail info

Fig. 3.41. M mode of information panel

Value of the averaging period is set in seconds in a field «Duration». Start of the beginning

of information accumulation is made by a choice of item «Measurement» the menu «Action» or

pressing of the toolbar button . After start of an accumulation and averaging mode in the top

of information panel there is a running line «Progress», displaying a course of data accumulation

process.


59

Information panel in «M» mode shows the following information:

Basic T1-T10 parameters describing psycho-emotional condition of the person:

Aggression, Stress, Tension/Anxiety, Suspect, Balance, Charm, Energy, Self-regulation,

Inhibition, Neuroticism.

VibraImage parameters A1-A4, F1-F9, S1-S7, P1-P4, Р21-Р27.

Fast processing VibraImage parameters A1 fast, A4 fast, F1 fast, F5 fast.

For each parameters displays the following numerical values:

V - The value of the parameter average for the set period

S - Root-mean-square deviation of parameter

VI - The variability of the parameter over a specified period

cMin - The minimal value of parameter for the period

cMax - The maximal value of parameter for the period

NMin - The minimal value of parameter for a normal condition of the person

NMax - The maximal value of parameter for a normal condition of the person

Note

Values of cMin, cMax parameter, are displayed only when measurement mode «M» has

been began and the information for the specified period is saved up.

Note, after ending of the information accumulation some lines of an information panel

allocates by color:

– parameters, which values less than the set limits are allocated.

– parameters, which values more than the set limits are allocated.


60

3.6.3 Information panel. LD mode.

In the mode «LD» information panel (see fig. 3.42) defines the basic «lie detection»

information processing mode and displays the following information :

VibraImage parameters A1-A4, F1-F9, S1-S7, P1-P4;

Fast processing VibraImage parameters A1 fast, A4 fast, F1 fast, F5 fast;


V – Current parameter value

cMin – The minimal value of parameter for the period

cMax – The maximal value of parameter for the period

bMin – The average basic minimal value of parameter for a normal condition of the

person

bMax – The average basic maximal value of parameter for a normal condition of the

person

Note

Values of cMin, cMax, bMin and bMax parameter, are displaying only when «LD mode»

has been began. In other case that value equal «0».

For each parameters set following numerical values, which using in Lie detector calculation:

Calculate Yes - this parameter using in LD level calculation, No - not using.

R1V «Weight» of parameter (Rate1) if its current value became more than

the set base maximum bMax OR became less than the set base

minimum bMin. Use in Р5 parameter calculation.


the set base maximum bMax AND became less than the set base


R1C «Weight» of parameter (Rate1) if its current value became more than






Level In % determines on how many value of parameter should exceed the

set limits that the system «considered» this change.


61

Fig. 3.42. Information panel in LD mode. Explanation of the parameters bMax, bMin, cMax, cMin.


62

3.6.4 Information panel. GR mode.

The «GR» information panel (see fig 3.43) allows you to customize the output graphs of

parameters changes and displays the following information:

Fig. 3.43. «GR» mode of information panel.

«Graph» section

«Period (s)» - define graphs visualized period (in seconds) on the screen;

«Average (s)» - specifies the number of seconds in interval by which averaging

parameter values is made;

Test signal sin(2π*nt).

«Integral» section

Total intensity of the points oscillation amplitude across the frame, accumulated over 2,

10 and N frames: Integrated2(Am), Integrated10(Am), IntegratedN(Am);


63

Total intensity of the points oscillation frequency across the frame, accumulated ove 2,

10 and N frames: Integrated2(F), Integrated10(F), IntegratedN(F);



Corelation parameters С1-С4;

User programming parameters Х1-Х5;

For each parameters displays the following values and settings:

V Current value of parameter.

Show Show graph -Yes, delete graph - No.

Graph2 Graph2=Yes – graph line will show with using filters.

Graph2=No – filter no used.

Diff. mode Choice of this mode-YES, graph will show difference between

current value of parameter and its average level for Diff time.

Choice of this mode-NO, graph will show current value of

parameter.

Auto When the parameter set «Yes», calculation of the scale on the

Y-axis of the graph make automatically.

gMin Defines the minimal value of parameter shown on the screen.

gMax Defines the maximum value of parameter shown on the screen.

HF.flt.% The filter of high frequencies on Battervort. Frequency of a cut

is set in % from entering graph frequency.

LF.flt.% The filter of low frequencies on Battervort. Frequency of a cut

is set in % from entering graph frequency.

GR Selected parameter displays in down spectrum histogram by

green graph (fig. 3.44).

Red Selected parameter displays in down spectrum histogram by red

graph (fig. 3.44).


64

Fig. 3.44. FFT diagram


65

3.6.5 Information panel. С mode.

Information panel in «C» mode (fig. 3.45) allows setting the mode «Corelation» and

displays the following information:

For correlation between parameters calculated on base Pearson method. If one of parameter

is selected in his line draw field. Select this parameter to check the correlation performes by

double-clicking the left mouse button over this field.

Fig. 3.45. «C» mode of information panel.

«Settings» section:

«Enable correlation» - defines the switch on/off «C» mode;

«Mediane» - define what parameter value (average or mediane) will use in correlation

calculation;

«Period» - defines what period occurs correlation parameters;

«Auto shift» - determines the maximum shift in time not influencing correlation

coefficient;

«Sort» - allows you to rank display parameters of the maximum current value of the

correlation coefficient to a minimum;


66

«HF.flt», «LF.flt» and «Average flt» - defines mode for the additional processing

(filtering) of source data before calculation.

«Correlation» section:

Total intensity of the points oscillation amplitude across the frame, accumulated over 2,

10 and N frames: Integrated2(Am), Integrated10(Am), IntegratedN(Am);

Total intensity of the points oscillation frequency across the frame, accumulated ove 2,

10 and N frames: Integrated2(F), Integrated10(F), IntegratedN(F);



Test signal sin(2π*nt);

Corelation parameter С1-С4. Frame is divided into four zones and parameter estimation

is performed between zones. For example, when using mobile versions VIMobile

estimated background vibration (vibration due to human brush), and the man himself

vibration;

User programming parameters Х1-Х5.


67

3.6.6 Information panel. S mode.

Information panel in «S» mode (fig. 3.48) allows adjusting vibraimage parameters and

displays the following information:

Frame rate

Fast processing Frequency (fps) for processing «fast» parameters of vibraimage,

noted by a word «fast».

Base processing Frequency (fps) for processing «base» parameters of vibraimage,

noted by a word «base».

FPS proc.period Frequency of the frames (fps) during calculation period.

Downrate Reduce input frame rate. At value 3, will be processed every

third frame.

Main settings

N(2) Minimum number of accumulated frames. By default, 2.

N(10) Average number of accumulated frames. By default, 10.

N Maximum number of accumulated frames. By default, 100.

K Gain factor.

L Threshold of a palette. Defines a threshold of displayed image,

value of less brightness considers as «black».

Apply global filters If this parameter is «Yes», than others parameters calculated

with filtering.

Filters

Single points Removes single points, surrounded by black.

Extended Intendes for reduction of noise of a video camera. Delete video

noise in bit. By default, 8.

This filter is important, when the object is motionless, and values

changed because of camera noise.

Extended (fast) Delete video noise for fast processing.

Stretch Scale normalization filter to a range 0-255 after its «trimming»

by filter Extended.

Max speed contour At the included mode, calculation fast parameters are done only

inside of aura contour, at switched off - on the whole frame.

Am scale Multiplication factor used for vibraimage visualization in a


68

«amplitude» mode.

Space Reduce vibraimage on borders of motionless contrast objects.

Color image No – Black and white real image in image area. Yes – color

image in image area.

Crops

Crop X, Crop Y If real image size more than 640x480 pixels, than will be use

only 640x480 pixels from centre part of image.

Crop X pos, Crop Y pos When cropping images define the coordinates (the position of

the upper left corner) the clipping region.

F6

F6 HF Sets in % frequency of a cut for the filter of high frequencies at

processing F1_fast parameter.

F6 LF Sets in % frequency of a cut for the filter of low frequencies at

processing F1_fast parameter.

F6 N Number of averaging frame at calculation of F6 parameter.

FPS filter Used for exact synchronization with a binding to the concrete

frame at work with Avi files. Frequency of the input frame from

the camera divided on set Base processing frequency and for

processing will undertake each N frame.

E-Monster Switch to the E-monster mode. The program opens the person

face deformed by latent emotions though externally he can

constrain these emotions. If the emotional condition of the

person is like to normal, then the the program image is like to

real video. Accordingly, than more emotions overflows the

person and then more especially deformed his image in Monsters

Detector mode (E-Monster) (fig.3.46).


69

Fig. 3.46. Face in E-monster mode

Auto downrate Automatic calculation of Downrate parameter is done in view of

frequency of the input frames, Base processing frequency and

computing capacity of a computer.

Fixed contour In this mode, vibra-aura around the human contour builds around

a fixed path, and not to repeat the contours of the body.

Stab. Х Image stabilization in the X coordinate entered when significant

vibrations image on the X-axis.

Stab. Y Image stabilization in the Y coordinate entered when significant

vibrations image on the Y-axis.

Suspicious thresholds

Ag, St, Tn

Suspicious level in the Aggression parameters (Ag), «Stress»

(St), «Tension» (Tn) is set. When exceeding level of danger the

system gives out a sound signal and fixes a frame.

Disable Note: Canceling of parameter calculation is use for increase

calculation speed of other parameters.

Disable Am Canceling of vibration amplitude calculation.

Disable F Canceling of vibration frequency calculation.

Disable 2x(fast) Canceling of 2 frames parameters fast calculation.

Disable VI(10) Canceling of 10 frames parameters calculation.

Disable VI(2) Canceling of 2 frames parameters calculation.

Disable FFT Canceling of Fast Fourier Transformation frequency processing.

Disable Entropy Canceling of Entropy processing.

Disable Audio Canceling audio analysis.


70

Motion detection

Motion detector Delete emotion calculation for object with motion amount less

than threshold.

Level Threshold level of Integrated10 for emotion calculation.

Auto reset Reset emotion calculation for macro movement.

Skip frames Skip frames with the frame difference more than threshold.

Lie detection

Enable Enable LD mode.

Stat periods Before you begin the process of «lie detection» system during

the «Base period» (in seconds) collects information to

determine the maximum and minimum current values of human

parameters that then at «lie detection» time during the «Stat

period» define «abnormal» change individual values

parameters.

Base periods

Lie threshold Threshold (in %) for the detection of lie level in view of every

calculated parameters and their «weights».

Audio sens. (s) After the ending of answer, the system continues to expect «lie»

calculation during the specified time interval.

Audio level The sound level used to start / stop lies detection process in the

«Audio» mode.

Opposite mode Alternative method of lie level calculation.

LD mode: Selection of mode for lie detection.

Audio Calculation of lie level starts when the level of entrance audio

signal exceeds the established threshold. LD calculation stops,

when the level of audio signal becomes less than the established

threshold

Manual Accumulation of the information is made in time «Base

periods». Calculation of lie level is made only after pressing

button «Start LD» , the end of processing - after repeated

pressing this button.


71

Auto Calculation of a lie level works constantly, current values of

parameters (Stat period) are compared to values processed for

previous Base period.

Compare Off - at the analysis of lie, as test, the interval «Base periods»

directly till the moment of started lie detection is used.

On - at the analysis of lie, as test, the interval «Base periods»

which has been marked by the user beforehand is used. When

the user includes accumulation the preliminary information, in

this field value «Capture».

Text Switch on/off display «text questions» in «LD Question»

window.

AVG filter

Anger Number of frames for aggression level averaging.

Stress Number of frames for stress level averaging.

Tension Number of frames for tension level averaging.

Suspicious Number of frames for suspect level averaging.

Macro mode

Macro mode Define on base of which formula danger level calculated. NO –

danger level calculated on base of Anger, Stress and Tension

levels. YES – danger level calculated on base of P13, P14 and

P15 parameters values.

Level L Threshold of a palette for danger calculation only (not for

displayed image. threshold of displayed image define parameter

L). Value of less brightness considers as «black» and not used in

danger calculation.

Level S Threshold of a area (in % from full frame square). Defines area

of «active brightness» pixels. If area of pixels (in %), which

brightness more than «Level L» value, less than «Level S»

value, than danger parameters in Status window equal 0.

Aura mode Reserved for future use.

Macro mode + Yes - the danger level is considered for every single person in

the frame.

No - the danger level is averaged over the entire frame.


72

Face detection

Face detection Yes – face detection mode is used. No – without face detection.

Detection quality Quality of face capture. 1 – capture one large person face in the

frame (loading of the processor is minimal), 4 – search of all

(even small) persons face in the frame (loading of the processor

is maximal).

Scale 1: X Sets the aspect ratio of the picture before detection of persons.

Min size

Max size

Sets in pixels the size of rectangle for search of persons.

Config The program gives the user an opportunity of loading the new

algorithms of person search. In the given line the path to a file of

new search algorithm is displayed. In more detail procedure of

loading of new algorithm is described in point 6.2 «Macro

Mode».

Draw No – not draw rectangle around face, Yes – draw rectangle

around more danger single person, All – draw rectangle for all

danger person in frame. For non-danger person rectangle draw

green color, but if person suspect level more than «Critical

level», than rectangle draw red color.

Quality test

Enable Switch on mode of automatical check of image quality (see point

2.3.1)

Light level Parameter use for define image noise level when illumination is

low.

FPS max, FPS min Maximum and Minimum allowable input frame rate.

Face delay This parameter determines how long (in seconds) the program

can not recognize a human face in the frame before you will get

an error message.

Alerts

Critical level % Stands critical level of emotion parameters for alarm signals.

Customer level % Sets customer level of emotion (low threshold) for alarm signals.

Area threshold%,

Area level %

Used to account for the small area factor of moving objects

relative to the frame area during the suspect level calculation.


73

Auto capture image

Auto capture image (s) At excess of the set level, psycho-emotion danger in the

specified catalogue will automatically saved BMP files of the

«dangerous» person from display screen. Record is done one

time for the specified quantity of seconds.

Save image files Determines whether stored in the database directory photo file of

«dangerous person» or not.

Save face XML On/Off saving of «suspicious» person face’s сoordinates

Save faces On/Off saving of «suspicious» person faces

Save original On/Off saving of original image from videosource

Show N image At work in Macro mode in «Capture window» will be

consistently displayed N images of «dangerous» objects, but if

for the specified interval of time has passed some «suspicious»

objects.

Sound (Susp) Defines, the sound signal will be used at work if «danger»

person appears or not.

Sound (A), Sound (S),

Sound (T)

Level for sound of a audio signal at excess of aggression, stress

or suspect levels the setting limits.

Maker’s beep On/Off maker’s beep in LD mode.

Reset beep On/Off reset sound beep.

FTP Storage

Enable FTP Enable/disable connection to server by FTP.

Configuration file Defines file whith data of FTP server, host, login, password.

Fn

X1-X5 In VibraImage program user can form itself formulas for

calculation of new parameters of vibraimage, using any

vibraimage parameters. For example (fig. 3.47).


74

Fig. 3.47 User’s formula for parameter X1 calculation

VibraSound

Disable std. sound

YES - VibraSound mode is switch on.

NO - VibraSound mode is switched off, the sound acts either

from a microphone or from a video file.

Vibra sound To switch on the VibraSound must select one of the values CG,

CR, HG, HR, SG, SR

If one of these items was chosen than VibraSound sound will be

switch on and will be modulated by curves of signal change in

one of frequency distribution windows (fig. 3.48). Letters C, H,

S define, from what window the signal for «sound» will be used:

C - the first window, H - the second, S - the third.

Letters G and R – show what color of graph will define

«modulation» of a sound: G-green color, R - red color.

Capture

Max length (s) Defines the maximal length (in seconds) for recorded video file.

After file limit finished and closed, a new file creates.

Purge old files Defines system action when the empty space on a hard disk will

finish. «YES» – the oldest video files will be removed.

Timer The system can begin record at the appointed time.


75

Fig. 3.48 Information panel in «S» mode.

Network

Network service Sanction of information transfer to network between a computer

on which program VibraImage.exe is started, and the terminal.

Critical level

Full video stream

The threshold psycho emotional conditions of the person at

which excess on the removed terminal the warning message will

be given and the picture of danger object (if parameter «Full

video stream» = NO) is sent or the video information (if

parameter «Full video stream» = YES) will be transferred.

Compression When transferring video the compression will be applied.

Parameter value define the compression rate

Local TCP port VibraImage.exe program interrogates the given port for data

exchange with the terminal.

Remote host – name of the removed terminal.

IP Network address of terminal computer on which program

VINetStatus.exe is started.

TCP port, UDP port Ports for software of terminal, through which it changed by

information with the computer, on which started program

VibraImage.exe. Through UDP port goes an exchange by short

messages. Through TCP port goes an issue video data.


76

The VibraImage system implemented the ability to work in a complex network monitoring

mode, when on the local module (a computer connected to the camera) VibraImage.exe is running,

which makes the diagnosis and condition of the person on the psycho-physiological parameters, and

on the other computer (terminal) one of the two modules running VINetStatus.exe or

VINetServer.exe.

More detailed information about the settings for the network mode operation, see the

«Behavior Detection System 8 PRO», http://www.psymaker.com/downloads/VI8_1ManualEng.pdf

section «Network monitoring».

3.6.7 Information panel. DB mode.

In «DB» mode information panel (see fig 3.49.) used to manage the experimental data

records and displays the following information:

Fig. 3.49. DB panel.

«DB folder» – Way to the database folder for written video files and files of statistics;

«Selected record» – Data on current object of research. List of all saved entries will be

displayed below;

«New record» – Information about the object of research is introduced in any form by

double-clicking the left mouse button over this field.

http://www.psymaker.com/downloads/VI8_1ManualEng.pdf


77

3.7 Saving of measurement results

Note, until the specified database folder not set, AVI file recording, BMP and other files,

settings and results of the saving to the archive is blocked. All results are stored in a single

«_Default» folder created in the directory where the program \ VibraImage10 \ database \ installed.

The way to the catalogue of an archive database where video files, files of images and files

of statistics will be save, is specified in a field «DB folder» in «DB» information panel. The list of

objects, the information about which is in the specified catalogue displays as the list in the bottom

of an information panel. In line «Selected record» show curent record with which the system

operates in a given time.

Item «New records...» is used for a new entry into the database. A further saving of files in

the archive are doing in the folder associated with the name of your entry. To make a new entry in

the archive, you must bring the mouse pointer to the line «New record» and double-click the left

mouse button.

Fig. 3.50. Example, new records are created in database

3.7.1 Saving of current images

The structured store of observable images in format BMP files according to the entered

demographic data are carried out with the help of a command «Image capture …» menu «File» or

the corresponding button of the toolbar.

NOTE, in archive as separate BMP files are written down images from all open windows in

the field of supervision. For example, in the field of supervision 3 windows with processing image

are open (VINA and VIN

F) and in archive result 2 files of images will be save:

2014-04-22 11_48_51_vi1_F.bmp

2014-04-22 11_48_51_vi1_A.bmp


78

3.7.2 Saving of video file

Save of the current image, which appears in the basic window, in format AVI file is carried

out with the help of a command «AVI: Start Capture» menu «File». Stop AVI- file recording

process is carried out repeatedly selecting this menu item. The same actions can be executed with

the help of the corresponding button of the toolbar.

Note, that if in the image area open multiple windows with different ways vibraimage

processing (see fig. 3.51), the user in the section «Capture channel» of informational column in

the «S» mode should be selected from any open window will be recorded the information to

videofile.

Note, data is written to a file with all of the switched processing modes. If you want to

record only the video image without processing, it is necessary to select SRC recording channel.

Fig. 3.51. Select vibraimage channel for videofile saving

For increase of video files recording reliability in «S» information panel designed the field

«Max length (s) » (records in seconds). If record lasts over the specified interval current AVI

the file will be closed and save on a disk, and record will be continued in a new file. At filling the

whole disk if the set «Purge old files» parameter the record of new video-files will be made atop of

old. The first «oldest» will leave by date of creation video-files.


79

3.7.3 Saving of results and settings files

1. After completion of the process of «Measure» (mode «M») and collect information about

the psycho - emotional state of a person in a specific database directory the following files are

automatically recorded:

Data_time_histH.xml – system settings and change the basic parameters of the

psychoemotional state of a person in the course of the experiment.

Data_time_M.xls – report file with results of analysis psychoemotional state of a person

for the specified period.

2. In addition the user can save in an external file with extension *.xml system settings at the

moment of the beginning of the information analization.

Item «Save settings as …» the menu «File» is intended for saving the current system

settings to external XML file.

Item «Load settings …» is intended for loading before saving settings from external

XML file.

3. After completing the questionnaire in lie detection mode automatically in the selected

database directory \ VibraImage10 \ Database \ *** creates files with the test results :

Data_time_histT.png – an analysis of changes in the human psychoemotional state at

the time of testing.


psychoemotional state of a person.

Data_time_LD.txt – lie detector report and result files.

Data_time_row.txt – Full record values recorded vibraimage system parameters. This

file can be used for statistical research and testing of algorithms for determining the

psychophysical and psychoemotional human condition.


80

3.8 Saving of suspicious person photos and data

In the information panel of «S» mode there are few tabs (Alerts, Auto Capture Image, FTP)

for saving photos and data.

Set Macro mode default in menu Settings, set critical level (on fig. 3.52 it is 55 %) and

switch on auto capture image as shown in fig. 3.52.

Then suspicious person photos and data will be appeared in catalog

\ELSYS\Vibraimage10\database\_default or another (depending on the settings in information panel

DB mode).

Fig.3.52 Example of settings in Macro mode for saving of photos and data.

In this catalog there are following files:

YYYY-MM-DD HH_MM_SS_org.png Original image (Fig. 3.53 a)

YYYY-MM-DD HH_MM_SS _1_src.png Image with a detected «suspicious» person in frame

(Fig. 3.53 b)

YYYY-MM-DD HH_MM_SS _face.png «Suspicious» person face (Fig. 3.53 c)

YYYY-MM-DD HH_MM_SS _img.xml «Suspicious» person face’s сoordinates (Fig. 3.53 d)

where YYYY – year, MM – month, DD – day, HH – hour, MM – minute, SS – second of photos

creating.


81

a) Original image b) Image with a detected «suspicious»

person in frame

c) «Suspicious» person face d) Suspicious person face’s data

Fig.3.53 Result files of Macro mode

Suspicious person face’s data file Fig.3.53 (d) includes the following information

<face face_rect="274,127,461,326 " – facial coordinates in pixels of left down and right up

points from the frame;

level="0,631029" – suspicious level of captured person;

img_size="640,480" /> frame size in pixels.

3.9 Sending images to a remote server

Perform the following steps for getting photo of suspicious person on your remote server.

1) Create a ".xml" file in catalog of program \Elsys\VibraImage10\ftp\ as an example of

FTP configuration file in your catalog (fig. 3.54)


82

Fig. 3.54. Example of FTP configuration file

On fig 3.54:

<host>127.0.0.1</host> – address of server where you want to save photos and data;

<user>anonymous</user> – FTP user name;

<pwd>aXXXm</pwd> –FTP password;

<path>/d/tmp</path> – path to the database folder on FTP server for saving photos.

2) Choose FTP configuration file in the information panel in «S» mode in tab «FTP» =>

«Configuration file». (fig. 3.55).

Fig. 3.53. Information panel in S mode. FTP storage.

3) Switch on FTP (Enable FTP = Yes) .

4) Check that images with a detected «suspicious» person in frame get to the FTP server (in

example - /d/tmp).

3.10 Example of getting images on mobile phone

1) Configure FTP as described in p. 3.9.

2) Create a ".php" file to your site or server (in example to elsys.ru/1/) as an example

«vi.php» in catalog of program \Elsys\VibraImage10\http\ or copy example file

(fig. 3.55). You can modify the php file as you wish to see images.


83

Fig. 3.55. Information panel in S mode. FTP storage.

3) Enter to browser on your mobile phone the address of web page. You can see last photo

with «suspicious» person (Fig.3.56).

Fig.3.56 Example of detected person

NOTE, your PC and mobile phone must be connected to Wi-Fi.


84

4 The basic modes of the VibraImage system

VibraImage system has 3 basic operation mode:

1. Micro mode – it is intended for supervision, research and the analysis psycho emotional

conditions of the one person in the frame.

2. Macro mode – it is intended for supervision, research and the analysis psycho emotional

conditions of the people in crowd.

3. «Lie detector» or LD mode - it is intended for lie detection of the one person in the

frame center.

The user can choose a system operating mode, having set options by default, selecting the

appropriate line in the sub-menu «Settings» - «Default» (see fig. 4.1).

Fig. 4.1 Select «micro» mode

When you select one of the basic modes of operation (micro, macro or lie detection) and

load its default settings, the system automatically displays only the necessary window (fig. 4.2).


85

Fig. 4.2. «Micro» mode loading

4.1 Micro mode. Emotions (personality traits) definition

The main targets of the MICRO mode («M») are receiving significant psychoemotional and

psychophysiological personality portrait and carrying out functional diagnostics test person. It is

possible to use MICRO mode for security system applications and identify suspicious people on the

protected objects. Usually, for security system applications MICRO mode is using without M

button, and detection of the suspicious level (Suspect indicator) is based on calculating T4

parameter in real time mode.

It is known that the psychoemotional and psychophysiological state of a person is constantly

changing under the influence of external and internal factors. In the «M» mode are measured

average values of psychophysiological parameters T1-T10 (emotion10print) for the fixed time

period and their deviation from the established norms.

There are different science opinions about emotions, behavior and personality traits. General

description about these points is described in Wikipedia and science publications, see

https://en.wikipedia.org/wiki/Emotion

https://en.wikipedia.org/wiki/Behavior

https://en.wikipedia.org/wiki/Personality_psychology

https://en.wikipedia.org/wiki/Emotion

https://en.wikipedia.org/wiki/Behavior

https://en.wikipedia.org/wiki/Personality_psychology


86

Elsys Corp. suggested own concept about personality and mental features which includes

several main points:

1. Preferable math methods than words for personality traits indication, because math

formula gives only one sense for indication. The word has different interpretation because different

users give different sense to the same word.

2. The list with formulas for indication of every vibraimage emotion 10print algorithm is

described in VibraStat program manual. It is not necessary to obstruct the current Manual by unused

for typical user information.

3. For T1-T10 parameters was selected 4 main parameters for indication positive emotions

(personality traits), 4 main parameters for indication negative emotions (personality traits) and 2

main parameters for indication of physiological characteristics. In our understanding we selected

the most important and informative parameters for selected groups and used the terms based on

current psychology science level.

4. From vibraimage point of view we suggested the different math methods for head

vibration calculation because the main math task of vibraimage is to detect all parameters of head

vibration so as we supposed that head vibrations reflect all personality traits and emotions.

5. Of course the list of selected parameters is not finished. Based on customers’ requests is

possible to extend this list and add some parameters which are actual like sleepiness level or

tiredness etc. The most part of a new emotional parameters could be calculate based on existing

emotion10print (T1-T10) after additional reseaches and statistics capturing.

The analysis determined the expectation M, standard deviation S, and variation V=S/M for

the following psychophysiological parameters measured in («M») mode:

Т1 – Aggression (Р7)

This parameter is determined by the frequency histogram and represents the maximum

allocation of the frequency and SD vibration frequency of the human face (fig. 4.3). The higher

value of the maximum distribution and higher SD value gives the greater value of the parameter T1.

a) b)

Fig. 4.3 Agression; a) T1= 18 %, b) T1= 60 %

Т2 – Stress (Р6)

http://www.psymaker.com/downloads/VibraStatRus.pdf


87

Parameter is determined by degree of the external vibraimage (vibra-aura) asymmetry,

means asymmetry of micromovements from the left and right parts of the person’s head (fig.4.4).

The great difference in amplitude and frequency movements for the left and right parts of the face

(head) characterizes the increased T2 parameter level.

a) b)

Fig. 4.4 Stress; a) T2 = 17 %, b) T2 = 45 %


88

Т3 – Tension/Anxiety (F5X)

Parameter is determined by the relation of high-frequency part of a range of vibrations to the

general power in a range of micromovements frequency for human head (fig.4.5). High value of

high-frequency vibrations density characterizes high value of the T3 parameter.

a) b)

Fig. 4.5 Tension; а) T3 = 28 %, b) T3 = 48 %

Т4 – Suspect (Р19)

The parameter is determined as the sum average of the first three conditionally negative

emotions (T1, T2, T3) and characterizes the general level of conditionally negative emotions in a

person status (fig.4.6).

a) b)

Fig. 4.6 Suspect; a) T4 = 20 %, b) T4 = 65 %


89

Т5 – Balance (Р16)

The parameter is determined by the frequency histogram and characterizes the level of

similarity of the current frequency histogram to the Gaussian distribution law (fig.4.7). The high

level of frequency histogram similarity to the normal law is characterized by a high level of

balance, and significant deviation from the Gaussian distribution is characterized by a low level of

the parameter T5.

a) b)

Fig. 4.7 Balance; a) Т5 = 10 %, b) Т5 = 80 %

Т6 – Charm (Р17)

The parameter is determined by the symmetry (left-right) of the head and face

micromovements, the maximum symmetry of movements (including frequency and amplitude)

represents a high level of charm T6 (fig.4.8).

a) b)

Fig. 4.8 Charm; a) Т6 = 40 %, b) Т6 = 85 %


90

Т7 – Energy (Р8)

The parameter is determined by the frequency histogram and characterizes the difference of

the maximum density of the vibration frequency and vibration frequency SD for the face and human

head (fig.4.9). The higher value of the maximum density and lower SD or variation of vibration

gives the higher value of energy T7.

a) b)

Fig. 4.9 Energy; a) Т7 = 3 %, b) Т7 = 70 %

Т8 – Selfregulation (Р18)

The parameter is determined as the sum average for conditionally positive emotions (T5,

T6) and characterizes the general level of conditionally positive person emotions at the

measurement time (fig.4.10).

a) b)

Fig. 4.10 Selfregulation; а) Т8 = 30 %, b) Т8 = 80 %


91

Т9 – Inhibition (F6)

It has a real physical dimension (time in seconds) and characterizes the minimum time of the

person reaction for the shown event (the stimulus). The value of the parameter T1 = 0,1 means that

the reaction time is 0,1 s (fig.4.11). The greater the reaction time corresponds to a higher level of

inhibition.

a) b)

Fig. 4.11 Inhibition; a) Т9 = 12 %, b) Т9 = 25 %

Т10 – Neuroticism (F9)

The parameter characterizes the SD measured value of the inhibition level (T9) at the

measurement time (default 60 seconds) (fig.4.12). High level for inhibition SD of

psychophysiological state characterized by instability and indicates high level of neuroticism T10.

a) b)

Fig. 4.12 Neuroticism; a) Т10 = 10 %, b) Т10 = 35 %


92

Note:

The set of parameters T1-T10 is selected for capturing of the maximum information content

for human head micromotion. At the same time the name of each Ti parameter can characterize

different physiological characteristics, depending on the application of the vibraimage system. The

primary characteristic for each parameter is not his name, the name can be considered secondary,

but only math formula (equation) for psychophysiological parameter calculation is primary.

Mathematical formulas, on which a calculation of parameters T1 - T10 are shown in the description

of the program of statistical processing of the measurement results (VibraStat).

Note:

1. Every from T1-T10 psychophysiological parameters measured by vibraimage system

are specified to range 0 - 1 (0 - 100) % using fixed coefficients experimentally selected.

2. Mathematical formula by which measured psychophysiological parameter is

determined is primary, and a code name (for example, Agression) is secondary.

Psychophysiological meaning of each parameter T1-T10 may be varied depending on the

experimental conditions.

3. The set of measured parameters T1-T10 determines the total psychophysiological

(psychosomatic, functional) status of a person based on the integral coefficient K.

Note:

This description is valid for the parameters to the default settings of the system and perform

basic rules for getting vibraimage:

uniformity and stability of the lighting;

use of low-noise television cameras;

frontal location of the object in front of the camera;

maximum «inscribing» the subject's face in the monitor;

mechanical stability of video camera.

4.1.1 «M» mode of information panel

In a «M» mode an information column (fig. 4.13) allows to control average for the period

parameters value of psycho-emotional person conditions and their deviation from the established

norm. The basic applicability of the given mode is use of vibraimage system for medical

diagnostics and psychological researches. Start of the beginning of information accumulation is

made by a choice of item «Measurement» of the menu «Action» or pressing of the toolbar button

. Value of the averaging period is set in seconds in a field «Duration». After start of a

accumulation and averaging mode in the top of an information column there is a running line

«Progress», displaying a course of data accumulation process.

http://www.psymaker.com/downloads/VibraStatRus.pdf


93

Fig. 4.13. «Measure» mode start

After gathering information in the information column in the «M» mode for all vibraimage

parameters (A1-A4, F1-F9, S1-S7, P1-P4) and all the parameters that characterize the psycho-

emotional state of a person (T1 - T10), displays the following information :

V – The value of the parameter average for the set period;

S – Root-mean-square deviation of parameter;

Vi The variability of the parameter over a specified period;

cMin – The minimal value of parameter for the period;

cMax – The maximal value of parameter for the period;

NMin – The minimal value of parameter for a normal condition of the

person;

NMax – The maximal value of parameter for a normal condition of the

person.

Note, after ending of the information accumulation some lines of an information panel can

be allocated by color:

– parameters, which values less than the set limits are allocated.

– parameters, which values more than the set limits are allocated.

Statistically set norms (corresponding to the normal state of man) for supervised psycho-


94

emotional parameters Aggression, Stress, Tension/Anxiety, Suspect, Balance, Charm, Energy, Self

regulation, Inhibition, Neuroticism are shown in figure 4.14 in columns and NMin NMax. Note,

that each parameter has its own range of normal values and deviations.

Set of the T1-T10 parameters is selected so that with the maximum information content to

record all micromovements of a human head. Thus, the name of each Ti parameter can characterize

different psychophysiological characteristics depending on use of any VibraImages programs.

Fig. 4.14. Information panel in «M» mode.

4.1.2 Psychophysiological state analysis results

Note, that the analysis results are automatically saved in the database folder in the form of

following files:


95

Data_time_M.xlsx – report file with the base results of psychophysiological state

analysis of a person for the specified period.

Data_time_histH.png – frequence histogram

Data_time_histT.png – an analysis of changes in the human psycho - emotional state

at the time of testing


psycho -emotional state of a person. Note, The parameters T1-T10 defined in the M

mode, may be processed in VibraStat program.

Note, that the base results of psychophysiological research are given in Data_time_M.xlsx

file (see fig. 4.15).

Fig. 4.15. Base results of the human psycphysiological state analysis

The parts of base results could be looked more detail by additional tables and pictures.

After gathering the information will be available the results of «Frequency Analysis» and

the analysis of changes in the psychoemotional state of a person. To do this, the appropriate sheets

(see fig. 4.16) must be opened in the main image window.

http://www.psymaker.com/downloads/VibraStat.zip


96

Fig. 4.16. Frequence histogram in sheet «Н»

In a window with the frequency histogram will be showed the graph of amplitude histogram

(the graph is painted by red color), the histogram of frequency is painted by green color.

Each histogram is characterized by the following parameters:

М – the center of weights of frequency distribution (average value of

microvibrations frequency);

S – root-mean-square deviation of frequency distribution;

D – a dispersion of frequency distribution.


97

Fig. 4.17. Information-energy graph

The results of the analysis of the information-energy state are showed in «T» sheet. The

point on the graph shows the current psycho (information) - energy state of a person (fig.4.17). The

Y-axis is displayed in % mental state (information comfort of his mental state). The X axis in kcal /

min displays how much energy a person spends on controling its psychoemotional state.

Note, if you open the «T» sheet and start the process of gathering information , in the

open window you can see how the human condition changed during the experiment.


98

а) changing around the average value b) stable condition, indicating a high degree

of self-control person

Fig. 4.18 (a,b). Change person psycho-energy conditions for the chosen period

Change of psychoenergy state of the person during a controlled time frame is visually

reflected in a graphics (fig. 4.18). Only the person who is in weakened, or on the contrary in a status

of high concentration (fig. 4.18b), can be in the fixed psychoenergy state during such insignificant

time, as 1 minute. The majority of people is made by noticeable oscillations of psychoenergy state,

even for short periods, depending on the thoughts (fig. 4.18a) and under the influence of an

environmental situation.


99

4.2 Macro mode. The suspicious people detection in crowd.

VibraImage system allows controlling macromovements (macrovibrations) as

microvibration. Macromovements analysis uses the same principles as the control of micro-

movements, at the same time it allows to monitor the status of the people in the crowd. If

micromovements of human head can not be seen without a technical system, it was well known that

movements and psychomotorics reflect emotional state of person since such behavioral reactions

are well observed by psychologists and profilers. However, visual inspection of the movements is

really subjectivity, at the time, as the vibraimage system macromovements control completely

objective and is determined by the calculation formulas and the selected system configuration. The

optimal camera location and the choice of checking place are determined with considering the lens

parameters, the distance from the camera to the object and the amplitude of motion of the object.

When choosing the location of the TV camera relative to the envestigated group of people is need to

use the following recommendations:

The maximum display of human on the frame is preferable, and the camera should not

be unduly moved from the envestigated group.

People in the envestigated group must be approximately on the same distance from the

television camera.

In the analysis of the emotional state should use an equivalent comparison principle, the

correct is a comparison of people making near the same motion, for example, feed the ticket

compared with the person submitting the ticket, the person transposing luggage compare with a

person committing the same act, etc.

Note, that in order to improve the accuracy of the human state measurement, reccomends to

control its movement in maximum details, therefore, observe the minimum number of people in the

frame. Question of the measurement accuracy for the psychophysiological state should be decided

separately for every controlled object. In this case, for more accuracy it is recommended to use

personal control in MICRO mode for suspicious people detection in the high important places.

4.2.1 «Macro» mode parameters

Load basic MACRO modes parameters of operation is carried out using a submenu

«Settings» - «Defaults». When one of the basic modes of operation (micro, macro or lie detection)

select and load its default settings, the system automatically displays only the necessary window

mode (fig. 4.19). To work in the «Macro» are necessary images window, «Suspect level» window,

which will display the value of danger level, and «Image capture» window detected potentially

dangerous people photos.


100

Fig. 4.19. Macro mode windows

Figures 4.20, 4.21 shows a comparison of the basic settings are set automatically when you

select Micro and Macro mode :

When micromotion control system also monitors the status of the person at the three

different accumulation times (from 0,1 to 20 seconds), characterized by the number of frames N =

2, 10, 100. Recommended accumulation amount frames in macro mode comprise N = 5, 10 and 15

frames that the input frequency 15 f/s, corresponding 0,3-0,6-1,0 second. Comparison of the number

of movements made by a person in a given time, gives a clear picture of the psychoemotional state

of a person. If a person is excited or aggressive state, it makes a lot of movement than those who are

at rest, and it stands out vibraimage color coloring compared to other people.

«Palette threshold» is set at the control macromovements above (L = 150) than in the

control micromotion (L = 2).

Frequency of «base processing» under the control macromovements set

substantially higher than in the control micro-movements, to the 15f/s instead of 5. This is due to

the fact that when micromovements no point in increasing the sampling rate, as TV system noise

does not allow stable fixing micro-movements with a higher frequency. Another thing

macromovements control - movement of the hands, feet or body when walking, turning or other

fixed macromovements confident enough television camera, and significantly higher than the noise

level.

In macromovements analysis mode to increase the computing capacity of a PC, the

calculations are disabled several parameters and the «Disable» information column «S».


101

Fig. 4.20. Default setting for Micro mode Fig. 4.21. Default setting for Macro mode


102

Especially for setting display modes when using the Macro mode in the information column

«S» introduced a number of parameters:

Macro section:

Маcro mode - If «Macro mode = Yes» than danger level calculation is made on the

basis of values of parameters Р13, Р14, Р15 (the description of parameters is see lower). In

«Micro» mode danger level calculation is made on the basis of the analysis of values of

aggression (Р7), stress (Р6) and tension parameters.

Level L - sets a palette threshold at danger level calculation. Vibraimage points

which brightness less than the specified threshold, are considered «black» and are not used

at calculation of a danger level. The vibraimage point is considered active, if its brightness

more than the set threshold«Level L». Parameter Р15 defines the relation between the area

of «active» vibraimage points to the area of all frame. Parameter Р13 characterizes shift of

the histogram to the right in area of high frequencies. So that parameter defines primary

color of «active» points of vibraimage.

Level S - defining the area of «active» vibraimage points. If the area of points (in

%), which value of brightness is more than value «Level L», is less than value «Level S»,

than danger level value displayed in status window equally 0. So, if in the frame it is not a

lot of «active» points, the level of danger is not calculated.Parameter Р14 defines in %

excess of the area of active vibraimage points above the set threshold of «active point»

«Level S». So, if the number of «active» points grows, value of this parameter too grows

also a level of danger increase.

Aura mode - automatic cut output vibration aura when working in macro mode.

Macro mode + - when mode is switch, the danger level is considered for each

individual person in the frame. In off mode - the danger level is averaged over the entire

frame. «Macro mode+»= NO recommended when working of face detection algorithms is

not effective in this particular case.


103

Fig. 4.22. Macro mode basic settings.

«Alerts» section:

«Critical level» – Sets a threshold of «danger level» at which excess the person is

considered «dangerous».

«Auto capture image (s)» – If set «non zero» value, than the image of «dangerous»

object at his detection will be automatically save in an external file. The chosen value of the

given parameter determines in seconds the period of saving the pictures in a file.

Simultaneously the image «dangerous» will be displayed in «Image capture» windows.

«Show N image» – If set value N distinct from 0 in «Image capture» window will

be displayed at once N images of the «dangerous » people which have been found out for

the specified interval «Auto capture image (s)». If set value N = 1 - that for the specified


104

interval in «Image capture» will be displayed only one image, and we can pass other

«dangerous» person!

«Auto capture image (s)» – Value of this parameter (other than 0) specifies the

number of seconds between saving images to a file and display them in «Image capture»

window.

«Area threshold %» and «Area level %» – These settings is recommended only for

experienced program users. Area and significance (level) coefficient factor are given in %

and is introduced to take into account the factor of small area of moving objects relative to

the area of the whole frame when calculating the danger level.

4.2.2 Face detection mode

Switching on the «Face detection» is made in the same section of the «S» information panel

(see fig. 4.23).

Рис 4.23. Macro mode. Face detection is switch on

The parameter «Detection quality» defines quality of persons face capture. 1 – capture only

one large person in the frame (loading of the processor is minimal), 4 – search of all face (even

small) persons in the frame (loading of the processor is maximal).

Parameter «Scale 1:X» sets picture compression ratio before process of search of persons.

By default, value 2.0, i.e. video of a format 640х480 will be transformed by the program to a format


105

320х240. Compression of a format is necessary for reduction of loading of the central processor in

case of simultaneous increase in speed of the main processing (base processing). In case of value 0

compression isn't made. The lower the compression, the more CPU usage. The greater the

compression, the lower face recognition algorithm works.

Parameters «Mines size» and «Max size» set the sizes of rectangular (in pixels) for persons

face searching. The given parameter is necessary for set depending on concrete medium-sized

people on the computer screen.

The parameter «Config» is intended for loading new algorithms of persons search. At

installation of Vibraimage program on your computer will be created the subdirectory

«…\VibraImage10\Ocv\» in which files of various algorithms of persons search settle down. For

loading new algorithm, it is necessary to execute the following actions:

1. In «File» menu select item «Open». Then open folder \VibraImage10\Ocv\ and choose

new algorithm for calculation.

2. In line «Config» appear path to selected file.

Note, that each algorithm at work require different amounts of computer resources and

implementing different quality capture individuals. When choosing the algorithm is recommended

not to exceed the CPU utilization of more than 70%. By default, when you install the system

VibraImage very little resource-loaded algorithm ocv_face.xml. For fast computers recommended

load frontalface_default.xml algorithm. But, note, the choice of the algorithm and the quality of the

capture of persons recommended when setting up the system after it is installed in a particular

location.

If parameter «Draw» = No – not draw rectangle around face. If «Draw» = Yes – draw

rectangle around «more danger» single person, «Draw» = All – draw rectangle for all person in

frame:.

For non-danger person rectangle draw green color, but if person suspect level more than

«Critical level», than rectangle draw red color (see fig. 4.24).

If a potentially «dangerous» man except the red outline appears around the head and a

red outline around the body, this person requires more attention from the security

services, because the system repeatedly fix it increased the suspect level.


106

Fig.4.24. Attention, «Critical level»=55 is exceeded

4.2.3 First start and settings selection for Macro mode

Before working in the «macro» mode is recommended to (or control) the following settings

in VibraImage system:

1. In the System menu «Settings» - «Defaults» switch on «Macro» mode and load the

default settings or to the «File» menu to load own «Macro» mode settings from an

external file ( «Load Settings»).

2. In «DB» information panel:

Set the path to the database directory, which will be saved video files and results

files.

Choose «Selected record» or create «New record».

3. In «S» information panel in «Face detection» section:

If you need to load a new algorithm to search persons.

Set the minimum and maximum dimensions of the frame to search for persons.

Set the required quality of face recognition.

Set the desired value scale compression of images.

«Draw» parameter set to «Yes» or «All».


107

4. In «S» information panel in «Alerts» section:

Set the value of «Critical level», which corresponds to the current mode of

observation.

Switch on the sound notification of the dangerous man by setting

«Sound (Suspect)» = Yes.

Set parameter «Auto capture image (s)» = 1 sec.

Set parameter «Show N images» = 3 to display both 3 photos of potentially

dangerous people.

5. In «S» information panel in section «AVG Filter» set parameter «Suspicious» = 5−10.

6. In «S» information panel in section «Capture» set parameters values:

In fields «Max length(s)» set maximum length (in seconds) of recorded video file.

The recommended value is 300 seconds.

In the «Purge old files (Mb)» field to specify the amount of free disk space, at

which the system will record new video files over the old ones. Recommended value

20000Mb.

7. If necessary, select the item «Save settings as...» in «File» menu and save the current

system settings in an external XML file.

8. If you want to save the AVI file than using «AVI: Start Capture» item of «File» menu

or using the appropriate control panel button.

9. Start working in Macro mode.

Attention!!! if you are changing system settings when working in the «Macro» mode, then

you need to constantly monitor the following settings:

1. After start of Vibraimage program and person vibraimage displaying on the screen

loading of the computer central processor power must be less than 60 %.

2. Speed of input frame processing. Speed of «fast processing» should be not less than

25 frame per second at resolution not less 640х480 pixels. Speed of «base processing»

should be not less than 14-15 f/s.

If you change the «macro» mode settings and specified speed is not respected, it is necessary

to set other parameters that require less computer resources.

Note, when a detailed system configuration at a particular place of its installation may

require advanced settings «Area threshold», «Area level», «Level S» and « Stab. X, Y ».


108

4.3 LD mode. Lie detection

The VibraImage program of psycho physiological lie detection allows revealing verbal and

nonverbal lie in the automatic, automated and manual modes. The program allows fixing and

comparing psycho physiological parameters of the person during the various moments of time at

use of various modern techniques of interrogation. All means existing now lie detector register

changes various psycho physiological parameters of the person, thus it is considered, and that

essential change psycho physiological parameters is observed when the person worries, is excited

and speaks a lie. In a still condition of person his psycho physiological parameters and emotions

vary less considerably in time, hence, having compared a known still condition with the answer

interesting us it is possible to define, when the person speaks the truth and when speaks lie.

The program allows to fix and compare psycho physiological parameters of the person

during the various moments of time. VibraImage system makes measurement and the analysis in

time more than 40 independent parameters describing an emotional condition of the person. The

standard method of definition of lie is based on an estimation of emotional reaction of the person on

the «put» question.

The standard method of lie detection is based on an estimation of emotional reaction of the

person on the put question. In an operating time the operator marks on graph CQ questions (Control

Question), RQ questions (Relevant Question) and GQ questions (General Question), pressing on the

, , on the toolbar at time of the given questions. After the ending same buttons

of the test the operator can check results of work in a special created file.

4.3.1 Before starting LD mode

For correct lie detection by Vibraimage system is recommended to take into account the

following factors and conditions:

1. The image of the person should be high quality, the maximal facial size preferable

and face position must be in the center of the screen. For camera horizontal

resolution across 640 pixels the person face should be not less than 200 pixels.

2. The object (person) should be well and stable illuminated also (black-and-white-

preferable, or color) the image of the person should be precise and contrast. As lie

detection depends on detection of the microvibrations and the object

micromovements fixed in reflected from object light, therefore poor light exposure

of object can increase error rates.

Natural illumination of object can be used if speed of natural light changes does not

exceed 1 lux/sec. Illumination of object by fluorescent lamps with illumination in the

range 400 - 600 Lux in object plane is preferable.


109

3. In a video camera options it is necessary to switch on a mode of fluorescent lamps

noise suppression (flicker mode 50Hz and 60Hz).

4. In camera options it is recommended to use black-and-white image mode.

5. Presence of the other people, taking place in the frame near to the researched object,

can influence and increase error rates of lie detection.

6. The video camera used for surveillance, and/or object on which the camera is fixed,

should be motionless and have no vibrations. The vibration or movement of camera

can increase error rates of lie detection

7. Speed of input frame from the camera should be not less than 25-30 frame per

second at resolution not less 640х480 pixels.

8. After start of Vibraimage program and person vibraimage displaying on the screen

loading of the computer central processor power must be less than 60 %.

9. The set of a microphone is recommended to use external, not built-in in the camera

or notebook.

10. At work with videofiles it is recommended to use files in length of 5-10 minutes and

for exact lie diagnostics it is recommended to analyze the same file repeatedly some

times.

11. Press button before next lie detection of the same file. button works as

reset and stabilized detection results. Double click on this button fixed graphs time

equal to the video file period.

Note

At repeated viewing the same videofile the deviation in repeated values the same parameters

up to 5 % is acceptable because live video is the same as live object error rate less than 5% is

normal. For stable work in a «Lie detector» mode is recommended use personal computer

CoreDuo2 3GHz (not less than 4Gb RAM) or more powerful. At such computer speed of input

frame from the camera should be equal speed of fast parameters processing FPS_in=FPS_fast> 25-

30 frame/s.

4.3.2 Switch on LD mode

Load basic LD modes parameters of operation is carried out using a submenu «Settings»-

«Defaults». When one of the basic modes of operation (micro, macro or lie detection) select and

load its default settings, the system automatically displays only the necessary window mode (fig.

4.25). To work in the «LD» mode are necessary images window, «QT» image quality window,

«LDr» lie level window, «Graph» window with changing main parameter, and «LD question»

window for show questionnaires question.


110

Window «Quality Test» (QT) indicates the time in %, for which the image quality of

100 %. When the quality test indicates 92% means that only 92% of the testing time have no errors,

and the 57 % of test time the image quality contained 1, 2 or 3 errors.

Note, before the start of the LD detection should ensure that the program processed the

image of a human without errors and work is allowable only at quality more than 80 %.

Fig. 4.25. «LD» mode settings load

Next, using the toolbar button , or via the submenu «Presets» menu «View» (see

fig. 4.26) need to switch on the LD mode image display.


111

Fig. 4.26. System ready to LD mode

Attention, at work in a LD mode is recommended to supervise under graphs of change in

time following psycho physiological parameters describing all types of impellent activity: А1 fast,

F3, F6, S2, P2, P5 and Р20.

A1 (fast) – shows maximum fast reaction of person for question or situation, so it changes

before any other VI parameters, but goes down also immediately as it changed. This parameters

shows macro movement and sometimes used for deleting artifacts from the lie detection process.

F3 – shows general mental energy level of examinee, in default settings this parameter

calculates for time period of 20 seconds, so it is slowly changing parameter reflects psycho

physiological state. High level of this parameter indicates high level of exciting, aggression or

activity so it could be correlated with lie.

F6 – shows inhibition of person and also correlated with respiratory tracing or breathing

activity, because it is physiology linked with inhibition process.

S2 – shows asymmetrical of movements in middle time (2 sec) period, so it includes

left/right hemisphere activity components and it high changes usually indicates lie.

P2 – shows Mean-Square-Deviation (MSD) of frequency histogram and low meaning of this

parameter usually indicates normal state, so high meaning of this parameter could be correlated

with lie.

P5 – indicates Lie level auto calculated for selected parameters, in Default settings for Lie

indication need to have significant changes at least in 8 vibraimage parameters, typically in Lie

detection system registers significant changes in 12 or more parameters, given in Lie Report.

P20 – Quantity indicator of a degree of change psycho physiological parameters in view of

various factors of the importance of measured parameters since the part of parameters is


112

accelerated, and others are slowed down during one reaction. Parameter Р20 is defined at the

moment of P5 maximum and display in «LDr» window.

When working with graphics, special attention should be paid to signal changes in the graph

of parameter P5 (lie), which define the most «suspicious» moments in human behavior. Each

question and answer (preferably separated by a time interval of not less than 10 seconds) is

characterized by a level change phychophysiological parameters tested person. This level is

characterized by two integral indicators - the level P5 (see fig. 4.59.) and parameter P20 in the

window «LDr», which provides a quantitative assessment of human responses to the question. The

higher this parameter, the more likely lies in the response.

4.3.3 LD working mode

Select the method of of the beginning lie calculating [LD mode] is made in the «ST»

information column in field «LD mode» (see fig. 4.27).

Fig. 4.27. LD mode settings.

The system uses the following ways to start the lie level calculation:

1) Audio - lie level calculation is performed when the input audio signal exceeds the

threshold, and stops when the audio signal level becomes less than the set threshold. On

graph at the start of data collection displays vertical green line, the time of completion -

a vertical red line.

This mode is recommended as the primary when working with a lie detector.

2) Manual - the accumulation of the preliminary information is available at the «Base

periods». Calculation of a lie level is made only after selecting the «Start LD block»


113

item in menu «Actions» (or corresponding toolbar item). To complete the

calculation interval of lie detection, you must repress the same button or choose the same

menu item. Time of lie start calculation is marked by a vertical green line, calculate the

end - red.

Lie detection in the manual mode are usually used, if the quality of live or recorded

sound is unsatisfactory and can not be on the level of sound to separate the questions and

answers of the test person from outside noise.

3) Auto - calculation lie level is made constant, the current values of the parameters are

compared with the values accumulated in the preceding period.

When operating in lie detecting mode in an «S» information column (see fig. 4.27) is set the

interval «Base period» (in seconds) during which the system collects data about the object under

study, accumulates the information to determine the maximum and minimum current values

parameters to then at «lie detection» during the «Stat periods» define «abnormal» change the

values of the individual parameters of the object. If the value of the parameter during the «Stat

period» exceeds the set limit, then it parameter is taken into account when lie level calculating with

a certain coefficient (weight (Rate) of this parameter).

The base case «Base period» immediately precedes the moment of the beginning of the

analysis lies. But the system provides the ability to collect initial information about the object at any

time. When you select a item «Compare»=Capture will be made beginning start the sampling

interval at an arbitrary time. To complete the collection interval, you must change the settings

«Compare» value.

Now when you lie detection analysis the state of the object will be compared with the

information stored in previous time in one of two ways:

«Compare» = Off - at the lie analysis, as a test, using the interval «Base period»

immediately before the start of lie detection.

«Compare» = On - in the lie analysis, as test, the interval «Capture period», which was

prepared preliminary.

4.3.4 Additional settings in «S» information panel

1. For stable work in a «Lie detection» mode in section «Filters» of the «S» information

panel it is necessary to set parameter «FPS filter» = YES. The parameter «FPS filter» provides

stability of input video frame stream frequency due to resources of a computer. If the parameter

«FPS filter» = No, than parameter «Downrate» in «S» information panel sets factor of division of

input frame frequency FPS_in for all processing mode (base and fast). If the parameter

«FPS filter» = Yes, than parameter «Downrate» sets factor of division of input frame frequency


114

only for base processing mode. If «Downrate» = 0, than division factor calculated by system

automatically. If input video frame stream frequency not stability, than additional parameter

«Stream errors» in «VI» information panel displayed quantity of entrance frequency «failures».

2. Additional parameter «Audio sens. s.» in an «S» information column sets in seconds,

how many after the person answer ending still to continue to analyze his condition.

3. The parameter «Lie threshold » in an «S» information column sets in % a threshold for

the indicator of a lie level in view of all designed parameters and their «weight». At excess

settlement value of this threshold «lie level» is registered and displayed.

4. Each person differently reacts to lie by virtue of the psychophysiological features. The

part of people when lie, «worries» also their reaction (value of parameter Р5-lie) on the «important»

questions (RQ questions) exceeds reaction to control questions (CQ questions), and the system

registers a condition of lie (DI). For such people parameter «Opposite mode» = NO (it is a mode

by default). And the part of people - on the contrary, internally «is clamped (strains)» and their

reaction (value of parameter Р5-lie) on the «important» questions (RQ questions) less reactions to

control questions (CQ questions), and the system does not register a condition of lie (NDI). For

such cases for increase of reliability of lie detection results the parameter «Opposite mode» = Yes

(it is a mode is recommended for experienced users).

5. Note, VibraImage system requests correct adjustment of input audio signal (procedure of

adjustment see above). The moment when the person starts to speak, is used by system for the

analysis start of the data in Audio mode. Vibraimage parameters during speaking (Stat period) are

compared to the data received earlier (Base period), for example, when the person was silent or

neutral answer questions.

Therefore it is necessary to adjust preliminary an «Audio level» so that the surrounding

level of a sound was below threshold, and the level of a sound at the task of a question and

reception of the answer was higher threshold.


115

Fig. 4.28. Audio level adjusting

To adjust sound level is necessary in an «VI» information column to measure the sound

level (fig. 4.28) for the two states: «the silence in the room» and «the sound of the human voice to

the camera». Then in the settings of «lie detection» in the «S» information column set the

parameter «Audio level» (fig. 4.28) so that its value was in the middle position between the

minimum value of the input signal that corresponds to the silence in the room, and a maximum

value, which corresponds to the sound voice man facing the camera.

Values of system options recommended (by default) for work in a lie detection mode:

Stat period = 10 s

Base period = 5 s

Lie Threshold = 0 %

Opposite mode = No

Audio sens = 2 s

N = 100


116

4.3.5 Settings in «LD» information panel

If you have enough experience works with the lie detector, you can manually configure the

numerical values of the parameters A1 to P29, opening the appropriate «LD» information panel (see

fig. 4.29).

Fig. 4.29. LD mode of information panel


V – Current parameter value;

cMin – The minimal value of parameter during the «Stat» period;

cMax – The maximal value of parameter during the «Stat» period;

bMin – The average basic minimal value of parameter for a normal condition of

the person during «Base» period;

bMax – The average basic maximal value of parameter for a normal condition of

the person during «Base» period.

For each parameters set following numerical values, which using in Lie detector calculation:

Calculate Yes - this parameter using in LD level calculation, No - not using.






117









Level In % determines on how many value of parameter should exceed the

set limits that the system «considered» this change.

The following are examples which illustrate the principle of collecting information. Fig 4.30

has no difference in the «threshold» values of S2 in intervals «Stat period» and «Base period. Fig

4.31 during the interval of definition lies (Stat period) value S2 has exceeded the maximum

threshold.

Fig. 4.30. S2 parameter value is within the limit


118

Fig. 4.31. One of the parameters was significantly higher than both the established limit

4.3.6 Backster’s test

The basis of lie detection is a technical comparison of the principle of psychophysiological

reactions responses zones (introduced Clive Backster), it is quite easy to understand and allows

each person to accurately determine the truth and lie even with minimal experience in working with

VibraImage system.

Principals of comparative testing and averaging for responses of question-answer zones,

coined in the 60th years of XX century by Cleve Backster

(http://www.backster.net/images/accuracy.pdf), gave requested high accuracy for

psychophysiological detection of deception and have done lie detector the reliable instrument in

expert hands. The comparative zones are based on the fixed structure of question-answer testing,

including general, comparative and relevant questions in one test. So fixed test structure allows

combine analyzing of response to several similar questions, so it is possible to calculate average

response to several control questions and separately calculates average response to several relevant

questions. This testing structure gives more accuracy for any measurement, so it is acceptable also

for lie detection, too. Standard lie detection test structure includes 9-14 questions, one of these

questions relevant (most important) is presented by several times (during one test), because was

proved that during one test is correct to present the only one relevant question. Several relevant

questions in one test give more errors, because examinee could concentrate only on one question

during the test.

http://www.backster.net/images/accuracy.pdf


119

Let’s consider the test structure on the simple actual test sample: You are interesting where

your partner was at night, when he tells that was working in office. In this case the question

«Really, were you in the office last night?» is relevant question and the main important question of

this test. All test must include several questions for replying one meaning answers as Yes or No,

like the suggested sample:

1. Did you have breakfast yesterday, as usual?

2. Was the cold weather on the morning street?

3. Did you tell lie to your friends?

4. Did you work in office this night?

5. Let’s go to cinema this weekend?

6. Did you ever tell lie to me or my family?

7. Really you were in office this night?

8. Did you take your purse from home at this morning?

9. Did you steal something before?

10. Is it true, that you were working this night?

General (blue) questions (GQ) have diverted meaning and have not influence to calculation

result, but they are necessary for reducing concentration attention of examinee on the relevant

questions. Response to the control (green) question (CQ) is very important to the test calculation,

control question usually asked about past criminals, which are happened in everybody life. The

verbal answer on control question is not so important (Yes or No), more important is

psychophysiological response corresponding to this reply. If quantitative average response to

control questions is more than analogical quantitative average response to the relevant (red)

questions (RQ) that means person tells true. If quantitative average response to relevant questions

(RQ) is more than analogical quantitative average response to the control questions (CQ), that

means person tells lie.

4.3.7 Lie detector with questionnaires

Program VibraImage has a special type series of thematic questionnaires intended for human

psychophysiological person testing, such as passing an interview before obtaining a credit.

You can select an existing questionnaire suitable for you («Loyalty», «Alcohol», «credit»,

«bribe», «Family» and others.) or create your own. An example of the questionnaire is shown in

figure 4.32.

The aim of the survey «Loyalty» is the definition of human loyalty basic principles of

security of modern society, and combating terrorism. The questionnaire includes graphics

(incentives) that increase psychophysiological effect on the test.


120

The aim of the survey «Credit» when issuing a credit is the lack of definition lies in the

intention of the applicant for the loan and detection of fraud in obtaining credit.

The aim of the survey «Bribe» is to determine the reliability of the test person answers that

he did not take bribes at the current position.

The survey «Family» is to detect lies with whether or not he had the answer to the question

of the subject the previous evening, at work, or located elsewhere.

Questionnaire «Insider» is intended to test, to hire personnel, the possibility of selling

company secrets to competitors.

The questionnaire R_Test allows rank (to determine the significance of) the test

psychophysiological response to questions.

Questionnaire «Alco» is intended to identify those who are likely to use alcohol.

The questionnaire «Computer» is designed to identify individuals who are prone to

compulsive gambling.

Questionnaire «Violences» is intended to identify individuals who are prone to violence in

the family.

The user may develop owns questionnaires on topics of interest to him and put them in the

installation directory \ VibraImage10 \ in the same file format ld_xxxxxx.ldg.

Fig. 4.32. «Lie detection» mode operation. The questionnaires text display.


121

Adding questionnaire windows «LD Question» (fig 4.33) to the screen is done by selecting

the menu item «View» - «Toolbar».

Download the survey questionnaire can be by selecting «LD load text...» in the «File»

menu. Allow withdrawal question text on the screen is made in the «S» information panel in «lie

detection» section by setting the parameter «Text» = Yes.

Fig. 4.33. «Lie detection» mode operation. The choice questionnaires.

Pressing the button in the window allows you to start working with the questionnaire.

Double-click returns to the beginning of the work as a questionnaire and video.

Рис 4.34. Questionnaires process

Answers to these questions can be given a voice, if a premade microphone audio level

adjustment, or manually by pressing the button «Yes» and «No» when the self-test.


122

In self-test mode, the test man is in front of the monitor, which sees the image requirements

and questions. By selecting the button «Yes» or «No» on the screen (fig. 4.34), responds to the test

questions are imposed in real time. When tested with a selection of the responses by pressing the

«Yes»/«No» as a result of the test will also be analyzed in the time delay between a stimulus

(question asked, the image) and the response (answer).

Please note, to answer this question only when the color of the question changes from black

to green. This time on the graphs corresponds to the green vertical line started lie detection. The

moment when the current question disappears from the screen corresponds the vertical line the red

color and end of the lie detection interval.

The proposed method allows to receive and to use for the automatic conclusion of psycho-

physiological information obtained 5 different independent methods during the three minute test:

1. Comparative information on psychophysiological reaction of the test (similar to the

classical polygraph) in answering the relevant (Rr) and control (Rc) questions, that

includes an evaluation of the reaction of the test at the maximum level (max result)

of vibraimage parameters:

Rc > Rr; NDI (test is passed positively if total psychophysiological reaction at

the answer to control questions is higher, than at the answer to relevant

questions);

Rc = Rr; INC (the test result isn't defined if total psychophysiological reaction at

the answer to control questions is approximately equal to reaction at the answer

to relevant questions);

Rc < Rr; DI (test is passed negatively if total psychophysiological reaction at the

answer to control questions is lower, than at the answer to relevant questions).

2. Comparative information on psycho-physiological reaction of the test (similar to the

classical polygraph) in answering the relevant (Rc) and control (Rr) questions, that

includes an evaluation of the reaction of the test at the average level (average result)

of vibraimage parameters (calculation is similar to a method 1).

3. Comparative information on psycho-physiological reaction of the test (similar to the

classical polygraph) in answering the relevant (Rc) and control (Rr) questions, that

includes an evaluation of the reaction of the test at the integrated level (integrated result)

of vibraimage parameters (calculation is similar to a method 1).

4. Information on the time delay in answering the questions. If the subject does not press

any of the buttons during the time set on this question, the system transitions to the next

question. According to the set algorithm absence of any response to the relevant

questions leads to a negative test result (calculation is similar to a method 1).


123

5. Information about changes in the dynamics of psycho-energetic (information-energy)

diagram of the test person at the answer to control and relevant questions. In more detail

the algorithm of calculation of this parameter is stated in the following section 5.1 of this

description.

According to set algorithm, the answer is YES to any of the relevant questions leads to a

negative test result.

The calculation of the final result of the test is carried out automatically with all the data.

The data calculation method 5 are used as the basic information. Results of the first four estimates

change the numerical value of reaction to relevant questions received by a method 5 according to

the following formula:

sRr=sR(5)r +0,1*sR(5)r*(∑NDI – ∑DI)

The final result of psychophysiological testing is defined according to the following

conditions:

NDI: sRr – sRc>0 or

NDI: sRr>0

DI: sRr– sRc<0

INC: 0,01<sRr – sRc < 0,01

4.3.8 Questionnaires stucture

According to the upgraded Bakster’s test of control questions questionnaire including three

blocks of control and relevant (test) questions (impact on the person can be strengthened by the

graphic information shown on the screen, the image of the pictures corresponding to a question) is

shown to the examinee person, general questions at the beginning and in intervals between which

are located. An example of such questionnaire indicating the time delay between the questions and

the type of questions used program is given below:

1. <GQ delay="10" length="7" text_delay="2" text_length="0" img="images/1.JPG"> Is your age over

20 years old?</GQ>

2. <GQ delay="5" length="7" text_delay="2" text_length="0" img="images/2.JPG"> Are you married

or single?</GQ>

3. <GQ delay="5" length="7" text_delay="2" text_length="0" img="images/3.JPG"> Are you ready to

answer truly the questions?</GQ>

4. <CQ delay="5" length="7" text_delay="2" text_length="0" img="images/4.JPG"> Earlier have you

been condemned for violations of the law?</CQ>

5. <RQ delay="5" length="7" text_delay="2" text_length="0" img="images/alco/5.JPG"> Do you

justify terrorist acts?</RQ>

6. <GQ delay="5" length="7" text_delay="2" text_length="0" img="images/6.JPG">Have you a

hobby?</GQ>

7. <CQ delay="5" length="7" text_delay="2" text_length="0" img="images/7.JPG"> Do you consider

yourself an honest and calm person?</CQ>


124

8. <RQ delay="5" length="7" text_delay="2" text_length="0" img="images/8.JPG"> Are you ready to

commit a terrorist act?</RQ>

9. <GQ delay="5" length="7" text_delay="2" text_length="0" img="images/9.JPG"> Are you a

believer?</GQ>

10. <CQ delay="5" length="7" text_delay="2" text_length="0" img="images/alco/10.JPG"> Are you

ready to do anything for money or people close to you?</CQ>

11. <RQ delay="5" length="7" text_delay="2" text_length="0" img="images/alco/11.JPG"> Are you

ready to support a terrorist, if he is your friend?</RQ>

12. <GQ delay="5" length="1" text_delay="2" text_length="0" img="images/alco/12.JPG"> Thank you

for your cooperation</GQ>

To reduce the uncertainty of comparative testing must have approximately the same time

interval upon presentation of the control and relevant questions, so the length of questions and

pauses when the synchronous presentation of a variety information needs to be given increased

attention. Tag «delay» sets the interval in seconds between questions. Tag «lenght» - the time

interval of the show text of the question. Tag «text_delay» delay before the question text painted.

Tag «text_lenght» determines the speed of text painting green, if value «0» the text is painted with

a constant speed depending on the number of letters in question, at other text is painted for a

specified time.

Note the «Img» tag in the structure of the questionnaire is optional. But properly selected

image (incentives) that the respondent sees on the screen increase its psycho-emotional response to

this question (see fig. 4.35).

Fig.4.35. The image and question on the monitor in front of the examinee.


125

4.3.9 Create new questionnaires

Under development.

User can be similar questionnaires on topics of interest to him and put them into the

program's installation folder in the same file format ld_xxxxxx.ldq by selecting «LD edit text... » in

the main menu. Then the window «LDQ» of creation of a new questionnaire will appear (fig. 4.36),

where you can enter questions and save profile by clicking «Save As».

To improve the efficiency of the questionnaire and increase the reaction of the test, you can

add an image corresponding to the question subject by clicking «img...» to the right of the question

in the window «LDQ» and selecting them from the pictures stored on your computer.

Fig. 4.36 Creation of a new questionnaire

4.3.10 Psychophysiological detection of deception in semi-automatic mode without questionnaires

Using the proposed standard method of comparison areas (Bakcler test) , the user can create

their own thematic tests.


126

During the test operator notes control (by marker CQ) and relevant questions (by marker

RQ) by clicking on the corresponding toolbar button when passing these questions. After the test

the operator (the person asking the questions ) presses the button [!] on the toolbar and instantly

receives a test result in «LDr» window: True (green column - NDI), False (red column - DI) or

uncertain (yellow column - INC).

Example of comparison zones test quantitative psychophysiological responses to control and

relevant questions shown in figure 4.37.

Fig. 4.37. Lie detection process with markers.

4.3.11 Psychophysiological detection of deception in semi-automatic mode, random questions

In «LD audio mode» user needs firstly to adjust «Audio Threshold» so that background

audio level must be lower than Audio Threshold and audio level of questions and answers must be

higher than Audio Threshold. In this case every question-answer response divided by time period

not less than 10 seconds from the next question-answer response is characterized by level of

changes for every measured psychophysiological parameter. The total changes in

psychophysiological parameters are characterized by two general indicators – P5 integral parameter

indicated on the down graph, and P20 differential parameter indicated on the vertical column. More

quantity of P20 parameter after response indicates more high level of psychophysiological response

and gives more lie probability for two response comparison.


127

4.3.12 Recording the main test LD results

Upon completion of the survey the system will automatically go into «Pause» mode to

enable the user to analyze the results on the screen (see fig. 4.38). In the lies level window «LDr»

will display the final test result. For example, DI- the final test result is found «Lie» and the graphs

at the answer to questions 9 and 10 recorded high value P5 parameter (lie).

In «Lie level» window (LDr) on test results may be display 3 variants:

1. True (green column - NDI), then the test person has successfully passed the test.

2. False (red column - DI), it means that the test person has not passed the test.

3. Uncertainty (yellow column - INC), the test result is not clear, the test should be

repeated or modified.

Fig. 4.38. LD test results

Note, Automatically save the results to a file is only available when operating in

«questionnaires» mode.

After completing the questionnaire in lie detection mode automatically in the selected


Data_time_histH.png – frequency histogram.




psycho -emotional state of a person


128

Data_time_LD.txt – lie detector report and result files

Data_time_row.txt – full record values recorded vibraimage system parameters. This



4.3.12.1 Graphics of psychophysiological state changes

Changing of psychoenergetic state of a person to a controlled period of time clearly

displayed on the graph (see fig.4.39) and in file Data_time_histT.png. Only a person who is in a

relaxed or in a state of high concentration may be in a fixed psychoenergetic state during such

insignificant time as 1 minute. Most of the people make a noticeable fluctuations of

psychoenergetic state, even for short periods of time, depending on their thoughts and under the

influence of the environment.

Color line of psychoenergetic state changes corresponds to the «color» of the test question:

general questions – blue;

control questions – green;

relevant questions – red.

Fig. 4.39. Periodic change psychoenergetic state along a certain trajectory, usually

characteristic for an interview, type a question-answer


129

Actual psychophysiological state is displayed in the form of a point and change of person’s

psychophysiological state in time is displayed in the form of a straight line or a curve between two

points. The example of psychophysiological state change from a state 0 in various states 1, 2, 3, 4, 5

is given in figure 4.40 and each transition has its emotional and psychophysiological sense.

Fig. 4.40 Psychoenergetic (information-energy) diagram of the psychophysiological state.

Transition 0-1 is characterized by an increase in energy consumption and improvement of

psychological state. The reason of this psychophysiological state change can be a good or pleasant

news (the stimulus), it leads to a more intensive exchange processes (increase in energy

consumption), and the psychological condition and mood notably improved.

Transition 0-2 is characterized by an increase in energy consumption and an even level of

psychological state. The reason can be, for example, an increase in mental and physical activity,

which lead to more intensive exchange processes (increase in energy consumption), at the same

time, the psychological state and mood are unchanged, as conducted by the impact did not cause

emotional changes.

Transition 0-3 is characterized by an increase in energy consumption and impairment of

psychological state. The reason can be unpleasant information that leads to a more intensive

exchange processes (increase in energy consumption), and the psychological condition and mood

became notably worse.

Transition 0-4 is characterized by a decrease in energy consumption and impairment of

psychological state. The reason can be unpleasant information that leads to a slowing of metabolic

processes (reducing energy consumption), and the psychological condition and mood became

notably worse.


130

Transition 0-5 is characterized by a decrease in energy consumption and improvement of

psychological state. The reason can be pleasant news, which soothes and slows down the metabolic

processes (reducing energy consumption), and the psychological condition and mood are notably

improved.

Vibraimage technology allows to obtain multi-dimensional relationship of a

psychophysiological state characteristics and to measure not only the energy change but also the

direction of this change.

For example, The psychophysiological reactions of the person at the answer to the control

(CQ) and relative questions (RQ) are compared. In answering the question person

psychophysiological state, displayed on the diagram changes from the point with coordinates (E1,

I1) to a point with coordinates (E2, I2).

ER = E1 – E2

IR = I2 – I1

Below we consider the situation where the respondent did not like the question, he's going to

say a lie on it. Energy state in such case increases, i.e. ER < 0, and the psychological comfort is

reduced, and IR > 0.

Comparison of the sum of these indicators for answers to relevant and control questions

allows to define truthfulness of the answer or psycho-energetic expenses at reaction to the shown

answers or incentives.

R = IR + ER

If a difference Rr – Rc = dR < 0, then the person has told a lie (DI) or reacted negatively to

the shown incentive.

Hereinafter the lower indexes «r» designate value of measurement for relevant questions,

and «c» – for control questions.

The results of the human psycho-physiological reactions than the test on the 3 group of

control and relevant questions is contained in a lie detection report file in the section «IE result».


131

4.3.12.2 Recording the main test results

The main results of change of psychophysiological state when carrying out

psychophysiological testing saved in the text file which structure is given in figure 4.41.

################################################################

Area 1 02.02.2016 10:47:44

*VIDEO:Microsoft LifeCam Cinema video timer: 23.3975

LDQ: C:\ELSYS\VibraLieC\ld_credit.ldq

################################################################

Area 2 ### Main config Frame frequency

Fast processing 0,0

Base processing 5,0 FPS period 2,00

Downrate Ч/К 0

... ################################################################

Area 3 ### LD config A1 (fast) 0,00

Calculate Yes

R1 V 1,00 R2 V 2,00

R1 C -2,00

R2 C -2,00 Level 100,00

... ################################################################

Area 4 ###### 1 RQ 02.02.2016 10:48:53 video: 91.7935

Have you been delayed at work today?

################################################################

Start time 02.02.2016 10:48:53

Video timer (start) 01:32 Stop time 02.02.2016 10:49:03

Video timer (stop) 01:42

LD time 02.02.2016 10:49:00

LD video timer 01:38

################################################################

Name cMin bMin cMax bMax vRates cRates

A1X 0,000150238 7,55247e-005 0,0771637 0,0282315 1 -2

A1 0,00409047 0,000426037 0,549241 0,066692 1 -1

A2 20,1334 10,0224 86,2681 19,5487 1 -1 A3

A4X 0,000251693 0,000198452 0,0242119 0,00419498 1 -1 A4 0,0278119 0,00656809 0,253695 0,0292217 1 1

F1X 3,61082e-005 1,96954e-005 0,00541951 0,00272781 1 1

F1D -0,00291492 -0,00152639 0,00382747 0,0026162 2 2 F1 0,00142904 0,000123698 0,048903 0,0132878 1 -1

F2 54,607 40,606 78,4315 55,9861 1 1

F3 F4 102,544 94,83 151,742 124,894 1 -1

F5X 0,16845 0,321748 0,399377 0,484708 1 1

F5 F6 0,150574 0,124949 0,199305 0,152812 1 -1

F7 0,0596623 0,031001 0,114005 0,0664505 1 1


132

F8 0,0384835 0,0491532 0,386444 0,268609 2 2

F9

S1 -131,267 -83,3541 139,172 86,3353 2 1

S2 -18,3586 -9,66255 1,47161 7,26032 1 -1 S3 -0,916659 -0,710579 0,775945 -0,212643 2 2

S4

S5 S6 -0,131085 -0,119924 0,0736296 -0,0764681 1 1

S7 -25,2939 -26,4201 -10,6387 -14,2742 1 0

P1 P2 23,6709 25,6102 26,8731 26,7899 2 -1

P3 0,266011 0,207058 1,40152 0,509807 1 1

P4

LD 4

################################################################ Audio

Level 31,1

Threshold 5,0

Delay (s) 0,00

################################################################

R(m) 4

R(a) 46.4286

tR(i) 357.615

###### 1 RQ 02.02.2016 10:49:03 END

Fig. 4.41. Example of the beginning of the text file with the first relevant question (RQ).

The text «Area 1» relates to general information about the test and provides information

about the date and time of the measurement, the source video signal, if the source - the video file,

then specify the path to the file and its duration (for example, U: \ Eugenia \ 2016_01_27 \ LD \

05.KJKa.avi 05:04). Line «LDQ: C: \ ELSYS \ VibraLieC \ ld_credit.ldq» - indicates the place

where the current questionnaire are stored.

«Area 2» contains information about the current system settings that were used during the

testing.

«Area 3» contains information about the current settings of lie detector, about the

importance (weight) of various parameters.

«Area 4» contains information about the test questions. The text of the question, its serial

number, the type of the question (GQ general,CQ control, RQ relevant), and the time when, during

the question was the maximum value of the parameter P5 (LD Time).

Also for each question are given values of the parameters that have exceeded the established

bMin and bMax limits, and the «weight parameters» in the calculation of the lie level - vRates (for

P5 calculation) and cRates (for P20 calculation).

Than shows the sym cRates for all parameters, whitch values are deliated from norm, for

example, LD = -2 – 1 – 1 – 1 + 1 + 1 + 2 – 1 + 1 – 1 + 1 – 1 + 1 + 2 + 1 – 1 + 2 + 1 + 0 – 1 + 1 = 4

At the end of the field shows the resulting measurement valuesfor each answer, calculated in

three ways :

R(m) 4 (max result) – results from the analysis of the parameter P20;


133

R(a) 46.4286 (average result) – results from the analysis of the parameter P5;

tR(i) 357.615 (integrated result) – results based on the analysis of the area under the

graph of the parameter P5.

At the end of the common text file shows the results of all measurements (fig. 4.42).

######################## max result

RQ(m) 7,00 3

RQ(m) stat: 4,00 0,00 3,00

CQ(m) 7,00 3

CQ(m) stat: 5,00 1,00 1,00

LD(M) INC

######################## average result

RQ(a) 39,29 3

RQ(a) stat: 46,43 28,57 42,86

CQ(a) 34,52 3

CQ(a) stat: 33,93 32,14 37,50

LD(a) DI

######################## integrated result

RQ(i) 275,93 3

RQ(i) stat: 357,62 190,76 279,41

CQ(i) 211,47 3

CQ(i) stat: 214,99 189,43 229,97

LD(i) DI

######################## dT result

Q1: Tc=3.967 Tr=5.666 DI

Q2: Tc=6.067 Tr=5.233 NDI

Q3: Tc=1.534 Tr=1.900 DI

dT result: sTc=11.568 sTr=12.799 INC


134

######################## IE result

Qc1: E1=0.298 E2=0.263 ERc=0.035

I1=0.527 I2=0.553 IRc=0.026

Qr1: E1=0.262 E2=0.278 ERr=-0.016 I1=0.554 I2=0.615 IRr=0.061

Rc=0.062 Rr=0.045 dR=-0.017 DI

Qc2: E1=0.300 E2=0.260 ERc=0.040

I1=0.557 I2=0.586 IRc=0.028 Qr2: E1=0.260 E2=0.256 ERr=0.003

I1=0.589 I2=0.587 IRr=-0.001

Rc=0.068 Rr=0.002 dR=-0.066 DI

Qc3: E1=0.217 E2=0.234 ERc=-0.017 I1=0.530 I2=0.522 IRc=-0.007

Qr3: E1=0.236 E2=0.292 ERr=-0.056

I1=0.527 I2=0.636 IRr=0.109

Rc=-0.024 Rr=0.053 dR=0.076 NDI

IE result: sRc=-0.063 sRr=-0.181 DI

IE final: sRc'=-0.063 sRr'=-0.181 DI=0 NDI=0

######################## global result

LD result INC

Fig. 4.42. Example of LD results file.

The decision is considered the sum of «weights» on relevant RQ question and CQ control

question. If Σ (RQ) > Σ (CQ), a person tells a lie (DI).

Max result – assessment of psycho-physiological reactions to stimuli is carried out taking

into account the various factors of vibraimage parameters significance (RateC).

Average result – average assessment of psycho-physiological reactions to stimuli is carried

out taking into account the equal factors of vibraimage parameters significance (RateV).

Integrated result – integral assessment of psycho-physiological reactions to stimuli is

carried out taking into account the equal factors of vibraimage parameters significance (RateV).

IE result – analysis of changes in psycho-energetic state of a person in the process of

response (fig. 4.39). We compare the physiological response to the control and relevant questions.

dT result – at the end of the file is an analysis of the time delay (in seconds) in answering to

the control (Tc) and the relevant (Tr) questions. Then longer a person is thinking about the answer,

than more likely a lie.

Note, if the camera settings and shooting conditions are wrong, then at the end of the

question, and at the end of the file appears message on the specific reasons for the error with the

quantitative contribution to the overall quality.

Warning: Low quality (1) ! [0.35%]




135

4.3.13 Ranking mode of reactions to questions

In contrast to the mode of comparative testing (comparison test zones proposed by Clive

Bakster) for many variants of psychological and psychophysiological testing necessary to obtain

information about the degree of importance of the various questions for the test person. In this case,

using a questionnaire R_Test program shows the absolute (not relative) the test reactions to

questions. In the text of the questionnaire all the questions marked with the tag <EQ>, for example:

<EQ delay=«5» length=«7» text_delay=«1» text_length=«0»> Are you often change the

decision ?</EQ>

After completing the questionnaire in lie detection mode automatically in the selected


Data_time_histH.png – frequency histogram.




psychoemotional state of a person.

Data_time_LD.txt – lie detector report and result files.

Data_time_row.txt – full record values recorded vibraimage system parameters. This



Data_time_LD_e.txt – an additional file with the results of ranking the importance

of questions for the test.

An example of the calculation results of the file with the ranking table is shown in figure

4.43.


136

----------------matrix table--------------------------------------

R A I S S1 At It M

1 9 2 12 12 12 4 7

2 6 4 4 4 5 2 6

3 5 9 1 5 6 5 9

4 4 1 5 10 4 10 3

5 2 5 10 6 9 9 12

6 1 8 6 9 10 6 10

7 10 6 9 2 2 8 8

8 12 10 2 3 3 3 11

9 8 7 3 8 7 12 4

10 7 11 8 7 1 1 2

11 11 3 7 1 11 7 1

12 3 12 11 11 8 11 5

----------------results of ranking--------------------------------------

R: 4 (24), 9 (30), 6 (31), 5 (32), 12 (37), 2 (40), 10 (40), 1 (55), 3 (60), 8 (60), 7 (61), 11 (76)

---------------- formula calculation for 7 algorithms-------------------------------------

A: P5 [ t' = t(max(P5)) ]

M: P20 [ t' = t(max(P5)) ]

I: Ʃ P5

S: A/(t(max(P5))-t(P5>0))

S1: A/t(max(P5))

At: A/dt

It: I/dt

Fig. 4.43. The results of the ranking of psychophysiological reactions in answering to questions

The number of rows in a matrix table is the number of questions in the questionnaire. The

top line in the table shows the number of questions that caused the maximal response of the subject.

The number of columns equal to 7 - for the number of used calculating algorithms (A, I, S,

S1, At, It, M). Formula each algorithm are shown in the lower part of the log file. In each column

the number of questions in order of their importance (human response). The higher the number of

the question in the column cells, the more psycho-physiological reaction to it showed during the

test.


137

In the «results of ranking» section shows the importance of the overall performance of each

of the questions asked. For example, the question №4 is rated the lowest from all the remaining

question and equal to 24, i.e. in answering this question the testing human showed the biggest

reaction.

4(24) – question №4 (its reaction = 1 (string number) *1 (the number of repetitions of the

question number in the string)+ 2*3 + 4*2+ 9*1 = 1+6+8+9 = 24).


138

5 Operation with external devices

The VibraImage 10 program have the ability to synchronize other devices recording

physiological parameters of the person with the VibraImage system. The synchronous registration

of different physiological processes allows expanding significantly possibilities of research of

psychophysiological and physiological characteristics of the person. Joint and synchronous

registration with the vibraimage of a pulse wave (DC21U scanner) and an electroencephalography

(Mitsar-EEG-201) allows watching visually correlation and correlation of functioning of different

physiological systems of the person.

5.1 Operation with EEG

Technology electroencephalography (EEG) is the most famous and informative for

psychophysiological testing. Therefore, it is EEG was chosen as the technology for comparative

testing vibraimage. Software VibraImage implements a joint synchronous registration and

processing of the signals of electrical activity (EEG) and motor activity (vibraimage). It should be

noted that the registered signals due to mechanical inertia of vibraimage are lower frequency than

the EEG signals, so the correct definition of the correlation between the signals should be carried

out in the frequency range up to 10 Hz.

To working EEG (for example Mitsar-EEG-10/70-201) it is not require the installation of

additional software or drivers. Enough after connecting EEG to choose an item «Mitsar-EEG».

When you connect EEG in information panels «GR» and «С» there will be additional points output

of diagrams and correlation of the following parameters:

EEG_FP1, EEG_FP2, EEG_FPZ, EEG_F3, EEG_F4, EEG_F7, EEG_F8, EEG_FZ,

EEG_Т3, EEG_Т4, EEG_Т5, EEG_Т6, EEG_С3, EEG_С4, EEG_СZ, EEG_P3, EEG_P4,

EEG_PZ, EEG_PG1, EEG_PG2, EEG_O1, EEG_O2, EEG_OZ, EEG_NZ, EEG_BIO1-

EEG_BIO8, EEG_AADIFF, EEG_EVENT.

The figure 5.2 shows an example of viewing graphs of electrical impulses from the EEG in

VibraImage 10.


139

a) b)

Fig. 5.1 New items when connecting EEG:

а) in the «GR» information panel, b) in the «C» information panel

Fig. 5.2. View information from the EEG


140

5.2 Operation with a fingerprint scanner and registration of the pulse wave

Under development.

To use the fingerprint scanner is required initially to install the drivers. The procedure to

install drivers fingerprint scanner DC21U described in detail in the description Biofinger system

(http://www.psymaker.com/downloads/BiofingerManualEng.pdf) in the section «Fingerprint

scanner DC21U driver installation».

Note, to install the DC21U drivers, you must have administrator rights.

You can get to work after connecting a fingerprint scanner to your PC. In the VibraImage 10

program you need choose an item «DC21» in the submenu «Settings». After that there will be a

program window DCРulse (fig. 5.2). It is possible to view and process all diagrams of the program

DCPulse reflecting pulse in different points of a fingerprint figure in the VibraImage 10. When you

connect a fingerprint scanner in information panels «GR» and «С» there will be additional points

(fig. 5.1) output of graphs and correlation of the following parameters:

Pulse AVG_ALL, Pulse SIGMA_ALL, Pulse AVG_ZONE1, Pulse AVG_ZONE2, Pulse

SIGMA_ZONE1, Pulse SIGMA_ZONE2, Pulse AVG_LINE1 - Pulse AVG_LINE3, Pulse

SIGMA_LINE1 - Pulse SIGMA_LINE3, Pulse SIN, Pulse PHASE T, Pulse PHASE A, Pulse

PULSE 10, Pulse AVG_X0 - Pulse AVG_X9, Pulse SIGMA_X0 - Pulse SIGMA_X9.

a) b)

Fig. 5.1 New items when connecting fingerprint scanner DC_21:

а) – in the «GR» information panel, b) – in the «C» information panel.

http://www.psymaker.com/downloads/BiofingerManualEng.pdf


141

Fig. 5.2 Window DCPulse program.


142

6 Vibraimage. General information

Values of amplitude and frequency of vibrations of a person head differ in each point of

space and are displayed as pseudo color image. Integrated processing of parameters values of

vibration in each point can give the general information on parameters of the person movement.

As against amplitude analyses, each point frequency vibraimage has physical dimension

frequencies (Hz) as really displays frequency of signal change in each element of the image.

Therefore the resulted color scale (fig. 6.1) scaling in Hz, i.e. violet color frequency vibraimage

displays a range of vibrations (0-1) Hz, dark blue displays a range of vibrations (1-4) Hz, green the

range of vibrations displays (4-8) Hz, red displays a range of vibrations (8-10) Hz (fig.6.1).

Red – activity and aggression color

Yellow – trouble and tension color

Green – normal activity and top condition color

Blue – rest and calm color

Fig. 6.1. Pseudo color scale of frequency distributions

External (around of a head) interline display of the maximal frequency and average

amplitude vibraimage looks as aura and more informatively displays a condition of the person, than

internal vibraimage. Color of vibra-aura is coded by the same color scale, as vibraimage (fig. 6.2),

and displays the maximal frequency in each line. The size of aura is defined by average amplitude

for the given line. Any non-uniformity in color and the size of aura characterizes movements of

object and its emotion condition. The normal condition of the person(see fig. 6.2) is characterized

more uniform external vibraimage (vibra-aura), and for an stress condition (see fig. 6.3)of the

person are characteristic the big space and color non-uniformity of vibra-aura.


143

Fig. 6.2. External vibraimage (vibra-aura) of

person in normal condition

Fig. 6.3. External vibraimage (vibra-aura) of

person in tension condition

Brief aura form analysis

11. Any aura asymmetry (form, color) characterized deviation from mental or physiological

norms.

12. Color irregularity of vibra-aura characterizes psycho-physiological imbalance of a person

status.

13. Any breaks in aura uniformity characterized deviation from mental or physiological norms.

14. Ideal aura has mono color, symmetrical and uniform. Any real aura differs from ideal and the

question of interpretation is to characterized real aura deviations.

Note!

This brief aura interpretation correspond default vibraimage system settings and based on

main rules for right vibraimage scanning:

uniform and stable object illumination;

high quality and low nose camera application;

frontal plane object before camera;

maximum facial image size on monitor;

mechanical stabilization of camera.

For more information about the basics of vibraimage technology, refer to the book Viktor

Minkin «Vibraimage», St.Petersburg, ed. Renome, 2007 (on Russian language),

http://www.psymaker.com/downloads/bookVI.pdf

More detailed information on basic modes of operation, preparation for work with the

system, the analysis of various human conditions, see the «Behavior Detection System

VibraImage 8. Manual», http://www.psymaker.com/downloads/VI8_1ManualEng.pdf

http://www.psymaker.com/downloads/bookVI.pdf

http://www.psymaker.com/downloads/VI8_1ManualEng.pdf


144

7 Warranty

Maintenance service and service regulations of VibraImage 10 system is carried out

according to this Manual and instructions of used hardware maintenance (a computer, the camera,

etc.).

ATTENTION!

Information in this document is subject to change without notice and does not represent the

commitment on the part of Elsys Corp. No part of this manual maybe reproduced or transmitted in

any form or by any means, electronic or mechanical, for any purpose without written permission of

Elsys Corp. The software VibraImage 10 described in this document is furnished under license

agreement and maybe used only in accordance with the terms of the license agreement. It is against

the law to copy the software or any other medium except as specifically allowed in license

agreement. The licensee may make one copy of vibraimage software for backup purposes.

7.1 Disclaimer of Warranties

You expressly acknowledge and agree that, to the extent permitted by applicable law, use of

the Vibraimage software and services is at your sole risk and that the entire risk as to satisfactory

quality, performance, accuracy and effort is with you. To the maximum extent permitted by

applicable law, the VibraImage 10 software and services performed by the VibraImage 10 software

are provided «as is» and «as available», with all faults and without warranty of any kind, and Elsys

and Elsys’ licensors (collectively referred to as «Elsys» for the purposes of sections 7 and 8) hereby

disclaim all warranties and conditions with respect to the VibraImage 10 software and services,

either express, implied or statutory, including, but not limited to, the implied warranties and/or

conditions of merchantability, satisfactory quality, fitness for a particular purpose, accuracy, quiet

enjoyment, and non-infringement of third party rights. Elsys does not warrant against interference

with your enjoyment of the VibraImage 10 software and services, that the functions contained in or

services performed by the VibraImage 10 software will meet your requirements, that the operation

of the VibraImage 10 software and services will be uninterrupted or error-free, that any service will

continue to be made available, that defects in the VibraImage 10 software or services will be

corrected, or that the Vibraimage software will be compatible or work with any third party software,

applications or third party services. Installation of this software may affect the usability of third

party software, applications or third party services. You further acknowledge that the

VibraImage 10 software and services are not intended or suitable for use in situations or

environments where the failure or time delays of, or errors or inaccuracies in, the content, data or

information provided by the VibraImage 10 software or services could lead to death, personal

injury, 1 or severe physical or environmental damage, including without limitation the operation of

nuclear facilities, aircraft navigation or communication systems, air traffic control, life support or

weapons systems. No oral or written information or advice given by Elsys or an Elsys authorized

representative shall create a warranty. Should the VibraImage 10 software or services prove

defective, you assume the entire cost of all necessary servicing, repair or correction. Some

jurisdictions do not allow the exclusion of implied warranties or limitations on applicable statutory

rights of a consumer, so the above exclusion and limitations may not apply to you.


145

7.2 Limitation of Liability

To the extent not prohibited by applicable law, in no event shall Elsys be liable for personal

injury, or any incidental, special, indirect or consequential damages whatsoever, including, without

limitation, damages for loss of profits, corruption or loss of data, failure to transmit or receive any

data, business interruption or any other commercial damages or losses, arising out of or related to

your use of or inability to use the VibraImage 10 software and services or any third party software

or applications in conjunction with the VibraImage 10 software, however caused, regardless of the

theory of liability (contract, tort or otherwise) and even if Elsys has been advised of the possibility

of such damages. Some jurisdictions do not allow the limitation of liability for personal injury, or of

incidental or consequential damages, so this limitation may not apply to you. In no event shall

Elsys’ total liability to you for all damages (other than as may be required by applicable law in

cases involving personal injury) exceed the amount of twenty five dollars (U.S. $25.00). The

foregoing limitations will apply even if the above stated remedy fails of its essential purpose.

Copyright 2001-2016 Elsys Corp. All rights reserved.

Version VibraImage 10

June 2016

Updates and questions on www.psymaker.com

Russia, 194223, Saint-Petersburg, Toreza, 68

ph./fax: +7 (812) 552 67 19

e-mail: [email protected]

www.elsys.ru

www.psymaker.com

http://www.psymaker.com/

mailto:[email protected]

http://www.elsys.ru/

Behavior Detection System VibraImage -...

Documents

Transcript of Behavior Detection System VibraImage -...