Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference...

13
Usage of FOT/NDS data as a reference for verification & validation methods Jan Sauerbier July 2018

Transcript of Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference...

Page 1: Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference for verification & validation methods Jan Sauerbier July 2018

Usage of FOT/NDS data as a reference for verification & validation methods

Jan Sauerbier

July 2018

Page 2: Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference for verification & validation methods Jan Sauerbier July 2018

Processing Data from Different Data Sources

© PEGASUS | Usage of FOT/NDS data as a reference for verification & validation methods | July 2018 2

PEGASUSDatabase

Parameter

Space

Logical

Scenarios

FOT/NDS with human driver

FOT with HAD system

Accident data

Driving Simulator

(Traffic-) Simulation

Test drive

Page 3: Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference for verification & validation methods Jan Sauerbier July 2018

Further Data Sources

© PEGASUS | Usage of FOT/NDS data as a reference for verification & validation methods | July 2018 3

Scenario Description Scenario Relevance Scenario Reference

Real Traffic Data (human driver)

Complete (depending on sensor

setup)Frequency of scenarios Limited

FOT with active ADAS/HAF function

Complete (depending on sensor

setup)

Frequency of scenarios with HAD/ADAS-function

Limited

FOT/NDS measurementdata scenarios

Realistic Parameter Combinations

Limited, only withstatistical population

Limited

Proving ground(test track)

Identification of human performance

SimulationIdentification of physical

boundaries of the scenariosTheoretical performance

Accident dataLimited (just two mainaccident participants)

Limited, only withstatistical population

Examples for negative human

performance

Driving simulatorIdentification of human

performance

Page 4: Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference for verification & validation methods Jan Sauerbier July 2018

Processing Chain of the Database

© PEGASUS | Usage of FOT/NDS data as a reference for verification & validation methods | July 2018 4

Data base

Post processing

of individual

scenarios

Abstraction of datalow high

Spec

ific

atio

no

fsc

enar

ios

low

hig

h

Requirement definition and selection criteria

Generation of

common environ-

ment and traffic

description

By data owner1

Time (s)

Scenari

o p

ara

met

er

Speed

Position in lane

Data checks and

administration

2 Generation

of deduced

signals

3

Time (s)

De

du

ce

dsi

gnals TTC

Use case

definition

0

Elements of the database

External elements

Legend

Determination

of scenario

affiliation

4

Time (s)

Fre

e d

rivin

g

1

0

Time (s)

Cut in

1

0

Time (s)

Follow

ing 1

0

Measurement

Data Scenarios

Merging of

scenarios and

determining of

exposures

5

Scenario

Fre

quen

cy

min TTC (s)

Fre

quency

Par. A

Pa

r. B

Parameter

space

Logical

scenarios

Test speci-

fications

Definition

of test

specifications

6

xP

ID vstart dstart vrel

1 120 15 -12

2 100 4 20

3 90 6 15

V3

Input data

Page 5: Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference for verification & validation methods Jan Sauerbier July 2018

Process to Upload Data into the Database

© PEGASUS | Usage of FOT/NDS data as a reference for verification & validation methods | July 2018 5

Signals according to JSON definitionsMinimum requirements on datasetFormat

Database Upload

Converteddataset

Converting to JSON signal definition

Dataset

Vehicle following with critical sudden braking

Page 6: Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference for verification & validation methods Jan Sauerbier July 2018

Displaying Deduced Signals in the Database

© PEGASUS | Usage of FOT/NDS data as a reference for verification & validation methods | July 2018 6

Page 7: Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference for verification & validation methods Jan Sauerbier July 2018

Determination of Scenario Affiliation

© PEGASUS | Usage of FOT/NDS data as a reference for verification & validation methods | July 2018 7

Page 8: Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference for verification & validation methods Jan Sauerbier July 2018

Determination of Scenario Affiliation

© PEGASUS | Usage of FOT/NDS data as a reference for verification & validation methods | July 2018 8

Page 9: Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference for verification & validation methods Jan Sauerbier July 2018

Scenario parameter

© PEGASUS | Usage of FOT/NDS data as a reference for verification & validation methods | July 2018 9

Ego

dxi

Initial distance

ye,i

Initial position ego in lane

Obj

yo,i

Initial position obj in lane

yo,f

Final position obj in lane

dyo

Lateral lanechange distance

Legend indices: e=ego, o=object, i=initial, f=final

Page 10: Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference for verification & validation methods Jan Sauerbier July 2018

Parameter distribution – correlations

© PEGASUS | Usage of FOT/NDS data as a reference for verification & validation methods | July 2018 10

Page 11: Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference for verification & validation methods Jan Sauerbier July 2018

Testing of a Concrete Scenario in Simulation

© PEGASUS | Usage of FOT/NDS data as a reference for verification & validation methods | July 2018 11

The selected concrete scenario can be reproduced in the simulation. A HAD-function integrated in the simulation can be tested.

Here: Vehicle following with sudden critical breaking maneuver

Page 12: Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference for verification & validation methods Jan Sauerbier July 2018

Testing of a Concrete Scenario in the Driving Simulator

© PEGASUS | Usage of FOT/NDS data as a reference for verification & validation methods | July 2018 12

The selected concrete scenario can be reproduced in the driving simulator.

Measuring human performance in the concrete scenario

Investigation of the acceptance of the HAD-function in the concrete scenario

Page 13: Usage of FOT/NDS data as a reference for verification ... · Usage of FOT/NDS data as a reference for verification & validation methods Jan Sauerbier July 2018

© PEGASUS | Usage of FOT/NDS data as a reference for verification & validation methods | July 2018 13

Contact:

fka Forschungsgesellschaft Kraftfahrwesen mbH Aachen

Jan Sauerbier, M.Sc.

[email protected]

+49 241 80 25614

www.pegasusprojekt.de