Simulation for Time Series Analysis & Forecasts

64
1/64 Liophant Simulation Liophant Simulation Agostino Agostino Bruzzone & Bruzzone & Simone Simone Simeoni Simeoni Liophant Liophant Simulation Simulation Simulation for Time Series Simulation for Time Series Analysis & Forecasts Analysis & Forecasts [email protected] [email protected] www.liophant.org

Transcript of Simulation for Time Series Analysis & Forecasts

Page 1: Simulation for Time Series Analysis & Forecasts

1/64

Liophant SimulationLiophant Simulation

Agostino Agostino Bruzzone &Bruzzone & Simone Simone Simeoni Simeoni

Liophant Liophant SimulationSimulation

Simulation for Time SeriesSimulation for Time SeriesAnalysis & ForecastsAnalysis & Forecasts

[email protected]@liophant.org

www.liophant.org

Page 2: Simulation for Time Series Analysis & Forecasts

2/64

Liophant SimulationLiophant Simulation

Tutorial Goals

� To identify Critical Issues in Forecasting

� To define M&S Potential in Testing Forecasting

� To introduce Forecast Algorithms

� To describe methodologies for Best Fitting ofForecast Algorithms

� Examples and Exercise in Logistics Networks

Page 3: Simulation for Time Series Analysis & Forecasts

3/64

Liophant SimulationLiophant Simulation

Forecasts

� Forecast is a statement of what is judged tohappen in the future in connection with historicaldata.

� Forecast is what you expect to happen in thefuture.

� Forecasts must be Credible

� People need to Trust Forecastsfor using these with success

Page 4: Simulation for Time Series Analysis & Forecasts

4/64

Liophant SimulationLiophant Simulation

Precision vs. Robustness

In Forecasting the Robustness is the most critical aspect interm of performance evaluation.In this context, usually it is not important to have a highprecision in forecasts if their robustness is still weak.

Robustnessthe degree to which a system orcomponent can function correctly inthe presence of invalid inputs orstressful environment conditionsInstitute of Electrical and Electronics Engineers. IEEE Standard Computer Dictionary: A Compilation ofIEEE Standard Computer Glossaries. New York, NY: 1990.

Page 5: Simulation for Time Series Analysis & Forecasts

5/64

Liophant SimulationLiophant Simulation Predicting the Past andPredicting the Future

The forecast methodologies use historical data to makeassumption about what will happen, but it is really critical forthem to predict major scenario changes.

In this context it is critical to check if:The past can predict the future ?!

Often it is necessary the human support to analyze and notethe market scenario, because the assumption that was trueyesterday will be true tomorrow not ever works.

Page 6: Simulation for Time Series Analysis & Forecasts

6/64

Liophant SimulationLiophant Simulation

Goodyear implemented a demand forecasting systemin mid-2000 but hasn’t shown significantimprovement in managing inventory and in the lastyear tire lost more money then the years ago.

Nike implemented a demand forecasting (i2) in June2000 and nine month later its executivesacknowledged that they would be taking a majorinventory write-off because the forecasts from theautomated system had been so inaccurate.

Forecasting CompanyExamples

Page 7: Simulation for Time Series Analysis & Forecasts

7/64

Liophant SimulationLiophant Simulation

� Forecasting systems are only as good as the data putin.

� Software can't predict the future, particularly sudden,unexpected shifts in economic or market conditions.

� Forecasts sometime affect the System Evolution

“ ...I would say that if you looked at the split betweenpeople, science and process, people are half theequation. Algorithms are algorithms. That is not whatwill win the game for me." Sumatra Sengupta CIO for Scotts Co. 1.8 Billion USD revenues in 2003, Lawn & Garden Care products

Forecasting Systems Highlights

"Anyone who thinks you can do it with just mathematicsand statistics is only partly right. Human intelligence isalso required." Doug Richardson, CIO of Vicor,

150million USD revenues in 2003, managing 1.7trillionUSD transactions over internet

Page 8: Simulation for Time Series Analysis & Forecasts

8/64

Liophant SimulationLiophant Simulation Forecasting SystemsInvestments

In 2002 alone, companies spent $19 billion ondemand forecasting software and othersupply chain solutions. IDC

In a survey of 196 senior executives, 45percent said that supply chain technology ingeneral had failed to meet their expectations.

Page 9: Simulation for Time Series Analysis & Forecasts

9/64

Liophant SimulationLiophant Simulation

Crystal Ball vs. Forecasts

� Crystal Ball don’t Exist

� Forecasts are not Point Values but ConfidenceRegions

� Reliability, Fidelity and Precision of Forecastsneed to be investigated during Analysis

� Sometime Reality is Unpredictable

� Predictability needs to be referred the specificProblem

� Good demand forecasting requires a combinationof accurate data and smart people.

Page 10: Simulation for Time Series Analysis & Forecasts

10/64

Liophant SimulationLiophant Simulation

Advanced TechniquesAdvanced Techniques can be used in order to providesignificant improvements in forecasts performances;among the others�Artificial Neural Networks (ANN)�Fuzzy Logic�Knowledge Based System KBS�Genetic Algorithms�Data Fusion

However� New Forecasts Techniques don’t change the Real

System Predictabilityor

� New Forecasts Techniques can’t overpasstraditional methods and become a Crystal Ball

Page 11: Simulation for Time Series Analysis & Forecasts

11/64

Liophant SimulationLiophant Simulation

Data Fusion & Forecasting� Most Promising advances in Forecasting are related

to merging information techniques devoted toimprove their reliability (Data Fusion, Fuzzy Logic)

Orders

Orders

Success Prob. No ?

Yes

Orders +Virtual Orders generated byForecast Fusion

Real Order Portfolio

Orders to be Simulated

Montecarlo Technique

ITEM iMetaProduct

Mix Component

ITEM jMix

Component

FrequencyDiagram

Random Number

ExtractedValue

CumulativeDiagram

MontecarloTechnique

Forecast

Quantity Estimation

Time Definition

Montecarlo Technique

Montecarlo Technique

Selection of theItem Mixage

Page 12: Simulation for Time Series Analysis & Forecasts

12/64

Liophant SimulationLiophant Simulation

Simulation & Forecasts

Forecasting techniques are devoted to extract in the mostefficient way Knowledge from various Input for improvingForecasting Capabilities

Historical DataExpert EstimationPhenomena SymptomsBoundary Conditions

Modeling & Simulation can be used for testing ForecastingTechniques and for Measuring their Performances overcomplex scenarios

Page 13: Simulation for Time Series Analysis & Forecasts

13/64

Liophant SimulationLiophant Simulation

Stochastic SimulationThe Stochastic Simulation allow to verify the robustness of thedifferent algorithm, we have to consider the following componentcombination on the time series to obtain the test scenario.

0

2

4

6

8

10

12

14

16

18

20

0 5 10 15 20 25 30 35 40

Time

Co

nsu

mp

tio

n0

2

4

6

8

10

12

0 5 10 15 20 25 30 35 40

Time

Co

nsu

mp

tio

n

Stochastic Punctual Variations Trend Components

The Simulator carries out the tests on different replications and itmakes an average of the obtained results on the different scenarios.

Trend hypothesis on DemandTime

SeriesStochastic DemandVariability

Time series

Page 14: Simulation for Time Series Analysis & Forecasts

14/64

Liophant SimulationLiophant Simulation

Advanced Forecasting vs M&S

�Advanced techniques can improve theCapability to Predict a Real System respecttraditional methods

�Modeling & Simulation is still necessary tomeasure robustness and efficiency of theForecasting System

Page 15: Simulation for Time Series Analysis & Forecasts

15/64

Liophant SimulationLiophant Simulation

Forecasting CostsForecasting Costs� Management that not pays attention to forecasting

assumes that what will happen in the future is thesame to what has happened in the past.

� An inadequate forecasting increase:

�Work

�Materials

�Costs (Expediting or Stock - Out ones)

� Increasing forecasting we increase cost ofcollecting and analyzing data.

� The optimal level cost of forecasting implies thebalance of the aspects above.

Page 16: Simulation for Time Series Analysis & Forecasts

16/64

Liophant SimulationLiophant Simulation

Generic ModelsGeneric Models� ARIMA (Autoregressive Integrated Moving

Average) was introduced by Box and Jenkins in1970, who supposed to eliminate the trend andseasonal component in a time series bydifferencing.

� ARMA (Autoregressive Moving Average) modelsa time series that was eliminated trend andseasonal components by differencing.

� ARMAX (Autoregressive Integrated MovingAverage with exogenous input) introduced by Boxand Tiao in 1976 consider the influence ofexogenous variable on the output variable ofinterest.

Page 17: Simulation for Time Series Analysis & Forecasts

17/64

Liophant SimulationLiophant Simulation

State Space MethodsState Space Methods� The State Space Method model separately each

term of a time series 0bservation as :

�Trend Term

�Seasonal Term

�Regression Term

�Disturbance Term

� The State Space Method puts together eachmodels of components in order to obtain a singlemodel for time series analysis.

� The State Space began in 1960 with Kalman.

Page 18: Simulation for Time Series Analysis & Forecasts

18/64

Liophant SimulationLiophant Simulation

Forecasting in Logistics

In logistics and supply chain management Forecasting is used inorder to:

-Estimate the Customer Demand

-Estimates Market Evolution

-Support Inventory Management

-Support Production Planning

Page 19: Simulation for Time Series Analysis & Forecasts

19/64

Liophant SimulationLiophant Simulation

Logistics & Forecasts

In logistics forecasting is really important to predict thefuture demand.In this scenario is really important to determinate where toget the data for the forecasts for the different actors involvedin supply chain.

As a study of Procter & Gamble the further away your data is from the point of sale, the more data accuracy decreased and forecasting errors increases .

In logistic forecasting is necessary use point of sale formationto directly from the retailer to avoid overforecasting demand.

Page 20: Simulation for Time Series Analysis & Forecasts

20/64

Liophant SimulationLiophant Simulation

Supply Chain & ForecastsDemand Forecasts are a particularly important piece ofinformation within a supply chain.

• Each level of a supply chain makes decisions that haveramifications throughout the entire system.

• The quality of a given decision depends on what the decisionmaker knows.

• As a result, the dissemination of accurate information is criticalfor the supply chain to operate effectively.

• Credibility is a key factor in the exchange of information: Willand should the receiver of information trust the veracity of thereported information.

• While credibility is easily established in some cases, it is oftenmore elusive.

• This is especially true when the informed party has an incentiveto distort her message to influence the receiver’s actions.

Gérard P. Cachon, The Wharton School, University of Pennsylvania,Martin A. Lariviere, Kellogg Graduate School of Management, Northwestern University

Page 21: Simulation for Time Series Analysis & Forecasts

21/64

Liophant SimulationLiophant Simulation

Example of CPFR

Collaborative Planning,Forecasting and Replenishment

CPFTRSyncra forP&G2004

Page 22: Simulation for Time Series Analysis & Forecasts

22/64

Liophant SimulationLiophant Simulation

Applications for Forecasting

To Forecasts the Future Forecasting Algorithms are requested.Many different applications (Weather, Economics, Logistics, etc.)

There are several Forecast Algorithms types, many of them arecustomizable, but in the developing phase for all of them thesetting is a really critical issue.

First Order Exponential Smoothing in 1944 was Implemented by Brown and Itwas promoted and used in 1959/1962

Weather Market Logistics Power Medicine Military

Page 23: Simulation for Time Series Analysis & Forecasts

23/64

Liophant SimulationLiophant Simulation

Algorithm Efficiency

The Forecast Algorithm effectiveness has to be measured onstatistic benefits in a medium long scenario not on the precisionon a single point

To use correctly a forecast algorithm is necessary to consider:

- Implementation Methodologies

-Algorithm Robustness

-Management and Procedure consolidation

-Parameter Proper Setting

Page 24: Simulation for Time Series Analysis & Forecasts

24/64

Liophant SimulationLiophant Simulation

Performance/Process ControlConsidering the scenario stochastic nature and variability it isreally important to guarantee a Control System for thePerformance and for the Process.

The Control System has to verify and correct Forecast SystemSettings:- To develop correct time series analysis and synthesis (i.e. Representative

Samples, various mix, errors/ periods with not representativeconsumption)

- To estimate Costs, Benefits and Risks of different Policies (i.e.Warehouse Costs, Stock-Out Risks, Service Quality)

- To develop a forecasting system easy to manage and to maintain (i.e.fitting of forecast algorithm)

- To set an implementing plan in order to control the advancement

- To measure Performances and critic event

- To control the Start - Up and the operative management

Page 25: Simulation for Time Series Analysis & Forecasts

25/64

Liophant SimulationLiophant Simulation

Algorithm’s Selection

In a case study in partnership with one of the most importantItalian Logistic Company that was implementing a new ERPSystem we used DICOSAP Simulator in order to to select theRobustness Algorithm and the parameter setting .

In the specific we used:

- A time series Analyzer in order to detect errors/ periods withnot representative consumption

- A simulator to select the best algorithm and the parametersettings

Page 26: Simulation for Time Series Analysis & Forecasts

26/64

Liophant SimulationLiophant Simulation

DICOSAP Depots & Inventory Clustering Optimal Setting, Analysis & PlanningDepots & Inventory Clustering Optimal Setting, Analysis & Planning

� Fit the parameters of each forecastalgorithms

� Choose the best algorithms

� Define the best algorithm and fit theparameters for different clustering

� Simulate stochastically the time seriesto estimate robustness of algorithms

� test the results on n-replications

� Define the seasonal period on timeseries

Page 27: Simulation for Time Series Analysis & Forecasts

27/64

Liophant SimulationLiophant Simulation

To analyze the effect ofpromotional policies on thecentral warehouse, we usemodel in order to collect allthe historical data about theDepartures and the Arrivalsflows and to analyze them.

Not representativeevent’s Detection

The Model consider inventory management hypothesis on differentscenarios, with days and/or week periods, cutting off the eventsrelated to values not compatible in a statistic way with the timeseries and evaluating the variance on stochastic factor withMontecarlo techniques.

Page 28: Simulation for Time Series Analysis & Forecasts

28/64

Liophant SimulationLiophant Simulation

The affordability and the coherence of the inputsare important issues to carry out a good forecast.

The DICOSAP Simulator was used over a Retail Case Study for:

• Elaborating the consumption historical data of over 15,000 items in a 48months scenario

• Optimal Best Fitting for the parameters ha of 15 algorithms

• Optimal Algorithm Identification for each item for week/day scenarios

Total elaboratingtime: 3 days on 33computers in alocal LAN

Input Importance

Page 29: Simulation for Time Series Analysis & Forecasts

29/64

Liophant SimulationLiophant Simulation

�Item

�Supplier

�Lead Time

�Safety Stock

�Stock -Out Number

�Rotation Index

�Overall

�Best Supply Policy

�Parameter Fitting of the selected algorithm

DICOSAP Simulator

Page 30: Simulation for Time Series Analysis & Forecasts

30/64

Liophant SimulationLiophant Simulation

OVERALL: is the measure of the algorithm excellenceconsidering the warehouse fees and stock - out costs withappropriate weight.

In the case of critical products, the strategicimportance define that Stockout and WarehouseWeights Factors; usually Stockout is moreimportant then Fees.

Evaluation Criteria

∑∑=

=

+=Np

i

ii

Tf

t

ii

tOperazionsstHandlingCotevelInventoryLTf

feescoeffeesWarehouseF

1 0

)()(_

∑∑= =

−⋅=Np

i

ii

Tf

t

i tevelInventoryLtDemandiceSalestsStockoutCo1 0

))()((Pr

∑=

⋅+⋅=Np

iii orWeightFactStockoutstStockoutCoorWeightFactFeeseesWarehouseFOverall

1

__

Page 31: Simulation for Time Series Analysis & Forecasts

31/64

Liophant SimulationLiophant Simulation

For each item, the parameters of every algorithms arevisible in a window or in a file. In the output there aresafety stock level, and the coefficient and parametervalues.

Using automaticoptimizationmethodologies themodel select the mostrobust algorithm.

Parameter Fitting

Page 32: Simulation for Time Series Analysis & Forecasts

32/64

Liophant SimulationLiophant Simulation

ALGOALGO: File with the best algorithm and its parameter fitting

SIMULSIMUL: File with simulation results in term ofconsumption, economic quantification , rotation index,stock -out for each simulation run

SUMMASUMMA: file with season period, the consumption with ashort/long scenario,quantification of fees, stockout andoverall

For each item simulator analyses all data.

DICOSAP Outputs

Page 33: Simulation for Time Series Analysis & Forecasts

33/64

Liophant SimulationLiophant Simulation

•Moving Average

•Weighted MovingAverage

•Single Exp. Smoothing

•Double Exp. Smoothing

•Triple Exp. Smoothing

Forecast Algorithm Examples

Page 34: Simulation for Time Series Analysis & Forecasts

34/64

Liophant SimulationLiophant Simulation

Moving Average AlgorithmThe Moving Average consider a time series before the period topredict and use the historical data to carry out the forecast forthe next period.

For each forecasting step the Moving Average consider the lasthistorical data and delete the oldest one, calculating the new ofaverage on the new time series.

This algorithm allow to smooth the irregular behavior on timeseries.

Order = number of periods

Page 35: Simulation for Time Series Analysis & Forecasts

35/64

Liophant SimulationLiophant Simulation

Weighted Moving AverageThis algorithm use the same principle of the simple MovingAverage , The Weighted Moving Average introduce weightingfactors for each historical data.

Typically, the weights are decreasing for the most remote data.In this algorithm the more weight is assigned to more recentdata.

Otherwise it is possible use different criteria to attribute theweight (i.e. seasonal).

WMA(3) = Pt+1 = p1(X t) + p2(X t-1) + p3(X t-2)

Third Order Weighted Moving Average

pi = weight

Pt +1 = forecast

X t = time series

Page 36: Simulation for Time Series Analysis & Forecasts

36/64

Liophant SimulationLiophant Simulation

Single Exp. SmoothingThe most fundamental aspect for this algorithm is the recent timeseries give a best support to make assumption on the futurebehavior. Using this algorithm it is possible reduce the number ofnecessary data for forecasting ad so reduce the database size.

0 ≤ α ≤ 1

High values of α means a major weightattributed to time series

P= Forecast

X=Time Series

Low αValue

High αValue

ttttt PXXPfP )1()(1 αα −+==+

Page 37: Simulation for Time Series Analysis & Forecasts

37/64

Liophant SimulationLiophant Simulation

Double Exp. Smoothing

The Double Exponential Smoothing use two coefficients α e β,making forecasts in two steps: a Basic Value (St) and a Trend Value(Gt), in order to consider also trend effects.

S1 e G1 can be estimated on the time series or usingregression methodology. The α e β factors can be

optimized using algorithms.τ = interval time

))(1( 11 −− +−+= tttt GSXS αα

11 )1()( −− −+−= tttt GSSG ββ

Page 38: Simulation for Time Series Analysis & Forecasts

38/64

Liophant SimulationLiophant Simulation

Triple Exp. SmoothingThis algorithm consider three components to carry out forecasting :

- a Basic Value St

- a Trend Value Gt

- a Seasonal Value Ct

The lack of seasonal effect is the most important critical issue ofDouble Exp. Smoothing

τ=Analysis Period

S = seasonal period

))(1( 11 −− +−+= tttt GSXS αα

11 )1()( −− −+−= tttt GSSG ββ

stt

tt C

S

XC −−+= )1( γγ

Page 39: Simulation for Time Series Analysis & Forecasts

39/64

Liophant SimulationLiophant Simulation

Parameter OptimizationThere are several methodologies to calculate the forecast accuracy ofthe different algorithms. The most common used are:

Total Error Minimization

M.A.D. : Mean Absolute Deviation

M.S.E. : Mean Squared Error

The algorithm forecast accuracy is not measured on the minimizationof the difference between forecast and actual value but on therobustness.

t

n

i

t nConsumptioForecastErrorTotal −=∑=1

_

∑=

−=n

i

tt nConsumptioForecastn

DAM1

1...

( )2

1

1... ∑

=

−=n

i

tt nConsumptioForecastn

ESM

Page 40: Simulation for Time Series Analysis & Forecasts

40/64

Liophant SimulationLiophant Simulation

Algorithm Comparison

Each model has specific features; we have to pay attention aboutthe Robustness, that is the capability to suggest optimum resultseven if there are aleatory components to disturb the scenario.

It is necessary to guarantee a management and accurate settingsof the forecast algorithms parameters in order to represent thereality evolution.

Growing

Page 41: Simulation for Time Series Analysis & Forecasts

41/64

Liophant SimulationLiophant Simulation

Forecast vs. Time SeriesMoving Average Examples

The Forecast inertia increase withthe increasing of the period number.

Moving Average

Periods

Con

sum

ptio

n

Time Series

2° Moving Average

4° Moving Average

8° Moving Average

Page 42: Simulation for Time Series Analysis & Forecasts

42/64

Liophant SimulationLiophant Simulation

Forecast vs. Time SeriesExp. Smoothing Examples

α

With α increasing, last valuesinfluence is more sensible on forecast

Periods

Con

sum

ptio

n

Time Series

Single Exp. Sm. 0.2

Single Exp. Sm. 0.5

Single Exp. Sm. 0.8

Page 43: Simulation for Time Series Analysis & Forecasts

43/64

Liophant SimulationLiophant Simulation

The different types of Exp.Smoothing allowto consider trend and seasonal behavior

Forecast vs. Time SeriesSingle vs. Double vs. Triple

Periods

Con

sum

ptio

n

Time Series

Single Exp. Sm.

Double Exp. Sm.

Triple Exp. Sm.

Page 44: Simulation for Time Series Analysis & Forecasts

44/64

Liophant SimulationLiophant Simulation

Seasonal Period Analyses

A prior knowledge of a probable seasonal period in the timeseries allow to know better the studying scenario and to carryout strategic forecast on the real case study at the same time.

For some Forecast algorithms (i.e. Triple ExponentialSmoothing) the seasonal period of time series is an input data.

We has estimate the seasonal period converting the time seriesin the frequency range.

Page 45: Simulation for Time Series Analysis & Forecasts

45/64

Liophant SimulationLiophant Simulation

Example from a Realistic Case

Typically real behaviors with strong stochasticcomponent and high values of Standard Deviationrespect the mean value

Page 46: Simulation for Time Series Analysis & Forecasts

46/64

Liophant SimulationLiophant Simulation

Period Analysis

In order to identify a priori possible seasonal behaviors on thedemand it is useful to acquire knowledge related to theprocesses under analysis and to its characteristics.

Some predictive algorithms (i.e. Triple Exponential Smoothing)have parameters considering the periodic component in timeseries.

By a frequency analysis based on Fourier transform it ispossible to identify the impact of periodic components.

Page 47: Simulation for Time Series Analysis & Forecasts

47/64

Liophant SimulationLiophant Simulation

Autocorrelation Analysis

Most Common Periods

1 2

34

5

6

7

9

14

15 19

21

28

32

35

42

47

49

55

56

60

63

70

72

7784

91

105

109112

119

122

126

127133138

147

154161

168

175180

182

188189196199

203

207

210

224

231

238

245

252259

265

266

269

273

277279

280

285

287

289

294

301

306

308

311313

314

315316

318

322

324

325

330

334335

336

340342350

354

3600%

1%

10%

100%1 10 100 1000

Best Autocorrelation / Period [days]

Occ

ure

nci

es o

ver

Go

od

Po

pu

lati

on

Most Common Periods

1

2

3

4

5

6

8

10

12

16

18

20

212426

30

3234

364042

444546

48

49

60

6162717274

78

8084909697

98

100

102

106

108

114116

118

120

122126128

130131

132

138

142144146

148

149

150

160

162

166167

168

170

172

174

176

177

180

186

190

192

194198199202

204

208210216220222226228

230

231236

237

240

244

246

248

258

260264268

270

272

276

278280

282

284286287

288

289290292293

294

295296298

300

301

302

304

306

307

308

310

312

314

315

316

318

320

322

323

324

327

330

334

335

336338

340

342

343

344

346348

350

351353

354

356

357358359

360

362

363

364

0%

1%

10%

100%1 10 100 1000

Best Autocorrelation / Period [days]

Occ

ure

nci

es o

ver

Go

od

Po

pu

lati

on

Autocorrelation analysis allows to identify the most significantperiodic component over a time series.

These figures are related to the case studyproposed about the demand of frozen goods.These figures consider the week withoutSundays (due to the delivery policies in use) itis evident that six days and multiple periodsare the most common and significant periodiccomponent.

In this figure the same representation isproposed considering weeks including all thedays; in this case the most significant periodis seven days and its multiples so is evidentthat consumption of these goods arecharacterized by week periodic behavior.

Page 48: Simulation for Time Series Analysis & Forecasts

48/64

Liophant SimulationLiophant Simulation

Autocorrelation Example

Autocorrelazione ITEM

0

500000

1000000

1500000

2000000

2500000

3000000

3500000

0 28 56 84 112 140 168 196 224 252 280 308 336 364

Delta T [days]

Au

toco

rrel

azio

ne

Real Consumption

0

50

100

150

200

250

0 10 20 30 40 50 60 70 80 90 100

110

120

130 140 150

160

170

180

190 200 210

220

230

240 250 260

270

280

290

300 310

320

330

340

350 360

Time [Days]

Co

nsu

mp

tio

n [

Pz]

Real Consumption

Autocorrelation

Max

Autocorrelation Analysis

• Autocorrelation highlights thepresence of periodic components

• In this case the behavior seemsincluding high randomcomponents (noise)

• Autocorrelation have is maxvalue in correspondence with 7days. However this value is just alittle bit higher than other timeshifts

• Zoom on a time windows it isevident that the week periodiccomponent is present but not toomuch significant

Real Consumption

0

50

100

150

200

250

0 7 14 21 28 35 42 49 56 63 70

Time [Days]

Con

sum

ptio

n [P

z]

Page 49: Simulation for Time Series Analysis & Forecasts

49/64

Liophant SimulationLiophant Simulation

Stochastic and PeriodicComponents

• Define the periodic componentinfluence over the time series.

• Main Frequency in this casereproduces just qualitatively theoverall behavior.

• It is evident that in the proposed casethe combination of first fivefrequencies have very lowreproduction capability over thishistorical behavior.

• The overall periodic behavior can bereconstructed just by adding all thehigh frequency components (noise).

Real Demand and Main Frequency

Real Demand and First 5 Frequencies

Total Time Series Reconstruction with all the Frequencies

By Fourier Analysis it is possibleto:

Page 50: Simulation for Time Series Analysis & Forecasts

50/64

Liophant SimulationLiophant Simulation

Time Series & Frequencies

0.001%

0.010%

0.100%

1.000%

10.000%

100.000%

6.5

7.5

13 15 26 33 55 65 85 95 115

125

135

170

180

350

5000

ALT

RO

Period [days]

Infl

uen

ce o

f th

e C

om

po

nen

t [%

]

MaxMeanMin

Different PeriodicComponents Analysis

Using the Fourier Series Methodology we identify the frequency’sinfluence determined on the each time series behavior.

In our case, even if thesix and seven daysfrequencies are themost significancetogether the semesterand the annual one,their influence is lessimportant thenaleatory components inthe time series (ALTRO).

Page 51: Simulation for Time Series Analysis & Forecasts

51/64

Liophant SimulationLiophant Simulation

The M.A.D. CalculationWe have choose the M.A.D. as optimization parameter because in acomplex scenario it allows to obtain number easier to manage.

In the case study proposed the M.A.D.calculation was made in twodifferent ways:

� Lead Time M.A.D.: the forecast is carried out on the Lead Timeand the delta among forecast and the time series are calculated.

� Future M.A.D.: the time orison is divided in two part, the firstpart is the total scenario less then the lead time and the other oneis the lead time. On the first part the algorithm is optimized and onthe second part the selected optimum one is tested.

The Future M.A.D. emphasize in a clear way the real performance ofthe selected algorithm.

Page 52: Simulation for Time Series Analysis & Forecasts

52/64

Liophant SimulationLiophant Simulation

The different M.A.D.

2

3

4

5

6

7

8

9

10

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32

Time

Co

nsu

mp

tio

n

Old Data for Optimization New DataLead Time

2

3

4

5

6

7

8

9

10

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32

Time

Co

nsu

mp

tio

n

\

Lead Time Lead Time

• Mean MAD in Lead Timeover Complete Time Series

• Parameters Optimized onMAD over All Data

• Tested and Measured overAll Data

• Mean MAD in Last LeadTime

• Parameters Optimized onMAD over “Old” Data

• Tested and Measured over“New” Data

Page 53: Simulation for Time Series Analysis & Forecasts

53/64

Liophant SimulationLiophant Simulation

Complexity of the Frameworks

It is important to state the complexity of the framework to beanalyzed.

To identify the complexity of the problem we can have an hypothesisabout the case related to frozen goods over a regional area with about30 millions inhabitants involving about 1470 types of item from 90suppliers organized in categories 96 with 33 subcategories and 11product segments.

Demand is based on historical data about quantities delivered dailyover the supply chain.

Page 54: Simulation for Time Series Analysis & Forecasts

54/64

Liophant SimulationLiophant Simulation

ExerciseExercise

� The proposed exercises is related to the Demandestimation of books

� In this Application case we need to identify howsimulation can support forecasting and whatresults we can obtain

� Scenario Characteristics:�Book Demand

�1242 Books Types

�6 Books Categories

�6 Books Subcategories

�6 Books Segments

�6 Books Suppliers

Page 55: Simulation for Time Series Analysis & Forecasts

55/64

Liophant SimulationLiophant Simulation

Simulation SettingsSimulation Settings

� Simulation in this exercise will be used to:

�Reconstruct Scenarios from Historical Databased on stochastic components

�Estimate robustness of algorithms to demandobscillations

� As Simulationists we need to:

�Identify the Variability and Trend to be addedto historical data

�Identify the number of Simulation RunsRequired to estimate overall performances

Page 56: Simulation for Time Series Analysis & Forecasts

56/64

Liophant SimulationLiophant Simulation

Trend & Trend & NoiseNoise� The analysis of the historical data plus the expert

knowledge in this case allows to identify the bestsetting:

�Trend Usually have to be estimated based onlast significant period trend analysis(i.e.regression) plus expert expectations

�Noise could be based on Standard deviationcollected over an analysis window related toa significant periodplus expertexpectation

Page 57: Simulation for Time Series Analysis & Forecasts

57/64

Liophant SimulationLiophant Simulation

ReplicationsReplications

� The simulation requires N replications changingthe random seeds in order to provide stableperformance; this could be estimated by applyingMean Square pure Error Temporal EvolutionAnalysis. Mean Square pure Error of TF

0.00E+00

1.00E+11

2.00E+11

3.00E+11

4.00E+11

5.00E+11

6.00E+11

1 101 201 301 401 501 601 701 801 901

Replications

MS

pE

(n)

E 1

(E2) 2

tb,n-12

__

Page 58: Simulation for Time Series Analysis & Forecasts

58/64

Liophant SimulationLiophant Simulation

Periodic ComponentPeriodic ComponentIdentification Identification && Evaluation Evaluation

� In order to complete this part we will:

�Take a Look on Item Demand over time

�Proceed to Autocorrelate each Item Demand

�Identification of Most Significant Period

�Proceed to Fourier Analysis on Each Item

�Identification of Periodic Component Influences

Page 59: Simulation for Time Series Analysis & Forecasts

59/64

Liophant SimulationLiophant Simulation

Best ClusteringBest Clustering

� Another important result is to use simulation inorder to group in the best ways items.

�Optimizing each grouping opportunity on bestalgorithms will provide an estimation of bestgrouping under different hypotheses

Page 60: Simulation for Time Series Analysis & Forecasts

60/64

Liophant SimulationLiophant Simulation

Best AlgorithmBest Algorithm

� For each Group it is possible to use simulation tomeasure overall performances and robustness for:

�identification of best algorithm

�best fitting of parameters for best algorithm

Page 61: Simulation for Time Series Analysis & Forecasts

61/64

Liophant SimulationLiophant Simulation

ConclusionsConclusions

� Simulation can improve performances of forecastingtechniques by:�Testing Hypotheses about the real System�Testing a priori their robustness� Identify best Management Policies� Identify best Algorithms and Fitting their Parameters�Evaluating the Operative Margins versus Predictability

Levels

� Simulation can’t provide:�Better Estimations on the Models than on real System�Crystal Ball on the Future�Correct Prediction in Random Systems

Page 62: Simulation for Time Series Analysis & Forecasts

62/64

Liophant SimulationLiophant Simulation

Amico Vince, Guha R., Bruzzone A.G. (2000) "Critical Issues in Simulation", Proceedings of Summer Computer Simulation Conference, Vancouver, JulyBox, G.E.P., Jenkins, G.M. and Reinsel, G.C. (1994). "Time Series Analysis,Forecasting and Control" 3rd edition. San Francisco: Holden-DayBrockwell, P.J. and Davis, R.A. (1987). "Time Series: Theory and Methods". New York: Springer-Verlag.Bruzzone A., Mosca R., Orsoni A., Revetria R. (2001) "Forecasts Modelling in Industrial Applications Based on AI Techniques", International Journal of

Computing Anticipatory Systems (extended from Proeedings of CASYS2001, Liege Belgium August 13-18), Vol 11, pp. 245-258, ISSN1373-5411

Bruzzone A.G., Briano C., Brandolini M. (2000) "Forecast Modelling integrated with ERP Systems", Proceedings of HMS2000, Portofino, October 5-7Bruzzone A.G., Giribone P. (1998) "Decision-Support Systems and Simulation for Logistics: Moving Forward for a Distributed, Real-Time, Interactive

Simulation Environment", Proceedings of the Annual Simulation Symposium IEEE, Boston, 4-9 AprilBruzzone A.G., Giribone P. (1998), "Robust and Central Composite Design as Collaborative Techniques for Production Planning using Simulation",

Proceedings of Eurosim98, Helsinki, April 14-17Bruzzone A.G., Giribone P., Mosca R. (1996) "Simulation of Hazardous Material Fallout for Emergency Management During Accidents", Simulation, vol.

66, no.6, June, 343-355Bruzzone A.G., Giribone P., Revetria R., Solinas F, Schena F. (1998) "Artificial Neural Networks as a Support for the Forecasts in the Maintenance

Planning", Proceedings of Neurap 98, Marseilles, 11-13 MarchBruzzone A.G., Kerckhoffs (1996) "Simulation in Industry", Genoa, Italy, October, Vol. I & II, ISBN 1-56555-099-4Bruzzone A.G., Merkuryev Y.A., Mosca R. (1999) "Harbour Maritime & Industrial Logistics Modelling & Simulation", SCS Europe, Genoa, ISBN 1-

56555-175-3Bruzzone A.G., Mosca R. (1998) "Special Issue: Harbour and Maritime Simulation", Simulation, Vol.71, no.2, AugustBruzzone A.G., Mosca R. (1999) "Modelling & Simulation And Erp Systems For Supporting Logistics In Retail", Proceedings of ESS99, Erlangen,

OctoberBruzzone A.G., Mosca R., Revetria R. (2002) "Supply Chain Management Dynamic Negotiation using Web Integrated Logistics Designer (WILD II)",

Proceedings of MAS2002, Bergeggi October 3-5Bruzzone A.G., Revetria R. (1999) "Artificial Neural Networks as Support for Logistics in Super-Market Chains", Proceedings of HMS99, Genoa,

September 16-18Bruzzone A.G., Revetria R. (2000) "FRINE: Forecasts Robust Intelligent Evaluator", Marconi Communication Report, Genova, NovemberBruzzone A.G., Revetria R. (2003) "Simulation as Support for Contract Negotiation", Proceedings of ASTC2003, Orlando FL USA, AprilBruzzone A.G., Simeoni S., Briano C., Brandolini M. (2002) "Chaotic System Study In Process Plants By Using Simulation", Proceedings of AI2002,

Innsbruk, February 18-21Burman, J.P. (1980). "Seasonal adjustment by signal extraction", J.Royal Statistical Society A, 143,321-37Chatfield C.(2003) "The Analysis of Time Series: An Introduction",CRCde Jong P. and Shephard, N. (1995). "The simulation smoother for time series models", Biometrika, 82, 339-50

ReferencesReferences

Page 63: Simulation for Time Series Analysis & Forecasts

63/64

Liophant SimulationLiophant Simulation

Durbin, J. (1960). "Estimation of parameters in time series regression models", J.Royal Statistical Society B, 22,139-53DurbinJ., Koopman S.J. (2001) "Time Series Analysis by State Space Methods", Oxford Press, NYCFahrmeir, L. and Tutz, G (1994). "Multivariate Statistical Modelling Based on Generalized Linear Models". Berlin: SpringerFranses P.H. (1998) "Time Series Models for Business and Economic Forecasting", Cambridge University PressGelman, A. (1995). "Inference and monitoring convergence", in Gilks et al. (1996), pp. 131-143Giribone P, Bruzzone A.G. M.Antonetti, G.Siciliano(1997) "Innovative Energy Management Techniques In Telecommunication Stations Through The

Application Of Neural Models", Proceedings of 1st World Congress on Systems Simulation, Singapore, September 1-4Giribone P. & A.G.Bruzzone (1995) "Chaos Theory: a Coal Terminal Design Application", Proceedings of MIC95, Innsbruck, February 20-23Giribone P., A.G.Bruzzone (1994) "Analysis through Simulation of Unstable Variables based on Chaos Theory: Warehouse Management in a Port

Terminal", Proceedings MIC94, Grindelwald, February 21-23Giribone P., Bruzzone A.G. & Tenti M. (1996) "Local Area Service System (LASS): Simulation Based Power Plant Service Engineering & Management",

Proc. of XIII Simulators International Conference, New Orleans LA, April 8-11Granger, C.W.J. and Newbold, P. (1986). "Forecasting Economic Time Series" 2nd edition Orlando : Academic PressHamilton J.D. (2003) "Time Series Analysis", Princeton University pressHarvey A.C. (1989). "Forecasting, Structural Time Series Models and the Kalman Filter" Cambridge University PressKalman, R.E. (1960). "A new approach to linear filtering and prediction problems", J.Basic Engineering, Transactions ASMA, Series D, 82, 35-45Lambert D.M., Stock J.A., Ellram L.M. (1998) "Fundamentals of Logistics Management", McGraw Hill, NYCMakridakis, S., Wheelwright, S.C. and Hyndman, R.J. (1998). "Forecasting: Methods and Application" 3rd edition. New York: Wiley and SonsMerkuriev Y., Bruzzone A.G., Novitsky L (1998) "Modelling and Simulation within a Maritime Environment", SCS Europe, Ghent, Belgium, ISBN 1-

56555-132-XMills, T. C. (1993). "Time Series Techniques for Economists" 2nd edition. Cambridge: Cambridge University PressMonks J.G. (1996) “Operations Management” 2nd edition. New York: McGraw Hill.Mosca R., Bruzzone A.G. (1997) "Simulation as a Support for Customer Satisfaction-Oriented Planning", Proceedings of Simulators International XIV,

SMC'97, Atlanta, Georgia, April 6-10Naadimuthu G., Bronson R. (1997) “Operations Research” 2nd edition. New York: McGraw Hill.Reinsel C.G. (1997) “Elements of Multivariate Time Series Analysis ”. 2nd edition New York: SpringerSage, A.P. and Melsa, J.L.(1971). "Estimation Theory with Application to Communication and Control". New York: McGraw Hill.Shephard, N. (1993). "Fitting non-linear time series models, with aplications to stochastic variance models", J.Applied Econometrics, 8, S135-52Shumway, R.H. and Stoffer,D.S.(2000). "Time Series Analysis and Its Applications". New York: Springer-VerlagTaylor, S.J. (1986). "Modelling Financial Time Series". Chichester: John Wiley.Theil, H. and Wage, S. (1964). "Some observation on adaptive forecasting, Management Science", 10, 198-206

ReferencesReferences

Page 64: Simulation for Time Series Analysis & Forecasts

64/64

Liophant SimulationLiophant Simulation

Agostino Bruzzone &Simone Simeoni

Liophant SimulationHeadquartersvia Molinero 117100 Savona, ItalyTel +39 019 264 555Fax +39 019 264 558

URL: www.liophant.orgEmail: [email protected]

[email protected]

Liophant Simulation

ReferencesReferences