The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of...
-
Upload
consolacion -
Category
Documents
-
view
217 -
download
3
Transcript of The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of...
![Page 1: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/1.jpg)
1
3
4
5
6
7 Q1
8
9101112
1314
1 6
171819202122232425
2 6
48
49
50
51 Q3
52
53
54
55
56
57
58
Q2Q1
Expert Systems with Applications xxx (2014) xxx–xxx
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
Contents lists available at ScienceDirect
Expert Systems with Applications
journal homepage: www.elsevier .com/locate /eswa
The assessment of evolutionary algorithms for analyzing the positionalaccuracy and uncertainty of maps
http://dx.doi.org/10.1016/j.eswa.2014.04.0250957-4174/� 2014 Published by Elsevier Ltd.
⇑ Corresponding author. Tel.: +34 950214501.E-mail addresses: [email protected] (F. Manzano-Agugliaro), [email protected]
(F.G. Montoya), [email protected] (C. San-Antonio-Gómez), [email protected] (S. López-Márquez), [email protected] (M.J. Aguilera), [email protected] (C. Gil).
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment of evolutionary algorithms for analyzing the positional accuracy andtainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.1016/j.eswa.2014.04.025
Francisco Manzano-Agugliaro a, Francisco G. Montoya a,⇑, Carlos San-Antonio-Gómez d,Sergio López-Márquez b, Maria J. Aguilera c, Consolación Gil b
a Department of Engineering, University of Almería, 04120 Almería, Spainb Department of Informatics, University of Almería, 04120 Almería, Spainc Department of Applied Physics, University of Cordoba, Cordoba, Spaind Department of Cartographic Engineering, Geodesy and Photogrammetry, Polytechnic University of Madrid, 28040 Madrid, Spain
27282930313233
a r t i c l e i n f o
Keywords:Pareto frontEvolutionary algorithmHistorical mapCoordinate transformationMap transformationMulti-objective optimization
34353637383940414243444546
a b s t r a c t
Pre-geodetic maps are an important part of our cultural heritage and a potential source of information forhistorical studies. Historical cartography should be evaluated in terms of precision and uncertainty priorto their use in any application. In the last decade, the majority of papers that address multi-objectiveoptimization employed the concept of Pareto optimality. The goal of Pareto-based multi-objective strat-egies is to generate a front (set) of nondominated solutions as an approximation to the true Pareto-opti-mal front. This article proposes a solution for the problems of multi-objective accuracy and uncertaintyanalysis of pre-geodetic maps using four Pareto-based multi-objective evolutionary algorithms: HVSEA,NSGAII, SPEAII and msPESA. ‘‘The Geographic Atlas of Spain (AGE)’’ by Tomas Lopez in 1804 provides thecartography for this study. The results obtained from the data collected from the kingdoms of Extrema-dura and Aragon, sheets of maps (54-55-56-57) and (70-71-72-73), respectively, demonstrate the advan-tages of these multi-objective approaches compared with classical methods. The results show that theremoval of 8% of the towns it is possible to obtain improvements of approximately 30% for HVSEA,msPESA and NSGAII. The comparison of these algorithms indicates that the majority of nondominatedsolutions obtained by NSGAII dominate the solutions obtained by msPESA and HVSEA; however, msPESAand HVSEA obtain acceptable extreme solutions in some instances. The Pareto fronts based on multi-objective evolutionary algorithms (MOEAs) are a better alternative when the uncertainty of map ana-lyzed is high or unknown. Consequently, Pareto-based multi-objective evolutionary algorithms establishnew perspectives for analyzing the positional accuracy and uncertainty of maps.
� 2014 Published by Elsevier Ltd.
47
59
60
61
62
63
64
65
66
67
68
69
1. Introduction
Pre-geodetic maps are an important part of our cultural heri-tage (Jenny & Hurni, 2011) and provide a suitable cartographicbase for historical urban and landscape analyses (San-Antonio-Gómez, Velilla, & Manzano-Agugliaro, 2014). These maps have tra-ditionally been examined by historians and geographers ratherthan specialists in modern mapping sciences. Thus, early mapsare considered to be a typical archive that serves as a historical tes-timony of territories and cities. In previous decades, due toadvancements in new computational technologies, the study of
70
71
72
73
74
the metric properties of old maps and the numerical approach tothis issue has improved (Balletti, 2006). Currently, early maps arefrequently incorporated into geographical information systems(GISs) for historical analysis (Audisio, Nigrelli, & Lollino, 2009;Hu, 2010).
Quality is a basic requirement for the users of any product.Since the 1980s, the interest in the quality of spatial data hasincreased due to two developments: the emergence of GIS in the1960s and the beginning of the 1970s and a substantial increasein available spatial data from satellites. As pre-geodetic maps havelimited quality, their quality must be analyzed prior to their use inhistorical studies. In previous decades, a large number of studies,which evaluate the quality of spatial data in early maps, have beenpublished (Boutoura & Livieratos, 2006; Giordano & Nolan, 2007;Leyk, Boesch, & Weibel, 2005; Pearson, 2005; Ravenhill & Gilg,1974).
uncer-
![Page 2: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/2.jpg)
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
2 F. Manzano-AgugliaroQ1 et al. / Expert Systems with Applications xxx (2014) xxx–xxx
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
Among the components of spatial data quality, positional accu-racy is the most common in academia. Traditionally, positionalaccuracy assessments in cartography have been based on a compar-ison between the positions of a set of points on a map and the posi-tions of the same points obtained from a more accurate source(Mozas & Ariza, 2011). Positional accuracy is determined by a statis-tical evaluation of random and systematic errors and is specified bythe root-mean-square error (RMSE) or the mean value error (l) andtheir standard deviation (r) (Ariza López & Atkinson Gordo, 2008).The International Organisation for Standardisation (ISO) considerspositional accuracy to be one of the quantitative quality elementsof spatial data (Ariza López & Atkinson Gordo, 2008). InternationalStandard 19113 (ISO2002) proposes a general framework fordescribing and reporting the quality of geographic information,and International Standard 19114 (ISO2003) presents a generalquality evaluation methodology for geographic information.
Currently, several standards complete the ISO norm and definethe positional accuracy of cartographic products based on the anal-ysis of a set of points (Ariza López & Atkinson Gordo, 2008):National Map Accuracy Standards (NMAS)-United States Geologi-cal Survey (USGS) 1947 (USA), engineering map accuracy standards(EMAS)-American Society of Civil Engineers (ASCE) 1983, accuracystandards for large-scale maps (ASLSM)-American Society for Pho-togrammetry and Remote Sensing (ASPRS) 1999, National stan-dards for Spatial Data Accuracy (NSSDA)-Federal Geographic DataCommittee (FGDC) 1998, and Standardisation Agreement (STA-NAG) 2215 (Bozic & Radojcic, 2011) by the North Atlantic Treat-ment Organisation (NATO).
A comparison of historical maps with contemporary mapsrequires additional analysis as the spatial elements and their delin-eations that are represented in historical documents contain con-siderable inherent uncertainty (Leyk et al., 2005; Plewe, 2002).The term uncertainty is more complex and extensive than the con-cept of accuracy. Fisher (1999) distinguished three forms of uncer-tainty that develop in the process of deriving a spatial data set fromthe real world: error, vagueness, and ambiguity. Error is defined asthe difference between the value of a property of a measuredobject and the true value of the same property; it can only be mea-sured for well-defined objects. Vagueness is attributed to poor def-inition, poor documentation, or fuzzy objects. Ambiguity stemsfrom disagreement about the definition of objects and fundamen-tal differences in opinion. Thus, positional inaccuracy only refers tothe concept of error. The uncertainty term must be applied whenaccuracy is not feasible (Hunter & Goodchild, 1993).
When studying positional uncertainty in early maps, it isimportant to consider that uncertainty is not limited to the differ-ent stages of map production. The paper or other material used byearly maps are not inert materials and maps can be deformed overthe years, which alters the geometry of a map (Jenny & Hurni,2011). Although positional accuracy and positional uncertaintyare different concepts, it is often difficult or impossible to distin-guish between the two concepts (Tucci & Giordano, 2011). This sit-uation occurs when analyzing the quality of historical maps.
An additional problem in the analysis of historical cartographicquality is caused by the uncertainty of the datum and the projec-tion on which historical maps are based. It is not always possibleto know if the observed displacement between feature locationson a historical map relative to a contemporary map is attributedto inaccuracy, different geodetic reference systems, or differentmethods for transferring features to the map plane (Pearson,2005).
The comparison of early maps with modern cartography allowsthe study of the geometric content and deformation of early maps.If the maps are expressed in different geodetic reference systems,this comparison can be performed after georeferencing the earlymap. Two methods for georeferencing exist: transformation
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment otainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.10
between two coordinate systems, in which the transformationparameters are known, and transformation using identical groundpoints, in which the transformation parameters are unknown(Podobnikar, 2009). The second method is usually used to refer-ence an early map, as only projection and datum information fromthe late nineteenth century is known with certainty (Pearson,2005). In addition, the influence of the geodetic coordinate systemcan be neglected in the study of old maps as its effects are minorcompared with positional uncertainty (Jenny & Hurni, 2011).
Thus, a comparison between early and contemporary maps canbe performed using best-fitting techniques of different schemes forrelevant transformations of sets of points on an early map to corre-sponding sets of points on a modern reference map (Boutoura &Livieratos, 2006). The transformation can comprise a global trans-formation, which alters the coordinates of the control points afterthe transformation, or a local transformation, which retains thecoordinates of the control points (Balletti, 2006). The global trans-formations are derived from a polynomial system of equations.The commonly employed global transformations consist of confor-mal, affine, and projective linear transformations and polynomial(usually second-order) transformations. Local transformations con-sist of finite element transformations and transformations that aretypically referred to as feature-based warping (Balletti, 2006). Anaffine transformation between geographic coordinates are used inthis study. Using five parameters, this transformation considersrotation, horizontal, and vertical scale errors and latitude and longi-tude displacements.
A crucial aspect of obtaining transformation parameters is theelection of common points in early maps and reference maps(Podobnikar, 2009), which should be carefully chosen as erroneouscontrol points can alter the comparisons of maps. Here, we mustconsider the heterogeneous positional uncertainty of early maps.Some control points may correspond to different spatial positions,possible landscape changes, and, a priori, we do not have criterionto identify them.
Multi-objective evolutionary algorithms are known for theirability to simultaneously optimize several objective functions toobtain a representative set of the Pareto front (Baños, Gil, Reca, &Martìnez, 2009; Márquez et al., 2011; Voorneveld, 2003). The goalof Pareto-based multi-objective strategies is to generate a front(set) of nondominated solutions as an approximation to the truePareto-optimal front (Alcayde et al., 2011). The majority of papersthat have addressed multi-objective optimization employed theconcept of Pareto-optimality to perform a comparison among sev-eral genetic algorithms (Anagnostopoulos & Mamanis, 2011;Baños, Ortega, Gil, Fernández, & de Toro, 2013; Fernández, Gil,Baños, & Montoya, 2013; Gómez-Lorente, Triguero, Gil, & Estrella,2012) or traditional analyses (Dovgan, Javorski, Tušar, Gams, &Filipic, 2013; Sánchez, Montoya, Manzano-Agugliaro, & Gil, 2013).
Previous studies show that the evolutionary algorithm msPESAis a viable alternative for transforming historical map coordinates,particularly where the quality of the position of the set of points tobe used for the transformation cannot be assured (Manzano-Agugliaro, San-Antonio-Gómez, López, Montoya, & Gil, 2013). Theaim of this study is the assessment of different evolutionary algo-rithms to determine the gross error in the control points and theaccuracy of pre-geodetic maps. These algorithms will be evaluatedusing the Geographic Atlas of Spain (AGE) produced by the Spanishcartographer Tomás López (1730–1802). The AGE comprises ananthology of maps of Spanish regions that were drawn in the sec-ond half of the eighteenth century; it is the most ambitious andsuccessfully completed cartographic work (Manzano-Agugliaro,Fernández-Sánchez, & San-Antonio-Gómez, 2013). These pre-geo-detic maps (San-Antonio-Gómez, Velilla, & Manzano-Agugliaro,2011) exhibit substantial heterogeneous positional uncertainty(Chias and Abad).
f evolutionary algorithms for analyzing the positional accuracy and uncer-16/j.eswa.2014.04.025
![Page 3: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/3.jpg)
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252254254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
Fig. 1. Flow diagram of a typical evolutionary algorithm.
F. Manzano-AgugliaroQ1 et al. / Expert Systems with Applications xxx (2014) xxx–xxx 3
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
2. A brief overview of evolutionary algorithms
Evolutionary algorithms (EAs) are mathematical techniquesthat search and find quasi-optimal solutions for complex problems(for which an exact mathematical solution does not usually exist)by applying strategies inspired by the evolution of living beings(Dekkers & Aarts, 1991; Goldberg et al., 1989; Horst, Pardalos, &Romeijn, 2002). Therefore, we can define an evolutionary algo-rithm as a probabilistic technique that converges towards a feasi-ble and quasi-optimal solution after several executions oriterations (Fonseca & Fleming, 1993). Evolutionary algorithmsoperate on a population of individuals in each execution. Each indi-vidual represents a potential solution to the problem; which iscoded as a complex data structure. Each solution is evaluated ateach iteration to obtain a measurement of its optimality. A newpopulation is formed by selecting the best individuals accordingto their optimality, which is based on the definition of a fitnessfunction (objective function). To produce new solutions and intro-duce diversity in the search space, some members of the new pop-ulation are subjected to certain transformations in their structure,which is achieved using genetic operators such us selection, cross-over and mutation. This process is repeated until a number of pre-viously defined iterations or generations. The quality of thesolutions improves through iterations (Goldberg & Holland,1988). Fig. 1 shows the flow diagram of a typical evolutionaryalgorithm.
The advantage that EAs offer over traditional search algorithmsis based in its ability to explore vast search spaces with a lower riskof getting trapped in local minimum. This means that one desiredquality of any EA is to keep a population with the higher variety, sothat the search space can be covered more efficiently.
As a single-objective optimization problem may only have asingle optimal solution, Multiobjective Optimization Problemspresent a possibly uncountable set of solutions, which when eval-uated, produce vectors whose components represent a trade-off inthe objective space between the different objectives of the problem(Coello, Lamont, & Van Veldhuisen, 2007; Deb, 2001). The multi-objective optimization attempts to solve problems with more thanone objective without the need to combine them in a single objec-tive (Baños et al., 2011).
A Multiobjective Optimization Problem (MOP) can be defined(Osyczka, 1985) as the problem of finding a vector of decision vari-ables that satisfies constraints and optimizes a vector functionwhose elements represent the objective functions. These functionsform a mathematical description of performance criteria that areusually in conflict with each other. A MOP is defined as
MOP ,min FðxÞ ¼ ðf1ðxÞ; f2ðxÞ; . . . ; fnðxÞÞ; x 2 S ð1Þ
where n is the number of objectives, and n P 2; FðxÞ ¼ ðf1ðxÞ;f2ðxÞ; . . . ; fnðxÞÞ is the vector of objectives to be optimized, and S rep-resents the set of feasible solutions associated with equality andinequality constraints and explicit bounds. Since in real-life MOPsthe criteria are usually in conflict, there is a need to establish otherconcepts to consider optimality. In that sense, a partial orderrelation, known as Pareto dominance relation can be defined(Edgeworth, 1881; Pareto). Fig. 2 shows the graphical descriptionof the Pareto-dominance concept for a function with two objectivesto minimize (Zitzler & Thiele, 1999). The figure shows the existenceof points (shown in red) that are dominated by other points (shownin purple). A set of points that form the Pareto front is also shown;thus, no better solutions than this front exist. A solution s1 domi-nates another solution s2 (s1 � s2) when at least one objective ins1 is better than at least one objective in s2 and not worse thanthe remainder of the objectives. Similarly, two solutions are indif-ferent or incomparable (s1 � s2) if none of the two solutions domi-
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment otainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.10
nates the remaining solutions. In this manner, it is possible toconstruct a set of nondominated solutions (there may be severalsolutions). These form the optimal Pareto front. As this problem isNP-complete (Garey & Johnson, 1979), we only obtain an approxi-mation to the front; formation of the complete front is notguaranteed.
Fig. 3 shows the solution ordering with respect to an arbitrarysolution G. Regions in which the solutions are worse (G dominatesthese solutions) or better (G is dominated by these solutions) thanG for both objectives are observed. Regions in which the solutionsare incomparable or indifferent (there is some improvement in oneobjective but the other object is worse) are also observed. The aimof the multi-objective technique is to obtain a complete set of non-dominated solutions (the Pareto front). However, in practice and inreal problems, this task can be complex. The search space can beextremely large, and therefore, excessive computing times arerequired.
The best way to approximate the Pareto front is via the utiliza-tion of heuristics, such as the heuristics utilized in this study. We
f evolutionary algorithms for analyzing the positional accuracy and uncer-16/j.eswa.2014.04.025
![Page 4: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/4.jpg)
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
Fig. 2. Graphical description of the Pareto-dominance concept for a function withtwo objectives to minimize.
Fig. 3. Ordering of solutions with respect to an arbitrary solution G.
4 F. Manzano-AgugliaroQ1 et al. / Expert Systems with Applications xxx (2014) xxx–xxx
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
have selected four evolutionary algorithms: the msPESA, which hasbeen proven suitable for the resolution of this multi-objectiveproblem and has been employed for maps composed of a singlesheet (Manzano-Agugliaro et al., 2013), the NSGAII, the SPEAIIand the HVSEA.
354
355
356
357
358
359
360
361
362
363
364
2.1. NSGAII
The nondominated sorting genetic algorithm II (NSGAII) (Deb,Agrawal, Pratap, & Meyarivan, 2000) is different from other tech-niques as it employs two properties or metrics, which are referredto as irank and idistance. Based on the irank, it is possible to mea-sure the dominance depth of each solution. The idistance enablesthe estimation of the population density in the vicinity of one par-ticular individual. This estimation is dependent on the computa-
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment otainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.10
tion of the‘‘cuboid’’ (Deb et al., 2000), which is associated withthe mentioned individual. NSGAII proposes that two solutionscan be partially ordered. The order is generated using a comparisonoperator named crowded, which adheres to the following the crite-rion: the ranks of the two solutions are verified. The solution with alower rank is considered to be the most adequate and is selected asthe best rank. If the ranks are equivalent, their densities are veri-fied (based on the cuboid computation) and the rank with thelower value is selected, that is, the rank that exposes a less-popu-lated vicinity. NSGAII employs a tournament selection. Duringalgorithm execution, the population size that forms the fronts isconsidered. If this size is exceeded, then the less-diverse frontsare eliminated. As expected, this pruning technique is conditionedby dominance criteria offered by the comparison operators.
2.2. msPESA
Due to the continuous search for faster and more efficientmethods, hybrid techniques have been proposed. In particular,the hybridisation of the Pareto envelope-based selection algorithmPESA (Corne, Knowles, & Oates, 2000) and the NSGAII, which areknown as the mixed spreading between PESA and NSGAII(msPESA) (Gil, Baños, Montoya, Márquez, & Ortega, 2005), has beendesigned to improve the concept of spreading. The msPESA algo-rithm implements a variation in the ‘‘fast non-dominated sortingalgorithm’’ of NSGAII. In this case, only one front and a new storagestrategy of the external population are computed. Specifically, thecandidate solutions are stored in the file of external solutions. Thisfile maintains a list of the best candidates obtained from the searchprocess. If the maximum size is exceeded during the execution,then some solutions are eliminated according to the concept‘‘squeeze factor’’, which is used in PESA. The ‘‘squeeze factor’’ isdefined as the number of elements or chromosomes that exist ina particular cell of the space associated with the objective function.Therefore, the final selection is obtained after searching for themaximum value in a given population and eliminating an indis-tinct (arbitrary) chromosome that contains the ‘‘squeeze factor’’.
2.3. HVSEA
HVSEA (HyperVolume-based Search Evolutionary Algorithm)(Antonio López Márquez, Consolacion Gil Montoya, & Márquez,2011) makes use of a sorted archive (sorted by the values of oneobjective) to store the solutions that become part of the generatedPareto front. For a solution S to enter the archive, it must increasethe hypervolume. In order to do so, HVSEA uses the concept of localhypervolume. The local hypervolume is the value of the S-metricwhen it only takes into account the solutions closest to the inser-tion point of S in the sorted archive (Bader & Zitzler, 2011). If thelocal hypervolume is greater than zero, then the solution Sincreases the local hypervolume, and therefore, the value of theS-metric. Using a local hypervolume means that there is no needto recalculate the whole S-metric each time a new solution is savedto the archive, since only the solutions that improve the localhypervolume are chosen. For faster access, solutions are saved tothe archive in order to finding the closest individuals to S. For gen-erating the solutions that make up the working population, it usesa tournament selection (with tournament size 4) for the crossoverselection of the solutions within the archive. The selection criterionis based on Pareto dominance, so non-dominated solutions will bepreferred in the tournament. In order to keep solution diversity,achieve an even spread of solutions along the Pareto front, and topurge the archive, a (N-1)-dimensional hypergrid (Gil, Márquez,Baños, Montoya, & Gómez, 2007) is implemented, where N is thenumber of dimensions of the objective space.
f evolutionary algorithms for analyzing the positional accuracy and uncer-16/j.eswa.2014.04.025
![Page 5: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/5.jpg)
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
F. Manzano-AgugliaroQ1 et al. / Expert Systems with Applications xxx (2014) xxx–xxx 5
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
2.4. SPEAII
SPEAII (Zitzler et al., 2001) uses a strength indicator in order tomeasure the solution quality of the individuals stored in thearchive. At the end of the procedure, the archive becomes the finalsolution, storing the generated Pareto front. The main operations inthis MOEA consist of generating the fitness of the solutions, calcu-lating the density information for each solution within the solutionset, and then truncating the archive once it becomes full, byremoving the worst quality solutions in the densest areas.
3. Materials and methods
3.1. Material: the Geographic Atlas of Spain of 1804 (AGE)
In 1788, Tomas Lopez began preliminary work on AGE. Thiswork was based on maps that he designed. In a type of dressrehearsal, which was published in 1790, the Private Atlas of thekingdoms of Spain, Portugal and adjacent islands was commis-sioned by Carlos III Manzano-Agugliaro et al. (2013). The carto-graphic method used by Lopez, which is known as deskcartography, was based on a questionnaire that was sent to eachvillage priest (San-Antonio-Gómez et al., 2011). Each priest wasrequired to provide a sketch of his village and two sketches ofthe surrounding leagues. Lopez composed a new sketch of theregion from the sketches provided by the village priests, existing
Fig. 4. AGE image of Extremadu
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment otainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.10
maps from the 16th, 17th and 18th centuries, and numerous otherdocuments (answers to questionnaires, local histories, geographi-cal descriptions, and cartographic sketches) (San-Antonio-Gómezet al., 2011).
The AGE was the culmination of forty years of work experience ofTomas Lopez Manzano Agugliaro, Martínez García, and San AntonioGomez (2012). His detailed map, which represented mainland Spainas no other map had accomplished, was distributed in 102 sheetswith geographic information about 36 territories. In this study, weexamined the kingdoms of Extremadura (sheets 54-55-56-57) andAragon (sheets 70-71-72-73). Each sheet of AGE has its own refer-ence frame, even when they belong to the same kingdom. This isbecause each sheet was made independently of each other. Thischoice is based on a previous study (Manzano-Agugliaro et al.,2013), in which all errors of AGE were determined to have an aver-age error of 6.5 km. Thus, Extremadura had an average error (RMS)of 10 km between the matched position of 958 towns of early car-tography and current cartography. With regards to Aragon, the pre-vious results showed an RMS error of 7.6 km for 1735 towns. In thiswork, we establish the initial error limit of 20 km to consider a townas correctly matched, this reduced the towns to 501 for Extremadu-ra and to 1399 for Aragon. Distributed as 84, 83, 205 and 129 townsfor sheets 54-55-56-57, respectively; and 137, 552, 363, and 347towns for sheets 70-71-72-73, respectively.
Figs. 4 and 5 display the four maps or sheets that comprise theExtremadura province and the Kingdom of Aragon. The towns that
ra with digitalised towns.
f evolutionary algorithms for analyzing the positional accuracy and uncer-16/j.eswa.2014.04.025
![Page 6: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/6.jpg)
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428429
431431
432
433
434
435
436
437
439439
440
441
442
443
444
445
446
447
448
449
451451
452
453
454
Fig. 5. AGE image of Aragon with digitalised towns.
6 F. Manzano-AgugliaroQ1 et al. / Expert Systems with Applications xxx (2014) xxx–xxx
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
have been digitalised appear in red; they correspond to existingtowns.
3.2. Methods
A software program has been developed that focuses on solvinga multi-objective optimization problem with evolutionary algo-rithms in parallel. The evolutionary algorithms consist of msPESA,NSGAII, HVSEA and SPEAII as described in previous sections. Theresults are obtained by 100 independent executions per map ofeach algorithm.
Two objectives are to be optimized: minimize the mean errorwhen calculating distances between existing urban areas andTomás López’s towns, whilst maximizing the number of locationsincluded in the calculations.
3.2.1. Software objectivesMinimize the average distance between actual coordinates and
Tomás López’s coordinates as
D ¼Xn
i¼1
haversindi
r
� �
¼Xn
i¼1
haversin /i2 � /i1ð Þ þ cos /i2 cos /i1 haversin wi2 � wi1ð Þ½ �
ð2Þ
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment otainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.10
where
� D is the average distance (the mean error in km between thecoordinates of Tomás López’s towns and the equivalent coordi-nates for existing locations)� haversin is the haversine function expressed as
f evolu16/j.esw
haversinðhÞ ¼ sinh2
� �2
¼ 1� cos h2
ð3Þ
� di is the distance between the actual coordinates and ThomasLópez’s coordinates,� r is the radius of the Earth,� /i1;/i2 represents the latitude of point i1 and the latitude of
point i2 and� wi1;wi2 represents the longitude of point i1 and the longitude of
point i2.
Minimize the number of excluded locations N
N ¼ n�Xn
i¼1
ei ð4Þ
where N is the number of excluded locations and n is the number oftotal locations. ei ¼ 1 when the location is excluded and 0otherwise.
tionary algorithms for analyzing the positional accuracy and uncer-a.2014.04.025
![Page 7: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/7.jpg)
455
456
457
458
459
460
461
462463
465465
466
467
468
469
470
471
472
473474
476476
477
478479481481
482483485485
486
487
488489491491
492
493494496496
497
498
499
500
501
502
503504
506506
507
508
509
510
511
512
513
521
522
523
524
525
526
527
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
F. Manzano-AgugliaroQ1 et al. / Expert Systems with Applications xxx (2014) xxx–xxx 7
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
3.2.2. Calculation parameters (genotype)The parameters in the evolutionary algorithm change until the
solution is obtained (which is known as the genotype). Theseparameters are used to perform the three transformations on themap coordinates and to obtain the final coordinates (Lat0; Lon0).
Rotation origin (Lat0; Lon0): The center coordinates on which thepoints are rotated; they are calculated at the beginning of the solu-tion and represent the center of mass of the towns
Lat0 ¼1n
Xn
1Lati Lon0 ¼
1n
Xn
1
Loni ð5Þ
Using the center of mass, we obtain coordinates for the approx-imate center of the nucleus of the towns; thus, the variation isminor. If we use the coordinates of 0� latitude and 0� longitudeas the rotation origin, we would have to increase the latitudinaland longitudinal displacement.
Rotation (a): the rotation applied, in degrees. It is limited to 0.5�as a large rotation skews the results. For this reason, a rotationgreater than 0.1 is typically not used.
Lat0 ¼ Lat � cos a� Lon� sinaLon0 ¼ Lat � sina� Lon� cos a
ð6Þ
Latitudinal displacement in sexagesimal degrees(DLat): sum of theoriginal value and the value calculated by the algorithm.
Lat00 ¼ Lat0 þ DLat ð7Þ
Longitudinal displacement in sexagesimal degrees (DLon):
Lon00 ¼ Lon0 þ DLon ð8Þ
Horizontal scale factor (SLon): the scale based on the coordinatesalong the longitudinal axis. It is limited to 20% to prevent excessiveshifting of the calculations (between 0.8 and 1.2).
Lon000 ¼ Lon00 � SLon ð9Þ
Vertical scale factor (SLat): the scale based on the coordinatesalong the latitudinal axis.
Lat000 ¼ Lat00 � SLat ð10Þ
The evaluation process calculate both objectives by applyingthe changes described in the genotype for each individual to eachof the coordinates on the Tomás López map (TL), for each locationin the individual (solution) for the town. This process yields thetransformed coordinates; we calculate the distance to the equiva-lent town in the existing nucleus for each coordinate. Calculate themean error with the arithmetical mean as
Error ¼ 1n
Xn
i¼1
Di ð11Þ
where Di is the distance between locations (TL map and current)
3.2.3. Genotype operatorsThis section offers a brief explanation on the operators used in
the algorithms. For the initial solution no town was excluded. Afterthis, a mutation is performed for the child solution. The mutationoperator excluded a town with a probability of 10%. Crossoveroperator for excluded towns was:
child[0].SelectorChance[i]
=(1.5*this.SelectorChance[i]
+ 0.5*parent.SelectorChance[i])/2.0;child[1].SelectorChance[i]
=(0.5*this.SelectorChance[i]
+ 1.5*parent.SelectorChance[i])/2.0;
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment otainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.10
For nonexcluded towns, the selection do a cross with 50% ofprobability for the selection/deselection of a town among its par-ents. E.g., for each town there is a 50% of probability of takingthe state (selected or removed) from parent A, and 50% take thestate of parent B.
The following formula is used to these genotypes:
//Change the value of a variable
if (Rand > 1/ mutating.Genotype.Length)
{double u = Rand;double y = 0;//Changeif (u < 0.5)
y = mutating.Bounds[i][1]
- mutating.Genotype[i];else
y = mutating.Genotype[i]
- mutating.Bounds[i][0];double delta = y * (1.0 -
(mutating.Stats.Evaluations * (0.5 + 0.5 * Rand))/mutating.Config.MaxEvaluations);
//Perform the change
if (u < 0.5)mutating.Genotype[i]
= mutating.Genotype[i] + delta;else
mutating.Genotype[i]
= mutating.Genotype[i] - delta;}
4. Results and discussion
4.1. Kingdom of Extremadura
4.1.1. Sheet 54The results of the analysis of sheet 54 of Extremadura kingdom
are shown in Fig. 6, where the classical solution obtained and aver-age error of 12.41 km with nonexcluded locations. When we runthe program based on algorithm SPEAII, a solution with less errorappears when 7 towns are excluded (11.22 km). Better solutionscan be found but at the price of higher number of towns excluded.The other three algorithms have better performance than the SPE-AII. The NSGA II algorithm presents cero excluded towns and anerror of 8 km, having a very flat Pareto front. To improve the error,7 towns are excluded, reducing the error to only 7.73 km. The algo-rithm HVSEA also get an initial solution (with an error of 8.59 km)with zero excluded towns like NSGAII did; but to achieve the sameerror of 7.73 km it needed to exclude 12 towns. The algorithmmsPESA begins the Pareto front excluding 1 town to achieve anerror of 8 km, however reaching the same error (7.82 km) fasterthan NSGA II with 3 towns excluded. The fronts of NSGAII, HVSEAand msPESA algorithms looks acceptable from 3 towns excludedonwards, representing 3.5% of excluded towns and lowering theerror by 37%.
4.1.2. Sheet 55Fig. 7 shows the results of the analysis of sheet 55 of Extrema-
dura kingdom, where the classical solution obtained an averageerror of 11.67 km with nonexcluded locations. The Pareto front ofSPEAII shows some solutions being better than classical solutionwhen 5 or more towns are excluded (11.19 km). msPESA andNSGAII fronts are quite similar up to 5 excluded towns with anerror of 9.52 km, i.e. remove 6% of towns to reduce the error by
f evolutionary algorithms for analyzing the positional accuracy and uncer-16/j.eswa.2014.04.025
![Page 8: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/8.jpg)
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
Fig. 6. Pareto fronts for sheet 54 of Extremadura kingdom.
Fig. 7. Pareto fronts for sheet 55 of Extremadura kingdom.
8 F. Manzano-AgugliaroQ1 et al. / Expert Systems with Applications xxx (2014) xxx–xxx
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
18.5%. In this case the msPESA Pareto front has better performanceovercoming all other methods with less average error. In this mapthe HVSEA pareto front is almost parallel to NSGAII front but bring-ing worst points as it excludes more towns.
4.1.3. Sheet 56Fig. 8 shows the results of the analysis of sheet 56 of Extrema-
dura kingdom, where the classical solution obtained an average
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment otainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.10
error of 14.93 km with nonexcluded locations. The Pareto front ofSPEAII is better than classical solution when 20 towns are excluded(11.5 km), needing to exclude 45 towns for reaching an error of7.31 km. In this case, only the front end solutions improve theother algorithms, as in previous cases. This means that excluding22% of towns reduce the error in 51%. The NSGAII algorithm pre-sents better front till 19 towns excluded with an error of8.57 km, i.e. removing 9.3% of towns reduce the error in 42.6%.
f evolutionary algorithms for analyzing the positional accuracy and uncer-16/j.eswa.2014.04.025
![Page 9: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/9.jpg)
599
600
601
602
603
604
605
606
F. Manzano-AgugliaroQ1 et al. / Expert Systems with Applications xxx (2014) xxx–xxx 9
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
From here the msPESA algorithm has almost the same front com-pared to NSGAII. In this map the HVSEA pareto front is parallel toNSGAII front but above it, and it has been better to msPSEA onlyfor the first and second solution of its front.
Fig. 8. Pareto fronts for sheet 56
Fig. 9. Pareto fronts for sheet 57
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment otainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.10
4.1.4. Sheet 57Fig. 9 shows the results of the analysis of sheet 57 of Extrema-
dura kingdom, where the classical solution obtained an averageerror of 17.51 km with nonexcluded locations. The Pareto front of
of Extremadura kingdom.
of Extremadura kingdom.
f evolutionary algorithms for analyzing the positional accuracy and uncer-16/j.eswa.2014.04.025
![Page 10: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/10.jpg)
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
10 F. Manzano-AgugliaroQ1 et al. / Expert Systems with Applications xxx (2014) xxx–xxx
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
SPEAII is better than classical solution when 11 towns are excluded(16.8 km), needing to exclude 18 towns for reaching an error of11.52 km. This means to exclude 14% of towns to reduce the errorin 34.2%. NSGAII as always, has a very flat front, having good initialsolutions, reducing the error to 46.6% by excluding only 7.8% of thetowns, i.e. 10 excluded towns for an error of 9.34 km, almost thesame msPESA solution (9.53 km) with the same number ofexcluded towns. In this case the HVSEA algorithm gets some pointin its Pareto front below the others fronts, e.g., for 7 excludedtowns the error was 7.5 km, this means to exclude 5.4% of townsin order to reduce 45.7% the error.
Regarding the obtained transformation parameter, as an exam-ple of Extremadura kingdom, the four algorithms are analyzed forsheet 57 and the results are shown in Tables 1 and 2. According toTable 1, NSGAII and msPESA exhibit the same trend: DLat exhibitsa positive value near 0.1� while DLon exhibits a negative valuebetween �0.01� and �0.06�, with the exception of one solution
Fig. 10. Pareto fronts for sheet
Table 1Transformation parameters and error (RMS) with NSGAII and msPESA for the Kingdom of
NSGAII
DLat (�) 0.1037 0.1119 0.1080 0.11DLon (�) �0.0422 �0.0685 �0.0350 �0.0a (�) -0.2338 �0.2160 �0.2258 �0.2SLon 0.9760 1.0009 1.0012 1.03SLat 1.0543 1.0765 1.1373 1.08Error (km) 9.96 9.95 9.64 9.34N (excluded) 3 4 5 10
Table 2Transformation parameters and error (RMS) with HVSEA and SPEAII for the Kingdom of E
HVSEA
DLat (�) 0.1353 0.1164 0.0982 0.10DLon (�) �0.0353 �0.0174 �0.0159 �0.0a (�) �0.2460 �0.2393 �0.2421 �0.2SLon 1.0192 1.0151 1.0577 1.02SLat 1.1741 1.2064 1.2135 1.11Error (km) 10.27 9.73 9.67 9.50N (excluded) 3 5 6 7
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment otainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.10
for msPESA; a always exhibited a negative value near 0.22�, SLon
exhibited a value near 1.009 and SLat exhibited a value near1.088. HVSEA exhibits the same trend as NSGAII and msPESA, asshown in Table 2. But SPEAII uses quite different parameters inorder to reach the solutions, noteworthy that the solutions with14 and 26 excluded towns are practically equal after rounding to4 decimal, and SLon and SLat exhibit values under 1, except for thesolution of 18 excluded towns.
4.2. Kingdom of Aragon
4.2.1. Sheet 70Fig. 10 shows the results of the analysis of sheet 70 of Aragon
kingdom, where the classical solution obtained an average errorof 10.84 km with nonexcluded locations. The Pareto front of SPEAIIis better than classical solution when 25 towns are excluded(5.7 km), this means to exclude 18% of towns in order to reduce
70 of Kingdom of Aragon.
Extremadura (sheet 57).
msPESA
10 0.0993 0.1033 0.0782 0.1017207 �0.0087 �0.0143 0.1909 �0.0409530 �0.2356 �0.2020 �0.2241 �0.240190 0.9927 1.0269 1.0019 1.036854 1.0375 1.1082 1.1470 1.0595
10.21 9.75 9.59 9.533 7 8 10
xtremadura (sheet 57).
SPEAII
06 0.5335 �0.0175 0.1587 �0.0174238 �0.0138 0.5000 �0.0070 0.5000522 �0.0088 �0.1655 �0.2129 �0.165563 0.8021 0.9967 0.8417 0.996721 0.9478 0.8000 1.1943 0.8000
16.83 12.53 11.52 11.0911 14 18 26
f evolutionary algorithms for analyzing the positional accuracy and uncer-16/j.eswa.2014.04.025
![Page 11: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/11.jpg)
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
F. Manzano-AgugliaroQ1 et al. / Expert Systems with Applications xxx (2014) xxx–xxx 11
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
the error by 47%. But the main drawbach is that this front is quitefar (i.e. covered) from the others. msPESA has a front starting with5 towns excluded and getting an error of 9.75 km, i.e. 3.6% ofexcluded towns to reduce the error by 10%. In this sheet the algo-rithm HVSEA has a front that covers msPESA until 15 excludedtowns from which, msPESA is always below. The NSGAII algorithmhas the best initial solutions until 10 excluded towns, i.e. excluding7.3% of towns reduce the error by 46%. From 10 towns onwards,there are algorithms that deliver better solutions such as HVSEA.
4.2.2. Sheet 71Fig. 11 shows the results of the analysis of sheet 71 of Aragon
kingdom, where the classical solution obtained an average errorof 6.2 km with nonexcluded locations, the lowest error analyzedtill this moment. Thus, for SPEAII, a better solution than classicalone is obtained excluding a high number of towns, i.e. 25% ofexcluded towns to reduce the error by 14%. With regard to NSGAII,excluding 5.6% of towns is able to reduce the error only by 2.4%, for
Fig. 11. Pareto fronts for sheet
Table 3Transformation parameters and error (RMS) with NSGAII and msPESA for the Kingdom of
NSGAII
DLat (�) 0.1061 0.1027 0.1004 0.09DLon (�) �0.1387 �0.1128 �0.1360 �0.1a (�) �0.0128 �0.0021 �0.0617 �0.0SLon 1.0154 1.0135 1.0555 1.01SLat 0.9918 0.9553 0.9181 0.92Error (km) 6.46 5.97 5.94 5.59N (excluded) 25 31 32 43
Table 4Transformation parameters and error (RMS) with HVSEA and SPEAII for the Kingdom of A
HVSEA
DLat (�) 0.0852 0.0841 0.0679 0DLon (�) �0.1361 �0.1210 �0.1134 �a (�) �0.0073 �0.0519 0.0138 �SLon 1.0018 1.0213 0.9913 1SLat 0.9241 0.9836 0.9390 0Error (km) 5.77 5.66 5.65 5N (excluded) 99 103 112 1
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment otainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.10
msPESA excluding 18.5% of towns is able to reduce the error onlyby 2.6%, almost the same of HVSEA that excluding 18% is able toreduce the error only by 5.7%. For these map, the 4 Pareto frontsneed to exclude too much towns to improve the classical solution,this is because the error is low and therefore it is difficult toimprove.
For the obtained transformation parameter, as an example ofAragon kingdom, the four algorithms are analyzed for sheet 71.Both algorithms (NSGAII and msPESA) in this case do not exhibitthe same trend for all parameters, as shown in Table 3. Thus,DLat exhibited a positive value of approximately 0.1� for NSGAIIand 0.08 for msPESA, DLon was approximately �0.13�, SLon wasapproximately 1.03 for both algorithms, and SLat was approxi-mately 0.95 for NSGAII and 0.87 for msPESA. However, the highestdifference was obtained for a, with a value of approximately�0.03�, a positive value for the first solutions of msPESA and a neg-ative value (�0.008�) in the last solution as analyzed by the Paretofront. The algorithm HVSEA, Table 4, has similar behavior that
71 of Kingdom of Aragon.
Aragon.
msPESA
16 0.0881 0.0875 0.0881 0.0648210 �0.1312 �0.1312 �0.1312 �0.1340483 0.0308 0.0180 0.0180 �0.009387 1.0650 1.0045 1.0255 1.054806 0.8000 0.8422 0.9121 0.9400
7.711 6.526 5.960 5.84097 98 102 105
ragon.
SPEAII
.0867 0.5000 0.1227 0.5018 0.50000.1076 0.4159 0.4999 0.4961 0.50000.0392 0.0000 0.0001 0.0000 0.0000.0297 0.8000 0.8225 0.7998 1.0171.9905 0.8000 0.8039 0.9647 0.8000.38 8.49 8.25 7.19 6.8714 132 135 136 137
f evolutionary algorithms for analyzing the positional accuracy and uncer-16/j.eswa.2014.04.025
![Page 12: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/12.jpg)
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
12 F. Manzano-AgugliaroQ1 et al. / Expert Systems with Applications xxx (2014) xxx–xxx
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
NSGAII, but SPEAII has the worst parameters, where the rotation ais zero or close to in all solutions and SLon and SLat exhibited valuesunder 1, except for the solution of 105 excluded towns.
4.2.3. Sheet 72Fig. 12 shows the results of the analysis of sheet 72 of Aragon
kingdom, where the classical solution obtained an average errorof 10.67 km with nonexcluded locations. The Pareto front of SPEAIIalgorithm begins to improve classical solution when a large num-ber of towns are excluded, thus excluding 23% of towns is only ableto reduce the error by 6%. Something similar happens to msPESAalgorithm, that needs to exclude 18.2% of the towns to reducethe error by 21.6%; and also for HVSEA that needs to exclude17.4% of towns to reduce the error by 23.5%, but excluding 18.7%of towns is able to reduce error by 37%. As happened in the previ-ous maps, the algorithm NSGAII has the best pareto front for low
Fig. 12. Pareto fronts for sheet
Fig. 13. Pareto fronts for sheet
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment otainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.10
non-excluded solutions. It begins to improve the classical solutionby excluding on 18 towns, i.e. excluding 5% of towns is able toreduce the error by 19.8%.
4.2.4. Sheet 73Fig. 13 shows the results of the analysis of sheet 73 of Aragon
kingdom, where the classical solution obtained an average errorof 7.26 km with nonexcluded locations. SPEAII begins to improveclassical solution when a large number of towns are excluded;excluding 17.6% towns only get to reduce the error to 1.5%, beingthis pareto front far from the other 3 fronts. The front of msPESAbegins excluding 15 towns, i.e. excluding 4.3% of towns is able toreduce the error by 11.8%, but evolving steeply, reaching withthe elimination of 5.8% of the towns reduce errors by 39.8%. Forthis map the front of HVSEA begins better than msPESA front, i.e.4.3% of excluded towns to reduce the error by 24.5%. The NSGAII
72 of Kingdom of Aragon.
73 of Kingdom of Aragon.
f evolutionary algorithms for analyzing the positional accuracy and uncer-16/j.eswa.2014.04.025
![Page 13: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/13.jpg)
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
Table 5Performance comparison for HVSEA, msPESA, NSGAII and SPEAII.
HVSEA msPESA NSGAII SPEAII
Sheet N (%) Error (%) N (%) Error (%) N (%) Error (%) N (%) Error (%)
54 3.6 35.8 3.6 37.0 3.6 37.0 22.6 12.155 6.0 13.2 6.0 18.4 6.0 18.5 6.0 4.156 4.9 32.5 4.9 35.3 4.9 38.7 22.0 51.057 5.4 45.7 5.4 44.3 3.9 44.9 10.9 28.470 8.0 48.9 8.0 45.7 7.3 46.1 18.2 47.071 17.9 5.7 18.5 2.6 14.3 10.3 25.7 14.272 18.7 37.0 19.0 24.4 13.5 31.9 23.1 6.373 4.3 24.5 4.3 11.8 4.0 35.1 18.7 5.8
Average 8.6 30.4 8.7 27.5 7.2 32.8 18.4 21.1
F. Manzano-AgugliaroQ1 et al. / Expert Systems with Applications xxx (2014) xxx–xxx 13
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
front behaves very well for initial solutions, i.e. 0.3% of excludedtowns to reduce the error by 21.3%, and for 4% of excluded townsto reduce the error by 35.1%. However to further reduce this error,other algorithms works better, especially HVSEA and msPESA.
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
4.3. Algorithms assessment
We have confirmed considerable improvement in the quality ofthe results with respect to the classical techniques used in theanalysis. This improvement is due to the inherent nature of theevolutionary algorithms. These algorithms efficiently explore thezones of promising solutions. By eliminating few solutions, wecan achieve an average error that is significantly lower than theerrors detected in current techniques.
Table 5 summarizes a general comparison of all four algorithmsimplemented, HVSEA, msPESA, NSGAII, and SPEAII. It is shown thepercentage of excluded cities per sheet, and the reduction of rela-tive percentage error compared to classical solution. The criterionschosen for this comparison was: first, choose a percentage ofexcluded towns between 5 and 10% when possible and always asclose to this lower limit; second, the percentage of excluded townsas similar between the 4 algorithms analyzed. When it has notbeen possible to choose these, choose some reference value forthe percent of excluded towns as similar as possible between them.
As shown in Table 5, the worst algorithm to address this prob-lem has been the SPEAII, which needed to exclude the same or sim-ilar percentage of towns to reduce that percentage error. The other3 algorithms (HVSEA, msPESA, and NSGAII,) in general can be con-sidered a quite similar behavior, and good compared to the classi-cal solution. For these three algorithms, by utilizing the algorithmsand eliminating 8% of the cities, it is possible to obtain improve-ments in the range of 30% for HVSEA, msPESA, and NSAG-II, respectto classical solution. The best behavior had especially in the initialsolutions was the NSGAII, and then HVSEA.
We highlight the utility of the different transforming factors ofcoordinates that were been selected. For solutions in the Paretofronts, the displacement (D) is the most important factor. This fac-tor corrects most of the existing errors, which may be related to theoriginal source of the historical maps. Previously and with avail-able means, it was not easy to establish the coordinate frameworkdue to the lack of support for precise cartographic methods. Theseparameters enable a systematic displacement in the historicalmaps with respect to current cartography. For both algorithmsand for all solutions, with the exception of one solution, the param-eters always act in the same direction: SLat > 0 and SLon < 0.
The rotation (a) does not present a distinct trend comparedwith the displacement. Note that this factor shows a negativedirection for NSGAII and HVSEA and a positive direction formsPESA and SPEAII in the map of the Kingdom of Aragon. Con-versely, this map shows a negative trend for all solutions in thefour algorithms for the map of the Kingdom of Extremadura. These
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment otainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.10
results indicate that this trend corresponds to particular errors inthese maps.
With regards to the scaling (S), it presents similar trends foreach map. For the map of Kingdom of Extremadura, we alwaysobserve SLat > 1 except for SPEAII, and after the second solutionin the Pareto fronts, SLon > 1 except for SPEAII. For the Kingdomof Aragon, both Pareto fronts always present SLon > 1 and SLat < 1except for SPEAII that was always SLat and SLon < 1. Then, takinginto account the three algorithms (NSGAII, msPESA and HVSEA)this could be because of a systematic error in the historical map.Given that the three algorithms (NSGAII, msPESA and HVSEA) workgood, obtaining similar transforming parameters in their best solu-tions, they converge towards ‘‘ideal’’ parameters. The algorithmthat discards fewer towns (NSGAII) ‘‘learns’’ at a faster rate. There-fore, we consider that improves the resolution of this problem.
5. Conclusions
The obtained Pareto fronts, Figs. 6–13 show that SPEAII algo-rithm performs worst for the left side of the front, i.e. findinglow error solutions with low non-excluded towns, in contrast toNSGAII that usually finds better solutions. The NSGAII algorithmpresents Pareto fronts that cover the fronts of the msPESA andHVSEA. This finding indicates that for the same number ofexcluded cities, it obtains better results, at least for the initial solu-tions. However, the msPESA and HVSEA algorithms reduce errorscompared with the NSGAII, at the cost of excluding more cities.That is, they perform better for solutions in the right side extremeof the front. The majority of non-dominated solutions obtained byNSGAII dominate the solutions obtained by msPESA and HVSEA,although msPESA obtains acceptable extreme solutions in someinstances. However it has been observed that NSGAII has a hori-zontal slope needing to exclude too many towns for reducing thenerror from a certain boundary. Therefore, it can be a good optioncombining Pareto fronts of several algorithms, using the envelopefronts obtained.
It has been observed that when the error is small, the uncer-tainty is also small because it’s more difficult for our algorithmsto outperform the classical solution, needing to exclude too manytowns, e.g., sheet 71 (Aragon kingdom whith the lowest error). SeePareto fronts of Fig. 11 and the results of Table 5, where on averagefor the four algorithms, excluding 19% of towns only reduce theerror by 8%. Then we can say that the algorithms studied, espe-cially HVSEA, msPESA and NSGAII, are best alternative when theuncertainty of map analyzed is greater.
In summary, comparisons of four multi-objective evolutionaryalgorithms (HVSEA, msPESA, NSGAII, and SPEAII) for analyzingthe positional accuracy and uncertainty problem of eight earlymaps have been presented. The experiments were performed ontwo historical maps composed of four sheets with high uncer-tainty, and with its own reference frame. The results show that
f evolutionary algorithms for analyzing the positional accuracy and uncer-16/j.eswa.2014.04.025
![Page 14: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/14.jpg)
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824825826827828829830831832833834835836837838839840841842843844845846847848849850851852853854855856857858859860861862863864865866867868869870 Q4871872873874875
876877878879880881882883884885886887888889890891892893894895896897898899900901902903904905906907908909910911912913914915916917918919920921Q5922923924925926927928929930931932933934935936937938939940941942943944945946947948949950951952953954955956957958959960961
14 F. Manzano-AgugliaroQ1 et al. / Expert Systems with Applications xxx (2014) xxx–xxx
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
by eliminating 8% of the cities it is possible to obtain improve-ments of approximately 30% for HVSEA, msPESA and NSGAII. Basedon the comparison between HVSEA, NSGAII and msPESA, we canconclude that, for this particular problem, the majority of non-dominated solutions obtained by NSGAII dominate the solutionsobtained by msPESA and HVSEA. However, acceptable extremesolutions can be obtained with HVSEA, msPESA and SPEAII in someinstances. It can be a good option combining Pareto fronts of sev-eral algorithms, using the envelope fronts obtained. The Paretofronts based on multi-objective evolutionary algorithms (MOEAs)are a better alternative when the uncertainty of a map to analyzeis high, making them very suitable for solving the problem posed.Consequently this creates new perspectives for analyzing the posi-tional accuracy and uncertainty of historical maps.
Acknowledgements
This study was funded by project HAR2009–12937 (GIS System-atic Analysis for the Planimetric Accuracy of the Geographic Atlasof Spain of Tomas Lopez, 1804) of the Spanish Ministry of Scienceand Innovation. The authors are grateful to Dr. Branko Bozic, a pro-fessor at the University of Belgrade (Serbia), for providing informa-tion for this manuscript.
References
Alcayde, A., Baños, R., Gil, C., Montoya, F., Moreno-Garcia, J., & Gómez, J. (2011).Annealing-tabu paes: A multi-objective hybrid meta-heuristic. Optimization,60(12), 1473–1491. http://dx.doi.org/10.1080/02331934.2010.505960<http://www.tandfonline.com/doi/abs/10.1080/02331934.2010.505960> . arXiv: http://www.tandfonline.com/doi/pdf/10.1080/02331934.2010.505960.
Anagnostopoulos, K., & Mamanis, G. (2011). The mean-variance cardinalityconstrained portfolio optimization problem: An experimental evaluation offive multiobjective evolutionary algorithms. Expert Systems with Applications,38(11), 14208–14217. http://dx.doi.org/10.1016/j.eswa.2011.04.233<http://www.sciencedirect.com/science/article/pii/S0957417411007603> .
Ariza López, F., & Atkinson Gordo, A. (2008). Analysis of some positional accuracyassessment methodologies. Journal of Surveying Engineering, 134(2), 45–54.http://dx.doi.org/10.1061/(ASCE)0733-9453(2008)134:2(45).
Audisio, C., Nigrelli, G., & Lollino, G. (2009). A {GIS} tool for historical instabilityprocesses data entry: An approach to hazard management in two italian alpineriver basins. Computers & Geosciences, 35(8), 1735–1747. http://dx.doi.org/10.1016/j.cageo.2009.01.012<http://www.sciencedirect.com/science/article/pii/S0098300409001277>.
Bader, J., & Zitzler, E. (2011). Hype: An algorithm for fast hypervolume-based many-objective optimization. Evolutionary Computation, 19(1), 45–76.
Balletti, C. (2006). Georeference in the analysis of the geometric content of earlymaps. e-Perimetron, 1(1), 32–42.
Baños, R., Gil, C., Reca, J., & Martìnez, J. (2009). Implementation of scatter search formulti-objective optimization: A comparative study. Computational Optimizationand Applications, 42(3), 421–441. http://dx.doi.org/10.1007/s10589-007-9121-1<http://dx.doi.org/10.1007/s10589-007-9121-1> .
Baños, R., Manzano-Agugliaro, F., Montoya, F., Gil, C., Alcayde, A., & Gómez, J. (2011).Optimization methods applied to renewable and sustainable energy: A review.Renewable and Sustainable Energy Reviews, 15(4), 1753–1766. http://dx.doi.org/10.1016/j.rser.2010.12.008<http://www.sciencedirect.com/science/article/pii/S1364032110004430> .
Baños, R., Ortega, J., Gil, C., Fernández, A., & de Toro, F. (2013). A simulatedannealing-based parallel multi-objective approach to vehicle routing problemswith time windows. Expert Systems with Applications, 40(5), 1696–1707. http://dx.doi.org/10.1016/j.eswa.2012.09.012<http://www.sciencedirect.com/science/article/pii/S0957417412010664> .
Boutoura, C., & Livieratos, E. (2006). Some fundamentals for the study of thegeometry of early maps by comparative methods. e-Perimetron, 1(1), 60–70.
Bozic, B., & Radojcic, S. (2011). Horizontal accuracy of 1:50 000 digital topographicmaps. Survey Review, 43(319), 94–104. http://dx.doi.org/10.1179/003962611X12894696204740<http://www.maneyonline.com/doi/abs/10.1179/003962611X12894696204740> . arXiv:http://www.maneyonline.com/doi/pdf/10.1179/003962611X12894696204740.
Chias, P., Abad, T., El arte de describir el territorio: Mapas y planos históricosen torno al puente de alcántara (cáceres, españa), Informes de la Construcción64 (Extra). <http://informesdelaconstruccion.revistas.csic.es/index.php/informesdelaconstruccion/article/view/2442/2752>.
Coello, C. A. C., Lamont, G. B., & Van Veldhuisen, D. A. (2007). Evolutionary algorithmsfor solving multi-objective problems. Springer.
Corne, D. W., Knowles, J. D., & Oates, M. J. (2000). The pareto envelope-basedselection algorithm for multiobjective optimization. In Parallel problem solvingfrom nature PPSN VI (pp. 839–848). Springer.
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment otainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.10
Deb, K. (2001). Multi-objective optimization using evolutionary algorithms. Wileyinterscience series in systems and optimization. Wiley<http://books.google.es/books?id=OSTn4GSy2uQC> .
Deb, K., Agrawal, S., Pratap, A., & Meyarivan, T. (2000). A fast elitist non-dominatedsorting genetic algorithm for multi-objective optimization: Nsga-ii. In M.Schoenauer, K. Deb, G. Rudolph, X. Yao, E. Lutton, & J. Merelo, et al. (Eds.),Parallel problem solving from nature PPSN VI. Lecture notes in computer science(Vol. 1917, pp. 849–858). Berlin Heidelberg: Springer. http://dx.doi.org/10.1007/3-540-45356-3_83<http://dx.doi.org/10.1007/3-540-45356-3_83> .
Dekkers, A., & Aarts, E. (1991). Global optimization and simulated annealing.Mathematical Programming, 50(1–3), 367–393. http://dx.doi.org/10.1007/BF01594945<http://dx.doi.org/10.1007/BF01594945> .
Dovgan, E., Javorski, M., Tušar, T., Gams, M., & Filipic, B. (2013). Comparing amultiobjective optimization algorithm for discovering driving strategies withhumans. Expert Systems with Applications, 40(7), 2687–2695. http://dx.doi.org/10.1016/j.eswa.2012.11.006<http://www.sciencedirect.com/science/article/pii/S095741741201216X> .
Edgeworth, F. Y. (1881). Mathematical psychics: An essay on the application ofmathematics to the moral sciences. C. Keagann Paul.
Fernández, A., Gil, C., Baños, R., & Montoya, M. G. (2013). A parallel multi-objectivealgorithm for two-dimensional bin packing with rotations and load balancing.Expert Systems with Applications, 40(13), 5169–5180. http://dx.doi.org/10.1016/j.eswa.2013.03.015<http://www.sciencedirect.com/science/article/pii/S0957417413001656> .
Fisher, P. F. (1999). Models of uncertainty in spatial data. Geographical InformationSystems, 1, 191–205.
Fonseca, C., & Fleming, P. (1993). Genetic algorithms for multiobjectiveoptimization: Formulation, discussion and generalization. In Proceedings of the5th international conference on genetic algorithms (pp. 416–423). San Francisco,CA, USA: Morgan Kaufman Publishers Inc..
Garey, M. R., & Johnson, D. S. (1979). Computers and intractability. Vol. 174. NewYork: Freeman.
Gil, C., Baños, R., Montoya, M., Márquez, A., Ortega, J., (2005). Global multi-objectiveoptimization using evolutionary methods: An experimental anaylisis. InInternational workshop on global optimization (pp. 115–120).
Gil, C., Márquez, A., Baños, R., Montoya, M., & Gómez, J. (2007). A hybrid method forsolving multi-objective global optimization problems. Journal of GlobalOptimization, 38(2), 265–281.
Giordano, A., & Nolan, T. (2007). Civil war maps of the battle of stones river: Historyand the modern landscape. The Cartographic Journal, 44(1), 55–70. http://dx.doi.org/10.1179/000870407X173850<http://www.maneyonline.com/doi/abs/10.1179/000870407X173850> . arXiv: http://www.maneyonline.com/doi/pdf/10.1179/000870407X173850.
Goldberg, D. E., & Holland, J. H. (1988). Genetic algorithms and machine learning.Machine Learning, 3(2), 95–99.
Goldberg, D. E. et al. (1989). Genetic algorithms in search, optimization, and machinelearning (Vol. 412). Reading Menlo Park: Addison-wesley.
Gómez-Lorente, D., Triguero, I., Gil, C., & Estrella, A. E. (2012). Evolutionaryalgorithms for the design of grid-connected pv-systems. Expert Systems withApplications, 39(9), 8086–8094. http://dx.doi.org/10.1016/j.eswa.2012.01.159<http://www.sciencedirect.com/science/article/pii/S0957417412001790> .
Horst, R., Pardalos, P. M., & Romeijn, H. E. (2002). Handbook of global optimization(Vol. 2). Springer.
Hu, B. (2010). Application of geographic information systems (gis) in the history ofcartography. Proceedings of World Academy of Science, Engineering andTechnology, 66, 1562–1565.
Hunter, G.J., Goodchild, M., (1993). Managing uncertainty in spatial databases:Putting theory into practice. In Papers from the annual conference-urban andregional information systems association. Urisa urban and regional informationsystems (pp. 15–15).
Jenny, B., & Hurni, L. (2011). Studying cartographic heritage: Analysis andvisualization of geometric distortions. Computers & Graphics, 35(2), 402–411.http://dx.doi.org/10.1016/j.cag.2011.01.005<http://www.sciencedirect.com/science/article/pii/S0097849311000069>.
Leyk, S., Boesch, R., & Weibel, R. (2005). A conceptual framework for uncertaintyinvestigation in map-based land cover change modelling. Transactions in GIS,9(3), 291–322. http://dx.doi.org/10.1111/j.1467-9671.2005.00220.x<http://dx.doi.org/10.1111/j.1467-9671.2005.00220.x> .
Antonio López Márquez, A. F. M. R. B. N., Consolacion Gil Montoya, Márquez, S.L.,(2011). Hvsea: Hypervolume-based search evolutionary algorithm. In EVOLVE2011, Luxembourg.
Manzano-Agugliaro, F., Fernández-Sánchez, J. S., & San-Antonio-Gómez, C. (2013).Mapping the whole errors of tomas lopez’s geographic atlas of spain (1804).Journal of Maps, 9(4), 617–622. http://dx.doi.org/10.1080/17445647.2013.842188<http://www.tandfonline.com/doi/abs/10.1080/17445647.2013.842188>. arXiv:http://www.tandfonline.com/doi/pdf/10.1080/17445647.2013.842188.
Manzano Agugliaro, F., Martínez García, J., & San Antonio Gomez, J. C. d. (2012). Gisanalysis of the accuracy of tomas lopez’s historical cartography in the canaryislands (1742–1746). Scientific Research and Essays, 7(2), 199–210.
Manzano-Agugliaro, F., San-Antonio-Gómez, C., López, S., Montoya, F., & Gil, C.(2013). Pareto-based evolutionary algorithms for the calculation oftransformation parameters and accuracy assessment of historical maps.Computers & Geosciences, 57(0), 124–132. http://dx.doi.org/10.1016/j.cageo.2013.04.010<http://www.sciencedirect.com/science/article/pii/S0098300413001106> .
f evolutionary algorithms for analyzing the positional accuracy and uncer-16/j.eswa.2014.04.025
![Page 15: The assessment of evolutionary algorithms for analyzing the positional accuracy and uncertainty of maps](https://reader030.fdocuments.net/reader030/viewer/2022020619/575098261a28abbf6bd9afb2/html5/thumbnails/15.jpg)
962963964965966967968969970971972973974975976977978979980981982983984985986987988989990991992
993994995996997998999100010011002100310041005100610071008100910101011101210131014101510161017101810191020
1021
F. Manzano-AgugliaroQ1 et al. / Expert Systems with Applications xxx (2014) xxx–xxx 15
ESWA 9294 No. of Pages 15, Model 5G
12 May 2014
Q1
Márquez, A. L., Baños, R., Gil, C., Montoya, M. G., Manzano-Agugliaro, F., & Montoya,F. G. (2011). Multi-objective crop planning using pareto-based evolutionaryalgorithms. Agricultural Economics, 42(6), 649–656. http://dx.doi.org/10.1111/j.1574-0862.2011.00546.x<http://dx.doi.org/10.1111/j.1574-0862.2011.00546.x> .
Mozas, A. T., & Ariza, F. J. (2011). New method for positional quality control incartography based on lines. A comparative study of methodologies.International Journal of Geographical Information Science, 25(10), 1681–1695.http://dx.doi.org/10.1080/13658816.2010.545063<http://www.tandfonline.com/doi/abs/10.1080/13658816.2010.545063> . arXiv:http://www.tandfonline.com/doi/pdf/10.1080/13658816.2010.545063.
Osyczka, A. (1985). Multicriteria optimization for engineering design. DesignOptimization, 193–227.
Pareto, V., Cours d’économie politique, Tome I. Lausanne.Pearson, B. C. (2005). Comparative accuracy in four civil war maps of the
shenandoah valley: A gis analysis*. The Professional Geographer, 57(3),376–394. http://dx.doi.org/10.1111/j.0033-0124.2005.00485.x<http://www.tandfonline.com/doi/abs/10.1111/j.0033-0124.2005.00485.x> . arXiv: http://www.tandfonline.com/doi/abs/10.1111/j.0033-0124.2005.00485.x.
Plewe, B. (2002). The nature of uncertainty in historical geographic information.Transactions in GIS, 6(4), 431–456. http://dx.doi.org/10.1111/1467-9671.00121<http://dx.doi.org/10.1111/1467-9671.00121> .
Podobnikar, T. (2009). Georeferencing and quality assessment of josephine surveymaps for the mountainous region in the triglav national park. Acta Geodaetica etGeophysica Hungarica, 44(1), 49–66.
Ravenhill, W., & Gilg, A. (1974). The accuracy of early maps? towards a computeraided method. The Cartographic Journal, 11(1), 48–52. http://dx.doi.org/10.1179/caj.1974.11.1.48<http://www.maneyonline.com/doi/abs/10.1179/caj.1974.11.1.48> . arXiv:http://www.maneyonline.com/doi/pdf/10.1179/caj.1974.11.1.48.
San-Antonio-Gómez, C., Velilla, C., & Manzano-Agugliaro, F. (2011). Tomas lopez’sgeographic atlas of spain in the peninsular war: A methodology for determining
Please cite this article in press as: Manzano-Agugliaro, F., et al. The assessment otainty of maps. Expert Systems with Applications (2014), http://dx.doi.org/10.10
errors. Survey Review, 43(319), 30–44. http://dx.doi.org/10.1179/003962610X12747001420861http://www.maneyonline.com/doi/abs/10.1179/003962610X12747001420861. arXiv:http://www.maneyonline.com/doi/pdf/10.1179/003962610X12747001420861.
San-Antonio-Gómez, C., Velilla, C., & Manzano-Agugliaro, F. (2014). Urban andlandscape changes through historical maps: The real sitio of aranjuez (1775–2005), a case study. Computers, Environment and Urban Systems, 44(0), 47–58.http://dx.doi.org/10.1016/j.compenvurbsys.2013.12.001<http://www.sciencedirect.com/science/article/pii/S0198971513001154>.
Sánchez, P., Montoya, F. G., Manzano-Agugliaro, F., & Gil, C. (2013). Geneticalgorithm for s-transform optimisation in the analysis and classification ofelectrical signal perturbations. Expert Systems with Applications, 40(17),6766–6777. http://dx.doi.org/10.1016/j.eswa.2013.06.055<http://www.sciencedirect.com/science/article/pii/S0957417413004508> .
Tucci, M., & Giordano, A. (2011). Positional accuracy, positional uncertainty, andfeature change detection in historical maps: Results of an experiment.Computers, Environment and Urban Systems, 35(6), 452–463. http://dx.doi.org/10.1016/j.compenvurbsys.2011.05.004<http://www.sciencedirect.com/science/article/pii/S0198971511000548> .
Voorneveld, M. (2003). Characterization of pareto dominance. Operations ResearchLetters, 31(1), 7–11. http://dx.doi.org/10.1016/S0167-6377(02)00189-X<http://www.sciencedirect.com/science/article/pii/S016763770200189X> .
Zitzler, E., Laumanns, M., Thiele, L., Zitzler, E., Zitzler, E., Thiele, L., etal., (2001).Spea2: Improving the strength pareto evolutionary algorithm.
Zitzler, E., & Thiele, L. (1999). Multiobjective evolutionary algorithms: Acomparative case study and the strength pareto approach. IEEE Transactionson Evolutionary Computation, 3(4), 257–271. http://dx.doi.org/10.1109/4235.797969.
f evolutionary algorithms for analyzing the positional accuracy and uncer-16/j.eswa.2014.04.025