UNIVERSITI PUTRA MALAYSIA DEVELOPMENT OF A NEW LiDAR …psasir.upm.edu.my/id/eprint/69988/1/FK 2017...

28
UNIVERSITI PUTRA MALAYSIA DEVELOPMENT OF A NEW LiDAR DATABASE MANAGEMENT SYSTEM USING OPEN SOURCE SOFTWARE KHAIRIL IZWAN BIN AHMAD ARSHAD FK 2017 87

Transcript of UNIVERSITI PUTRA MALAYSIA DEVELOPMENT OF A NEW LiDAR …psasir.upm.edu.my/id/eprint/69988/1/FK 2017...

  • UNIVERSITI PUTRA MALAYSIA

    DEVELOPMENT OF A NEW LiDAR DATABASE MANAGEMENT

    SYSTEM USING OPEN SOURCE SOFTWARE

    KHAIRIL IZWAN BIN AHMAD ARSHAD

    FK 2017 87

  • © CO

    PYRI

    GHT U

    PMDEVELOPMENT OF A NEW LiDAR DATABASE MANAGEMENT SYSTEM

    USING OPEN SOURCE SOFTWARE

    By

    KHAIRIL IZWAN BIN AHMAD ARSHAD

    Thesis Submitted to the School of Graduate Studies, Universiti Putra Malaysia,

    in Fulfilment of the Requirements for the Degree of Master of Science

    July 2016

  • © CO

    PYRI

    GHT U

    PM

    All material contained within the thesis, including without limitation text, logos, icons,

    photographs and all other artwork, is copyright material of Universiti Putra Malaysia

    unless otherwise stated. Use may be made of any material contained within the thesis

    for non-commercial purposes from the copyright holder. Commercial use of material

    may only be made with the express, prior, written permission of Universiti Putra

    Malaysia.

    Copyright © Universiti Putra Malaysia

  • © CO

    PYRI

    GHT U

    PM

    i

    Abstract of thesis presented to the Senate of Universiti Putra Malaysia in fulfilment

    of the requirement for the degree of Master of Science

    DEVELOPMENT OF A NEW LiDAR DATABASE MANAGEMENT

    SYSTEM USING OPEN SOURCE SOFTWARES

    By

    KHAIRIL IZWAN B AHMAD ARSHAD

    July 2016

    Chairman: Associate Professor Helmi Zulhaidi Mohd Shafri, PhD

    Faculty: Engineering

    LiDAR Survey is one alternative method that gives an extra advantage especially to

    get coordinate and height value data. It is known as the best way to retrieve coordinate

    and height data for the broad area in short period of time. Data produced from LiDAR

    is enormous but sadly, they are kept, not in proper relational database management

    system. They have been kept in Hard disk or Digital Versatile Disk (DVD) after

    serving their purpose. This way of storing make searching difficult because these data

    may come from different file versions and varieties of a coordinate system. Survey

    Department and Mapping (JUPEM) is the only government agency that has been

    given an authority to handle all airborne data based on Circular of Prime Minister

    Agency (JPM 1/2007). This researched been carried out to enhanced the way of

    LiDAR data been stored. Currently, management of these data is not so effective. Lots

    of time and money involved just to know the data availability and retrieves the data.

    The objective of this researched is to a developed database using open source software

    called LiDAR Database Management System (LiDMS). Next, the evaluation of

    LiDMS is based also on its performance via online. This system can work on

    windows, iPhone Operating System (iOS) and android which is used the MySQL as

    a database. User satisfying test has been carried out to see how the user accepts the

    LiDMS. The user experience evaluation test result showed that, LiDMS Portal able to

    be used by using Windows, smartphone, ios or others gadget platform smoothly but it

    is subject to bandwidth and speed of the processor used. Overall this researched

    manage to developed a portal that benefit to the government, researcher, decision

    maker, and client either to apply for a new fly permit via online, monitoring the permit

    given as follow Prime Minster Circular 1/2007, upload or retrieve the data or just to

    browse the data location availability in Malaysia.

  • © CO

    PYRI

    GHT U

    PM

    ii

    Abstrak tesis yang dikemukakan kepada Senat Universiti Putra Malaysia sebagai

    memenuhi keperluan untuk ijazah Master Sains

    PEMBANGUNAN PENGURUSAN PANGKALAN DATA LiDAR

    BARU MENGGUNAKAN PERISIAN SUMBER TERBUKA

    Oleh

    KHAIRIL IZWAN B AHMAD ARSHAD

    Julai 2016

    Pengerusi: Profesor Madya Helmi Zulhaidi Mohd Shafri, PhD

    Fakuti: Kejuruteraan

    LiDAR menawarkan pelbagai kegunaan dan kelebihan antaranya mendapatkan data

    ketinggian kepada ramai pengguna. Ia diakui kaedah terbaik bagi mendapatkan nilai

    ketinggian bagi kawasan yang luas dalam masa yang sangat cepat. Namun begitu data

    yang dihasilkan dari LiDAR adalah sangat besar dan selalunya data ini selepas

    digunakan ia hanya akan disimpan dalam bentuk storan seperti Cakera Keras atau

    Digital Versatiles Disk (DVD). Kaedah ini memberikan kesukaran untuk

    mendapatkan data-data tersebut malahan data-data yang disimpan itu kadangkala

    terdiri dari pelbagai rujukan sistem koordinat dan versi fail. Jabatan Ukur dan

    Pemetaan (JUPEM) adalah agensi kerajaan yang dikhususkan untuk mengawal semua

    data bawaan udara termasuk data-data LiDAR berdasarkan Pekeliling Jabatan

    Perdana Menteri (JPM 1/2007). Oleh kerana JUPEM memiliki hak keatas data ini

    maka pengguna perlu di beritahu berkenaan data ini supaya mereka boleh

    mendapatkannya dengan cara yang mudah. Penyelidikan ini dilakukan kerana kaedah

    simpanan data di JUPEM sebelumnya kurang efektif dan melibatkan tenaga, kos masa

    dan wang bagi mendapatkan data tersebut. Objektif penyelidikan ini adalah untuk

    membangunkan satu sistem pangkalan data LiDAR dengan melaksanakan

    penggunaan pangkalan data berasaskan perisian terbuka yang dikenali sebagai LiDAR

    Database Management System (LiDMS) dan seterusnya menilai prestasi sistem

    pangkalan data yang telah dibangunakan tersebut secara atas talian juga menggunakan

    platform perisian terbuka sepenuhnya. Sistem ini telah dibangunkan untuk berfungsi

    pada sistem operasi Windows, IOS dan android yang mana menggunapakai perisian

    pangkalan data terbuka MySQL untuk pangkalan data LiDAR. Ujian kepuasan

    pengguna telah dijalankan untuk melihat bagaimana penerimaan oleh pengguna dan

    ujian prestasi juga telah dijalankan dalam penyelidikan ini. Penyelidikan ini

    menunjukkan bahawa Portal LiDMS berjaya digunakan menggunakan platform

    Windows, telefon pintar atau perantian lain berdasarkan faktor-faktor seperti

    penggunaan bandwidth dan kelajuan pemproses yang digunakan. Kesimpulannya

    penyelidikan ini akan menghasilkan sumbangan yang besar kepada pengawal,

    pembuat keputusan, para penyelidik dan pengguna samada bagi permohonan permit

  • © CO

    PYRI

    GHT U

    PM

    iii

    penerbangan secara atas talian, memantau penghantaran data mengikut pekeliling

    1/2007, menghantar dan mendapatkan data LiDAR secara atas talian dan melihat

    lokaliti kawasan data LiDAR yang ada di Malaysia.

  • © CO

    PYRI

    GHT U

    PM

    iv

    ACKNOWLEDGEMENTS

    Alhamdulillah, I am very thankful and grateful to Allah for making things possible. I

    would like to acknowledge the support and assistance that I have received from so

    many people especially from my supervisor, Assoc. Prof. Dr. Helmi Zulhaidi Mohd

    Shafri and to thank him for his untiring guidance, advice, help and encouragement

    throughout my study in UPM. Many thanks also to Dr Raja Azlina Raja Mohammad

    from faculty of Science Information of Technology, UPM that assist me a lot on the

    idea and consultation on programming and development the portal. Sincere thanks

    also to the guidance and encouragement by my co-supervisor, Prof. Dr. Shattri Mansor

    that gave some idea and consultation in LiDAR management works

    Sincere thanks to my friends Yun Mohamad Amin, Mohammed Mustafa Al-Habshi,

    Nik Mohamad Ramli Nik Yusoff and Mohd Nor Azman for assisting me on preparing

    the programming code for my research. Thanks to my colleagues Alireza, Amiruddin,

    Kelvin, Malik, Zhoobin, Ebi, Sarah Hanim, Naddia and Bahare who have given any

    information and help me during the years of study and make my study in UPM a

    valuable one. Finally, I would like to thank my family, especially my wife, my mother

    and father, brothers for all their support and encouragement.

  • © CO

    PYRI

    GHT U

    PM

  • © CO

    PYRI

    GHT U

    PM

    vi

    This thesis was submitted to the Senate of Universiti Putra Malaysia and has been

    accepted as fulfilment of the requirement for the degree of Master of Science. The

    members of the Supervisory Committee were as follows:

    Helmi Zulhaidi Mohd Shafri, PhD

    Associate Professor

    Faculty of Engineering

    Universiti Putra Malaysia

    (Chairman)

    Shattri Mansor, PhD Professor

    Faculty of Engineering

    Universiti Putra Malaysia

    (Member)

    __________________________

    ROBIAH BINTI YUNUS, PhD

    Professor and Dean

    School of Graduate Studies

    Universiti Putra Malaysia

    Date:

  • © CO

    PYRI

    GHT U

    PM

    vii

    Declaration by graduate student

    I hereby confirm that:

    this thesis is my original work;

    quotations, illustrations and citations have been duly referenced;

    this thesis has not been submitted previously or concurrently for any other degree

    at any other institutions;

    intellectual property from the thesis and copyright of thesis are fully-owned by

    Universiti Putra Malaysia, as according to the Universiti Putra Malaysia

    (Research) Rules 2012;

    written permission must be obtained from supervisor and the office of Deputy

    Vice-Chancellor (Research and Innovation) before thesis is published (in the

    form of written, printed or in electronic form) including books, journals, modules,

    proceedings, popular writings, seminar papers, manuscripts, posters, reports,

    lecture notes, learning modules or any other materials as stated in the Universiti

    Putra Malaysia (Research) Rules 2012;

    there is no plagiarism or data falsification/fabrication in the thesis, and scholarly

    integrity is upheld as according to the Universiti Putra Malaysia (Graduate

    Studies) Rules 2003 (Revision 2012-2013) and the Universiti Putra Malaysia

    (Research) Rules 2012. The thesis has undergone plagiarism detection software.

    Signature: _______________________ Date: ______________________________

    Name and Matric No.: _________________________________________________

  • © CO

    PYRI

    GHT U

    PM

    viii

    Declaration by Members of Supervisory Committee

    This is to confirm that:

    the research conducted and the writing of this thesis was under our supervision;

    supervision responsibilities as stated in the Universiti Putra Malaysia (Graduate

    Studies) Rules 2003 (Revision 2012-2013) are adhered to.

    Signature:

    Name of Chairman

    of Supervisory

    Committee:

    Signature:

    Name of Member

    of Supervisory

    Committee:

  • © CO

    PYRI

    GHT U

    PM

    ix

    TABLE OF CONTENTS

    Page

    ABSTRACT i

    ABSTRAK ii

    ACKNOWLEDGEMENTS iv

    APPROVAL v

    DECLARATION vii

    LIST OF TABLES xii

    LIST OF FIGURES xiii

    LIST OF ABBREVIATIONS xiv

    CHAPTER

    1. INTRODUCTION 1

    1.1 General 1

    1.2 Problem Statement 2

    1.3 Objectives 3

    1.4 Specific Objectives 3

    1.5 Scope 3

    1.6 Motivation 3

    2. LITERATURE REVIEW 5

    2.1 Light Detection and Ranging 4

    2.2 LiDAR Data 6

    2.3 Managing LiDAR Data 7

    2.4 LiDAR LAS Data 8

    2.5 LiDAR ASCII Data 9

    2.6 Boise Center Aerospace Laboratory (BCAL) LiDAR Software 9

    2.6.1 ENVI BCAL Extension 10

    2.7 Open Source Software For Government Sector 11

    2.8 Related research 12

    2.9 Summary 14

    3. METHODOLOGY 16

    3.1 Research Workflow 16

    3.2 Materials 18

    3.3 System and Architecture Design 20

    3.3.1 Client-side Tier 21

    3.3.2 Before Login Page 24

    3.3.3 After Login Pages 26

    3.3.4 Administrator Pages. 28

    3.4 Server-side Tier 37

    3.4.1 Web Server 37

    3.4.2 Server-side Programming Language 37

    3.4.3 PHP settings in Apache for this LiDMS 38

    3.4.4 Model View Controller (MVC) 38

    3.5 MVC History 38

    3.5.1 MVC Concept 39

  • © CO

    PYRI

    GHT U

    PM

    x

    3.6 CI History 39

    3.6.1 CI Structure 40

    3.7 Application 40

    3.8 System 41

    3.9 Benefit of CI 42

    3.9.1 Easy Learning Curve 42

    3.9.2 Good Documentation 42

    3.9.3 Large Support Group 42

    3.9.4 Faster Execution 42

    3.10 Server Side Structure and Architecture 43

    3.11 Database Tier 47

    3.11.1 RDBMS 47

    3.11.2 MySQL 47

    3.11.3 Phpmyadmin 47

    3.12 Database Tier Structure 48

    3.13 Database ERD 50

    3.14 User Flow 51

    3.14.1 Download XAMPP 51

    3.14.2 Configuration PHP 51

    3.14.3 Configuration MySQL 51

    3.14.4 Setup The LiDMS 52

    3.14.5 Test LiDMS 52

    3.15 Evaluation User Acceptance Test 53

    3.16 Testing Method 54

    3.16.1 Installation 54

    3.16.2 Performance 54

    3.16.3 Speed 54

    4. RESULTS AND DISCUSSION 55

    4.1 Introduction 55

    4.2 Deployment Test and Result 55

    4.2.1 Speed of Deployment 55

    4.2.2 Upload Speed Comparison 57

    4.2.3 Performance of Deployment 58

    4.3 Performance Evaluation Test and Resul 60

    4.3.1 Evaluation 60

    4.3.2 Data Retrieval Method In JUPEM 61

    4.3.3 Result On Type of LiDAR Data Been Requested 62

    4.4 Result Discussion 63

    4.5 Overall Discussion 64

    5. CONCLUSION AND FUTURE RECOMMENDATION 66

    5.1 Introduction 66

    5.2 Conclusions 66

    5.3 Future Work 68

    REFERENCES 70

    APPENDICES 78

    BIODATA OF STUDENT 91

    PUBLICATION 92

  • © CO

    PYRI

    GHT U

    PM

    xi

    LIST OF TABLES

    Table Page

    2.1 Benefits of Open Source Software 11

    2.2 Related studies 13

    3.1 Before Login Pages 24

    3.2 After Login Pages 26

    3.3 Administrator Pages 28

    3.4 Table MVC Structure 44

    3.5 Database Tables Table 48

    4.1 LiDMS upload speed comparison 57

  • © CO

    PYRI

    GHT U

    PM

    xii

    LIST OF FIGURES

    Figure Page

    2.1 LiDAR Concept 5

    3.1 Methodology Workflow 16

    3.2 BCAL On ENVI Software 19

    3.3 BCAL To LAS Selection Ascii Output 20

    3.4 System Architecture 20

    3.5 LiDMS Client-side Architecture Diagram 21

    3.6 RBAC Diagram 22

    3.7 Basic RBAC Diagram for e-Government 23

    3.8 Login Page 23

    3.9 Pre-Login User Flow 25

    3.10 Front Dashboard 28

    3.11 Due Flight Data Submit 32

    3.12 Public Search and Vendor's Flight List User Flow 32

    3.13 Managers Dashboard User Flow 33

    3.14 Manager's Flight User Flow 33

    3.15 Administrator's Users User Flow 34

    3.16 Roles And User Flow 35

    3.17 Classification Userflow 36

    3.18 Pages Userflow 36

    3.19 Server-side Architecture Diagram 37

    3.20 MVC Diagram 38

    3.21 Codeigniter Application Flow 40

    3.22 Codeigniter Basic Structure Diagram 40

    3.23 LiDMS Server-side Structure Diagram 43

    3.24 LiDMS Database-tier Structure Diagram 48

    3.25 Database ERD 50

    4.1 Pekan's Convertion Total Point vs Time 56

    4.2 Kuala Lumpur's Conversion Total Point vs Time 56

    4.3 Conversion Size for Low Accuracy Data Capture- Pekan 58

    4.4 Conversion Size for High Accuracy Data Capture- Kuala Lumpur 59

    4.5 LiDMS Deployment Performance Result 60

    4.6 Academician, Public Sector and Government Repondents Percentage 61

    4.7 Pecentage of Data Retrieving Method 62

    4.8 Percentage of LiDAR Data File Type Requested 63

    4.9 Performance of Work Efficiency 64

  • © CO

    PYRI

    GHT U

    PM

    xiii

    LIST OF ABBREVIATIONS

    3D Three Dimensional

    ACID Atomicity, Consistency, Isolation, Durability

    ACL Access Control List

    AFSM Augmented Finite State Machine

    API Application Program Interface

    ASCII American Standard Code for Information Interchange

    ASPRS American Society for Photogrammetry and Remote Sensing

    BCAL Boise Center Aerospace Laboratory

    CI Codeigniter

    DAC Discretionary Access Control

    DEM Digital Elevation Model

    DSM Digital Surface Model

    ENVI Exelis Visual Information Solutions

    ERD Entity Relationship Diagram

    Gb Gigabyte

    GHz Gigahertz

    GLONASS Global Navigation Satellite System

    GNU General Public License

    GPS Global Positioning System

    GUI Graphical User Interphase

    HTML HyperText Markup Language

    IDL Interactive Data Language

    IMU Inertial Measurement Unit

    JUPEM Malaysia Land Surveying and Mapping

    LAS Laser

    LiDAR Light Detection and Ranging

    LiDMS V 1.0 LiDAR Database Management System V 1.0

    MAC Mandatory Access Control

    MVC Model View Controller

    NetCDF Network Common Data Format

    NOAA National Oceanic and Atmospheric Administration

    PHP Hypertext Preprocessor

    RBAC Role Base Access-Control

    RDBMS Relational Database Management System

    SAN Storage Area Network

    SDSC San Diego Supercomputer Center

    SQL Structured Query Language

    UAT User Acceptance Test

    UI User Interface

    UX User Experience

    XYZ Cartesian Coordinate System( latitude, longitude, and elevation)

    http://en.wikipedia.org/wiki/Relational_database_management_system

  • © CO

    PYRI

    GHT U

    PM

    1

    CHAPTER 1

    INTRODUCTION

    1.1 General

    Light Detection and Range, LiDAR has been widely used in various applications

    (Cao et al., 2015). LiDAR is a rapidly developing measurement technology that has

    been extensively applied to feature detection (Tong et al., 2014), terrain monitoring

    (Zhou et al., 2012), 3D model reconstruction (Cheng, 2012) and ground object

    extraction (Kumar et al., 2013). Aerial laser scanning (ALS) has also been used to

    collect topographic data for wide areas and had produced millions of point cloud

    data. (Cao et al., 2015). The support for good management of these data is still in the

    beginning stages (Mosa et al., 2012).

    Airborne LiDAR is widely applied as one kind of survey data source, especially in a

    highly automated generation of digital elevation models (DEM) and digital surface

    models (DSM) because of its highly accurate three-dimensional (3D) information

    acquisition capability (Zhu, 2011). The Global Positioning System (GPS) and Inertial

    Measurement Unit (IMU) data recorded on the plane is combined with laser pulse

    range measurements to produce point data with x, y-locations and elevations

    (ASPRS, 2005).

    “The wide use of LiDAR brings about problems in storage, processing, and

    application services of massive point cloud data” (Hongchao et al., 2011). LiDAR

    data contain a huge amount of points with associated scalar values (Lipus, 2012).

    This LAS file format is a public file format for the interchange of 3-dimensional

    point cloud data between data users. Although developed primarily for exchange

    of LiDAR point cloud data, this format supports the exchange of any 3-dimensional

    x,y,z. This binary file format is an alternative to proprietary systems or a generic

    ASCII file interchange system used by many companies. The problem with

    proprietary systems is that data produced cannot be easily used from one system to

    another (Shan et al., 2009).

    “The storage and computing patterns in the local file system can no longer meet the

    demands, while the networking storage and parallel processing of unstructured

    LiDAR data are becoming new requirements for storage, processing and application

    of point cloud data” (Wende, 2014).

    Restricted by the size and distribution of the point-cloud makes the operation of the

    point-cloud time consuming and difficult to deal with (Meijers, 2011). Therefore, the

    management and storage research of large-scale 3-D laser scanning data is still rare

    around the world (Ehinger, 2011).

  • © CO

    PYRI

    GHT U

    PM

    2

    1.2 Problem statement

    The large size of LiDAR topography data causes many organizations to struggle with

    the managing of relatively large size datasets (Viswananth et al., 2010). No existing

    integrated framework solution can exploit the access and storage of these vast data

    sets such as LiDAR (Lewis et al., 2010). Users only want a simple and easy method

    to store data. The quick and simple solution to just simply save the data is

    understandable (Bjorset, 2013)

    However, there might be benefits from having the LiDAR data stored in a more

    organized manner. Point clouds are versatile and can be reused many times for

    different purposes. This becomes more interesting when the acquisition cost is taken

    into account. Usually, raw LIDAR data are collected by a variety of vendors.

    Datasets may also available in different formats, with different schemes, different

    attributes, and different compression schemes.

    There are cases of data recorded in different geographic projections even within the

    same dataset (Viswanath et al., 2010). Gathered data is processed after the flight and

    every measured point is referenced with its geospatial position (Zlatanova, 2006).

    Processed point clouds are then written into output files of different formats, with the

    preferred format being the open LAS file format (Qing et al., 2001). The LAS format

    is currently the common way of storing and managing LiDAR point clouds (ASPRS,

    2010).

    Various ASCII formats exist, depending on the information available. It could be a

    basic XYZ file, XYZI or an extended version with intensity. Other features could be

    added as ASCII columns in any possible order. The most frequent features are the

    GPS acquisition time, pulse number or classification field (ISPRS, 2012).

    Additionally, a file can represent different things, such as a tile of lidar data or a strip

    (raw acquisition geometry). Lastly, some formats also propose spatial indexing

    (McGaughey, 2007). Convincingly, it becomes clear that a modern lidar library

    should be able to manage this two standards and also provide extended ASCII import

    and export functionalities for ensuring compatibility with toolkits and current

    software packages (David et al., 2008).

    Even though the intention to organize LiDAR data is there, directions for selecting a

    system that can manage the data is problematic. Software solutions for storing and

    working with LiDAR data are still in their very early stages. As a result of many

    current spatial databases and Geographical Information Systems having poor support

    for LiDAR data, it is not thoroughly clear-cut for researchers to easily use these as

    data management solutions (Bjorset, 2013).

    An effective organization and management of a vast point-cloud data would be the

    key obstacle in point-cloud storage research. It is an urgent problem to define the

    point-cloud data type and the organization in 3-D spatial databases (Ming, 2007,

  • © CO

    PYRI

    GHT U

    PM

    3

    Wang, 2008). The choice of the right and appropriate database is always crucial for

    any information system (Kulshrestha, 2014

    This research explores the possibility of using an open source in the development of

    the web application based on a database structure using Graphical User Interface

    (GUI) to make information accessible to users. However, the main target group of

    this research will be the vendor and managers in JUPEM.

    1.3 Objectives

    The objective of this research is to improve and develop a new method for managing

    LiDAR database system using open source platforms to accommodate future needs

    by JUPEM and Industries develop a LiDAR database management system using

    open source platforms. The purpose of developing LiDAR Database Management

    System (LiDMS V 1.0) is to be used by operators and managers at JUPEM as well as

    public and researchers to get information on LiDAR data via a web application.

    1.4 Specific Objectives

    The specific objectives of this study are as follows:

    1. To develop a LiDAR Database management system. 2. To implement the database system using an open software system. 3. To evaluate the performance of the system

    1.5 Scope

    This thesis aims to investigate how LiDAR data can be stored in an efficient,

    organized and user-friendly manner especially for users who do not possess full

    knowledge of LiDAR. This was done by, firstly, developing a thorough

    understanding of the challenges related to the structure, acquisition, data conversion

    and storage of the LiDAR data. A LiDAR database prototype will be developed,

    followed by an assessment of what can be done from the system’s implementation.

    The study will focus only on data available from the Malaysian Department of

    Surveying and Mapping (JUPEM). JUPEM as a proprietary data holder or library

    data for aerial photography receives a lot of aerial photography data from other

    government agencies or the private sector who captures data year every year, and this

    includes LiDAR data (Circular Document of Classified Security Geospatial

    Instructions, 2007).

    1.6 Motivation

    The motivation of this research is to provide access to LiDAR data in Malaysia to

    users such as university students, researchers, the army, the police, managers and

  • © CO

    PYRI

    GHT U

    PM

    4

    decision makers through the online portal. The current methods practiced acquiring

    LiDAR data from JUPEM are either by making phone calls asking for data or

    sending formal letters to management requesting so. While this is manageable at the

    moment, it is important to explore the usage of open source platforms because it is

    available freely and has the required capabilities to function the same as commercial

    software like Oracle. A LiDMS v1.0 is customized to address the needs of JUPEM

    operators to manage LiDAR data and to provide access to researchers for their

    studies. LiDMS v1.0 gathers LiDAR data that been received from JUPEM in

    Malaysia for public access.

  • © CO

    PYRI

    GHT U

    PM

    70

    REFERENCES

    Achuthan, K., SudhaRavi, S., Kumar, R., & Raman, R. (2014). Security

    vulnerabilities in open source projects: An India perspective. International

    Conference on Information and Communication Technology (ICoICT). May

    28.30, 2014. pp: 18-23.

    American Society for Photogrammetry & Remote Sensing, ASPRS (2010. LAS

    Specification Version 1.1. Bethesda, Maryland: American Society for

    Photogrammetry and Remote Sensing. 11 pp. Accessed, 30 October 2015)

    American Society for Photogrammetry & Remote Sensing, ASPRS (2010) LAS

    Specification version 1.3,http://www.asprs.org/a/society/committees/

    Standards / LAS_3_3_r11.pdf (Accessed, 30 October 2015).

    AppliedImagery, (2008). QTModeler 6.0.5 : Quick Terrain Modeler.

    http://www.appliedimagery.com/

    Bazghandi, A. (2006). Web Database Connectivity Methods (using Mysql) in

    Windows Platform. Conference on 2nd Information & Communication

    Technologies In 2006. IEEE Xplore Press. Vol. 2, pp. 3577-3581.

    Beinat, A., & Sepic, F. (2005). Un programma per l’elaborazione di dati LIDAR in

    ambiente Linux. 50o Convegno Nazionale della Societa Italiana di

    Fotogrammetria e Topografia, Palermo, Italy.

    Bernama (2015) Flood Mitigation Plans To Get Priority Under 11th

    Development Plan Najib) http://web.archive.org/web/20141231084718/

    http://www.bernama.com.my/bernama/v7/ge/newsgeneral.php?id=1097160

    (accessed 1 September 2015)

    Besimi, A., Shehu, V., Abazi-Bexheti, L., & Dika, Z. (2009, June). Managing

    security in a new Learning Management System (LMS). Proceedings of the

    ITI 2009 31st International Conference on Information Technology Interfaces,

    2009. ITI'09, Dubrovik, June 22-25, 2009. IEEE Xplore Press. pp: 337-342.

    Boise Centre Space of Laboratory, BCAL. Boise State University. Retrieved 16

    September 2015 from http://bcal.boisestate.edu/ research/ publications/

    Bunting, P., Armston, J., Lucas, R., & Clewley, D. (2011). Sorted Pulse Data (SPD)

    Format: A new file structure for storing and processing LiDAR data.

    SilviLaser 2011. Hobart, Australia, Oct 17-19, 2011.

    Burman, H. (2002). Laser strip adjustment for data calibration and verification.

    International Archives of Photogrammetry Remote Sensing and Spatial

    Information Sciences, 34(3/A), 67-72.

    Cao, V. H., Chu, K. X., Le-Khac, N. A., Kechadi, M. T., Laefer, D., & Truong-Hong,

    L. (2015). Toward a new approach for massive LiDAR data processing. 2nd

    IEEE International Conference on Spatial Data Mining and Geographical

  • © CO

    PYRI

    GHT U

    PM

    71

    Knowledge Services (ICSDM). Fuzhou, July 8-10, 2015. IEEE Xplore Press.

    pp: 135-140.

    Carter, J., Schmid, K., Waters, K., Betzhold, L., Hadley, B., Mataosky, R., &

    Halleran, J. (2012). Lidar 101: An introduction to lidar technology, data, and

    applications. National Oceanic and Atmospheric Administration (NOAA)

    Coastal Services Center. Charleston, SC.

    Chen, Q. (2007). Airborne lidar data processing and information extraction.

    Photogrammetric engineering and remote sensing, 73(2), 109.

    Chen, Q., Gong, P., Baldocchi, D., & Xie, G. (2007). Filtering airborne laser

    scanning data with morphological methods. Photogrammetric Engineering &

    Remote Sensing, 73(2), 175-185.

    Cheng, L., Tong, L., Chen, Y., Zhang, W., Shan, J., Liu, Y., & Li, M. (2013).

    Integration of LiDAR data and optical multi-view images for 3D

    reconstruction of building roofs. Optics and Lasers in Engineering, 51(4),

    493-502.

    Chopra, S. and S. Dexter (2009) Free software, economic 'realities', and information

    justice, SIGCAS Computers and Society, ACM, New York, NY, USA.

    Chuanfan, L. (2010, May). Research on Role-Based Access Control Policy of E-

    government. International Conference on E-Business and E-Government

    (ICEE). Guangzhou, May 7-9, 2010. IEEE Xplore Press. pp: 714-716.

    Codeigniter http://phpsyntax.blogspot.com/2012/08/codeigniter-directory-

    structure.html (accesed 22 Mei 2015)

    David, N., Mallet, C., & Bretar, F. (2008, August). Library concept and design for

    lidar data processing. Proceedings of the GEOgraphic Object Based Image

    Analysis (GEOBIA) Conference. Calgary, AB, Canada (Vol. 58).

    Dong, S., & Hu, Q. (2005). Building remote sensing database on Grid. Proceedings

    of the International Geoscience and Remote Sensing Symposium

    (IGARSS'05). 25-29 July, 2005. IEEE Xplore Press. Vol. 1, pp. 2105-2108.

    Ellislab https://ellislab.com/codeigniter/user-guide/overview/appflow.html,

    (accessed 14 April 2015)

    Fauscette, M.,(2009) The value of open source, IDC Analyst Connection, IDC, USA.

    Ghosh, R. A., & Schmidt, J. P. (2006). Open Source and Open Standards: A New

    Frontier for Economic Development. UNU Policy Brief, MERIT, Maastricht,

    The Netherlands. Vol 1.

    Guo Ming, (2007). Database Management & Visualization of Huge Range Images

    and Digital Images. Master's thesis of Beijing University of Civil

    Engineering and Architecture.

  • © CO

    PYRI

    GHT U

    PM

    72

    Haider, A., & Koronios, A. (2009). Promises of Open Source Software For

    Australian Government Agencies-An Exploratory Study. Proceedings of the

    Pacific Asia Conference on Information Systems (PACIS). Hyderabad, India,

    July 10-12, 2009. Vol 16.

    Hao, W., Heping, C., & Tian, Q. (2015). Research on Manufacturing SME

    Information Management Systems Based on Ajax and MVC. Seventh

    International Conference on Measuring Technology and Mechatronics

    Automation. Nanchang, 13-14 June, 2015. IEEE Xplore Press. pp: 884-887.

    Henley, M., & Kemp, R. (2008). Open Source Software: An introduction. Computer

    Law & Security Review: The International Journal of Technology Law and

    Practice, 1(24), 77-85.

    Hua, X., Zhanga, Z., Duana, Y., Zhanga, Y., Zhua, J., & Longb, H. (2011). LIDAR

    Photogrammetry and its Data Organization. ISPRS-International Archives of

    the Photogrammetry, Remote Sensing and Spatial Information Sciences,

    3812, 181-184.

    Holck, J., Larsen, M. H., & Pedersen, M. K. (2004). Identifying business barriers

    and enablers for the adoption of open source software. Proceedings of the

    13th International Conference on Information Systems Development.

    Vilnius, Lithuania, July 19, 2004. pp: 1-15.

    Holmgren, J. (2004). Prediction of tree height, basal area and stem volume in forest

    stands using airborne laser scanning. Scandinavian Journal of Forest

    Research, 19(6), 543-553.

    Hongchao, M., & Wang, Z. (2011). Distributed data organization and parallel data

    retrieval methods for huge laser scanner point clouds. Computers &

    geosciences, 37(2), 193-201.

    Hug, C., Krzystek, P., & Fuchs, W. (2004). Advanced lidar data processing with

    LasTools. International Archives of Photogrammetry and Remote Sensing,

    Commision II, ISPRS 20th Congress. Istanbul, Turkey, July 13-23, 2004. pp:

    12-23.

    Hwang, S. Y. (2005). Adopting open source and open standards in the public Sector:

    five deciding factors behind the movement. Michigan Journal of Public

    Affairs, 2, 1-19.

    Isenburg, M. (2011) “LAStools : converting, filtering, viewing, processing, and

    compressing LIDAR data”. http://www.cs.unc.edu/~isenburg/lastools/

    Isenburg, M., & Shewchuk, J. (2009). Visualizing lidar in google earth. 17th

    International Conference on Geoinformatics 2009. Fairfax, VA, Aug 12-14,

    2009. IEEE Xplore Press. pp: 1-4.

    ISPRS (2012) http://www.isprs.org/proceedings/XXXVIII/4-C1/Sessions/

    Session2/6703_David_Proc.pdf (accessed, 2 September 2015)

  • © CO

    PYRI

    GHT U

    PM

    73

    James, S. and J. P. Van Belle (2008). Ensuring the long-term Success of OSS

    Migration: A South African Exploratory Study. 6th Conference on

    Information Science Technology and Management (CISTM), New Delhi,

    India.

    Jokonya, O. (2015). Investigating Open Source Software Benefits in Public Sector.

    48th Hawaii International Conference on System Sciences (HICSS). Kauai,

    HI, Jan 5-8, 2015. IEEE Xplore Press. pp: 2242-2251.

    Keller, G., Seber, D., Sinha, A. K., & Baru, C. (2005). The Geosciences Network

    (GEON): one step towards building cyberinfrastructure for the geosciences,

    European Geophysical Union. In Geophysical Research Abstracts. Vol. 7, p.

    05726.

    Kemp, R. (2009). Current developments in open source software. Computer Law &

    Security Review, 25(6), 569-582.

    Kjartan, B., (2013). LiDAR Data Warehouse. Master Thesis, Faculty of Engineering

    Science and Technology Department of Civil and Transport Engineering,

    Norwegian University of Science and Technology.

    Kulshrestha, S., & Sachdeva, S. (2014). Performance comparison for data storage-

    Db4o and MySQL databases. Seventh International Conference on

    Contemporary Computing (IC3). Noida, Aug 7-9, 2014. IEEE Xplore Press.

    pp: 166-170.

    Kumar, P., McElhinney, C. P., Lewis, P., & McCarthy, T. (2013). An automated

    algorithm for extracting road edges from terrestrial mobile LiDAR data.

    ISPRS journal of photogrammetry and remote sensing, 85, 44-55.

    Kumar, S. (2015). Using Social Network Analysis to Inform Management of Open

    Source Software Development. 48th Hawaii International Conference on

    System Sciences (HICSS). Kauai, HI, Jan 5-8, 2015. IEEE Xplore Press. pp:

    5154-5163.

    Ledoux, H., & Meijers, M. (2013). A star-based data structure to store efficiently 3D

    topography in a database. Geo-spatial Information Science, 16(4), 256-266.

    Lewis, P., McElhinney, C., Schoen-Phelan, B., & McCarthy, T. (2010). Mobile

    mapping system LiDAR data framework. International Archives of the

    Photogrammetry, Remote Sensing and Spatial Sciences Information. 38,

    pp.135-138.

    Lipus, B., & Zalik, B. (2012). Lossy LAS file compression using uniform space

    division. Electronics letters, 48(20), 1278-1279.

    Liu, J., Dang, Y., Wang, Z., & Zhou, T. (2006). Relationship between the in-degree

    and out-degree of WWW. Physica A: Statistical Mechanics and its

    Applications, 371(2), 861-869.

  • © CO

    PYRI

    GHT U

    PM

    74

    Malaysia Circular of Geospatial Safety Instructions on The Classified Document

    1/2007 Section 2 number 14 (v). Kuala Lumpur. Retrieved 13 Mac 2015.

    McGaughey, R. (2015) FUSION/LDV: software for LiDAR data analyse and

    Visualization. Retrieved 20 August 2015 from http://forsys.cfr

    .washington.edu/fusion/fusionlatest

    McNaughton, M. (2010). 16P. Broadening The Revolution: An Assessment Of Open

    Source Initiatives In The Caribbean and Latin America. International

    Conference on Information Management (CONF-IRM). Montego Bay,

    Jamaica. May 16-18, 2010.

    Ming, G., & Yanmin, W. (2008). Management and visualization of huge range

    images and digital images. The International Archives of the

    Photogrammetry, Remote Sensing and Spatial Information, 273-278.

    Ming, G., Yanmin, W., Youshan, Z., & Junzhao, Z. (2009). Research on Database

    Storage of Large-Scale Terrestrial LIDAR Data. International Forum on

    Computer Science-Technology and Applications, 2009 (IFCSTA'09).

    Chongqing, Dec 25-27, 2009. IEEE Xplore Press. Vol. 2, pp: 19-23.

    Miyamoto, N., Higuchi, K., & Tsuji, T. (2014). Incremental Data Migration for

    Multi-database Systems Based on MySQL with Spider Storage Engine. 3rd

    International Conference on Advanced Applied Informatics (IIAIAAI).

    Kitakyushu, Aug 31-Sept 4, 2014. IEEE Xplore Press. pp: 745-750.

    Morgan, L. and P. Finnegan (2007) How perceptions of open source software

    influence adoption, Proceedings of the 15th European Conference on

    Information Systems, St.Gallen, Switzerland.

    Mosa, A. S. M., Schön, B., Bertolotto, M., & Laefer, D. F. (2012). Evaluating the

    benefits of octree-based indexing for LiDAR data. Photogrammetric

    Engineering & Remote Sensing, 78(9), 927-934.

    Mtsweni, J. and E. Biermann. (2008) A Roadmap to Proliferate Open Source

    Software Usage within SA Government Servers, Third International

    Conference on Broadband Communication, Information Technology &

    Biomedical Applications, Pretoria, South Africa, pp. 430-436.

    Nagy, D.; A. Yassin and A. Bhattacherjee.(2010) Organizational adoption of open

    source software: Barriers and remedies, Communications of the ACM, ACM

    New York, NY, USA, 2010, pp. 148-151

    Nandigam, V., Baru, C., & Crosby, C. (2010). Database design for high-resolution

    LIDAR topography data. International Conference on Scientific and

    Statistical Database Management. Scientific and Statistical Database

    Management Volume 6187 of the series Lecture Notes in Computer Science.

    pp: 151-159.

  • © CO

    PYRI

    GHT U

    PM

    75

    Olsen, M. J., Johnstone, E., Driscoll, N., Ashford, S. A., & Kuester, F. (2009).

    Terrestrial laser scanning of extended cliff sections in dynamic environments:

    Parameter analysis. Journal of Surveying Engineering, 135(4), 161-169.

    Oracle Press (2015) http://www.oracle.com/us/corporate/press/018363 (Accessed, 7

    September 2015)

    Parreiras, F. S., Gröner, G., Schwabe, D., & de Freitas Silva, F. (2015). Towards a

    marketplace of open source software data. 48th Hawaii International

    Conference on System Sciences (HICSS). Kauai, HI, 5-8 Jan, 2015. IEEE

    Xplore Press. pp: 3651-3660.

    Samberg, A. (2007). An implementation of the ASPRS LAS standard. ISPRS

    Workshop on Laser Scanning and SilviLaser. Finland, 12-14 Sept. 2007. pp:

    363-372.

    Sara E. E., (2010). Design, Development, and Application of Lidar Data Processing

    Tools. Master Thesis, Idaho State University.

    Schön, B., Bertolotto, M., Laefer, D. F., & Morrish, S. (2009). Storage,

    manipulation, and visualization of LiDAR data. Presented at the 3rd

    International Workshop, 3D-ARCH'2009: 3D Virtual Reconstruction and

    Visualization of Complex Architectures. Trento, Italy, Feb 25-28, 2009.

    International Society of Photogrammetry and Remote Sensing.

    Shan, J., & Toth, C. K. (Eds.). (2008). Topographic laser ranging and scanning:

    principles and processing. CRC Press. Boca raton, FL. Access online via

    Taylor & Francis Group. ISBN: 978-1-4200-5142-1.

    Sharma, N., Parikh, J., & Clark, M. (2006). A lidar collaboratory data management

    system. IEEE International Symposium on Geoscience and Remote Sensing.

    Denver, CO, July 31-Aug 4, 2006. IEEE Xplore Press. pp: 817-820.

    Shekhar, S., Sanjay, C., (2004). Spatial Database: A Tour. Pearson Education Asia

    Limited and China Machine Press.

    Song, B., & Chen, S. (2012). Roles-based Access Control Modeling and Testing for

    Web Applications. Third World Congress on Software Engineering (WCSE)

    2012. Wuhan, 6-8 nov, 2012. IEEE Xplore Press. pp: 57-62.

    Straatsma, M. W., & Baptist, M. J. (2008). Floodplain roughness parameterization

    using airborne laser scanning and spectral remote sensing. Remote Sensing of

    Environment, 112(3), 1062-1080.

    Sukhoo, A., Soobron, M., Soodin, R., Hawabhay, R., & Beerbul, S. (2013). Open

    source software adoption in Mauritius. In IST-Africa Conference and

    Exhibition (IST-Africa). Nairobi, 29-31 May, 2013. IEEE Xplore press. pp:

    1-10.

  • © CO

    PYRI

    GHT U

    PM

    76

    Tong, L., Cheng, L., Li, M., Wang, J., & Du, P. (2014). Integration of LiDAR data

    and orthophoto for automatic extraction of parking lot structure. IEEE

    Journal of Selected Topics in Applied Earth Observations and Remote

    Sensing, 7(2), 503-514.

    Wang, W., & Hu, Q. (2014). The Method of Cloudizing Storing Unstructured LiDAR

    Point Cloud Data by MongoDB. Proceedings on the 22nd International

    Conference on Geoinformatics. Kaohsiung, 25-27 June, 2014. IEEE Xplore

    Press. pp: 1-5.

    Zlatanova, S. (2006). 3D geometries in spatial DBMS. In Innovations in 3D geo

    information systems. Springer Berlin Heidelberg. pp: 1-14.

    Vierling, K. T., Vierling, L. A., Gould, W. A., Martinuzzi, S., & Clawges, R. M.

    (2008). Lidar: shedding new light on habitat characterization and modeling.

    Frontiers in Ecology and the Environment, 6(2), 90-98.

    Weber, S.,(2004) The Success of Open Source, Harvard University Press,

    Cambridge, MASS.

    Wehr, A., & Lohr, U. (1999). Airborne laser scanning - an introduction and overview.

    ISPRS Journal of photogrammetry and remote sensing, 54(2), 68-82.

    Wei, Y., Shi, C., & Shao, W. (2010). An attribute and role based access control

    model for service-oriented environment. Chinese Control and Decision

    Conference. Xuzhou, 26-28 May, 2010. IEEE Xplore Press. pp: 4451-4455.

    Xia, D., Xie, X., & Xu, Y. (2009). Web GIS server solutions using open-source

    software. IEEE International Workshop on Open-source Software for

    Scientific Computation (OSSC). Guiyang, Sept 18-20, 2009. IEEE Xplore

    Press. pp: 135-138.

    Zhao, F. J., Zhang, J. F., & Cao, D. Y. (2005). Dynamic database connection and

    dynamic web map service for internet mapping. Proceedings. of the

    International Geoscience and Remote Sensing Symposium, 2005

    (IGARSS'05). July 25-29, 2005. IEEE Xpolre Press. Vol. 5, pp: 3167-3169.

    Zhen, K., Zhu, L. F., Wu, X. C., Liu, X. G., & Li, J. (2006). Study on spatial

    indexing techniques for 3D GIS. Geography and Geo-Information Science,

    22(4), 35-39.

    Zheng, X. L., Zeng, D. J., LI, H. Q., Mao, W. J., Wang, F. Y., & Dai, R. W. (2007).

    Analyzing and Modeling Open Source Software as Complex Networks [J].

    Complex Systems and Complexity Science, 4(3), 1-9.

    Zhou, L., & Vosselman, G. (2012). Mapping curbstones in airborne and mobile laser

    scanning data. International Journal of Applied Earth Observation and

    Geoinformation, 18, 293-304.

  • © CO

    PYRI

    GHT U

    PM

    77

    Zhu, Q., Yao, X., Huang, D., & Zhang, Y. (2002). An Efficient Data Management

    Approach for Large Cyber-City GIS. International Archives of

    Photogrammetry Remote Sensing and Spatial Information Sciences, 34(4),

    319-323.

    Zlatanova, S., & Prosperi, D. (Eds.). (2005). Large-scale 3D data integration:

    challenges and opportunities. CRC Press. Boca raton, FL. Access online via

    Taylor & Francis Group. ISBN: 978-1-4200-3628-2.

    Title Page etc 190917Combined All 190917Blank PageBlank PageBlank PageBlank PageBlank Page