Evolution of Data Analysis By Monica Holtforster.
-
Upload
branden-watts -
Category
Documents
-
view
216 -
download
1
Transcript of Evolution of Data Analysis By Monica Holtforster.
Impact of Technology on Software
• Speed of processing / file size accommodated• Ease of use• Import options available• Graphical repesentation• Technical level of user
Data created and captured worldwide
Source: “Digital Universe” study 2008
Exabytes
Tenfold growth observed in five years
ATMsERPs
Transactional data CRM , Accounting
databases, new compliance requirements, new medias etc…
IDC Study highlights
• In 2011, digital data was 10 times size of 2006
• 44-fold in the next ten years
• Data growth can not be ignored
• Tools are in place and proven
Definition of Ad Hoc
• Typically used for initial investigation • Typically run to support specific projects• Rarely performed directly on production
systems• May be difficult to repeat if steps not well
documented• Often relies on skill of selected skilled
individuals
Definition of Repeatable
• Predefined and scripted to perform the same tests on similar data
• Data access tools may be used to import data directly from production systems
• Reliance on skilled individuals significantly reduced
• The quality of analysis is improved and remains consistent as the data acquisition process is partially or fully automated
Centralized Analytics
• Centralized approach for the development, storage and operation of repeatable DA
• Standards for development of DA are documented
• Applications are set up and scheduled to run against the centralized data on a regular basis
• Data can either be pushed or pulled from different sources
Continuous Monitoring
• Analytics are fully automated and running at regularly scheduled intervals
• may be embedded directly into a production system
• often developed and owned by operations management
Recommendations
• Do simple process development first, using existing software
• Automate data extraction and validation• Reduce false positives• Prioritize by likelihood of recovery• Refine and document the testing process
over several cycles.
Future Expectations
Predictive pre-canned analysisIncreased intelligence in the
softwareIntegration of different toolsUse of external sources for
comparison