Realising the Value of Big Data Technology Innovation Requirements

EmilLupuImperialCollegeLondone.c.lupu@imperial.ac.uk

Future Software Eco-Systems

Data Infrastructures

Sensing&LocalInference

ContentAggregationDistribution

Learning,Planning,Optimisation

What are the main obstacles?

• Compliancewithlegislation?

• Dataacquisition,managementandexchangerequirements?Inparticularw.r.tDataQuality?

• Howtofacilitateinnovationthroughadaptivedataframeworks?

• Howtofacilitatecontractualaspectsfordataservices?

• Howtoprotectdataconsistentlywithitsvalue,ownershipandusage?UsageControl?Deriveddata?

• Limitationsofdataanalyticsandmachinelearning?

• Howtoanticipatepossibleusesandknowledgethatcanbeextractedfromthedata?

Policy-Based Techniques for Data Management and Compliance

• Policies(rules)canbeexpressedtodefinedatahandlingprocedures,legalrequirements(underagiveninterpretation),…

• Overthelast10-15yearssignificantadvanceshavebeenmadethatenableto:

• Verifydatahandlingtracesagainstpolicyrequirements

• Analysecomplexpolicysets

• Specifypolicyathigherlevelsofabstractionandrefineit.

• Learnpoliciesfrompractice.

Policy (Rule) Based Systems

PolicyRefinement

PolicyLearning

PolicySpecification

PolicyAnalysis

PolicyDeploymentandEnforcement

Adaptive Data Frameworks

• Dataacquisitionandmanagementframeworksaregovernedbythefirstintendeduse.

• Cost/performanceaspectsrequireframeworksthatprovidesufficientdataqualitybutnotmore.

• Howcanwerealisedynamicallyadaptivedataframeworkswherethecollection,managementandaggregationcanbedynamicallyre-programmedatlowcost?

• Isthereanappetiteforinvestinginsuchframeworks?

Data Sharing (Usage) Agreements = SLAs for Data Services

• Thespecification,monitoringand(partially)automatedenforcementofServiceLevelAgreementshasplayedasignificantroleinthedevelopmentofInternetandWeb-Services.

• ThereisalmostnoequivalentworkforDataServices.• Applicablelegislation• Accessandpurposeofuse• Datahandlingrequirements• Dataqualityanddeliveryparameters• Trustrelationshipsforautomatedenforcement

Data Sharing (Usage) Agreements

DataSharing Agreement

Refin

emen

t

Analysis

• Whataresuitablecasestudies?• Wouldthisfacilitatedatacommerce?

• CanPrivacyAspectsbetreatedasaspecificcaseofdatasharing(usage)agreementsbetweenanindividualandanorganisation?

Data Protection Requirements

• Deriveddatacouldbeautomaticallyprotectedbasedona)contractrequirementsb)knowledgeofthetransformationsthatwillbeapplied.

• Whichmodelsarelikelytodominate?• Towhatextentisdataprotectionanobstacletothe

developmentofdatamarketplaces?• Isdatausagecontrolnecessarytomaximiseprofitandvalue?

Contractual (Legal)EnforcementOnly

AccessControl PolicywithClientEnforcement

RightsManagement

RightsManagementwithTPMandattestation

Anticipating Future Uses

• Ifonlywecouldanticipatewhatthedatacouldbeusedfor…• Wecoulddetermineitsprivacyimplications.• Wecouldestimateitsvaluetosomebodyelse.• Wecouldanticipatetheriskofmisuse.• Wecouldidentifynewavenuesofexploitation.

• Butwecan’t.http://pleaserobme.com/

• (Crowdsourced)Explorationofthedataspace?• Hybridhuman/machineanalysisofdatatoderiveknowledge.

From Data to Value and back again

Sensing&CrowdsensingUsagecontrolPrivacy

FromDatatoKnowledgeDataQuality

Datasharing,storageanduse

DataValue,Risk&EconomicModels

What are the main obstacles?

• Compliancewithlegislation?

• Dataacquisition,managementandexchangerequirements?Inparticularw.r.tDataQuality?

• Howtofacilitateinnovationthroughadaptivedataframeworks?

• Howtofacilitatecontractualaspectsfordataservices?

• Howtoprotectdataconsistentlywithitsvalue,ownershipandusage?UsageControl?Deriveddata?

• Limitationsofdataanalyticsandmachinelearning?

• Howtoanticipatepossibleusesandknowledgethatcanbeextractedfromthedata?

Questions