Matt Franklin - Apache Software (Geekfest)

Apache Software

Foundation:

What’s Next?Matt Franklin

Foundation Member

Incubator PMC Member

PMC Chair & Vice President, Apache Rave

The Apache Software Foundation

“The Apache Software Foundation provides support for

the Apache community of open-source software projects,

which provide software products for the public good.”

Apache Projects

Over 300 Open Source Projects

Over 25 different programming languages

Over 20 different categories from big data to e-mail

The Apache Incubator

“The Incubator project is the entry path into The Apache Software Foundation for projects and codebases wishing

to become part of the Foundation’s efforts.”

Apache TinkerPop (incubating)

• A graph computing framework– Defines and manages the Gremlin graph

query language

– Provides abstracted server runtime for most major graph databases

• Neo4J

• TinkerGraph

• Sail Graph

• Titan

• Working on their first official Apache release

• Last pre-Apache release: 3.0.0M3

Apache NiFi(incubating)

• Distributed data processing system– Guaranteed Delivery

– Data Buffering w/ Throttling

– Prioritized Queuing

– Configurable QoS optimizations

– Data Provenance

– Visual C2

– Security

• Latest Release 0.0.1-incubating

Apache Kylin(incubating)

• Distributed Analytics Engine– Open sourced from eBay

– Provides a SQL interface

– Supports existing BI tools

– Sub-second response across large data sets

– Leverages Hadoop as a data store


• Last pre-Apache release: 0.6.6

Apache Zeppelin (incubating)

• Web-based Analytics Visualization System– Integrates Apache Spark for data

processing

– Multi-language backend and query engine

– Rich plugin and extension capability

– Native visualizations with embedding capability

– Organized into a sharable notebook for collaboration


Apache HTrace (incubating)

• Provides a mechanism for easily tracing processes in distributed systems

• Simple integration model by wrapping threads

• Modular tracing receivers allows for custom back-ends

• Supports Zipkin natively

• Latest release 3.1.0-incubating

Apache Ignite (incubating)

• In-memory data fabric– Distributed processing

– Supports multiple use cases• In-memory DBMS operations with persistent backend

• High performance, massively-parallel computing

• Distributed messaging

• Advanced clustering capabilities

• Distributed data structures

– Optimized for speed in all cases

• Latest release 1.0.0-RC1

Groovy

• Popular dynamic programming language for the JVM– Interoperability with any JVM libraries

– More permissive programming model than Java

– Allows for a wider set of use cases than java• Dynamic scripting

• Programming console

• Proposed Apache Incubator project

• Latest Pre-Apache Release 2.4

Boyd HemphillTechnology Evangelist | StackEngine

TsunamiDocker is here and Lambda is next.

Boyd E. Hemphill - @behemphi

Pants?Nope

Gyros?Nope

Linux Container Virtualization?

Yes!

What is StackEngine? We’ll get there

Who am I? Director of Evangelism - StackEngine Jesus, Jobs, Gates - Pick a religion

A Brief History of Virtualization

Is history repeating itself?

History from an Engineers

Perspective

First there were

containers (1982, 1998,

2005) but they were hard


Perspective

First there were

containers (1982, 1998,

2005) but they were hard

Then there was the cloud

(2009). It was easy.


Perspective

First there were containers

(1982, 1998, 2005) but they

were hard

Then there was the cloud

(2009). It was easy.

Today there is Docker and

containers are ready for mere

mortals

What’s a ContainerShould all horses become unicorns?

What is a Container

A Virtual Machine (Cloud)

is a full copy of an entire

computer running in

software via a hypervisor

What is a Container

A Virtual Machine (Cloud) is

a full copy of an entire

computer running in

software via a hypervisor

A Container is a slice of a

computer with no hypervisor

overhead.

A Virtual Machine (Cloud) is a full

copy of an entire computer running

in software via a hypervisor

A Container is a slice of a

computer with no hypervisor

overhead.

Executive Summary: The lack of

extra stuff in the bottom picture

means big efficiency gains

What is a Container

But Wait!Why do I care?

Typical

Rockstar

CTO

Starts

with,

“Why?”

Why you care

In the cloud a physical

machine might practically

be split into 16 VMs.

Why you care

In the cloud a physical

machine might practically

be split into 16 VMs.

With containers the

number is in the 100s for

the same machine

(Density)

Why you care

In the cloud a physical machine

might practically be split into 16

VMs.

With containers the number is in

the 100s for the same machine

(Density)

In the cloud it can take minutes

to get a new VM

Why you care

In the cloud a physical machine

might practically be split into 16

VMs.

With containers the number is in the

100s for the same machine

(Density)

In the cloud it can take minutes to

get a new VM

Containers start in milliseconds.

(Agility)

Yeah, still don’t see why it matters.

But I am listening …

Cost Reduction - Density

Today you have 100’s or

1000’s of machines.




Tomorrow you have

10,000’s containers (and

10 to 100 machines).




Tomorrow you have 10,000’s

containers (and 10 or 100

machines).

You pay for machines, not

containers.

Cost Reduction - Better Geek

Efficiency

Geeks are expensive


Efficiency

Geeks are expensive

Containerized

development

environments save

developer time.


Efficiency

Geeks are expensive

Containerized development

environments save developer

time.

At W2O using VMs we recouped

up to 8 hours per week

(measured) of geek time!

~$250,000 per year. Containers

can be better!


Efficiency

Geeks are expensive

Containerized development

environments save developer time.

At W2O using VMs we recouped up to 8

hours per week (measured) of geek

time! ~$250,000 per year. Containers

can be better!

We did not measure the recovered

opportunity costs (shame)

OK … I like spending less money.

But will it help me grow revenue?

Revenue Growth -

Innovation

Remember that 8 hours

per week we saved

developers?

Revenue Growth -

Innovation


per week we saved

developers?

8 hours per week more

features

Revenue Growth -

Innovation


per week we saved

developers?

8 hours per week more

features

Features = Revenue

Revenue Growth -

Innovation

These containerized

development

environments are

disposable

Revenue Growth -

Innovation

These containerized

development

environments are

disposable

Developers want to

upgrade for the latest

features.

Revenue Growth -

Innovation

These containerized

development environments are

disposable

Geeks want to upgrade for the

latest features.

Majority of Developers have

bespoke development

environments

Revenue Growth -

Innovation

These containerized development

environments are disposable

Geeks want to upgrade for the latest

features.

Majority of Developers have

bespoke development environments

Easy to make, easy to throw away.

Easy to try something new.

Revenue Growth -

Innovation

These containerized development

environments are disposable

Geeks want to upgrade for the latest

features.

Instead of bespoke development

environments

Easy to make, easy to throw away.

Easy to try something new.

Easy to go back if you don’t like the

result

Al … most … careWhat else you got?

A/B Testing

Marketing is more metrics

driven than engineering

teams (irony?)

A/B Testing



teams (irony?)

Build, Measure, Learn,

Lather, Rinse, Repeat

A/B Testing



teams (irony?)

Build, Measure, Learn,

Lather, Rinse, Repeat

Bullets not Cannonballs

We should look into this Docker thing. You also

mentioned Lamb Chops?

It’s all Geek to me.

Amazon Lambda

Containers mean truly on

demand compute

Amazon Lambda


demand compute

In the same way the cloud

abstracted all the details of

a machine, lambda does

the same for compute

Amazon Lambda


demand compute


abstracted all the details of a

machine lambda does the

same for compute

Tsunami #2

Amazon Lambda


demand compute


abstracted all the details of a

machine lambda does the

same for compute

Tsunami #2

Don’t be caught

So what is StackEngine?

StackEngine

We provide a way to

manage containers in a

Production environment

StackEngine

We provide a way to

manage containers in a

Production environment

Cattle not Pets -> Ants not

Cattle

StackEngine

We provide a way to manage

containers in a Production

environment


Cattle

Want some help

understanding this potential?

Look us up!

StackEngine

We provide a way to manage

containers in a Production

environment


Cattle

Want some help understanding

this potential? Look us up!

http://stackengine.com

http://stackengine.com

Tech Colophon

Containers vs. VMs at Pantheon - Use Case -

goo.gl/u3ztxj and goo.gl/gRkKGN

Disposable Development Environments - Vagrant -

goo.gl/whsRV3

Docker 101 - tech tutorial - goo.gl/cuXUU6

Amazon Lambda - announcement - goo.gl/sb1rLh

Reading Colophon

Bullets not Cannonballs, Creative Empiricism - Great by Choice - Jim

Collins

Start with Why - Simon Sinek

Measured Learning - The Lean Start up - Eric Reis

Features = Revenue - The Goal, It’s not Luck - Eliyahu Goldratt

Change or Die (goo.gl/Y8cMNT)- The Three Horsemen of the Digital

Apocalypse Considered - Michael Cote

Open Source Software Panel

Digital Marketing /Design

Jon KolkoDirector & Founder| Austin Design Center

Daina MiddletonTwitter | Head of Global Business

Kurt HolsteinPresident | Azoic Ventures

Matthew ZitoVP Products | Synthesio

Digital Marketing /Design Panel

Security / Cloud

TK KeaniniCTO| Lancope

Cybersecurity: a game of

Innovation

TK Keanini, CTO

Lancope, Inc.

Evolution of Cyber Conflict

War Dialing, Phone Phreaking …

Manual Attacks (1980s)

Viruses, Worms …

Mechanized Attacks (1988)

Google, RSA …

Talented Human / Mechanized Attackers (2009)

Target, Neiman Marcus …

DIY Human /

Mechanized Attackers (2011)

Intelligence

Driven Human

76

Manual DefensesUnplug

Mechanized DefensesFirewall, IDS/IPS

Targeted Human/Mechanized Defenders

Reputation, App-aware Firewall

© 2014 Lancope, Inc. All rights reserved.

Running the numbers for Feb 2015

http://hackmageddon.com/


Target Distribution for Feb 2015


Industry Drill Down Feb 2015

We are losing!

Defenders need to find

hundreds of

vulnerabilities and fix

them all, while the

Attackers only need to

find one

Attackers need to

complete a series of

operations without being

detected, while the

Defenders only need to

detect them in one

Changing the Game


Security is Everyone’s Problem!

• Be social about security– Establish methods of authentication proactively

– Neighborhood watch

• Healthy Paranoia– Extra care with any call to action (click on this, download that..)

• Use 2-factor authentication early and often.– https://twofactorauth.org/

• Pay for security features and demand more from vendors!

• The only secure data is encrypted data

• Security is everyone’s problem – do your part and out innovate your attacker!

https://twofactorauth.org/

• [email protected]

• Follow me on Twitter – @tkeanini

• Personal Blog: – tkonsecurity.com

• Professional Blog– www.lancope.com/blog

• LinkedIn: www.linkedin.com/in/tkkeaninipub/

• Goodreads: TK Keanini

Because I’m noisy


MAHALO! (Thank you)

Michael CrosnoCEO| Click Security

Changing Security Landscape

CNET, 2013

Cyber Crime Market

Click Security Confidential

Criminal Action Estimated Costs

Global Cyber Activity $300 billion – $1 trillion

Drug Trafficking $600 billion

Piracy $1 billion – $16 billion

Globally, we spend $70 billion per year to stop the bad guys

The bad guys are making $300+ billion a year

Why Security Systems are Failing


Attack Surfaces

Adversaries

Enterprise Defenses

Expanding Attack Surfaces


Humans

78% of IT professionals

consider employees as the

biggest security threat

508 is the average

number of applications

in an enterprise

Networks

5.2 is the average number of

devices per knowledge worker

connecting to a network

Software

Citrix, 2013

Forbes, 2014 Ponemon Institute, 2015

AV-test.org, 2015.

Evolution of Adversaries


$1,300 is the average

attacker payment for a

banking Trojan

400,000 hackers

estimated in China alone &

growing daily

Malware Explosion # Skilled Hackers Black Market

383,000 new

malware variants

every day

US Intelligence, infosecisland.com

darkreading.com, 2012AV-test.org, 2015

Overwhelmed Defenses


1-3 is the average

number of headcount

devoted to IT security

64% of US companies

face 10,000+ alerts

per month

Point Products Insufficient Workloads Increasing Budgets Underfunded

8% of incidents are detected

by endpoint, firewall &

network solutions

FireEye, 2015FireEye, 2015Verizon DBIR, 2013

Impact on your Enterprise


32 is the average number

of days to resolve &

lockdown an attack

173 is the average

number of days from

infiltration to discovery

$8.9m is the cost of

the average enterprise

breach

Escalating Costs Slow to Discover Long to Resolve

Verizon 2012 DBIR Ponemon Institute, 2013darkreading.com, 2012

Stuxnet – Iran’s Nuclear Power Plants


Dave & Buster’s Restaurant


D&B – Slow and Methodical


Event Date Time Kill Chain Description of Actor’s Activities

Dave & Busters Feb. 1 0 1 Estonian and Ukrainian intruders scan /evaluate restaurant internet-facing connections

Dave & Busters Mar. 1 28 2 Estonian and Ukrainian intruders breached network security controls at a restaurant

Dave & Busters Mar. 2 1 4 Intruders breach a poorly secured retail system with internal network access, explore network

Dave & Busters Mar. 15 13 3 Yastremskiy and Suvorov contract Albert Gonzalez to customize sniffer for DB network

Dave & Busters Apr. 1 17 4 Intruders used network access to install packet sniffer designed to capture track 2 credit card data

Dave & Busters Apr. 15 14 5 The initial tests of the sniffer failed by crashing or failing to record data

Dave & Busters Apr. 15 0 5 Revised packet sniffer often failed to capture the intended information

Dave & Busters Sept. 1 139 5 Over 6 months intruders improved, tested and monitored their tools

Dave & Busters Sept. 22 1 6 Intruders establishing reliable and persistent control of the restaurant environments

Dave & Busters Sept. 3 1 6 Intruders prepare for breaching the corporate network in Dallas

Dave & Busters Sept. 15 12 5 Corporate servers breached, and admin passwords allow access to network devices

Dave & Busters Sept. 16 1 7 Intruders install the refined tools at 11 locations without detection

Dave & Busters Sept. 17 1 8 Packet capture tools return over 130,000 credit cards' full track data

Dave & Busters Sept. 30 13 10 The intruders were eventually blocked and identified by financial records

New Model for Security


The bad guys are

going to get in – how

do you find them

before they do

damage?

Transformational Changes


Current Security Practices

• Blocking & preventing attacks will work

• Big data produces better results

• Monitoring events will find bad actors

• Canned rules in SIEM’s are enough

Future Solutions Focus

• Detection, profiling & lockdown

• Adversary monitoring & investigation

• Actor kill-chain visualization & analysis

• User created analytics & sharing

Focus on what they do, not

what they use…

Michael CoteDirector, Technical Marketing| Pivotal

Security / Cloud Panel

Emerging Technologies

Alex GruzenCEO, WiTricity

Andres CarvalloCEO, CMG

EDGE POWER DRIVING

SUSTAINABIL ITY

2 ND EDIT ION

THE ADVANCED

SMART GRID

Andres Carvallo

CEO & Founder, CMG

www.512cmg.com

2003 – 2015 © Andres Carvallo 107

AE Smart Grid Program 2003 - 2011

First deployment of 127,000 AMR meters in 2003• Enterprise Architecture deployed in 2006

– Portal, Enterprise Service Bus, Data Warehouse, Business Intelligence, Cyber Security, IT Management Tools, Fiber backbone

• 2-way RF network upgraded in 2007– One way RF network built in 2003

• Nodal Market Tools deployed in 2008– New Generation Management System, New Network Model, SCADA/EMS Upgrades,

Maximo / Power Plant for Generation

• All 430,000 AMI meters installed in 2009

• New IVR and VOIP call center installed in 2009• New Meter Data Management System deployed in 2009• 120,000 smart thermostats installed (25% of homes in Austin)

– Started in 2003, 80k residential, 6k commercial, double by 2015

• New Billing System installed in April of 2011– RT/TOU Pricing, Pre-pay, Web2.0, TXT/SMS, Self-service

• New Distribution Management System installed in June of 2011– Piloting with 2,500 sensors in 2009. Grow to 20,000 sensors


We Have Been Here Before

The Grid must be

upgraded to become

an Advanced Smart

Grid because the

nature of technology

is to evolve over time

to empower

individuals at the

edge.

The electricity

industry will follow

similar trend lines

described by

evolution in the IT and

telecom industries.


Multiple Versions of The Truth


The Advanced Smart Grid Architecture Design


What is the Smart Grid 1.0 (SG1)?It is the automation of the entire Utility Grid

• Smart Grid 1.0 = GA + TA + SA + DA +AMI

• Smart Grid 1.0 (SG1) monitors, controls and manages the

creation, distribution and consumption of energy, AND has

dynamic visibility and control of the distribution assets,

including meters.

• This step requires the logical integration of SCADA/EMS

with DMS with GIS with AMI/MDM in a new way.


What is the Smart Grid 2.0 (SG2)?Utility Grids + Buildings + Homes + Vehicles

• My Smart Grid definition since March 5, 2004 united the

Utility Grid, Buildings, Homes, and Vehicles into one grid

• Smart Grid = GA + TA + SA + DA + DR + AMI + DER (i.e.

DG + ES + EV)

• The Smart Grid monitors, controls and manages the

creation, distribution and consumption of energy

• The Smart Grid of the future is distributed, interactive, self-

healing and reaches every device connected to it.


Smart Home Design


Smart Building Design


Smart Utility Design


SG2 Enables Smart City


What is the Smart Grid 3.0?Smart Grid 2.0’s interconnected enabling energy roaming

• My Smart Grid definition since March 5, 2004 unites the

Utility Grid, Buildings, Homes, and Vehicles into one grid and

predicts the eventual roaming of energy among service

territories.

• Either ISO/RTOs, Utilities or New Energy Service Providers

will perform such roaming exchange and settlements.

• This new reality will decouple the transaction for the

commodity from the physical delivery of it regionally,

national, internationally, globally.


SG3 enables Smart Nation


Trends to Watch

• Technology Disruptions

– Renewable and Distributed Energy,

Demand Response, Microgrids, Energy

Storage and Electric Vehicles.

• Business Disruptions

– Retail Choice, Product Bundling,

Municipalization, Nationwide Wholesale

Markets, and New Business Models (i.e.

EaaS).2003 – 2014 © Andres Carvallo 120

Questions?

Andres Carvallo

CEO & Founder, CMG

www.512cmg.com

[email protected]

512-215-9080

@andresecarvallo


http://www.512cmg.com

mailto:[email protected]

Alexander (Xan) OserDir. Of Business Development | Metaio

Metaio

Key Enabling

Technologies• AREngine

• Thermal Touch

Over 12 Yearsof Augmented Reality and

Computer Vision Experience

OptimizedFor Next Gen Devices

Best in ClassSoftware for Professionals

• Metaio Suite

• Metaio Creator

• Metaio SDK

• Metaio Cloud

Largest Productive

AR Distribution• Every IKEA Catalogue

• Victoria’s Secret

• Audi AR Vehicle Manuals

Mitsubishi MeView

BMW Window to the World

Audi Smart Manual

Emerging Technologies Panel

Future of Tech / Marketing

Zita CasszziChief Digital Officer | TOMS

Beyond Omni-Channel

Zita Cassizzi@ZitaC

• Your purpose – your reason for existing – is your key

message…and it is not “to make a profit”.

• Why are you really in business?

• Your audience are those that connect with that purpose,

and whose values align with yours. Know your brand

values!

It all starts with your PURPOSE

• You don’t own your brand.

• Your customers thoughts and emotions about your

brand are more important.

• Inspire and collaborate with your fans in co-creating

brand stories and content with you, making them

participants and leading stars!

• Empower via site, social media to create & foster a

sense of community and belonging both online and

offline.

From “Customer” to “Advocate”

#TRAVELINGTOMS

#TOMSHOLIDAYCHEER

• Create events and moments = experiences that connect your fans with the rest of the community.

• Use your brand as a platform for this connectednessand foster the sense of belonging.

• Examples:– Brand Moments and Milestones

– Instameets

– Store Openings or events with influencers

– Music Festival

Weaving Physical & Digital

Diverse touchpoints

Offline Online

Mobile

Responsive

WebsiteMobile Site

Mobile App

One Day Without Shoes

Experiential

Social Media

TOMS Stores

Experiential

Retail Partners

Community Outreach

Campus Programs

Giving Trips

Ticket to Give

Sweepstakes

Customer

Service

Cohesive creative and delivery

deliver memorable

momentsINSPIRE and MOTIVATE to TAKE ACTION

• CREATE a dialog – in physical and digital contexts.

• INVITE to be active participators.

• CO-CREATE and deliver value.

• PROVIDE a sense of fun and entertainment.

Beyond Touchpoints / Places …

Thank you!

Zita Cassizzi

@ZitaC

Becky BrownVP/ Director of Media | Intel

Pete BlackshawGlobal Head of Digital & Social | Nestle

Future of Tech/ Marketing Panel

THANK YOU!

See you tonight at Geek-a-cue!

Matt Franklin - Apache Software (Geekfest)

Technology

Transcript of Matt Franklin - Apache Software (Geekfest)