Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling?...

62
The OWASP Foundation http://www.owasp.org Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead [email protected] Rackspace Application Security Engineer Austin, Feb 2012

Transcript of Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling?...

Page 1: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

The OWASP Foundationhttp://www.owasp.org

Testing from the Cloud: Is the sky falling?

Matt TesauroOWASP Foundation Board Member,

WTE Project [email protected]

Rackspace Application Security Engineer

Austin, Feb 2012

Page 2: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

2

Who's this Matt guy anyway?

Broad IT backgroundDeveloper, DBA, Sys Admin, Pen Tester, Application Security professional, consultant, CISSP, CEH, RHCE, Linux+

Long history with Linux and Open SourceContributor to many projectsLeader of OWASP Live CD / WTE

OWASP Foundation Board Member

Rackspace – Cloud Application Security

Page 3: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

OWASP WTE: A History

Page 4: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

4

It all started that fine spring day...

Page 5: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

5

At all started that summer...

Page 6: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

6

Then that summer...

Page 7: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

7

•Current Release•OWASP WTE Sept 2011•Alpha of WTE Cloud

•Previous Releases•OWASP WTE Feb 2011•OWASP WTE Beta Jan 2010•AppSecEU May 2009•AustinTerrier Feb 2009•Portugal Release Dec 2008•SoC Release Sept 2008•Beta1 and Beta2 releases during the SoC

Note: Not all had ISO, VirtualBox and Vmware versions

Page 8: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

8

Other fun facts

•~5,094 GB of bandwidth since launch (Jul 2008)

•Most downloads in 1 month = 81,607 (Mar 2009)

Overall downloads: 330,081 (as of 2009-10-05)

Page 9: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

9

There's a new kid in town

OWASP WTE

Web Testing Environment

Page 10: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

10

The project has grown to more than just a Live CDVMWare installs/appliancesVirtualBox installsUSB InstallsTraining EnvironmentsPre-packaged toolsCloud???

Add in the transition to Ubuntu/Debian and the possibilities are endless (plus the 26,000+ packages in the repos)

Page 11: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

11

GOAL

Make application security tools and documentation readily available and easy to use

Compliment's OWASP goal to make app security visible

Design goalsEasy for users to keep updatedEasy for project lead to keep updatedEasy to produce releases (more on this later)Focused just on application security –

not general pen testing

Page 12: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

What's on WTE

Page 13: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

13

Page 14: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

14

Page 15: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

15

29 “Significant” Tools Available

WapitiWeb Goat

CAL9000

JBroFuzz

DirBuster

WebSlayer

WSFuzzerWeb Scarab

OWASP Tools:

a tool for performing all types of security testing on web apps and web services

an online training environment for hands-on learning about app sec

a collection of web app sec testing tools especially encoding/decoding

a web application fuzzer for requests being made over HTTP and/or HTTPS.

a fuzzer with HTTP based SOAP services as its main target

audits the security of web apps by performing "black-box" scans

a multi threaded Java app to brute force directory and file names

A tool designed for brute-forcing web applications such as resource discovery, GET and POST fuzzing, etc

JBroFuzza web application fuzzer for requests being made over HTTP and/or HTTPS.

EnDeAn amazing collection of encoding and decoding tools as well as many other utilities

ZAP ProxyA fork of the popular but moribund Paros Proxy

Page 16: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

16

Zenmap

Paros

nmap

Wireshark

Firefox

Burp Suite

Grendel Scan

Nikto

sqlmap

SQL Brute

w3af

netcat

Httprint

Spike Proxy

Rat Proxy

Fierce Domain Scanner

Metasploit

tcpdump

Maltego CE

Other Proxies: Scanners:

Duh:

SQL-i: Others:

Page 17: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

Why is it different?

Page 18: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

18

Page 19: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

19

Page 20: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

20

Page 21: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

21

OWASP DocumentsTesting Guide v2 & v3CLASP and OpenSammTop 10 for 2010Top 10 for Java Enterprise EditionAppSec FAQBooks – tried to get all of themCLASP, Top 10 2010, Top 10 + Testing + Legal, WebGoat and Web Scarab, Guide 2.0, Code Review

OthersWASC Threat Classification, OSTTMM 3.0 & 2.2

Page 22: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

22

Page 23: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

23

Page 24: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

24

Page 25: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

25

Page 26: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

26

Page 27: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

27

Page 28: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

What is next?

Page 29: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

29

Page 30: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

30

Cloud-ifying WTE

Cloud Provider

Ubuntu / Debian Install

WTE Repository

Fun ensues

Page 31: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

31

WTE Cloud - The12 Step ProgramCurrently this still mostly manual

12 steps to get a fully-functional WTE

~30 minutes until you are logged in

Page 32: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

32

Step 1: Get a cloud account

Page 33: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

33

Step 2: Select Ubuntu/Debian

Page 34: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

34

Step 3: Choose Name & RAM

Page 35: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

35

Step 4: Start your server

Page 36: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

36

Step 5: A bit of Prep

ssh to your new Linux box

Add Ubuntu partners and WTE repos & apt-get update

$ ssh [email protected]

root@wte-test:~# echo "deb http://archive.canonical.com/ubuntu maverick partner" >> /etc/apt/sources.list

root@wte-test:~# echo "deb http://appseclive.org/apt/stable /" >> /etc/apt/sources.list

root@wte-test:~# apt-get update

Page 37: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

37

Step 6: Install Desktop + WTE

Page 38: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

38

Step 7: Finish things off...

Add a NX Serverppa:freenx-team (plus a fix) ~ or ~No Machine NX server (free or $)

Add OWASP user

Start lightdm (graphical login)

# useradd --comment "OWASP WTE" --create-home owasp# echo -e "owasp\nowasp" | passwd owasp# service lightdm start

Page 39: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

39

Step 8: NX Client setup

Page 40: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

40

Step 8: Connect to WTE

Page 41: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

41

Step 9: WTE ala Cloud

Page 42: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

42

Step 9: WTE ala Cloud

Page 43: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

43

Step 9: WTE ala Cloud

Page 44: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

44

Step 10: Test Connectivity

Page 45: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

45

Step 11: Test the Tools

Page 46: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

46

Turn Cats into Dogs

Page 47: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

47

Step 12: Check your bill

Page 48: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

48

Cost Estimates

Page 49: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

49

Cost Estimates

For 40 hours + 1 GB transfer $4.98

For M-F, 24 hrs + 1 GB transfer = $15.48

For 30 days, 24 hrs + 4 GB transfer = $88.32

Page 50: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

Now what?

Page 51: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

51

More AutomationMake configuration steps into a script

Add to postinst for wte-cloud package

Get setup down to a single step

Ideally all in the wte-cloud package

Automate the bling (theme, etc)

Test on other Cloud providers

Page 52: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

52

Even More Automation

Python library to abstract away differences between multiple cloud provider APIs

Cloud ServersCloud StorageCloud Load balancers

Supports 24 different providers

Page 53: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

53

More OptionsDifferent desktop installs

Minimal (Gnome, KDE, XFCE, LXDE...)Tweaked for specific need

Instant WebGoat in the sky

Internal Clouds OpenStack, VMware, Xen VirtualBox (headless)

Page 54: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

54

Document, Document Document

Document and post the current manual process (coming soon)

Create then document the Libcloud process

Tutorials for various providers

Page 55: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

Problems

Page 56: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

56

Current Issues

Yikes! AMD64 CPU Some tools lack a dependency WTE Firefox is for i386 NX server is a bit tricky Either outdated or limited/$

The WTE theme gets lost

Need to look at X2go to replace NX

Page 57: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

57

How can you get involved?

Join the OWASP mail list Announcements are there – low traffic

Download an ISO or VM or Cloud instanceComplain or praise, suggest improvementsSubmit a bug to the Google Code site

Page 58: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

58

How can you get involved?

Suggest missing doc or links

Do a screencast of one of the tools

Suggest some cool new tool

Create a .deb package

Page 59: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

59

Learn More...

OWASP Site http://www.owasp.org/index.php/Category:OWASP_Live_CD_Project or just look on the OWASP project page (release quality)

http://www.owasp.org/index.php/Category:OWASP_Project

or Google “OWASP Live CD” or “OWASP WTE”

Download & Community Site

http://AppSecLive.org

Previously: http://mtesauro.com/livecd/

Page 60: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

60

Why do I do this?

Page 61: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

61

Questions?

http://www.sintel.org Independent film produced by the Blender Foundation using free and open software

Download it free at: Sintel

Page 62: Testing from the Cloud: Is the sky falling? - OWASP · Testing from the Cloud: Is the sky falling? Matt Tesauro OWASP Foundation Board Member, WTE Project Lead matt.tesauro@owasp.org

62