Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon...
Transcript of Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon...
![Page 1: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/1.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Arthur Petitpierre – [email protected] Solutions Architect – EC2 A1 InstancesNovember 2019
Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances
![Page 2: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/2.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Who am I ?
Arthur Petitpierre – [email protected] / @ArthurPtPSpecialist Solutions Architect – A1 Instances @AWS
Previously:• HPC Specialist SA @AWS• HPC Services CTO @ATOS• And a few other stuffs…
Occasionally deliver Snowballs around Paris Seattle on a cargo-bike
![Page 3: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/3.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon EC2 purchase optionsSpot Instances
Spare EC2 capacity at
off On-Demand prices
Fault-tolerant, flexible, stateless workloads
Reserved Instances
Make a 1 or 3-year commitment and receive a off
On-Demand prices
Committed & steady-state usage
On-Demand
Pay for compute capacity with no
long-term commitments
Spiky workloads, to define needs
![Page 4: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/4.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Spot is easy
Price changes infrequently based on long term supply and demand of spare capacity in each pool
independently
Just request capacity and pay the current rate. No Bidding
Interruptions only happen when OD needs capacity. No outbidding
![Page 5: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/5.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Large customer base
![Page 6: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/6.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon EC2 Spot integrations
Auto Scaling
AWS Batch
Amazon EMR
AWS Data Pipeline
Amazon Elastic Container Service
AWSCloudFormation
Amazon Elastic Container Service
for Kubernetes
AWS Thinkbox Deadline
![Page 7: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/7.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
I s my work load Spot Ready?
Stateless Fault-Tolerant Flexible: Multi-AZ and Instance
Flexibility
Loosely Coupled
Looks familiar?
![Page 8: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/8.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Spo t p r i c ing mode l change – no more b idd ing
New smooth pricingNovember 2017
![Page 9: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/9.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
$0.27 $0.29$0.50
1b 1c1a
8XL
$0.30 $0.16$0.214XL
$0.07 $0.08$0.082XL
$0.05 $0.04$0.04XL
$0.01 $0.04$0.01L
C4
$1.76
OnDemand
$0.88
$0.44
$0.22
$0.11
EC2 Spot pools – instance flexibil ity
Each instance family
Each instance size
Each Availability Zone (69)
In every region (22)
Is a separate Spot pool
R5 M4
C5
I3 M5d
R4 D2
A1
![Page 10: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/10.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Monitoring Spot usage – Savings Summary
![Page 11: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/11.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What about interruptions?
![Page 12: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/12.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
EC2 Spot with Amazon EKS
• Run a DaemonSet on every worker to catch the Spot interruption and coordon & drain the node
• Use labels to identify Spot nodes (for the DaemonSet, and other purposes – affinity & tolerations?)
![Page 13: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/13.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The picture can't be displayed.
The picture can't be displayed.
The picture can't be displayed.
The picture can't be displayed.
The picture can't be displayed.
The picture can't be displayed.
The picture can't be displayed.
The picture can't be displayed.
The picture can't be displayed.
The picture can't be displayed.
The picture can't be displayed.
The picture can't be displayed.
m4.large Spot Instances
m5.large Spot Instances
c4.xlarge On-Demand instances
Availability Zone 1
Availability Zone 2
Availability Zone3
The picture can't be displayed.The picture can't be displayed. The picture can't be displayed.
The picture can't be displayed.The picture can't be displayed.The picture can't be displayed.
The new ASG combines purchase options, instance types and AZs in a single ASG
Single ASG
Mul t ip le ins tance types & purchase op t ions in ASG
https://tinyurl.com/NewASGblog
![Page 14: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/14.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Ma in takeaways fo r success w i th Spot
• Be instance type agnostic and let ASG/Fleet provide the required capacity at the lowest price
• Adopt Launch Templates to benefit from new ASG and Fleet features
• New instance families generally have higher interruption rates
• Architect for fault-tolerance to be Spot compatible and increase your availability
![Page 15: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/15.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
EC2 Spot instance Workshops: https://ec2spotworkshops.com
+
![Page 16: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/16.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Choice of processors and architectures
Intel Xeon Scalable (Skylake) processor
Right compute for each application and workload
Choice of GPUs and FPGAs for compute acceleration
AWS Graviton processor 64-bit Arm
AMD EPYC processor
![Page 17: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/17.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
First instance powered by AWS Graviton Processor
Run scale-out and Arm-based applications in the cloud
Up to 45% cost savingsAWS Graviton Processor 64-bit Arm Neoverse cores and custom AWS silicon
Amazon EC2 A1
Lower costMaximize resource
efficiency with AWS Nitro System
Flexibility and choice foryour workloads
![Page 18: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/18.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Target applications for Amazon EC2 A1
Web tier Containerized microservices
Caching fleets IoT, Gaming, Arm workloads
![Page 19: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/19.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Arm software ecosystem for A1 instances
OSVs and ISVsAmazon Linux 2
Ubuntu 16.04, 18.04and newer
Red Hat Enterprise Linux 7.6 and 8.0
SUSE Linux Enterprise Serverfor Arm 15
Docker Desktop Community andDocker Enterprise Engine
(Beta)
Added since launch:Fedora Rawhide, Fedora Atomic, Debian 10,
and Ubuntu 18.10 (Bionic)More coming soon.
Containers
Most Docker official images support arm64
Amazon ECS
Available today!
Amazon EKS
Public Preview!
Tools
+ Amazon Corretto (OpenJDK)
![Page 20: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/20.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon EKS A1 Preview
![Page 21: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/21.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Blog shout out - Cost optimization for Kubernetes on AWS
This post was contributed by AWS Container Hero, Casey Lee, Director of Engineering
for Liatrio
https://aws.amazon.com/blogs/containers/cost-optimization-for-kubernetes-on-aws/
![Page 22: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/22.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo: Docker Desktop x86_64/arm64 build
![Page 23: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/23.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo goals
Show how seamless it is to build bi-arch containers and use them in a simple web application
What will we leverage ?- Docker buildx- AWS CloudFormation- AWS Elastic Load Balancer- Amazon EC2 A1 and T3 Instances
![Page 24: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/24.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo Architecture
![Page 25: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/25.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Show me the code !
![Page 26: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/26.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Wrap-up
What have we learnt ?- There’s an easy transition path from x86_64 to arm64- Bi-arch containers are easy to build with buildx- AWS EC2 A1 instances are yet another cost reduction
lever
![Page 27: Amazon EC2 :: Optimize EKS cost with Spot & A1 Instances. Arthur-Petitpierr… · © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon EC2 purchase options.](https://reader030.fdocuments.net/reader030/viewer/2022041013/5ec45d102e674518d252600d/html5/thumbnails/27.jpg)
© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank youArthur Petitpierre – [email protected]@ArthurPtP