Amazon s3ec2

Amazon S3/EC2

Thomas Fankhänel, Dominik Hurtienne, Georg Wicherski

Web Technologies – Prof. Dr. Ulrik Schroeder – WS 2010/111The slides are licensed under a

Creative Commons Attribution 3.0 License

Overview AWS (amazon web services) offers over

20 different web services The Amazon Cloud is one of the

largest clouds on the web Founded in 2002 Amazon S3 (Amazon Simple Storage Service) is a scalable and

fast way for data storage Amazon EC2 (Amazon Elastic Computing Cloud) provides

computing capacity Trivia: Wikileaks used AWS to manage traffic spikes during

the recent disclosures of secret data

Web Technologies2

Amazon S3: Basics

Amazon account and a credit card is sufficient to use S3

Write, read, delete objects from 1 byte up to 5 terabytes

Objects can be stored in different regions (US Standard, US West, EU, Asia Pacific)

Uses standards-based REST and SOAP interfaces

Web Technologies3

Amazon S3: Features & Use Cases Multipart Upload

Common use cases: Storage and distribution data analysis periodic backups

Grant, restrict access to certain parties

Various download protocols (HTTP, BitTorrent, ...)

Web Technologies4

Amazon S3: Basic Operations Manually uploading a file by using the AWS Management

Console

Web Technologies5

Amazon S3: REST

Example Authentication Amazon S3 REST Request

The Authorization Header consists of:

The AWSAccessKeyID is a 20-character, alphanumeric string that uniquely identifies an AWS accout

Web Technologies6

Amazon S3: Signature

Pseudo grammar for the construction of the Authorization Header

The SecretAccessKeyID is a 40-character string that should be known only by you and AWS

Web Technologies7

Amazon S3: REST Example Object GET

Example Object PUT

Web Technologies8

Amazon S3: REST Example Fetch Access Control

Example Delete

Using the alternate x-amz-date methode to specify the date

Web Technologies9

Amazon S3: REST Example Upload

Using the x-amz methodes to add meta-data x-amz‘s are automatically sorted

Web Technologies10

Amazon S3: Pricing

Web Technologies11

Amazon S3: Summary Easy, reliable way to store data

Can handle traffic spikes

Highly scalable

Fast growing cloud

Web Technologies12

Amazon EC2 (Elastic Compute Cloud)

Web Technologies13

Amazon EC2: Why?You’re doing business and you:Expect high traffic on your websiteHave some computational tasks to do (simulation, math problems, image rendering, video transcoding...)Need to perform network load tests, application clustering

But:You do not want to build up your own infrastructure (data centre, broadband internet...)You need these services for a short period of time onlyYou need it right now!?

Web Technologies14

Amazon EC2: Overview

Every EC2 instance is a (virtual) server: Running your choice of operating systems (Windows Server

2003/2008, Solaris, Linux) Full super-user access: install and run every software

As many instances as you need

Works in conjunction with S3

Appliances: community provided image templates or Amazon Machine Images (AMI)

Web Technologies15

Amazon EC2: Additional features

VPC (Virtual Private Cloud) via VPN CloudWatch web service to monitor EC2 Elastic Block Store: persistent system storage High Performance Computing (HPC) Clusters External load balancer VM Import

Web Technologies16

Amazon EC2: Limitations

No installation support No help on specific applications No automated backup

Prohibited: Spam, DOS, illegal file sharing…!

Web Technologies17

Amazon EC2: Instance types and pricing

Web Technologies18

http://aws.amazon.com/ec2/pricing/

Amazon EC2: Basic Operations Demo of Management Console Use EC2 instance to find a password hash (by bruteforce)

Web Technologies19

Amazon EC2: Summary Advantages

High virtual server performance No hardware or connectivity issues SLA: 99.95% (10% refund) Just in time appliance deployment Number of cpus and memory size adjustable to appl. Needs

Disadvantages Paravirtualization (XEN):

Very fast but guest-system with compatible kernel is required

Security issues, sensible data?

Web Technologies20

Literature - Introduction Books Paper Tutorials Links Examples Software

1 Introduction21