memonic

Presentation

Save
I presented at the Cloud Suisse Conference 2010 in Zürich about how we at Memonic use the Amazon cloud.

The presentation is attached below.

Attachments (1)

cloud-suisse-presentation.pdf 938.42 KB

Programm Cloud Suisse Conference 2010 Zürich

Save
Cloud Suisse Conference 2010


Türöffnung

08:30 Registrierung

 

Keynotes im Auditorium

09:00 Begrüssung und Impulsreferat zu Cloud Computing (D), Daniel Ebneter & Holger Walche, FHNW

09:15 Die Zukunft liegt in der Cloud (D), Philipp Karmires, Google Enterprise

09:45 Kein Hype sondern Realität - Cloud Computing in Unternehmen (D), Mani Pirouz, Salesforce.com

10:15 Amazon's Cloud Computing Vision (E), Martin Buhr, Amazon Web Services

10:45 Kaffeepause

11:15 Microsoft Windows Azure Platform (D), Ronnie Sauermann, Microsoft

11:45 BPM in the Cloud (E), Richard Helliar, Cordys

12:15 Podiumsdiskussion, Q&A (E)

 

Mittagspause

12:45 Stehlunch / Mittagspause

 

Track 1 - Produktiver arbeiten in der Cloud - Auditorium

13:45 Der Büroarbeitsplatz der Zukunft (D), Philipp Karmires, Google

14:30 Cloud MashApps with Google Apps and Salesforce (E), Arsalan Minhas, Cordys

15:15 Kaffeepause

15:45 Wie Blogwerk AG in der Cloud arbeitet (Salesforce, Google Apps, Amazon und mehr) (D),
Philip Hetjens, Blogwerk AG

16:30 Prozessmodellierung und Prozessmanagement in der Cloud (D), Gero Decker, Signavio

 

Track 2 - Software as a Service entwickeln und anbieten - Raum Fortran

13:45 Relationale Datenbanken in der Cloud am Beispiel von Microsoft Azure (D), Meinrad Weiss, Trivadis

14:30 Rapid Application Development in der Cloud mit der Force.com Platform (D), Manuel Dietrich & Andreas Von Gunten, PARX

15:15 Kaffeepause

15:45 Vom Branchenbedürfnis zur Schweizer Cloud Anwendung (D), Paul Schär,
Contria GmbH / Hector Egger Holzbau AG

16:30 Die Vorteile der Cloud für Softwareanbieter (D), Jeremias Meier & Oliver Koffler, iBrows GmbH

 

Track 3 - Infrastructure as a Service - Raum Cobol

13:45 Transformative Effects of IaaS (E), Robert Jenkins, CloudSigma

14:20 High Performance Computing in der Cloud (D), Wibke Sudholt, CloudBroker GmbH

14:55 Where the Cloud Lives - The Carrier Neutral Data Center (E), Vincent in't Veld, Interxion

15:20 Kaffeepause

15:45 Als Startup die Cloud nutzen, Ein Praxisbeispiel für die Amazon Web Services (D), Patrice Nef, Memonic

16:30 P2P Storage in the Cloud (D), Fabius Klemm, Wuala

 

Abschluss & Networking

17:15 Apéro 

Amazon Simple Storage Service (Amazon S3)

Save

Amazon Simple Storage Service (Amazon S3)




Amazon S3 is storage for the Internet. It is designed to make web-scale computing easier for developers.

Amazon S3 provides a simple web services interface that can be used to store and retrieve any amount of data, at any time, from anywhere on the web. It gives any developer access to the same highly scalable, reliable, fast, inexpensive data storage infrastructure that Amazon uses to run its own global network of web sites. The service aims to maximize benefits of scale and to pass those benefits on to developers.





Pricing

Pay only for what you use. There is no minimum fee. Estimate your monthly bill using the AWS Simple Monthly Calculator.

We charge less where our costs are less, and prices are based on the location of your Amazon S3 bucket.


Data transfer “in” and “out” refers to transfer into and out of an Amazon S3 Region. There is no Data Transfer charge for data transferred within an Amazon S3 Region via a COPY request. Data transferred via a COPY request between Regions is charged at regular rates. There is no Data Transfer charge for data transferred between Amazon EC2 and Amazon S3 within the same Region or for data transferred between the Amazon EC2 Northern Virginia Region and the Amazon S3 US Standard Region. Data transferred between Amazon EC2 and Amazon S3 across all other Regions (i.e. between the Amazon EC2 Northern California and Amazon S3 US Standard Regions) will be charged at Internet Data Transfer rates on both sides of the transfer.

Storage and bandwidth size includes all file overhead.

(Amazon S3 is sold by Amazon Web Services LLC.)

Amazon CloudFront (beta)

Save

Amazon CloudFront (beta)




Amazon CloudFront is a web service for content delivery. It integrates with other Amazon Web Services to give developers and businesses an easy way to distribute content to end users with low latency, high data transfer speeds, and no commitments.

Amazon CloudFront delivers your static and streaming content using a global network of edge locations. Requests for your objects are automatically routed to the nearest edge location, so content is delivered with the best possible performance. Amazon CloudFront works seamlessly with Amazon Simple Storage Service (Amazon S3) which durably stores the original, definitive versions of your files. Like other Amazon Web Services, there are no contracts or monthly commitments for using Amazon CloudFront – you pay only for as much or as little content as you actually deliver through the service.





Pricing

Pay only for what you use. There is no minimum fee. Estimate your monthly bill using the AWS Simple Monthly Calculator.

United States Edge Locations

Data Transfer

$0.150 per GB – first 10 TB / month data transfer out
$0.100 per GB – next 40 TB / month data transfer out
$0.080 per GB – next 100 TB / month data transfer out
$0.070 per GB – next 100 TB / month data transfer out
$0.060 per GB – next 250 TB / month data transfer out
$0.050 per GB – next 250 TB / month data transfer out
$0.040 per GB – next 250 TB / month data transfer out
$0.030 per GB – data transfer out / month over 1,000 TB

Requests

$0.010 per 10,000 GET requests

European Edge Locations

Data Transfer

$0.150 per GB – first 10TB / month data transfer out
$0.100 per GB – next 40 TB / month data transfer out
$0.080 per GB – next 100 TB / month data transfer out
$0.070 per GB – next 100 TB / month data transfer out
$0.060 per GB – next 250 TB / month data transfer out
$0.050 per GB – next 250 TB / month data transfer out
$0.040 per GB – next 250 TB / month data transfer out
$0.030 per GB – data transfer out / month over 1,000 TB

Requests

$0.012 per 10,000 GET requests

Hong Kong Edge Locations

Data Transfer

$0.190 per GB – first 10 TB / month data transfer out
$0.140 per GB – next 40 TB / month data transfer out
$0.120 per GB – next 100 TB / month data transfer out
$0.110 per GB – next 100 TB / month data transfer out
$0.100 per GB – next 250 TB / month data transfer out
$0.090 per GB – next 250 TB / month data transfer out
$0.080 per GB – next 250 TB / month data transfer out
$0.070 per GB – data transfer out / month over 1,000 TB

Requests

$0.012 per 10,000 GET requests

Japan Edge Locations

Data Transfer

$0.201 per GB – first 10 TB / month data transfer out
$0.148 per GB – next 40 TB / month data transfer out
$0.127 per GB – next 100 TB / month data transfer out
$0.117 per GB – next 100 TB / month data transfer out
$0.106 per GB – next 250 TB / month data transfer out
$0.096 per GB – next 250 TB / month data transfer out
$0.085 per GB – next 250 TB / month data transfer out
$0.075 per GB – data transfer out / month over 1,000 TB

Requests

$0.013 per 10,000 GET requests

We charge less where our costs are less, thus some prices vary across geographic regions and are based on the edge location through which your content is served. Usage tiers for data transfer are measured separately for each geographic region. The prices above are exclusive of applicable taxes, fees, or similar governmental changes, if any exist, except as otherwise noted. Effective January 1, 2010, the prices for usage out of Japan edge locations are inclusive of Japan consumption tax.

Origin Server

Amazon CloudFront uses Amazon S3 as the origin server to store the original, definitive versions of your files. Normal fees will apply for Amazon S3 usage, including “origin fetches” – data transferred from Amazon S3 to edge locations.

Amazon Elastic Compute Cloud (Amazon EC2)

Save

Amazon Elastic Compute Cloud (Amazon EC2)




Amazon Elastic Compute Cloud (Amazon EC2) is a web service that provides resizable compute capacity in the cloud. It is designed to make web-scale computing easier for developers.

Amazon EC2’s simple web service interface allows you to obtain and configure capacity with minimal friction. It provides you with complete control of your computing resources and lets you run on Amazon’s proven computing environment. Amazon EC2 reduces the time required to obtain and boot new server instances to minutes, allowing you to quickly scale capacity, both up and down, as your computing requirements change. Amazon EC2 changes the economics of computing by allowing you to pay only for capacity that you actually use. Amazon EC2 provides developers the tools to build failure resilient applications and isolate themselves from common failure scenarios.





Pricing

Pay only for what you use. There is no minimum fee. Estimate your monthly bill using AWS Simple Monthly Calculator. The prices listed are based on the Region in which your instance is running. For a detailed comparison between On-Demand Instances, Reserved Instances and Spot Instances, see Amazon EC2 Instance Purchasing Options.

On-Demand Instances

On-Demand Instances let you pay for compute capacity by the hour with no long-term commitments. This frees you from the costs and complexities of planning, purchasing, and maintaining hardware and transforms what are commonly large fixed costs into much smaller variable costs.

The pricing below includes the cost to run private and public AMIs on the specified operating system (“Windows Usage” prices apply to both Windows Server® 2003 and 2008). Amazon also provides you with additional instances with other option for Amazon EC2 running Microsoft and Amazon EC2 running IBM that are priced differently.


Pricing is per instance-hour consumed for each instance type, from the time an instance is launched until it is terminated. Each partial instance-hour consumed will be billed as a full hour.

Reserved Instances

Reserved Instances give you the option to make a low, one-time payment for each instance you want to reserve and in turn receive a significant discount on the hourly usage charge for that instance. After the one-time payment for an instance, that instance is reserved for you, and you have no further obligation; you may choose to run that instance for the discounted usage rate for the duration of your term, or when you do not use the instance, you will not pay usage charges on it.


Reserved Instances can be purchased for 1 or 3 year terms, and the one-time fee per instance is non-refundable. Usage pricing is per instance-hour consumed. Instance-hours are billed for the time that instances are in a running state; if you do not run the instance in an hour, there is zero usage charge. Partial instance-hours consumed are billed as full hours.

If Microsoft chooses to increase the license fees that it charges for Windows, we may correspondingly increase the per-hour usage rate for previously purchased Reserved Instances with Windows. The initial one-time payment for a Reserved Instance will be unaffected in this situation. Any such changes would be made between Dec 1 – Jan 31, and with at least 30 days’ notice. If the per-hour usage rate does increase, you may continue to use your Reserved Instance with Windows with the new per-hour usage rate, convert your Reserved Instance with Windows to a Reserved Instance with Linux, or request a pro rata refund of the upfront fee you paid for the Reserved Instance with Windows.

Reserved Instances are currently available for Linux/UNIX and Windows operating systems. Click here to learn more about Reserved Instances.


Spot Instances

Spot Instances enable you to bid for unused Amazon EC2 capacity. Instances are charged the Spot Price, which is set by Amazon EC2 and fluctuates periodically depending on the supply of and demand for Spot Instance capacity. To use Spot Instances, you place a Spot Instance request, specifying the instance type, the Region desired, the number of Spot Instances you want to run, and the maximum price you are willing to pay per instance hour. To determine how that maximum price compares to past Spot Prices, the Spot Price history is available via the Amazon EC2 API and the AWS Management Console. If your maximum price bid exceeds the current Spot Price, your request is fulfilled and your instances will run until either you choose to terminate them or the Spot Price increases above your maximum price (whichever is sooner).

Click here to learn more about Spot Instances. For information on how to get started, click here.

The following table displays the Spot Price per Region and instance type (updated every 30 minutes).

If you would like to go straight to a view of the latest Spot Instance pricing:
  1. Log in to the AWS Management Console, then click the “Amazon EC2” tab.
  2. Click on “Spot Requests” in the navigation pane on the left.
  3. Click on “Pricing History” to open a view of pricing selectable by instance type.


Data Transfer

Internet Data Transfer

The pricing below is based on data transferred "in" and "out" of Amazon EC2.

Data Transfer In  
All Data Transfer Free through June 30, 2010*

Data Transfer Out  
First 10 TB per Month $0.15 per GB
Next 40 TB per Month $0.11 per GB
Next 100TB per Month $0.09 per GB
Over 150 TB per Month $0.08 per GB

There is no Data Transfer charge between Amazon EC2 and other Amazon Web Services within the same region (i.e. between Amazon EC2 US West and Amazon S3 in US West). Data transferred between Amazon EC2 instances located in different Availability Zones in the same Region will be charged Regional Data Transfer. Data transferred between AWS services in different regions will be charged as Internet Data Transfer on both sides of the transfer.

Usage for other Amazon Web Services is billed separately from Amazon EC2.

* Data Transfer In will be $0.10 per GB after June 30, 2010.

Availability Zone Data Transfer

  • $0.00 per GB – all data transferred between instances in the same Availability Zone using private IP addresses.

Regional Data Transfer

  • $0.01 per GB in/out – all data transferred between instances in different Availability Zones in the same region.

Public and Elastic IP and Elastic Load Balancing Data Transfer

  • $0.01 per GB in/out – If you choose to communicate using your Public or Elastic IP address or Elastic Load Balancer inside of the Amazon EC2 network, you’ll pay Regional Data Transfer rates even if the instances are in the same Availability Zone. For data transfer within the same Availability Zone, you can easily avoid this charge (and get better network performance) by using your private IP whenever possible.

See Availability Zones for tools to describe instance location.

Amazon Elastic Block Store


Elastic IP Addresses

No cost for Elastic IP addresses while in use

  • $0.01 per non-attached Elastic IP address per complete hour
  • $0.00 per Elastic IP address remap – first 100 remaps / month
  • $0.10 per Elastic IP address remap – additional remap / month over 100

Amazon CloudWatch


Auto Scaling

Auto Scaling is enabled by Amazon CloudWatch and carries no additional fees. Each instance launched by Auto Scaling is automatically enabled for monitoring and the Amazon CloudWatch monitoring charge will be applied.

Elastic Load Balancing


(Amazon EC2 is sold by Amazon Web Services LLC.)

Elastic Load Balancing

Save

Elastic Load Balancing




Elastic Load Balancing automatically distributes incoming application traffic across multiple Amazon EC2 instances. It enables you to achieve even greater fault tolerance in your applications, seamlessly providing the amount of load balancing capacity needed in response to incoming application traffic. Elastic Load Balancing detects unhealthy instances within a pool and automatically reroutes traffic to healthy instances until the unhealthy instances have been restored. Customers can enable Elastic Load Balancing within a single Availability Zone or across multiple zones for even more consistent application performance.

Amazon Elastic MapReduce

Save

Amazon Elastic MapReduce




Amazon Elastic MapReduce is a web service that enables businesses, researchers, data analysts, and developers to easily and cost-effectively process vast amounts of data. It utilizes a hosted Hadoop framework running on the web-scale infrastructure of Amazon Elastic Compute Cloud (Amazon EC2) and Amazon Simple Storage Service (Amazon S3).

Using Amazon Elastic MapReduce, you can instantly provision as much or as little capacity as you like to perform data-intensive tasks for applications such as web indexing, data mining, log file analysis, machine learning, financial analysis, scientific simulation, and bioinformatics research. Amazon Elastic MapReduce lets you focus on crunching or analyzing your data without having to worry about time-consuming set-up, management or tuning of Hadoop clusters or the compute capacity upon which they sit.





Pricing

Amazon Elastic MapReduce currently is available in the US and EU Regions. Pay only for what you use – there is no minimum fee. Amazon Elastic MapReduce pricing is in addition to normal Amazon EC2 and Amazon S3 pricing.


Amazon EC2, Amazon S3 and Amazon SimpleDB charges are billed separately. Pricing for Amazon Elastic MapReduce is per instance-hour consumed for each instance type, from the time job flow began processing until it is terminated. Each partial instance-hour consumed will be billed as a full hour. For additional details on Amazon EC2 Instance Types, Amazon EC2 Reserved Instances Pricing, Amazon S3 Pricing, or Amazon SimpleDB Pricing, follow the links below:

Amazon EC2 Instance Types

Amazon EC2 Reserved Instances Pricing

Amazon S3 Pricing

Amazon SimpleDB Pricing

Amazon SimpleDB TM (beta)

Save

Amazon SimpleDB TM (beta)




Amazon SimpleDB is a highly available, scalable, and flexible non-relational data store that offloads the work of database administration. Developers simply store and query data items via web services requests, and Amazon SimpleDB does the rest.

Unbound by the strict requirements of a relational database, Amazon SimpleDB is optimized to provide high availability, ease of scalability, and flexibility with little or no administrative burden. Behind the scenes, Amazon SimpleDB creates and manages multiple geographically distributed replicas of your data automatically to enable high availability and data durability. The service responds to changes in traffic by charging you only for the compute and storage resources actually consumed in serving your requests. You can change your data model on the fly, and data is automatically indexed for you. With Amazon SimpleDB, you can focus on application development without worrying about infrastructure provisioning, high availability, software maintenance, schema and index management, or performance tuning.

Featured Use Cases
Learn about data sets and use cases well-suited to take advantage of Amazon SimpleDB’s scalability, availability, flexibility, and zero-administration service model. Featured applications include:





Pricing

Free Tier*
You can get started with SimpleDB for free. Amazon SimpleDB users pay no charges on the first 25 Machine Hours, 1 GB of Storage, and 1 GB of Data Transfer Out consumed every month. Under the new free inbound data transfer promotion, all data transfer into Amazon SimpleDB is free of charge until June 30, 2010. In most use cases, the free tier enables approximately 2,000,000 GET or SELECT API requests to be completed per month before incurring any usage charges. Many applications should be able to operate perpetually within this free tier, such as a daily website analysis and traffic reporting tool, a web indexing service, or an analytics utility for online marketing programs.

As your demand grows, you still pay only for what you use. As with other AWS services, there is no minimum fee and no long-term commitment. Also, note that we charge less where our costs are less, thus some prices vary across Geographic Regions. The prices listed are based on the Region in which you establish your Amazon SimpleDB domain(s). Amazon SimpleDB may be used from most countries, so long as payment is made in US Dollars.

Machine Utilization


Amazon SimpleDB measures the machine utilization of each request and charges based on the amount of machine capacity used to complete the particular request (SELECT, GET, PUT, etc.), normalized to the hourly capacity of a circa 2007 1.7 GHz Xeon processor. See below for a more detailed description of how machine utilization charges are calculated.See below for a more detailed description of how machine utilization charges are calculated.

Data Transfer

  • Data Transfer In is free until June 30, 2010*

  • First 1 GB of data transferred out per month is free; thereafter:
  • $0.15 per GB – first 10 TB / month data transfer out
  • $0.11 per GB – next 40 TB / month data transfer out
  • $0.09 per GB – next 100 TB / month data transfer out
  • $0.08 per GB – data transfer out / month over 150 TB
* Data Transfer In will be $.10 per GB after June 30, 2010

Data transfer “in” and “out” refers to transfer into and out of Amazon SimpleDB. There is no additional charge for data transferred between Amazon SimpleDB and other Amazon Web Services within the same Region (i.e., $0.00 per GB). Data transferred across Regions (e.g., between Amazon SimpleDB in the EU (Ireland) Region and Amazon EC2 in the US-East (Northern Virginia) Region, will be charged at Internet Data Transfer rates on both sides of the transfer.

Structured Data Storage


Amazon SimpleDB measures the size of your billable data by adding the raw byte size of the data you upload + 45 bytes of overhead for each item, attribute name and attribute-value pair.

Amazon SimpleDB is designed to store relatively small amounts of data and is optimized for fast data access and flexibility in how that data is expressed. In order to minimize your costs across AWS services, large objects or files should be stored in Amazon S3, while the pointers and the meta-data associated with those files can be stored in Amazon SimpleDB. This will allow you to quickly search for and access your files, while minimizing overall storage costs. See below for a detailed explanation of how storage in Amazon SimpleDB and storage in Amazon S3 differ and a more detailed description on calculating your Storage Costs.

* The free tier is a monthly offer. Free usage does not accumulate.

** Any data stored as part of the free tier program must be actively used. If a domain is not accessed for a period of 6 months, it will be subject to removal at the discretion of Amazon Web Services.

(Amazon SimpleDB is licensed by Amazon Web Services LLC.)

Amazon Simple Queue Service (Amazon SQS)

Save

Amazon Simple Queue Service (Amazon SQS)




Amazon Simple Queue Service (Amazon SQS) offers a reliable, highly scalable, hosted queue for storing messages as they travel between computers. By using Amazon SQS, developers can simply move data between distributed components of their applications that perform different tasks, without losing messages or requiring each component to be always available. Amazon SQS makes it easy to build an automated workflow, working in close conjunction with the Amazon Elastic Compute Cloud (Amazon EC2) and the other AWS infrastructure web services.

Amazon SQS works by exposing Amazon’s web-scale messaging infrastructure as a web service. Any computer on the Internet can add or read messages without any installed software or special firewall configurations. Components of applications using Amazon SQS can run independently, and do not need to be on the same network, developed with the same technologies, or running at the same time.





Pricing

Pay only for what you use. There is no minimum fee. Estimate your monthly bill using AWS Simple Monthly Calculator.

Requests

  • $0.01 per 10,000 Amazon SQS Requests ($0.000001 per Request)

Amazon SQS requests are CreateQueue, ListQueues, DeleteQueue, SendMessage, ReceiveMessage, ChangeMessageVisibility, DeleteMessage, SetQueueAttributes, GetQueueAttributes, AddPermision, and RemovePermission

Data Transfer

The pricing below is based on data transferred “in” and “out” of Amazon SQS.

Data Transfer In  
All Data Transfer Free until June 30, 2010*

Data Transfer Out  
First 10 TB per Month $0.15 per GB
Next 40 TB per Month $0.11 per GB
Next 100 TB per Month $0.09 per GB
Over 150 TB per Month $0.08 per GB

* Data Transfer In will be $0.10 per GB after June 30, 2010.

Data transfer “in” and “out” refers to transfer into and out of Amazon SQS. Data transferred between Amazon SQS and Amazon EC2 within a single region is free of charge (i.e., $0.00 per GB). Data transferred between Amazon SQS and Amazon EC2 in different regions will be charged at Internet Data Transfer rates on both sides of the transfer.

(Amazon SQS is sold by Amazon Web Services LLC.)

pneff's binarypool at master - GitHub

Save
Binary Pool is a REST web service that handles generation of thumbnails
(renditions) for images. Clients can upload images, Binary Pool generates all
renditions based on configuration on the server and then stores the original
file along with the renditions.

Each binary gets accompanied with an asset file which allows consumers to
retrieve information about binaries and easily use the renditions on frontend
sites.

Binaries can be storied either in the local file system or on Amazon S3.