Control Your Amazon AWS Cloud Data Transfer Costs
The traffic of a typical web application directly linked to the amount of concurrent users that use the system. The variations in daily traffic volumes generated by a typical web application match our daily life schedule. Data Traffic transfer, running the application on Amazon cloud, can mean substantial costs. These cloud costs can even amount to more than half the overall charges for all instances utilized for the same amount of time.
The cost of traffic on Amazon AWS stems from two main factors:
1 – Outbound data transfer, between regions as well as out of the Amazon cloud.
2 – ELB data transfer fees across availability zones (AZ).
The Cloud changes add great complexity to how you track and maintain your data traffic. Controlling performance and cost in the Amazon cloud can be a great challenge for cloud newcomers. Even experienced early adopters sometimes struggle to manage their cloud right and find clear visibility into their ongoing real time traffic costs. This continues to be a challenge for cloud adopters, so I’d like to share a few brief points that can help improve and control.
1 – Data Transfer Costs
Make sure you understand the different costs for data traffic usage:
1 – Incoming traffic is free all the time
2 – Traffic between instances in the same availability zone is free.
3 – Outgoing data is always charged, even between instances inside AWS if they are on different AZs or regions.
4 – If you are using ELB as your FE, you will have incoming data fees because traffic between ELB and your instances will always be charged as traffic between amazon cloud availability zones (AZs).
2 – Plan and Architect
Add the data traffic parameters to your architecture – Try to minimize the amount of data traffic between different AZs; if you have a flow of instances that communicate with each other a lot, try to keep them in the same AZ (while considering HA as well….).
Use Private IPs - Always use EC2 private IP addresses when communicating between different instances. I have seen many setups where public IP addresses are used, which eventually are charged as outgoing traffic instead of inner-AZ traffic.
3 – Monitoring and Governance
Depends on your application, you can’t always control data usage but you should have full visibility and the ability to analyze environment behavior.
1 – I recommend monitoring your data transfer levels using the AWS account activity (you see the monthly data usage there) to make sure your usage meets your expectations. If not, you should investigate your instances and understand who/what’s using your data.
2 – Use CloudWatch NetworkIn and NetworkOut metrics to determine whether there are instances that are serving more data than needed. The relevant metrics for Amazon AWS CloudWatch are DataIn and DataOut. These only show a specific point in time, so you will need to calculate totals in order to really understand traffic flow per hour.
Pricing for “In” an “Out” data transfer of S3 Storage and Amazon EC2:
Image Resource: http://aws.amazon.com/ec2/pricing/
For even more visibility, and so that you can better forecast your traffic costs, you need to analyze the growth of your data and its transfer rates. Knowing your application and becoming familiarity with how much traffic it can be expected to consume will help give you a better feel for your Cloud computing needs.
Newvem actively prioritizes significant risk to cloud health based on its severity, including security and availability. Get started with Newvem’s AWS cloud care:
About the Author
Galed is an IT and operations professional with over 10 years of experience in technology management and IT operations. Galed has held many IT management positions, working on both traditional dedicated hosting and Cloud environments. Today, Galed is Head of Operations at Onavo, a Sequoia-funded startup, which runs entirely on cloud technologies and on AWS platform.
Keywords: amazon cloud services, cloud monitoring, amazon elb, amazon elastic load balancer, cloud cost, EC2, S3, data transfer, out-going traffic costs, amazon cloud usage, best practices,