The up.time IT Systems Management Blog

Posts Tagged ‘cloud cost monitoring’

The Cost of Cloud – Part 3: Testing in the Cloud

Wednesday, June 1st, 2011

Cloud Capacity and Cloud TestinAs the conclusion to my 3 part Cost of Cloud Follow-up (click here to read part 1, click here for part 2), I wanted to focus on development and testing in the cloud and what questions you need to answer before beginning any tests.

 

Example #3 – Development and Testing in the Cloud: Although spinning up new test and development environments in the cloud improves agility, the essential questions to ask are:

 

  • Internal or Cloud: Is it more cost-effective to host the application or service internally or in the cloud? Can IT prove its decision?
  • Which Cloud is Best: Which cloud vendor should be chosen?
  • How Much will it Cost: How much will this service/workload cost month over month?
  • Failsafe Cloud Alerting and Reports: Additionally, the added problem of developers forgetting to de-commission cloud infrastructure and services drives major cost overruns. Proper notification of these ‘cloud zombies’ is essential to prevent large bills over time.  While services like Amazon’s AWS are an incredible boon to being able to create development and test environments in a few clicks, there are latent costs which aren’t always readily apparent – stopped instances still consume storage resources (and cost), snapshots linger even when volumes are deleted (and add more cost), just to name a few. IT needs better visibility.

As stated earlier (part 1), there are no tools that can help IT (or LOBs) model the cost of their cloud needs, predict their workload costs or notify when costs are escalating. However, there are tools coming in the future.

The most fundamental aspect of optimizing performance monitoring in the cloud is to understand the relationship between application/infrastructure performance and cost. Presently, the industry is just beginning to understand how to monitor the performance of applications in the cloud, yet it lacks a cloud costing dashboard necessary for IT managers to make smart budget related decisions. How can organizations understand the cost of cloud computing without a deeper level of visibility? It has become crucial for IT to tie cloud success to cost analysis, as well as overall system performance.

Conclusion: So to Cloud or Not to Cloud? How will you tie your cloud decisions to cost for justification to senior management? Or will you just deploy and cross your fingers?

Alex

The Cost of Cloud – Part 2: Applications in the Cloud

Wednesday, May 25th, 2011

As part 2 of my Cost of Cloud Follow-up (click here to read part 1), I wanted to focus on applications in the cloud and what you need to see, report on and predict future cloud costs.

 

Example #2 – Applications in the Cloud:

  • See Cloud Cost: IT needs to see a clear monthly workload cost of their entire Amazon AWS deployment (by server, application or service) before they get the bill. For those companies that have deployed in AWS, the anxiousness and pain associated with the monthly AWS bill can be quite frustrating.
  • Predict Cloud Cost: Reports are needed that can estimate or predict the cost of running an application or service in AWS before it’s deployed. Predicting cloud cost based on individual workloads, applications or services is essential.
  • Identify Cloud Ready Applications: Reporting that can show which workloads are prime candidates for cloud deployment would be extremely helpful to IT departments wrestling with how to use cloud most effectively.

If you have any questions about how you accomplish any of the above, let me know by posting a comment.

Alex.

The Cost of Cloud – Part 1: Cloud Cost Analysis

Wednesday, May 18th, 2011

Clost of Cloud, Cloud CostAs a follow-up to my cost of cloud computing post that had a large response, I decided to do a follow-up cloud cost analysis. This is part 1 of a 3 part series that will be posted over the next few weeks.

The ultimate goal of deploying application or dynamic infrastructure to the cloud is the truly agile and cost-competitive nature of running and managing applications and infrastructure. However, cost can increase exponentially without proper cloud monitoring and cloud cost modeling. It has become crucial for IT to tie cloud success to cost analysis, in addition to overall system performance. This article will provide some common pitfalls and pains around current gaps in cloud costing and deployment, as well as a key set of questions to help IT make smart cloud decisions.

Up to now, the success of applications in cloud, virtual and physical environments have been viewed in only two dimensions – availability and performance. However, perhaps the most important dimension is cost, and it’s cost that will dramatically influence what, when and where IT organizations deploy to the cloud. Presently a major gap is in tooling, where no cloud monitoring tools can help IT and LOBs monitor their cloud costs, predict workload/application cost, notify when costs are escalating, as well as provide standard cloud performance and availability monitoring. However, we do see this tooling issue changing in the near future.

To date, companies have been oblivious to the workload cost of an application running in the cloud, apart from unclear monthly billing. We are entering a new era where performance and availability will be baseline requirements, but workload cost efficiency will be the new key to success. This will be the age of ‘economic compute’ and will be defined by how and where companies can run workloads at the best cost (assuming performance and availability remain constant). It won’t matter if it’s internally run on physical or virtual servers, or in the cloud, as the economics will drive this decision. However, the lynch pin to this costing decision model is missing…

To responsibly manage IT budgets, companies need visibility to the cost and performance data of workloads, applications and dynamic infrastructure services. However, the industry is missing a complete toolset or product suite that can help IT easily see and predict the cost of cloud deployment. Applications and services can be deployed on cloud infrastructure (assuming it returns acceptable performance and availability), but it’s essential for IT to have clear visibility to what the workloads will cost comparatively, across different cloud vendors or even the cost of an internally run workload. How can IT make a cost-conscious decision without the basic cost data of an application, workload or service? Quite simply, it can’t. This is part one of a three part series where the idea of the economic cloud comes into play:

Example #1 – Dynamic Infrastructure Services:

  • Ensure IT Doesn’t Overpay: A company may have provisioned a $500 per month system, but if its CPU is only consumed 10 percent of the time, then one is largely over paying. Now scale that scenario out to a company that is running many services, applications and servers in the cloud.
  • Companies with Many Separate Cloud Accounts: For IT managers trying to understand the cumulative costs of many developers or departments (LOBs) with cloud accounts, it can be almost impossible, with no clear means of reconciling usage (until it’s too late).
  • Manage Cost Across Geographically Dynamic Workloads: For more advanced scenarios, there are now a number of services that allow the creation of cloud instances in specific geographic regions, which enables a new generation of smartphone or mobile applications to exist.  There are millions of smartphone users in the world in non-North American geographies, such as Latin America – imagine if you could dynamically and geographically provision cloud resources that are compute heavy, or can service the requests of these remote smartphone clients, in a cost effective manner.  This reduces bandwidth requirements, increases the response time and can be done on cheaper, temporarily available compute resources. This kind of dynamism is incredibly powerful, yet monitoring the changing costs and performance of these cloud resources is going to be a difficult problem to solve.

Stay tuned over the next few weeks for more examples of where the economic cloud comes into play and please, let me know your feedback/questions by posting a comment.

Until next week…

Alex

Cost of cloud computing, expensive!

Wednesday, January 28th, 2009

With a large number of initiatives around cloud computing, I was interested in determining if the current cost of moving something like a lab environment into an outsourced environment would be cost effective.  Now, I realize that current ‘cloud’ offerings are really geared to dealing with temporary spikes in compute load rather than moving an entire infrastructure out of a corporate data center, however, mirroring a lab environment is perhaps a plausible use of the cloud.

This demonstration was simply to determine the monthly cost of hosting a lab environment in Amazon’s EC2 and then comparing it to the fully loaded cost of having a lab environment in house. 

The service that I ran the experiment on was Amazon’s EC2 and their storage service (S3) for persistent data management.  EC2 allows you to provision various types of x86 servers of differing compute capabilities and you are billed by instance hour of time.  There is no restriction on how compute intensive your instance is.  Their cost matrix for Linux instances and S3 storage can be viewed here and the Windows pricing is here.  The Windows pricing also includes options for SQL Server (and authentication services).
The experiments I ran were for five systems of various configurations running our application (up.time).  This included Linux running MySQL, Linux running Oracle, Windows running SQL Server and other combinations.  The databases were stored on Amazon’s EBS (Elastic Block Store) storage for persistence reasons.  The applications were run for two weeks under simulated load for monitoring 1,000 systems to get an idea of network and storage bandwidth.
After two weeks, the compute costs, I/O costs, and persistent storage costs were tallied and then scaled to mirror the monthly cost of a sample lab environment.
Amazon EC2 Costs for 300 lab instances.  There are 744 hours in a typical month (24*31).
Instance Type Num Cost/Instance Hour Compute Cost/Month
Windows 100 $0.125 $9,300
Windows + SQL Server 50 $1.100 $40,920
Linux 150 $0.100 $11,160
Windows (SQL/xlarge) 2 $2.400 $3,571.20
Total Cost Per Month $64,951.20
Storage Storage Cost/Month
5.6T (usable) $0.10 Gb/month $573.44
I/O 30B $0.10 per 1MM I/Os $300.00
Network Network Cost/Month
I/O 20 Gb $0.10 Gb/month $2.00
Total EC2 Cost/Month $64,826.64
Total EC2 Cost/Year $789,919.68

Now, if I calculate actual lab costs that mirror this environment here’s what we get (I’ve deliberately excluded our non-x86 platforms such as POWER and SPARC).  I’ve included the retail costs for Microsoft SQL Server and Oracle even though as an ISV we wouldn’t nearly pay as much.  The EC2 cost for Windows systems is considerably higher than Linux, and this is because of the software licensing costs blended into the instance hour calculation.

In the cases of leasing hardware, the number is more or less a constant cost as new gear is purchased and older gear is bought out. For software costs, they’ve been amortized over three years.

Gear Number Cost Per Month
Dell 1950 28
Dell 2950 2
HP DL585 2
10TB iSCSI 1 $10,000
Dell/HP/Equallogic Support $300
HVAC/Power $1,000
Floor Space 500 sq/ft $24 sq/ft/year $1,000
VMware ESX 9 $1,250
Annual Support (VMware) $1,250
Internet $1,200
Network Infrastructure $556
Total Infrastructure Cost/Month $16,556
Software Cost
SQL Server 2008 $2,083
Oracle 10g/11g $2,083
Labour Cost/Month $4,166
Total In-House Cost/Month $24,888.89
Total In-House Annual Cost $298,666.67
I’m torn about including labour, as instance management overhead is the same in both scenarios, however, the actual network and compute infrastructure when in-house, does require some amount of headcount.  In this case, I’ve added 0.5 of a resource (fully loaded cost).
So, the difference between an EC2 lab environment and an in-house environment is ($789,919.68 – $298,666.67) = $491,253.01.  This is quite a substantial difference for an always-on environment.
I am curious as to how many enterprises have truly dynamic workloads that could take advantage of a cloud (either internal or external) to truly derive the cost benefits of cloud computing.
Certainly, at first blush, a straight migration of servers is a costly proposition.
Alex