Wed. Feb 21st, 2024

These two Companies OneUptime and Prerender are finding that migrating from Amazon Web Services (AWS) to bare metal servers hosted in colocation data centres can lead to substantial cost savings. They have cut costs by over 50% by taking control of their infrastructure while maintaining performance and reliability.

OneUptime was spending $456K+ annually on a 28-node AWS Kubernetes cluster.Prerender projected over $1M per year on AWS services and data transfer.📈 The Hidden Costs of Cloud

For many startups and tech companies, AWS seems like an easy choice. It allows you to spin up servers and scale rapidly without investing in your hardware upfront. But as these companies grow, the operating costs on AWS start to add up:

Monthly bills for instances, storage, data transfer, load balancing services, etc. can exceed $100,000+Data transfer costs in particular can be astronomical – $0.08+/GB in some regionsNo control over hardware – “noisy neighbour” problems can affect performanceVendor lock-in reduces infrastructure flexibility📟 Why Does Bare Metal Make Sense?

Bare metal servers refer to physical servers that are dedicated to a single tenant. In contrast, virtual machines (VMs) are virtualized compute instances that run on shared hardware.

➕ Benefits of Bare Metal ServersCost – Bare metal eliminates the hidden fees and unpredictable billing associated with the cloud. You pay for the resources you use, with no additional charges for things like egress traffic or API calls.Performance – Bare metal allows full access to resources for more consistent high workload performance like high I/O requirementsControl – Bare metal provides granular hardware control and customizationIsolation – Dedicated single-tenant resources, so no “noisy neighbour” problemsScalability – VMs allow fast automated scaling, bare metal has more limited flexibility


Bare Metal
Maximum performance and consistencyHigh IOPS for intensive workloadsHardware customization and controlBetter security and isolation
Higher upfront costsManual server managementLimited flexibility for scaling

Virtual Machines
Rapid deployment and scalingPay only for resources usedHardware abstraction and flexibility
“Noisy neighbour” performance issuesLimited performance and IOPSHardware abstraction overhead

Bare Metal vs Virtual Machines vs Containers: The Differences
When deploying a modern application stack, how do we decide which one to use? Bare Metal, VMs or Containers?
How Companies Are Saving Millions by Migrating Away from AWS to Bare Metal Servers?

🔜 Migration to Bare Metal Infrastructure

To slash costs, both companies planned and executed systematic migrations from AWS onto the bare metal servers in colocation facilities and both companies have direct access to hardware instead of virtualized instances.

🚴 OneUptime’s Phased Migration

Prerender chose to use JavaScript everywhere to build expertise in solving the issues caused by JavaScript rendering. They also took advantage of CloudFlare’s distributed system for fast response and global scalability, while their uptime guarantees were supported by Digital Ocean’s cloud platform.

Set up and tested MicroK8s Kubernetes on bare metal for a subset of trafficGradually shifted more workloads onto new servers over weeksCarefully monitored performance and made adjustmentsOnce stable, routed all traffic to the bare metal clusterReduced annual costs by 55%+ (saving over $230,000 per year)🪜Prerender’s Step-by-Step ProcessProvisioned bare metal servers and benchmarked performanceMoved caching and storage services (S3) from AWS servicesSystematically redirected traffic and shut down AWS resourcesContinually stress-tested environment for robustnessCut monthly infrastructure costs by 80% (saving $800K+ per year)

Substantial cost savings resulted from careful migrations, as OneUptime achieved an annual cost reduction exceeding 55% (saving over $230K), while Prerender significantly reduced infrastructure costs by 80% (saving over $800K annually).
Top 50+ AWS Services That You Should Know in 2023
Amazon Web Services (AWS) started back in 2006 with just a few basic services. Since then, it has grown into a massive cloud computing platform with over 200 services.
How Companies Are Saving Millions by Migrating Away from AWS to Bare Metal Servers?

👨🏻‍💻 Which Technologies Have Been Used for the Migration from AWS Cloud to Bare Metal Servers?

Technologies like Kubernetes, Docker, Docker and Helm enabled frictionless migrations off AWS by providing:

Kubernetes – automated container deployment & scalingDocker – portable, containerized applicationsHelm – simplified Kubernetes application packaging

Together, these enabled flexibility beyond the public cloud vendors.

Kubernetes for Noobs
Kubernetes is an open-source system that helps with deploying, scaling, and managing containerized applications.
How Companies Are Saving Millions by Migrating Away from AWS to Bare Metal Servers?

🛠️ So, What Are the Tradeoffs of Moving Away from the AWS or Public Cloud?

Managing your bare metal servers requires significant investments in skilled staff compared to leveraging AWS’s services. Transitioning to bare metal means you now need specialized DevOps engineers to handle it.

Server provisioning, setup, and managementNetwork architecture and storage configurationContainerization and orchestrationMigration execution and testingSecurity hardening and access controls

This likely requires adding several additional experienced engineers with skillsets like Kubernetes, Docker, database admin, storage/SAN management etc.

At average salaries of $120-160K per engineer, those human resource costs add up rapidly. Plus server hardware expenses. Plus the loss of integrated AWS services like S3, Cognito, and many others accelerated development.

So you need to hire more backend developers to replicate all that useful functionality you’re losing from the cloud provider. Adding 4-6 or more engineers can mean $500K+ in additional annual developer salaries.

In total, you might be spending an extra $2M+ per year in human resources to match what AWS provides out of the box. That’s in addition to physical server costs in the range of $200K+.

So while bare metal hosting fees are lower, the human labor tradeoff is real. The efficiency and integrated services of the public cloud should not be discounted when comparing the total cost of ownership. Relying on AWS or any public cloud means less specialized in-house staff is needed. The male labour costs can rapidly diminish potential bare metal shavings.

DevOps vs SRE vs Platform Engineering – Explained
At small companies, engineers often wear multiple hats, juggling a mix of responsibilities. Large companies have specialized teams with clearly defined roles in DevOps, SRE, and Platform Engineering.
How Companies Are Saving Millions by Migrating Away from AWS to Bare Metal Servers?

✴️ Takeaway — Re-evaluate Public Cloud Costs

For fast-scaling startups, public clouds can end up being far more expensive than bare metal hosting in the long term. The journeys of Prerender and OneUptime highlight how companies can realize major cost savings by moving off AWS onto their bare metal servers.

Their systematic and careful transitions to owned bare metal servers enabled over 50% expense reductions without performance sacrifices or major client impacts. This showcases that while AWS provides power and flexibility, it doesn’t always fit every business’ needs or long-term budgets. Their experiences prove that companies should continually reassess if public cloud services align with their changing business requirements over time.

In the last I want to ask you, Does managing your own infrastructure make sense from a technical and financial perspective? Why or why not?

Based on the Following Resources:

How moving from AWS to Bare-Metal saved us $230,000 /yrHow we reduced our annual server costs by 80% — from $1M to $200k — by moving away from AWSShocking Cloud Costs: How AWS Charged $800,000 for Egress Data Transfer in a Single Month

Leave a Reply

Your email address will not be published. Required fields are marked *