Skip to content
GPUs
Aurora MarketingApr 23, 2026 9:30:37 AM3 min read

The Hidden Cost of Hyperscaler Storage (When You Start Running AI)

The Hidden Cost of Hyperscaler Storage (When You Start Running AI)
4:33

The bill arrives when you start using your data.

AWS S3 costs $0.023 per GB per month. That number looks fine in a spreadsheet. At one petabyte — which is not a large dataset for an organization running production AI — that is $23,500 per month. Still manageable. The problem is not the storage line item. The problem is everything that happens when you try to use that data.

Hyperscaler storage is cheap to write to. It is expensive to operate AI against. The pricing model is designed that way.

What you are actually paying for

Here is the cost structure nobody shows you on the getting-started page.

  • Egress out of S3 to the internet: $0.09 per GB. Run a 10 TB training dataset through a pipeline once, that is $900 in egress alone.
  • Transfer between AWS services within the same region: $0.01 to $0.02 per GB. Moving data from S3 to EC2 GPU instances costs money even when everything is in the same availability zone.
  • Cross-region transfer: $0.02 per GB. If your storage and compute are not in the same region — and they often are not — every training run crosses a billing boundary.
  • Archive retrieval: S3 Glacier charges $0.01 to $0.03 per GB to retrieve. Cold data that needs to warm up for a training run generates a retrieval bill before a single GPU instruction runs.
  • API calls above the free tier: S3 charges per PUT, COPY, POST, and LIST request above a threshold. High-frequency AI pipelines that read and write metadata constantly can generate meaningful API costs.

None of these are hidden fees in the sense of being undisclosed. They are disclosed in detail, in pricing tables that require careful reading to understand. The problem is that most organizations do not model them until the bill arrives.

Hyperscaler storage is cheap to write to. It is expensive to operate AI against. The pricing model is designed that way.


The GPU cost compounds everything

The storage costs are painful. The GPU costs are where the economics break down completely.

AWS p4d.24xlarge instances — 8x A100 GPUs — run at approximately $32 per hour on-demand. Reserved instances reduce that, but reserved GPU capacity requires 1 or 3 year commitments that most organizations are not ready to make when they are still figuring out their AI workload patterns.

H100 GPU instances on private infrastructure run at $2.50 to $3.00 per hour. That is 2 to 7 times cheaper than equivalent hyperscaler GPU capacity — before accounting for the egress costs you are no longer paying to move data between storage and compute.

At 1,000 GPU-hours per month — a modest inference or fine-tuning workload — the difference between $32/hr and $2.75/hr is $29,250 per month. Every month. That is before egress. That is before API fees. That is before the archive retrieval bills.

The lock-in makes it worse

The costs alone are enough to warrant a serious look at alternatives. The lock-in makes the decision more urgent.

Once your data lives in S3 and your AI workloads run on EC2, every infrastructure decision that follows is constrained. Moving data out of AWS costs money — at $0.09 per GB, moving a petabyte costs $90,000 in egress alone. That is not a switching cost in the traditional sense. It is a structural trap.

Private S3-compatible infrastructure removes that trap. Full API compatibility means nothing in your pipeline changes. No egress fees means your data moves freely to compute. No lock-in means your architecture decisions are yours to make.

What the alternative looks like

Aurora's storage pricing is $5.99 per TiB per month. No egress fees. No API surcharges. No retrieval penalties. Data moves freely between storage and compute on the same private network — no billing event, no cross-region transfer, no architectural constraint.

At one petabyte, that is $5,990 per month — versus *$23,500 for AWS S3 standard, before a single byte moves anywhere. The egress savings on a regular AI pipeline typically exceed the storage savings by a significant margin.

Start with a 1 TB free trial. Full S3 compatibility. No credit card required. The bill that does not arrive is often more persuasive than any pricing table.


*Pricing figures: AWS S3 pricing sourced from AWS public rate cards, April 2026. Aurora pricing current as published. GPU pricing indicative — confirm current rates. Figures are illustrative; actual costs depend on workload patterns and configuration.

RELATED ARTICLES