Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> Nobody seems to talk about this, I guess because it's taken for granted?

No, because it has a theoretical limit, same as queues, back pressure, etc.

One cannot simply scale up indefinitely because it is not profitable.



There's no product in the world that would hit a limit if autoscaled globally on AWS. Sure, you could write an app whose literal sole purpose is "take up all memory, CPU and bandwidth, recursively, infinitely", but nobody is making that product. Real products built today have a finite amount of demand, and global cloud capacity is larger than that.

You can't say what architecture is or isn't profitable in general, business is more complicated than that. But besides the realities of commerce, you can easily architect a system such that the autoscaling cost is a fraction of opex.


> Real products built today have a finite amount of demand, and global cloud capacity is larger than that.

This isn't really true, and it's especially not true when specialized hardware comes into play. If you have a "web-scale" GPU workload, it's not unlikely that you'll hit resource availability constraints from time to time. The question isn't whether cloud capacity is larger than your demand for a particular resource, it's whether cloud capacity is larger than the aggregate peak demand for that resource. Cloud providers aren't magic. They engage in capacity planning, sometimes underestimate, and are sometimes unable to actually procure as much hardware as they want to.


> There's no product in the world that would hit a limit if autoscaled globally on AWS.

While this may be true, autoscaling indefinitely is still not profitable.

> You can't say what architecture is or isn't profitable in general, business is more complicated than that. But besides the realities of commerce, you can easily architect a system such that the autoscaling cost is a fraction of opex.

Customer acquisition and retention cost more money than it should.

I cannot count how many times I got an email from the CTO asking to lower our cloud costs, while product and marketing refuse to raise prices, making the whole endeavor borderline unprofitable. You may then argue that the product suffers from either bad architecture, or bad pricing, or both, but the situation is far from uncommon.


> There's no product in the world that would hit a limit if autoscaled globally on AWS > but nobody is making that product

Nobody is making that product because nobody has money for it...(or the demand to supply that money).

You can auto-scale without AWS, actually, its called measuring server load and auto-ordering new machines when your load increases (and keeping machines turned off on standby for spikes).

Or you can go hybrid, and load-shed to a cloud...which would be the smart thing to do.


I have made and deployed pieces of that infinite recursive. Most spectacularly by having infinite call loops triggered. Had we had autoscaling rather than sharp queue limits leading to load shedding it would have been worse.


Not really true (I work for one that can, and does, hit limits in AWS, let alone GCP/Azure), but the general point is mostly true. You just might not actually get what you want fast enough, however.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: