I remember the HW shortage during 2020-2021, fun time.
bitwize 47 minutes ago [-]
This is going to last longer.
The economics of owning your own powerful hardware make sense less and less with each passing year. Compute that's rented from the cloud gets far more utilization per dollar spent, and that's just on the hardware costs, let alone the cost of electricity to run it. What we're seeing now is the market adjusting to this new reality, as foundries reallocate capacity from consumer-oriented hardware to gear aimed at superscalers.
y42 35 minutes ago [-]
I don't know.... With all those approaches to run AI in your own premise, people need their own hardware. It makes them independent. Of course hyperscalers and AI labs don't like that, but I argue that consumers prefer independence over some costs of operations. If this would be the case, people wouldn't own cars.
The economics of owning your own powerful hardware make sense less and less with each passing year. Compute that's rented from the cloud gets far more utilization per dollar spent, and that's just on the hardware costs, let alone the cost of electricity to run it. What we're seeing now is the market adjusting to this new reality, as foundries reallocate capacity from consumer-oriented hardware to gear aimed at superscalers.