This at the moment is a clear Ponzi scheme.
OpenAI or Nvidia announces some partnership or a deal for X amount of billions. As a result the valuation of the recipient company goes straight to the sky, increasing the market valuation of said company X-times more.
And then try to tell me this isn’t a bubble.
The future is very small models trained to work in a certain domain and able to run on devices.
Huge foundational models are nice and everything, but they are simply too heavy and expensive to run.
China right now is leading the way with releasing open weights models. The US lags behind, as they are all more concerned about releasing closed weights commercial models.
I don’t know but I am constantly hitting the RAM limit with 16Gb of RAM with around 20-30 open tabs and other apps, both on Linux and Windows