Reward*P(Success) - Penalty*P(1-Success) - OpportunityCostBut I think this week we are seeing a lot of extremely capable large models. DeepSeek V3 (670B) was joined by Kimi K2 (1T), and now Qwen3 Coder (480B). Trying to run these at home with any reasonable speed is very hard. Smaller models can be quite useful too but I feel like one absolutely wants to be able to tap these large models for a lot of core crucial work. https://www.reddit.com/r/LocalLLaMA/
In fact we have an example of a company that spent years moving off cloud - Dropbox - and the company has been stagnating since - so this isn't some "easy win".
If you talk to smart business leaders you'll hear the main 3 points come up over and over: cloud offers three huge advantages that are worth incredible margins to many companies:
1. Your business can scale existing or new workloads very quickly
2. It frees up organizational focus for your customer's problem
3. It's easier to hire cloud skills for than bare metal skills
You'll note that improvement on all of these are a trade of money for more time and lower risk. Put in those terms I hope it's not confusing why we continue to pay cloud provides.
There's something else going on here.
After all, as a business manager with a duty to make the most for your shareholders, if you really anticipated scaling your compute needs, wouldn't you invest in the cheapest way to do more computing ?
If you were a board member of a trucking company, and your CEO told you "Managing trucks is a pain, always filling them with fuel and stuff, I outsourced it to another trucking company, they are only charging us 5 times our previous budget in equipment and drivers salaries. Now we can focus on what we do best, making our customers happy" you'd fire that CEO.
"It's easier to hire for cloud skills that bare metal skills" is self-fulling in part, but if you are doing self-hosting correctly, it's also meaningless because you will just run largely the same software infrastructure. You can go to Dell or HP and have them deliver you a rack or more that already have the cloud software you want installed.
The "it frees up organizational focus for your customer's problem" is the closest to being meaningful. Modern corporate management seems weak generally, other examples include the trend of not promoting internally and instead hiring from outside -- it's like the none of the corporations trust themselves to evaluate people themselves, and inherently feel more confident hiring someone another corporation has found valuable.
"We are bad at managing our core business which has a profit margin of 10%. Therefore, we will take an essential service in support of that, outsource it to a company which is known for algorithmically detecting customer lock-in and raising prices, and is extremely difficult to leave, and will charge us 5 times as much."
But yeah, migrating the core business systems to cloud surely adds risk of lock-in, as well as juridical and geopolitical risks.
These are very similar financial engineer dynamics that drove the large outsourcing drive in the late and early 2000s.
Don't be a sucker - go create your own model, train it for hundreds of millions of dollars. With your own money - you aren't a sucker to borrow from anyone. Fine tune a model, train it again.
Only then, when and if you're get done, will you be able to claim "I'm not sucker, I don't rent anything. And you shouldn't too!".
Until then, no model is yours. Even if you run it locally, you're inevitably engaging in renting it, if not for money directly, then for knowledge and expertise of those large companies. The ones that've created them for you. With an option to utilize them for free, locally.
Hard to explain this to some folks
MrResearcher•6mo ago
Even for a simple web site.