Sort of writing a narrative on top live.
Unfortunately, local models are still a bit slow and weak but was interesting to see what it came up with nonetheless.
It doesn't help that the marketing leans heavily on anthropomorphizing LLMs either, IMHO.
This trips me up occasionally when I'm translating things into English. Once, when I referred to an indefinite gender player character in a gacha game as a "he" (because the word "player" is a "he"), quite a few people got mad! Even though in my head I was never trying to imply one way or the other.
Yes judgment. Loads of it. Judge away.
This is just bizarre. Do not refer to this product of marketing-technology as you refer to a person. EVER.
So that's another, maybe more harmless reason for it.
https://drive.google.com/file/d/1A7kfcjHjSmCNidqc9t731uoglzL... https://drive.google.com/file/d/1Bl_n0ECqc78LGGf7SsOx38mRUOP... https://drive.google.com/file/d/1JMcgzqcnZ2ncboeyAXvscRWagqR... https://drive.google.com/file/d/1-luJ6y7YslNfwmFnCdIDbJ871i0... https://drive.google.com/file/d/14n4TLAVywk_1GMhLLGOuukQwUmb...
Also Anthropic is by far the best, open (local) models are glorified autocomplete at best unless you casually have 20k€ worth of hardware at home.
Very usable locally assuming you setup your local tooling correctly and you are an actual programmer who can generally help drive this stuff correctly and not just a vibe coder.
I have a ML Setup with 2 4090 and 128gb of ram, its warm when i use them for finetuning or batch processes.
I do not run them for coding. Its a lot easier and nicer to play around with better models for just 20 $.
[we've hopefully deprovokified the title now]
Why does it bother me so? I have no idea.
i doubt anyone is nouning "agentic" of their own accord (yet)
Pretty much 100% of projects I've done with vibe coding/engineering is in the second category. Stuff I need that either doesn't exist or exists, but is either horribly complex to configure or is a mess of 420 features even though I just need one of them.
It's a lot easier for me to implement that one specific feature just for myself than keep vigilant on an existing app's eventual scope creep as it progresses to the eventual ability to read email[0] =).
Now it is different in a way — I don’t have time to use them.
now Claude will gas you up and tell you your bad ideas are actually the most amazing thing it’s ever heard
I got it working well enough to display what I wanted in text and ascii, but I could never get the interface good enough to want to use it daily, and certainly couldn't get the graphical interface working. I threw it a Claude Code, told it what I wanted the graphical interface to look like, and let it run.
It got an app exactly what I wanted, and even found a bug in the date parser that I hadn't noticed. I now have it running in the corner of my screen at all times.
The next app I'm going to build is an iPhone app that turns off all my morning alarms when the kids' don't have school. Something I've wanted forever, but never could build because I know nothing about making iPhone apps and don't have time to learn (because of the aforementioned children).
Claude Code is brilliant for personal apps. The code quality doesn't really matter, so you can just take what it gives you and use it.
cyanydeez•1h ago
And when you inevitably get bored with it, well, you've not done much anyway. You can always get back up to speed in a month and have the LLM remind you of what it was doing.
AntiUSAbah•1h ago
And with a Claude or GPT $20 Subscription, i can do other fun things too like using it for real things (emails) or image generation.
A Mac Studio or AMD395 is neither of it. And its not just a basic setup either. I need to buy it, configure it, put it somewhere. That alone is a grand and more + a whole weekend.
IanCal•1h ago
kowbell•1h ago
I'm very interested in Local LLMs but the cheapest Mac Studio right now is more expensive than 8 years of a Claude Code Pro subscription, and incomparably slower/less capable. If I get bored with it, I will have a piece of unused hardware and a couple grand less in my bank account.
politelemon•1h ago
kowbell•55m ago
My partner on the otherhand has an M3 Max 64GB which I've had way more success with. Setting up opencode and doing a tiny spec-driven Rust project and watching it kiiinda work was extraordinarily exciting!
binary0010•1h ago
kowbell•49m ago
binary0010•11m ago
binary0010•1h ago
It's actually really cool to have it work on some internal tooling and stuff while I work on my primary projects.
I'm surprised how easy it is to setup and that it can handle modestly complex planning and development flows.