frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

LLMs Are Great, but They're Not Everything

4•procha•1y ago
Three years after ChatGPT’s release, LLMs are in everything—demos, strategies, and visions of AGI. But from my observer’s perspective, the assumptions we’re making about what LLMs can do seem to be drifting from architectural reality.

LLMs are amazing at unstructured information—synthesizing, summarizing, reasoning loosely across large corpora. But they are not built for deterministic workflows or structured multi-step logic. And many of today’s most hyped AI use cases are sold exactly like that.

Architecture Matters

We often conflate different AI paradigms:

    LLMs (Transformers): Predict token sequences based on context. Great with language, poor with state, goal-tracking, or structured tool execution.

    Symbolic AI / State Machines: Rigid logic, excellent for workflows—bad at fuzziness or ambiguity.

    Reinforcement Learning (RL): Optimizes behavior over time via feedback, good for planning and adaptation, harder to scale and train.
Each of these has a domain. The confusion arises when we treat one as universally applicable. Right now, we’re pushing LLMs into business-critical automation roles where deterministic control matters—and they often struggle.

Agentic Frameworks: A Workaround, Not a Solution

Agentic frameworks have become popular: LLMs coordinating with other LLMs in roles like planner, executor, supervisor. But in many cases, this is just masking a core limitation: tool calling and orchestration are brittle. When a single agent struggles to choose correctly from 5 tools, giving 10 tools to 2 agents doesn’t solve the problem it just moves the bottleneck.

Supervising a growing number of agents becomes exponentially harder, especially without persistent memory or shared state. At some point, these setups feel less like robust systems and more like committee members hallucinating their way through vague job descriptions.

The Demo Trap

A lot of what gets shown in product demos—“AI agents booking travel, updating CRMs, diagnosing errors”—doesn’t hold up in production. Tools get misused, calls fail, edge cases break flows. The issue isn’t that LLMs are bad it’s that language prediction is not a process engine.

If even humans struggle to execute complex logic reliably, expecting LLMs to replace structured automation is not vision it’s optimism bias.

On the Silence of Those Who Know Better

What’s most puzzling is the silence of those who could say this clearly: the lab founders, the highly respected researchers, the already-rich executives. These are people who know that LLMs aren’t general agents. They have nothing to lose by telling the truth and everything to gain by being remembered as honest stewards.

Instead, they mostly play along. The AGI narrative rolls forward. Caution is reframed as doubt. Realistic planning becomes an obstacle to growth.

I get it, markets, momentum, investor expectations. But still: it’s hard not to feel that something more ethical and lasting is being passed over in favor of short-term shine.

A Final Thought

I might be wrong—but it’s hard to ignore the widening gap between what LLMs are and what C-level execs and investors want them to be. Engineering teams are under pressure to deliver the Hollywood dream, but that dream often doesn’t materialize. Meanwhile, sunk costs pile up, and the clock keeps ticking. This isn’t pessimism it’s recognizing that hype has gravity, and reality has limits. I’d love to be proven wrong and happily jump on the beautiful AI hype train if it ever truly arrives.

Comments

designorbit•1y ago
Love this perspective. You nailed the core issue: LLMs ≠ process engines. And agentic frameworks stacking roles often end up masking fragility instead of fixing it.

One thing I’ve been exploring is this middle ground—what if we stop treating LLMs as process executors, and instead make them contextual participants powered by structured, external memory + state layers?

I’m building Recallio as a plug-and-play memory API exactly for this gap: letting agents/apps access persistent, scoped memory without duct-taping vector DBs and custom orchestration every time.

Totally agree the dream won’t materialize through token prediction alone—but maybe it does if we reconnect LLMs with better state + memory infra.

Have you seen teams blending external memory/state successfully in production? Or are most still trapped inside the prompt+vector loop?

dpao001•1y ago
What is your opinion on Manus. Is it closing in on AGI or is it as you suggest a sticking plaster waiting to break?

Show HN: I built a Rick and Morty explainer video generator (It's Paid)

https://usediorama.com/rick-and-morty
1•dixitbavu•4m ago•0 comments

Is prompt tuning still a thing today? Anybody still using the likes of DSPy?

1•nlpnerd•4m ago•0 comments

Local Only Encrypted Journal

https://private-journal.netlify.app/
1•rammy1234•12m ago•0 comments

Draft-tree decoding on Apple Silicon: M4 vs. M5/M6 and bit-exact Metal

https://blog.yuhuachen.com/blog/2ArXyvXoSTOQ9nFQtp3Fz
1•yuhuabill•15m ago•0 comments

MotherDuck, Meet Excel

https://motherduck.com/blog/motherduck-duckdb-meet-excel/
1•Tomte•15m ago•0 comments

Why we're blind to the color blue (2021)

https://calebkruse.com/10-projects/seeing-blue/
1•sammatilda•16m ago•0 comments

Inkling 2 Small on Nvidia B300: 5.1x to 7.5x faster expert GEMMs, same bits

https://www.rightnowai.co/blog/bit-identical-fp4-moe-kernels-on-blackwell
3•OsamaJaber•20m ago•0 comments

Three-way translation merge: keeping translated pages in sync with an LLM

https://maxmart.github.io/posts/three-way-translation-merge/
1•maxmart•20m ago•0 comments

Show HN: Cloud-drift-report – an open-source driftctl alternative for AWS

https://github.com/orchesterra/cloud-drift-report
1•akshaykilam•21m ago•0 comments

A Slinky on an Escalator Is a Weirdly Good Test of LLM Intelligence

https://morethanamachine.com/posts/slinky-escalator-benchmark/
1•reddmachine•21m ago•1 comments

Gemini: Can't prevent training or review even with no history retained

https://techcrunch.com/2026/11/17/google-to-keep-gemini-chats-for-two-months-up-from-72-hours-eve...
2•iotage•21m ago•1 comments

Hex Marks the Spot

https://www.museumofplay.org/blog/hex-marks-the-spot/
1•jonbaer•25m ago•0 comments

A History of Clojure (2020)

https://dl.acm.org/doi/pdf/10.1145/3386321
1•tosh•27m ago•0 comments

Qlaude – Claude Code against your own model server

https://github.com/trail-openers/qlaude
1•velmu•33m ago•0 comments

The Manufacturing of Novelty

https://www.ft.com/content/99711b1a-3e54-4349-9c81-769cf7c96b97
1•JumpCrisscross•36m ago•0 comments

Probabilistic data structures in Go, part 2

https://antonz.org/probabilistic-data-structures-2/
1•mfrw•36m ago•1 comments

California train burglars carefully executed heists for 'staggering' $22M haul

https://www.theguardian.com/us-news/2026/nov/21/california-arrests-train-heists
2•ljf•39m ago•0 comments

Ask HN: Who Owns API Drift

1•Nalin_2408•41m ago•1 comments

Can Psychedelics Improve Decision-Making?

https://nautil.us/can-psychedelics-improve-decision-making-1286863
2•the-mitr•48m ago•0 comments

The Engineering Manager's role is under attack (again)

https://www.manager.dev/newsletter/the-engineering-manager-s-role-is-under-attack-again
15•fagnerbrack•52m ago•5 comments

Ask HN: Is Anthropic being public better or worse for your org?

4•ares623•53m ago•1 comments

Web Search on Amazon Bedrock expands language support and country-aware search

https://aws.amazon.com/about-aws/whats-new/2026/11/web-search-amazon-bedrock/
1•yackrru•58m ago•0 comments

Notes on the discrete Fourier transform (DFT)

https://eli.thegreenplace.net/2026/notes-on-the-discrete-fourier-transform-dft/
10•kouosi•1h ago•1 comments

Show HN: App Pixel3D – Dream to 3D Reality

https://apps.apple.com/hu/app/pixel3d-dream-to-3d-reality/id6479245806
1•cflsdf•1h ago•0 comments

Postgres 19 is out: try it on Neon

https://neon.com/blog/postgres-19-is-out-try-it-on-neon
2•yackrru•1h ago•0 comments

Show HN: iOS App Dancing Particle is an interactive app

https://apps.apple.com/us/app/dancing-particle/id6444665083
1•cflsdf•1h ago•0 comments

Amazon is complaining about NYC Council on shipping labels, too

https://www.theverge.com/tech/1039564/amazon-nyc-council-packages-shipping-label
2•burnt-resistor•1h ago•0 comments

Show HN: Prompt Upgrader – a no-signup tool that scores and rewrites AI prompts

https://madgpt1.github.io/prompt-upgrader/
1•MadGPT•1h ago•0 comments

AI resolved all null pointer dereferences in C

https://kapteko.com/ai-resolved-all-null-pointer-dereferences/
1•fessguid•1h ago•1 comments

The Indignity of Makework

https://poisonandoak.wordpress.com/2026/11/21/the-indignity-of-makework/
2•wburglett•1h ago•0 comments