frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Is it possible to have an LLM always give a consistent output?

2•twosdai•1h ago
Is there any LLM who's focus is this? EG:

1. Given the same exact tokens, 2. Always return the same tokens.

EG: I give the LLM the following tokens:

"What color is the sky?"

it always would return a message like:

"It's Purple!"

and never change. I understand this not a normal usecase or in many cases desired for an LLM, but I am curious if anyone is working on this in an academic paper, or if there is a private organization which is doing something along these lines.

Comments

twosdai•1h ago
To clarify I am valuing consistency in the output to the token level, not the actual information of the content.
cratermoon•1h ago
maybe, if you set the temperature to 0, but by nature the math is stochastic, not deterministic.
yorwba•1h ago
Deterministic output is a property of the inference framework, not the model. E.g.

https://docs.sglang.ai/advanced_features/deterministic_infer...

https://github.com/ggml-org/llama.cpp/pull/16016

twosdai•20m ago
Really appreciate this, this is exactly what I was looking for.
compressedgas•1h ago
Use a fixed sampler seed.
danenania•55m ago
If you need this, could you just put your own kv cache in front?
vunderba•19m ago
Do you mean:

Given a user input X/Y/Z that "resolves" to the target information of "sky color", respond with "Purple"?

That sounds to me more like sticking a classifier and/or vector similarity database interceptor in front of an LLM and pre-empt with cached response.

Otherwise I'm not sure I understand the question. If you just want EXACT TOKEN INPUT => EXACT TOKEN OUTPUT then it's just a KVP as @danenania mentioned.

Random Sequences, Experienced Coincidences, and Pseudoscientific Beliefs

https://onlinelibrary.wiley.com/doi/10.1002/acp.70133
1•DrierCycle•1m ago•0 comments

Llmdeathcount.com

https://llmdeathcount.com/
1•brian_peiris•1m ago•1 comments

DFW deploys SIX new Striker Volterra Electric ARFF 6×6 fire trucks

https://electrek.co/2025/11/14/dfw-deploys-six-new-striker-volterra-electric-arff-6x6-fire-trucks/
1•Bender•1m ago•0 comments

Ask HN: Anyone tried using AI SREs? What's missing?

1•dlee6018•1m ago•0 comments

Apple intensifies succession planning for CEO Tim Cook

https://finance.yahoo.com/news/apple-intensifies-succession-planning-ceo-033813352.html
1•retskrad•2m ago•0 comments

The Economics of Transformative AI

https://www.nber.org/books-and-chapters/economics-transformative-ai
1•tmoertel•4m ago•0 comments

Sony cracks down on Concord custom servers, issues DMCA takedowns on videos

https://thegamepost.com/sony-cracks-down-concord-custom-servers-dmca-takedowns/
1•haunter•4m ago•0 comments

Small-Business Owners Are Putting AI to Good Use

https://www.wsj.com/tech/ai/these-small-business-owners-are-putting-ai-to-good-use-f790d5a9
1•nradov•5m ago•0 comments

New York Fed met with banks over key lending facility

https://www.reuters.com/sustainability/boards-policy-regulation/new-york-fed-met-with-banks-over-...
1•clanky•6m ago•0 comments

SigmaOS: Say hi to a whole new browser experience

https://sigmaos.com/
1•eustoria•7m ago•0 comments

Using Your Credit Card at the Checkout Is Set to Get More Complicated

https://www.wsj.com/personal-finance/credit/using-your-credit-card-at-the-checkout-is-set-to-get-...
1•apparent•7m ago•1 comments

My Home Network Domain Name Resolution Plan

https://blog.l3zc.com/en/2025/02/what-i-have-done-on-my-dns/
1•eustoria•8m ago•0 comments

Discover Books That Don't Exist Until You Look at Them

https://latentlibrary.xyz/
1•mooreds•12m ago•0 comments

Limnic Eruption

https://en.wikipedia.org/wiki/Limnic_eruption
1•areoform•13m ago•0 comments

California startup creates a giant inflatable bag to catch asteroids and debris

https://www.moneycontrol.com/europe/?url=https://www.moneycontrol.com/science/california-startup-...
2•ashishgupta2209•18m ago•0 comments

The Ends of the Earth

https://www.quantamagazine.org/photos-capture-the-extreme-beautiful-work-of-climate-science-20250...
1•tzury•19m ago•0 comments

FBI Director Waived Polygraph Security Screening for Three Senior Staff

https://www.propublica.org/article/fbi-kash-patel-dan-bongino-waived-polygraph
3•Jimmc414•19m ago•0 comments

Meta Says the 2,400 'Adult Movies' They Torrented Were for Personal Use

https://www.vice.com/en/article/meta-says-the-2400-adult-movies-they-torrented-were-for-personal-...
4•horsellama•20m ago•0 comments

Researchers push "Context Engineering 2.0" as the road to lifelong AI memory

https://the-decoder.com/researchers-push-context-engineering-2-0-as-the-road-to-lifelong-ai-memory/
1•tanelpoder•21m ago•0 comments

America Is Taking the Train

https://www.theatlantic.com/technology/2025/11/amtrak-train-holiday-travel/684940/
2•JumpCrisscross•26m ago•0 comments

Oh LinkedIn, Why

https://mtende.blog/oh-linkedin-why
1•sonderotis•28m ago•0 comments

Friction Was the Feature

https://johnstone.substack.com/p/friction-was-the-feature
1•paulpauper•33m ago•0 comments

Seattle new Mayor: Government-owned grocery stores, Rent control across the city

https://mynorthwest.com/kiro-opinion/harger-katie-wilson-seattle/4156878
2•donsupreme•34m ago•0 comments

Did prison just replace mental hospitals?

https://www.slowboring.com/p/did-prison-just-replace-mental-hospitals
2•paulpauper•35m ago•1 comments

'This Is the War Against Human Nature'

https://www.nytimes.com/2025/11/14/opinion/paul-kingsnorth-humanity-technology.html
2•paulpauper•35m ago•0 comments

Deception Island

https://www.deceptionisland.aq
1•keepamovin•36m ago•0 comments

Wrapping My Head Around AI Wrappers

https://www.wreflection.com/p/wrapping-my-head-around-ai-wrappers
1•nowflux•39m ago•0 comments

Lessons Men Learn Too Late in Life, According to Miyamoto Musashi

https://www.newtraderu.com/2025/11/14/10-lessons-men-learn-too-late-in-life-according-to-miyamoto...
2•begueradj•40m ago•0 comments

AI Code Is Going to Kill Your Startup (and You're Going to Let It)

https://medium.com/@kcl17/ai-code-is-going-to-kill-your-startup-and-youre-going-to-let-it-9f364fe...
2•tanelpoder•41m ago•1 comments

US Postal Service seeks reforms as it reports $9B yearly loss

https://www.reuters.com/business/autos-transportation/us-postal-service-seeks-reforms-it-reports-...
2•bikenaga•43m ago•1 comments