frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Show HN: I'm tired of my LLM bullshitting. So I fixed it

3•BobbyLLM•3h ago
As a handsome local AI enjoyer™ you’ve probably noticed one of the big flaws with LLMs:

It lies. Confidently. ALL THE TIME.

I’m autistic and extremely allergic to vibes-based tooling, so … I built a thing. Maybe it’s useful to you too.

The thing: llama-conductor

llama-conductor is a router that sits between your frontend (eg: OWUI) & backend (llama.cpp + llama-swap). Local-first but it should talk to anything OpenAI-compatible if you point it there (note: experimental so YMMV).

LC is a glass-box that makes the stack behave like a deterministic system, instead of a drunk telling a story about the fish that got away.

TL;DR: “In God we trust. All others must bring data.”

Three examples:

1. KB mechanics (markdown, JSON, checksums)

You keep “knowledge” as dumb folders on disk. Drop docs (.txt, .md, .pdf`) in them. Then:

>>attach <kb> - attaches a KB folder

>>summ new - generates SUMM_.md files with SHA-256 provenance baked in + moves the original to a sub-folder

Now, when you ask something like:

> “yo, what did the Commodore C64 retail for in 1982?”

..it answers from the attached KBs only.

If the fact isn’t there, it tells you - explicitly - instead of winging it. Eg:

"The provided facts state the Commodore 64 launched at $595 and was reduced to $250, but do not specify a 1982 retail price. The Amiga’s pricing and timeline are also not detailed in the given facts.

Missing information includes the exact 1982 retail price for Commodore’s product line and which specific model(s) were sold then."

[Confidence: medium | Source: Mixed]

No vibes. Just: here’s what’s in your docs, here’s what’s missing, don't GIGO yourself into stupid.

Then, if you're happy with the summary, you can:

>>move to vault

2. Mentats: proof-or-refusal mode (Vault-only)

Mentats is the “deep think” pipeline against your curated sources.

* no chat history

* no filesystem KBs

* no Vodka

* Vault-only grounding (Qdrant)

It runs a triple-pass (thinker → critic → thinker). It’s slow on purpose. You can audit it. And if the Vault has nothing relevant? It refuses and tells you to go pound sand:

FINAL_ANSWER:

The provided facts do not contain information about the Acorn computer or its 1995 sale price.

Sources: Vault

FACTS_USED: NONE

[ZARDOZ HATH SPOKEN]

Also yes, it writes a mentats_debug.log. Go look at it any time you want.

The flow is basically:

Attach KBs → SUMM → Move to Vault → Mentats.

No mystery meat. No “trust me bro, embeddings.”

3. Vodka: deterministic memory on a potato budget

Potato PCs have two classic problems: goldfish memory + context bloat that murders your VRAM.

Vodka fixes both without extra model compute.

* !! stores facts verbatim (JSON on disk)

* ?? recalls them verbatim (TTL + touch limits so memory doesn’t become landfill)

* CTC (Cut The Crap)* hard-caps context (last N messages + char cap) and creates a concatenated summary (not LLM) so you don’t get VRAM spikes after 400 messages

So instead of:

“Remember my server is 203.0.113.42” → “Got it!” → [100 msgs later] → “127.0.0.1”

you get:

!! my server is 203.0.113.42` ?? server ip → 203.0.113.42 (with TTL/touch metadata)

And because context stays bounded: stable KV cache, stable speed, your potato PC stops crying.

There’s more (a lot more) in the README, but I’ve already over-autism’ed this post.

TL;DR:

If you want your local LLM to shut up when it doesn’t know and show receipts when it does, come poke it:

Primary (Codeberg) https://codeberg.org/BobbyLLM/llama-conductor

Mirror (GitHub): https://github.com/BobbyLLM/llama-conductor

PS: Sorry about the AI slop image. I can't draw for shit.

PPS: A human with ASD wrote this using Notepad++. If it the formatting or language are weird, now you know why.

Comments

gogopromptless•2h ago
How many facts do you have after using your tool for 2 weeks?
BobbyLLM•2h ago
Well, I've been using it more than two weeks (though I did just spend a month in Tokyo) so ... not sure how to answer that :)

Do you mean generally though - how many facts does it extract from a typical document of X length? Or do you mean what my own personal corpus currently is?

gogopromptless•1h ago
Size of your personal corpus is a rough signal of usefulness. If you've been using it a while and you have 500 facts, thats very different from 5000 facts.

My crappy personal system is a telegram channel "Today I Learned" that grows at roughly 5 messages per day. The search is obviously much worse than your tool.

The design of no rewrites for facts storage was an approach I have not seen from any of my friends' agent memory setups, so that difference struck my curiosity for how well its working in practice.

BobbyLLM•51m ago
Got it. Answer in 3 parts.

If you're talking about the "Fastrecall" part of it, it's clamped to around 3000 entries. Beyond that...I mean...it's just a JSON file. How much do you hate yourself? lol :)

I use mine as intended (well, by me) as a short term memory store with a TTL of 14 days. Right now it has...350ish stored facts with different expiration dates. You can play around with the settings and max resets (touches), but if ctx > max_items, janitor rolls in and the oldest get pruned anyway.

If you're talking about the chat bloat control part (cut the crap), I set mine to keep the last 2 user/assistant pairs and a soft cap of 2000 characters. That middle part obviously decays during the chat. I like to keep my chatty fast.

If you're asking about the KB (attach) system: generally speaking, the SUMM function seems to generate a summary of upto about 1500 characters. That's what...250 words? Short and sweet...because again, potato pc + smart grep = don't be stupid.

In theory, the KB thing is limited by you SSD and pain tolerance. I have about 1500 items I query against and it's still in the sub-secondish range.

Mentats / vault? Scales via Qdrant.

Does that answer it? None of this shit is enterprise grade; it's purely for personal use.

reify•1h ago
gooncoding

"bro I spent all weekend in claud code. Its incredible"

"Oh nice, what did you build?"

"Dude my set up is crazy. I've got all the vercel skills. plus custom hooks for every project"

"Sick, what are you building?"

"My set up is so optimized. I'm using, like 5 instances at once"

"Hello bro, stop playing with your dick, answer my questions bro!"

BobbyLLM•1h ago
Bro, what you get up to with your bro, is between you and your bro, bro.

Also, Claude said he likes me better than you and he'd know because he's French and old soul and shit.

PS: The concrete thing is a local control layer that makes my LLM shut up unless it can cite my docs. Plus I can run in on my p.o.s P1000 and not line NVIDIA shareholders pockets by buying more VRAM.

Repo’s over there if you want to kick the tires.

Show HN: isometric.nyc – giant isometric pixel art map of NYC

https://cannoneyed.com/isometric-nyc/
296•cannoneyed•3h ago•94 comments

Show HN: Text-to-video model from scratch (2 brothers, 2 years, 2B params)

https://huggingface.co/collections/Linum-AI/linum-v2-2b-text-to-video
12•schopra909•4h ago•6 comments

Show HN: BrowserOS – "Claude Cowork" in the browser

https://github.com/browseros-ai/BrowserOS
25•felarof•4h ago•12 comments

Show HN: CLI for working with Apple Core ML models

https://github.com/schappim/coreml-cli
3•schappim•32m ago•0 comments

Show HN: Sweep, Open-weights 1.5B model for next-edit autocomplete

https://huggingface.co/sweepai/sweep-next-edit-1.5B
500•williamzeng0•21h ago•111 comments

Show HN: I'm writing an alternative to Lutris

https://github.com/navid-m/styx
2•death_eternal•14m ago•0 comments

Show HN: Synesthesia, make noise music with a colorpicker

https://visualnoise.ca
9•tevans3•14h ago•3 comments

Show HN: ProblemHunt – A place to collect real problems before building startups

https://problemhunt.pro
3•gostroverhov•21m ago•2 comments

Show HN: Elden Ring–style "Git Pushed" screen when you Git push in VS Code

https://github.com/iiviie/CODE_PUSHED_darkSouls
2•iiviie•24m ago•0 comments

Show HN: Interactive physics simulations I built while teaching my daughter

https://www.projectlumen.app/
60•anticlickwise•3d ago•14 comments

Show HN: Figr – AI that thinks through product problems before designing

https://figr.design/
2•Mokshgarg003•32m ago•0 comments

Show HN: macOS CLI tool for managing Calendar events and Reminders via EventKit

https://github.com/schappim/ekctl
2•schappim•37m ago•0 comments

Show HN: Infrastructure for multi-agent AI memory

https://nexuswaitlist.framer.website/
2•sillygoose_189•59m ago•0 comments

Show HN: ChartGPU – WebGPU-powered charting library (1M points at 60fps)

https://github.com/ChartGPU/ChartGPU
651•huntergemmer•1d ago•203 comments

Show HN: AI Search Index – Track which AI bots crawl your website

https://www.aisearchindex.com
2•ihmissuti•1h ago•0 comments

Show HN: I've been using AI to analyze every supplement on the market

https://pillser.com/
9•lilouartz•6h ago•6 comments

Show HN: LaReview, local open-source CodeRabbit alternative

https://github.com/puemos/lareview
2•deofoo•1h ago•0 comments

Show HN: A Node Based Editor for Three.js Shading Language (TSL)

https://www.tsl-graph.xyz/
3•bhushanwtf•3h ago•1 comments

Show HN: An AI-powered web video editor built with Next.js and Fabric.js

https://pablituuu.space/video-editor
2•pablituuu•2h ago•0 comments

Show HN: Rails UI

https://railsui.com/
195•justalever•1d ago•107 comments

Show HN: Bible translated using LLMs from source Greek and Hebrew

https://biblexica.com
29•epsteingpt•4h ago•36 comments

Show HN: RatatuiRuby wraps Rust Ratatui as a RubyGem – TUIs with the joy of Ruby

https://www.ratatui-ruby.dev/
149•Kerrick•5d ago•31 comments

Show HN: I'm tired of my LLM bullshitting. So I fixed it

3•BobbyLLM•3h ago•6 comments

Show HN: yolo-cage – AI coding agents that can't exfiltrate secrets

https://github.com/borenstein/yolo-cage
59•borenstein•1d ago•72 comments

Show HN: Differentiable Quantum Chemistry

https://github.com/lowdanie/hartree-fock-solver
49•lowdanie•5d ago•14 comments

Show HN: Mastra 1.0, open-source JavaScript agent framework from the Gatsby devs

https://github.com/mastra-ai/mastra
212•calcsam•2d ago•69 comments

Show HN: High speed graphics rendering research with tinygrad/tinyJIT

https://github.com/quantbagel/gtinygrad
28•quantbagel•17h ago•9 comments

Show HN: Retain – A unified knowledge base for all your AI coding conversations

https://github.com/BayramAnnakov/retain
43•Bayram•1d ago•14 comments

Show HN: Open-source certificate from GitHub activity

https://certificate.brendonmatos.com
41•brendonmatos•4d ago•9 comments

Show HN: I built a JSON viewer that decodes Base64 media inline

https://viewjson.net
3•dassh•5h ago•0 comments