frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

If you don't run your own LLM proxy, how do you know whats going on?

https://jrdsgl.com/if-you-dont-run-your-own-llm-proxy-how-the-fuck-do-you-even-know-whats-going-on/
20•amrrs•4h ago

Comments

voodooEntity•3h ago
Well that was one of the reasons why i build my own agent/harness - to have actual full observability of what it is doing and why it is doing what it is doing.

Don't really understand why other agents to give those insights but well found my solution.

skeptrune•49m ago
most interesting link i've seen on this site in a while
hoppp•43m ago
Yup. Setting up liteLLMProxy on some servers as we speak and will start playing around.

I can't orchestrate agents in sandboxes without it.

1. It can issue virtual keys, so provider API keys never go near the sandbox

2. I can see everything

3. Guardrails

And much more

Looking forward to it.

DelightOne•21m ago
1) What kind of guardrails are you using? Do you do models like prompt injection checkers? Or what guardrails are useful that do not know the environment the agent lives in?

2) I heard Bifrost also works for this. Did you try that as well, pros/cons?

stavros•32m ago
Does anyone here use LiteLLM for this? How well does it do? Can I use it with my Claude subscription?
verdverm•19m ago
I use GoModel and its amazing. My favorite features are virtual model, the support for arbitrary request labels, and the nice dashboads / ui. Creator has more sophisticated report generation on the near term roadmap. He's super responsive to feedback and ships fast. (except for his recent trip to the US west coast to meet founders and investors, he's EU based)

You can use and control all.your subscriptions or aoikeys through a gateway like this, so you don't get pwned like what just happened with OpenCode (or an OpenRouter like vendor). GoModel has some ambitions like this, but is open source so you can run it on you own infra, with plans for self hosted enterprise as well (there are a few features already like SSO). We are rolling out the free version at work right now.

I run GoModel at home and have hyper detailed history of every agent interaction, across models running on my sparks and OpenCode sub. You can call me a committed superfan of this project.

selcuka•16m ago
https://docs.litellm.ai/docs/tutorials/claude_code_max_subsc...
impure•28m ago
OpenRouter does all this for you. It's pretty nice. Although for apps I use another server to lock down the requests even more and prevent the client from seeing my API key.
soared•21m ago
One man’s fun is another man’s “idk what any of these words mean, I pay $20/mo for some company to abstract this complexity away”

For clarity, I do like blog posts like these.

sroerick•3m ago
Seeing some good stuff in the comments, but how are people doing this?

Hybrid Reasoning Agents: LLM agents that think in latent space, act through text

https://arxiv.org/abs/2610.18861
201•allinonai•4h ago•122 comments

William Gibson and the trademarking of cyberspace

https://colo.to/cyberspace.html
53•Eric_Gullichsen•1h ago•3 comments

Someone behind the software

https://karrisaarinen.com/posts/someone-behind-the-software/
311•tosh•8h ago•134 comments

If you don't run your own LLM proxy, how do you know whats going on?

https://jrdsgl.com/if-you-dont-run-your-own-llm-proxy-how-the-fuck-do-you-even-know-whats-going-on/
20•amrrs•4h ago•11 comments

Free Pascal compiler now supports dynamic packages

https://www.getlazarus.org/dynamic/
113•sysrpl•6h ago•22 comments

Laptop Based on 6502 CPU

https://www.maddox.pro/?p=448
24•nanochess•3d ago•5 comments

RepRapMicron

https://github.com/VikOlliver/RepRapMicron/wiki
329•RobotToaster•11h ago•54 comments

Show HN: WhatsApp MCP running free on Cloudflare

https://github.com/finereli/whatsapp-mcp
37•zoozla•3h ago•23 comments

Dogs seem to agree with humans that 'bouba' is round and 'kiki' is spiky

https://www.sciencealert.com/dogs-seem-to-agree-with-humans-that-bouba-is-round-and-kiki-is-spiky
125•gmays•23h ago•75 comments

There's never been a better time to go into math (by: 3blue1brown) [video]

https://www.youtube.com/watch?v=LKrwhjOI8Nc
158•mdp2021•1d ago•111 comments

DeepSeek search and fetch – $0.75 per 1000 successful requests

https://api-docs.deepseek.com/guides/search/
546•fagnerbrack•18h ago•257 comments

PalmOS Lemmings

https://github.com/ardiri/palmos-lemmings
89•memalign•7h ago•23 comments

"Traditional, but Puzzling"

https://unsung.aresluna.org/traditional-but-puzzling/
19•colinprince•2d ago•2 comments

One parser, two bugs, many routers: Exploiting Broadcom WiFi across eCos, Linux

https://quentinkaiser.be/security/2026/10/16/one-parser-two-bugs/
45•zoobab•2d ago•9 comments

16-bit fully functional DIY magnetic core memory

https://www.youtube.com/watch?v=OJ1WYyO2jdY
36•oliculipolicula•3d ago•16 comments

What the heck is /pkg?

https://anderegg.ca/2026/10/18/what-the-heck-is-pkg
15•GavinAnderegg•8h ago•4 comments

Java sealed classes and exhaustive pattern matching

https://neilmadden.blog/2026/04/24/java-sealed-classes-and-exhaustive-pattern-matching/
136•hnisjafx40•10h ago•102 comments

I built a programming language that LLMs can't use

https://blog.picheta.me/post/killswitch-lang/
74•dom96•1d ago•66 comments

"I'm on a war footing": Terry Tao and the crisis in math

https://www.nytimes.com/2026/10/16/us/math-ai-terence-tao.html
82•vinipolicena•2d ago•116 comments

The Intel 8087 chip: floating-point addition and subtraction

https://www.righto.com/2026/10/8087-addition-subtraction-microcode.html
88•pwg•9h ago•33 comments

Namecheap just seized and disabled all my domains

https://www.reddit.com/r/sysadmin/comments/1x8cycd/namecheap_just_seized_and_disabled_all_my_doma...
429•sashk•8h ago•202 comments

SIGSALY: Churchill's top secret hotline to the president

https://www.iwm.org.uk/history/iwm/cwr/telephone
111•stmw•4d ago•39 comments

Open MicroManipulator – A sub-micrometer 3D motion control plattform

https://github.com/0x23/MicroManipulatorStepper
173•_Microft•14h ago•13 comments

Developing for Debugging (2025)

https://www.davepacheco.net/blog/2025/developing-for-debugging-dns-propagation/
28•mpweiher•1d ago•0 comments

A new way to think about borrow checking (in reverse)

https://verdagon.dev/blog/reverse-borrow-checking
19•verdagon•13h ago•4 comments

The Elizabeth Holmes documentary “You Can See Everything” is deceiving

https://www.readtheprofile.com/p/elizabeth-holmes-documentary-you-can-see-everything
364•MaysonL•22h ago•514 comments

I electrified my push scooter with a power drill

https://eddieabbondanz.io/post/shop/drill-powered-scooter/
131•speckx•4d ago•50 comments

Show HN: The Zelda timeline to catch up before the Ocarina of Time remake

https://legendofhyrule.com/
161•jsomau•12h ago•99 comments

Types of types: Haskell's Kind system

https://thunk.blog/posts/types-of-types-haskell-kind-system/
102•Thom2503•4d ago•73 comments

Parser Combinators

https://t3.at/blog/2026-10-17-parser-combinators/
221•schindlabua•17h ago•79 comments