frontpage.
newsnewestaskshowjobs

Made with ♥ by @iamnishanth

Open Source @Github

fp.

Open in hackernews

Ask HN: Where are you keeping your LLM logs?

1•platypii•10h ago
LLM logs are crushing my application logging system. We recently launched AI features on our app and went from ~100mb/month of normal website logs to 3gb/month of llm conversation logs and growing. Our existing logging system was overwhelmed (queries timing out, etc), and costs started increasing. We’re considering how to re-architect our llm logs specifically so we can handle more users plus the increasing token use from things like reasoning models, tool calling, and multi-agent systems. I’m not selling any solutions here, genuinely curious what others are doing. Do you store them alongside APM logs? Dedicated LLM logging service? Build it yourself with open source tools?

Comments

barbazoo•10h ago
Lots of LLM observability tools out there. Lots of them integrate with model sdks or llm frameworks" and sends traces via OpenTelemetry to providers like Braintrust, that's the one I know. You shouldn't have to build all this yourself if you're willing to spend some money.
platypii•9h ago
We're willing to spend money, but I've had the "datadog billing problem" before where it starts reasonable and then grows to a non-trivial percent of saas budget, and then theres a scramble to refactor. Trying to get ahead of that as the LLM logs are MUCH larger that my APM logs.
barbazoo•8h ago
Then I'd try to integrate via a standard connector, OTel for example. Then the cost of switching is much lower. But yeah not sure myself how this will scale and how expensive or even useful it will be.
dewolfe1037a•8h ago
LangSmith is good https://smith.langchain.com/

Private Inference

https://confer.to/blog/2026/01/private-inference/
1•vishnukvmd•3m ago•0 comments

Bash by the Numbers

https://mckern.sh/post/bash-by-the-numbers/
1•thunderbong•3m ago•0 comments

Some first thoughts about live immersive basketball

https://sixcolors.com/post/2026/01/some-first-thoughts-about-live-immersive-basketball/
1•coloneltcb•9m ago•0 comments

Where's the $100k iPhone?

https://boydkane.com/essays/100k-iphone
1•zdw•14m ago•0 comments

MIT Non-AI License

1•dumindunuwan•15m ago•1 comments

Show HN: Understand the Picture of the Day

https://picture.learntosolveit.com
1•orsenthil•16m ago•0 comments

Haraltd – A cross-platform Bluetooth daemon with a JSON-based RPC

https://github.com/bluetuith-org/haraltd
1•darkhz•17m ago•0 comments

The Stick in the Stream

https://randsinrepose.com/archives/the-stick-in-the-stream/
1•zdw•19m ago•0 comments

MAKERphone 2: first modular DIY phone, no soldering

https://circuitmess.com/products/makerphone-2-0
1•nateb2022•19m ago•0 comments

Sodium-ion battery cells near lithium-ion cost parity, set to get cheaper

https://www.ess-news.com/2026/01/09/sodium-ion-battery-cells-already-near-lithium-ion-cost-parity...
1•toomuchtodo•19m ago•1 comments

OpenAI to Buy Pinterest? Strategic Analysis

https://nekuda.substack.com/p/openai-to-buy-pinterest-heres-what
1•gmays•21m ago•0 comments

Vajra BM25 is a fast BM25 implementation in Python

https://twitter.com/aiexplorations/status/2009846407881212136
1•aiexplorations•24m ago•1 comments

Show HN: A website to save moments that remind you of someone

https://thisremindedme.com/
1•Winggo•24m ago•0 comments

Google and chatbot startup Character move to settle teen suicide lawsuits

https://www.washingtonpost.com/technology/2026/01/07/google-character-settle-lawsuits-suicide/
1•1vuio0pswjnm7•27m ago•0 comments

Agent skills: what can go wrong?

https://github.com/pors/skill-audit
1•pors•27m ago•0 comments

You probably don't need Oh My Zsh

https://rushter.com/blog/zsh-shell/
13•fla•28m ago•5 comments

Fix Your Robots.txt or Your Site Disappears from Google

https://www.alanwsmith.com/en/37/wa/jz/s1/
2•qingcharles•28m ago•1 comments

Show HN: VoiceBrainDump – voice-first idea capture, single HTML file, offline

https://voicebraindump.app/
1•digi_wares•32m ago•0 comments

Show HN: Focus timer that turns hours into assets

https://seton.run/
1•keplerjst•36m ago•0 comments

Kazakhstan Launches First Institute of Transport Sciences and Technologies

https://qazinform.com/news/kazakhstan-launches-first-institute-of-transport-sciences-and-technolo...
1•Bolat14•41m ago•0 comments

AI Flatters with Fidelity

https://lucent.substack.com/p/ai-flatters-with-fidelity
2•surprisetalk•42m ago•0 comments

Lidify: Self-hosted, on-demand audio streaming platform like Spotify

https://github.com/Chevron7Locked/lidify
1•thunderbong•45m ago•0 comments

Show HN: Rank up your local business on Google Maps

https://www.mapclimb.com/
3•bagusfarisa•45m ago•0 comments

The world has too much oil – Will companies want Venezuela's?

https://www.npr.org/2026/01/07/nx-s1-5668491/venezuela-oil-global-markets
4•geox•51m ago•0 comments

Elon Musk's Grok Has Friends in High Places: US Patent Office chief AI officer

https://jacobin.com/2026/01/grok-hayes-artificial-intelligence-deepfakes
2•wahnfrieden•52m ago•0 comments

Checks and Balances Are Dead

https://rall.com/2026/01/08/checks-and-balances-are-dead
6•SanjayMehta•52m ago•0 comments

M2.1: Multilingual and Multi-Task Coding with Strong Generalization

https://www.minimaxi.com/news/m21-multilingual-and-multi-task-coding-with-strong-general
1•gmays•55m ago•0 comments

Character.ai and Google agree to settle lawsuits over teen suicides

https://www.ft.com/content/ac518567-d901-4fae-86a3-eab54b12a81d
1•1vuio0pswjnm7•1h ago•0 comments

Demystifying Evals for AI Agents

https://www.anthropic.com/engineering/demystifying-evals-for-ai-agents
1•vinhnx•1h ago•0 comments

Best Practices for Coding with Agents

https://cursor.com/blog/agent-best-practices
1•vinhnx•1h ago•1 comments