frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Ask HN: How do you send large sets of data to an LLM

2•obayesshelton•1y ago
So, I am hitting limits with the amount of data I am sending to Claude via the API.

I am trying to send about 5000 comments but I would love to send more but I am hitting limits of the message size.

What are some good design patterns when sending large sets of data to an LLM?

I ideally need to send all the data together at it gives context to the overall prompt.

Comments

curious_curios•1y ago
Some approaches we’ve used:

- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.

- RAG where only relevant parts are included in the context.

- Use an LLM with a larger context window (like Gemini pro)

obayesshelton•1y ago
Yeah, I think I need to use Gemini

Question, how if possible could you query rows in a table?

Surely the better approach would be to have some sort of connection to table rows?

Show HN: ClashPulse – a Mihomo client that switches nodes by real download tests

https://fishman.github.io/clashpulse/
1•rjzzleep•1m ago•0 comments

The Human Sacrifice Zone: Rare Earth Mining in Myanmar

https://www.tni.org/en/article/rare-earth-mining-in-myanmar?hl=en-US
1•paimapi•3m ago•0 comments

Show HN: Karaoke Is All You Need

https://github.com/holmesworcester/karaoke-is-all-you-need/
1•holmesworcester•4m ago•0 comments

Pion Interceptor: WebRTC for Hackers

https://pion.ly/blog/pion-interceptor-webrtc-for-hackers/
1•Sean-Der•6m ago•0 comments

Show HN: 100ms copy-on-write workspaces for AI agents on macOS

https://github.com/gabrielvfonseca/replica
1•gabrielfonseca•6m ago•0 comments

Build Windows C++ programs on Linux

https://github.com/abidanBrito/build-windows-on-linux
1•abidanbrito•7m ago•0 comments

Phishing at the Front Desk: Usable Security in Luxury Hotels

https://www.benthamsgaze.org/2026/11/11/phishing-at-the-front-desk-usable-security-in-luxury-hotels/
1•DASD•8m ago•0 comments

Sarasa Gothic Mono

https://picaq.github.io/sarasa/
1•birdculture•9m ago•0 comments

"The best escape room players" What Red Hat's AI architect thinks about agents

https://thenewstack.io/openshell-ai-agent-security/
1•CrankyBear•10m ago•0 comments

Patients Hospitalized with Psychosis or Mania After Abruptly Stopping GLP-1s

https://www.sciencealert.com/2-patients-have-been-hospitalized-with-psychosis-or-mania-after-abru...
1•speckx•12m ago•0 comments

On-device AI: new knowledge without fine-tuning

https://github.com/viperfoundation/Viper/blob/main/on-device-ai.md
1•designervoid•13m ago•1 comments

Show HN: Signature benchmark, designed for engineering leaders

https://fairbake.dev/signature/
2•ariwilson•13m ago•0 comments

Show HN: Intercede – A Patron Saint for the Browser

https://intercede.wyattsell.com/
1•wyattsell•14m ago•0 comments

Why educational system is broken

https://keycybermonk.com/edu
4•makosst•15m ago•0 comments

AI-Free FOSS Alternatives

https://codeberg.org/ethical-foss/ai-free-foss-alternatives
3•bemtevi•16m ago•0 comments

Unblockable Communication with Gravity

https://www.science.org/doi/10.1126/sciadv.aee0802
1•itcmcgrath•17m ago•0 comments

AI Bots Broke It

https://travelingluck.com/
1•absoluteleyyes•18m ago•0 comments

Show HN: Brume – video, GIF and image tools that run in the browser

https://brume.tools/
1•cesarvenzac•18m ago•0 comments

MAI Licensed Weights: Frontier Performance You Control – Microsoft AI

https://microsoft.ai/news/introducing-mai-licensed-weights/
2•htk•23m ago•0 comments

Sashiko: Lessons from building an agentic code review system for Linux

https://cloud.google.com/blog/products/application-development/lessons-from-building-sashiko-an-a...
1•matt_d•24m ago•0 comments

The Wachowskis Are Reclaiming 'The Matrix'

https://puck.news/hollywood/2026/11/the-wachowskis-are-reclaiming-the-matrix
3•donohoe•25m ago•0 comments

US charges Irishman with destroying a $60M Air Force C-130

https://taskandpurpose.com/news/c-130-damage-ireland-daithi-ocorrain/
12•ilamont•27m ago•4 comments

LLM Assisted Reverse Engineering

https://www.slowchronicle.com/posts/llm-assisted-reverse-engineering
2•ioma8•28m ago•0 comments

Shaping the Loops, Closing the Loops

https://revyl.com/blog/pattern-engineering/
3•based0x10•28m ago•2 comments

X/Twitter Banned Roboclawbot?

https://x.com/roboclawbot
1•Iolaum•29m ago•2 comments

Project Natick: the cloud, under the sea

https://en.wikipedia.org/wiki/Project_Natick
1•simonebrunozzi•29m ago•0 comments

Forks and Spoons: Uniting over AI Differences in Free Software

https://www.oblomovka.com/wp/2026/11/16/forks-and-spoons-uniting-over-ai-differences-in-free-soft...
1•dannyobrien•29m ago•0 comments

GTA6-like as a 942Kb UEFI bootable image

https://github.com/eklavya-raj/gta6-uefi
3•bananaboy•31m ago•0 comments

AI Access Index, Nov 2026: how 684 of the topk hostnames treat AI crawlers

https://www.crawlreadiness.com/ai-access-index/2026-11
1•grubbomatic•32m ago•0 comments

Show HN: Boo-Mas

https://robinduckett.github.io/boo-mas/
1•robinduckett•33m ago•0 comments