frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Ask HN: How do you send large sets of data to an LLM

2•obayesshelton•1y ago
So, I am hitting limits with the amount of data I am sending to Claude via the API.

I am trying to send about 5000 comments but I would love to send more but I am hitting limits of the message size.

What are some good design patterns when sending large sets of data to an LLM?

I ideally need to send all the data together at it gives context to the overall prompt.

Comments

curious_curios•1y ago
Some approaches we’ve used:

- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.

- RAG where only relevant parts are included in the context.

- Use an LLM with a larger context window (like Gemini pro)

obayesshelton•1y ago
Yeah, I think I need to use Gemini

Question, how if possible could you query rows in a table?

Surely the better approach would be to have some sort of connection to table rows?

Apple's iPhone camera chief, an opponent of AI-altered photos, has retired

https://www.dpreview.com/news/apples-iphone-camera-chief-has-retired/
1•DASD•2m ago•0 comments

Fuck You

2•titsAssFaceAgeX•3m ago•0 comments

Can Network Science Transform Health and Nutrition?

https://www.quantamagazine.org/can-network-science-transform-health-and-nutrition-20261112/
1•abixb•10m ago•0 comments

The No AI Slop Manifesto

https://gist.github.com/dexhorthy/4cc96f01be5b1208519e75dad250a948
2•ohjeez•14m ago•0 comments

Supposed Fired Rockstar Engineer Says GTAVI Makes Psychological Profiles

https://www.gadgetreview.com/man-claiming-to-be-fired-rockstar-engineer-says-gta-6-is-secretly-tr...
13•christhecaribou•20m ago•1 comments

Conic Sections Rebellion

https://en.wikipedia.org/wiki/Conic_Sections_Rebellion
3•subset•20m ago•0 comments

Chroma keying an image model to make stickers for my kids

https://sandkassa.app/en/workshop/green-screen-for-stickers
2•Espenhh•21m ago•1 comments

Show HN: Mount your iPhone as a filesystem on Linux over WiFi

https://github.com/Amirjon06/iphone-linux
1•Amirjon_Abd•22m ago•0 comments

SoftBank explored $1T buyout of SK Hynix

https://www.reuters.com/world/asia-pacific/softbanks-son-explored-1-trillion-buyout-sk-hynix-info...
4•linhns•24m ago•0 comments

Muru – Rust server for running ASGI and WSGI Python apps

https://github.com/muruhq/muru
1•vismit2000•26m ago•0 comments

Browser API for Utilizing On-Device Models

https://github.com/webmachinelearning/proposals/issues/22
2•kenzic•26m ago•0 comments

The Biggest Lie in the Jensen Huang Story

https://www.theringer.com/2026/11/18/tech/jensen-huang-nvidia-china-chips-ai-race
2•donbox•28m ago•0 comments

Claude Watermarks Your Words, and You Can't Check Them (Yet)

https://www.oreilly.com/radar/claude-watermarks-your-words-and-you-cant-check-them-yet/
4•Anon84•30m ago•0 comments

TonkAI – OpenAI-Compatible Gateway for GPT, Claude, Gemini, DeepSeek, and Qwen

https://tonkai.app/
1•reqz•33m ago•0 comments

High Agency

https://www.highagency.com/
2•xtacy•33m ago•0 comments

The Oracle of Bluegrass Bacon

https://pickipedia.xyz/bacon
1•jMyles•33m ago•1 comments

Show HN: Matinee – guess the year six films came out

https://matineegame.com/
1•Aeskiev•34m ago•1 comments

Leonida – PC Recompilation of the Xbox Version of GTA 6

https://github.com/ItsNotRexed/Leonida
2•ebrahimh•34m ago•0 comments

Automated K8s hill-climbing harness and tuning vLLM and SGLang on a single A100

https://github.com/johnsonshi/a100-inference-hillclimb
1•johnsonshi•35m ago•0 comments

24 Years of Derek Lowe's in the Pipeline: Topics, Trends, and Turning Points

https://analogintelligence.com/24-years-in-the-pipeline-derek-lowe-topics-trends-turning-points/
1•shagie•38m ago•0 comments

Mastodon instance hosting servers that allow you to have longer posts?

https://old.reddit.com/r/Mastodon/comments/1y25vgx/are_there_any_mastodon_instance_hosting_servers/
1•doener•48m ago•1 comments

Open-Source FPGA The "startup idea" to "go big fast"

1•daly•50m ago•2 comments

West Coast Customs Turns a Tesla Model 3 into a 1955 Chevy Bel Air

https://electrek.co/2026/11/18/west-coast-customs-tesla-model-3-1955-chevy-bel-air-ev/
2•MilnerRoute•51m ago•0 comments

Show HN: A phase diagram of CoreWeave's GPU economics, from its Q3 10-Q

https://erikbethke.com/coreweave/index.html
1•erikbethke•52m ago•1 comments

Leonardo de Moura, creator of the Lean proof assistent

https://en.wikipedia.org/wiki/Leonardo_de_Moura
1•tomtomtom777•54m ago•1 comments

lo-pi radio

https://pudding.cool/projects/lopi/
1•bookofjoe•55m ago•0 comments

The first conceptually aware space-time information platform

https://graphmetrix.com/TwinPod
1•gibsonf1•55m ago•0 comments

Send Something to 2050

https://the2050capsule.com/
2•zermelo_circle•1h ago•1 comments

ProDOS, Briefly: Checking a ProDOS volume's directory tree against its bitmap

https://norsewanderer.com/blog/BlogDSK6.html
1•mheilemann•1h ago•0 comments

GitHub's "Security Advisory Permissions" a win for OSS security sustainability

https://sethmlarson.dev/github-security-advisory-permissions-sustainability
1•lumpa•1h ago•0 comments