Ask HN: How do you send large sets of data to an LLM

2•obayesshelton•10mo ago

So, I am hitting limits with the amount of data I am sending to Claude via the API.

I am trying to send about 5000 comments but I would love to send more but I am hitting limits of the message size.

What are some good design patterns when sending large sets of data to an LLM?

I ideally need to send all the data together at it gives context to the overall prompt.

Comments

curious_curios•10mo ago

Some approaches we’ve used:

- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.

- RAG where only relevant parts are included in the context.

- Use an LLM with a larger context window (like Gemini pro)

obayesshelton•10mo ago

Yeah, I think I need to use Gemini

Question, how if possible could you query rows in a table?

Surely the better approach would be to have some sort of connection to table rows?

Fooling Go's X.509 Certificate Verification

'To be free, we have to be feared,' Macron says in keynote nuclear speech

I built a pint-sized Macintosh

Ask HN: How to get traction for Open-Source Projects

Show HN: Proofbox – Defensive Publishing Platform to preserve freedom to operate

Building AI agent for our own company

Show HN: I built a social media distribution tool that helps you find users

Performance Analysis and Tuning on Modern CPUs 2nd edition [pdf]

Show HN: Neural Siege – A Multi-Agent RL Combat Simulation

4. How to Keep Using Nano Banana Pro After Gemini Replaces It with Nano Banana 2

Show HN: C-Suite Skills – a full exec team as skills

Veo 3 AI

Show HN: GitHub Repo Agent – an agent that explores and reasons on GitHub repos

I Put a Full JVM Inside a Browser Tab

Full speech pipeline in native Swift/MLX – ASR, TTS, speech-to-speech, on-device

People in northeast BC say rest of province should embrace year-round time zone

California to require age verification for all OS including Linux

Rare Not Random – Using Token Efficiency for Secrets Scanning

Strict Monospace Font for LLM-CLI users using Chinese Japanese Korean, CodexMono

Working on Things That Suck

Ask HN: How Do Emergency Alerts on Phone Work?

US President struggles to explain why he launched another Middle Eastern war

Apple Does Value (Week)

The Pointless War Between The Pentagon and Anthropic

Show HN: wo; a better CD for repo management

Show HN: AI gaming copilot that uses a phone camera instead of screen capture

OpenAI Amends A.I. Deal with The Pentagon

Show HN: Archilvx-Own your Twitter data because cloud tools will fail you

Israel hacked Iran traffic cams for years to pinpoint Khaemnei prior to strike

What 10 Years of Building Social Apps Taught Me