Ask HN: How do you send large sets of data to an LLM

2•obayesshelton•10mo ago

So, I am hitting limits with the amount of data I am sending to Claude via the API.

I am trying to send about 5000 comments but I would love to send more but I am hitting limits of the message size.

What are some good design patterns when sending large sets of data to an LLM?

I ideally need to send all the data together at it gives context to the overall prompt.

Comments

curious_curios•10mo ago

Some approaches we’ve used:

- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.

- RAG where only relevant parts are included in the context.

- Use an LLM with a larger context window (like Gemini pro)

obayesshelton•10mo ago

Yeah, I think I need to use Gemini

Question, how if possible could you query rows in a table?

Surely the better approach would be to have some sort of connection to table rows?

Thorny issue plaguing lithium-ion batteries laid bare in new study

Mikk – your AI wrote the code but doesn't know what breaks

Show HN: Experiments Mapping the "Primitive Layer" in Language Models

Inverses

BYD's Brazil plant secures 100k vehicle orders from Argentina and Mexico

Show HN: Notebooklm-SDK – Unofficial Node.js/Bun Client for NotebookLM

Linux 7.0 Lands Improvements to Deal with Rust Changes, Build Reproducibility

Open Source PLFM Radar. Up to 20Km Range

Show HN: AntroCode-A zero-dependency,single-file local AI client,159 clone in 4D

Dyalog and AI [video]

Show HN: Agent 404 – Stop AI agents from hitting dead links and making things up

GlobalDex – AI agent readiness index with WebMCP detection

Show HN: Execute local LLM prompts in remote SSH shell sessions

LLM Time

He Was Chevron's Man in Venezuela–and a CIA Informant

Context windows aren't the bottleneck. Context quality is

Estaria – eBook Haven

Humanoid robots get to work at German BMW factory [video]

Writing a game of Snake in one language that compiles to 6 others natively

Ben Affleck sells his AI postproduction startup to Netflix

NetBlocks: Iran's internet blackout enters day 16

Brain Abstracted: Simplification in the History and Philosophy of Neuroscience

TLA+ as a Design Accelerator: Lessons from the Industry

Convictions for Parents of Teen Shooters Put Wyoming Gun Culture Under Scrutiny

An AI burned every credit staring at a shirt. That's not a tool

Reentrancy (Computing)

Show HN: I made an API letting people search in real AI – human conversations

Interactive Periodic Table of Oil shows key streams in global oil markets

BrokenArXiv: How often do LLMs claim to prove false theorems?

Comprehension Debt – the hidden cost of AI generated code