Ask HN: How do you send large sets of data to an LLM

2•obayesshelton•1y ago

So, I am hitting limits with the amount of data I am sending to Claude via the API.

I am trying to send about 5000 comments but I would love to send more but I am hitting limits of the message size.

What are some good design patterns when sending large sets of data to an LLM?

I ideally need to send all the data together at it gives context to the overall prompt.

Comments

curious_curios•1y ago

Some approaches we’ve used:

- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.

- RAG where only relevant parts are included in the context.

- Use an LLM with a larger context window (like Gemini pro)

obayesshelton•1y ago

Yeah, I think I need to use Gemini

Question, how if possible could you query rows in a table?

Surely the better approach would be to have some sort of connection to table rows?

Show HN: Dataforge Honeypot – Simple decoy system for LAN intrusion alerts

Apple, Google push for judicial oversight in Canada online safety bill

UK Births fall to the lowest level in 50 years

Authors Sue Meta's AI Scientists Directly in Llama Copyright Case

Securing Your AI Agent Infrastructure

Show HN: Remove Audio | mute any video in the browser, no upload

Anthropic co-founder hallucinates ghost in the machine

The LOGOS Framework: A five-level taxonomy for AI-assisted assessment

Prose programs are Markdown contracts agents can run

Removing Carbon using geochemistry and volcanic rocks

WP23

Champion ethical hacker warns AI tools like Mythos will make competing harder

IXI's autofocusing lenses are almost ready to replace multifocal glasses

Closely watched Parkinson's drug from Biogen, Denali comes up short

Fuelwise: Find the Cheapest Fuel Near You in Seconds

ARN: Local semantic memory server for AI agents (Pi 5, 22ms recall, 10/10 tests)

Germany Law to Force Algorithm Boost for State-Approved News

CC-Wiki: Turn Claude Code sessions into a shareable knowledge base wiki

Thornton Wilder's Last Play Vanished into Thin Air. Or Did It?

UK Visa Portal exposed applicants' passports and selfies

Volvo gets US approval to bypass Chinese connected-car ban

Show HN: Gandalf the Grader

Agents-Collab.md – A live handoff protocol for multi-agent projects

Ask HN: What would you like to rant about?

Thea Energy Raises $100M Series B Funding to Build Scalable Fusion Power Plants

What's an Entity, Anyway?

Atomically Precise Mechanosynthesis of Carbon Structures on Hydrogenated Si(100)

Windows computer-use: synthetic cursors for background agents

I found a second vote.gov – and it's registered to the White House

Building current, a browser-based file sharing tool, with Rust and WASM