Ask HN: How do you send large sets of data to an LLM

2•obayesshelton•1y ago

So, I am hitting limits with the amount of data I am sending to Claude via the API.

I am trying to send about 5000 comments but I would love to send more but I am hitting limits of the message size.

What are some good design patterns when sending large sets of data to an LLM?

I ideally need to send all the data together at it gives context to the overall prompt.

Comments

curious_curios•1y ago

Some approaches we’ve used:

- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.

- RAG where only relevant parts are included in the context.

- Use an LLM with a larger context window (like Gemini pro)

obayesshelton•1y ago

Yeah, I think I need to use Gemini

Question, how if possible could you query rows in a table?

Surely the better approach would be to have some sort of connection to table rows?

Find hiphop class near you

Apple to Drop the iPhone's Action Button Next Year

Galactica, a TypeScript codebase map for developers and agents

The Components of Agent Memory

A proof of the Aaronson‑Ambainis conjecture

Slonbase – A PocketBase like back end built on PostgreSQL

DailyCal Your Daily Calendar

Cyber Crime Investigation Masterclass – Complete Course (14 Video Chapters)

Stream generative UI with JSON-render

Are You Ready for Superintelligence?

Creating Logic Using Waves: Photonic Gates [video]

Do Not Tread Lightly

Major strawberry grower for Driscoll's calls it quits in coastal California

Daily game guess what old tech cost at launch (and where it was invented)

Unix Won over the World [video]

Cognitive Outsourcing and the Erosion of Collective Memory

Church quits role at AI startup claims 'sleazy' behavior stole credit

Dark personality levels relate to people's job interests and chosen careers

Do not ask "Is A a B?": Inheritance and the Is-A Trap

Ask HN: What tech companies do you think have a good moral compass?

Editing at the Speed of Thought in Emacs

Envelox: Private Email Client

Stanford scientists find solution to reverse coral bleaching

A Quantum Theorem Has Killed Einstein's Reality

Show HN: Tyler RSS – Open-source and feature-packed desktop RSS reader

SigmaTrace: Library-Agnostic Observability for CPU/GPU-Initiated RDMA Comms

Show HN: Diff MCP tool lists: one server added 33 tools, README unchanged

Kubernetes, mark II? Why Google's giving away gVisor used by A/ and OAI

Why Do We Build Fluxcut?

He Was a Suspect in the Yogurt Shop Murders for Thirty Years. He Can't Forget