Ask HN: How do you send large sets of data to an LLM

2•obayesshelton•1y ago

So, I am hitting limits with the amount of data I am sending to Claude via the API.

I am trying to send about 5000 comments but I would love to send more but I am hitting limits of the message size.

What are some good design patterns when sending large sets of data to an LLM?

I ideally need to send all the data together at it gives context to the overall prompt.

Comments

curious_curios•1y ago

Some approaches we’ve used:

- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.

- RAG where only relevant parts are included in the context.

- Use an LLM with a larger context window (like Gemini pro)

obayesshelton•1y ago

Yeah, I think I need to use Gemini

Question, how if possible could you query rows in a table?

Surely the better approach would be to have some sort of connection to table rows?

Open knowledge compiler: a compiler for the open knowledge format

Chatbots are doing the work of Congress with little oversight

DeepSeek peak/off-peak pricing update

Gemini 3.7 Flash: On the Intelligence vs. Time per Task Pareto frontier

I burned $157,143 in tokens last month. I paid $400

Show HN: RAGless – similar to RAG, but $0 LLM API costs at runtime

Super Mario Bros. speedrunning

Pinterest Dark Mode and Theme

Ketamine increases neuroplasticity in female mice but not in males

Bring your spreadsheet data to life with Sheets canvas

Announcement on DeepSeek V4 API New Pricing

How to export ChatGPT chat to pdf, word and Google Docs [video]

The Empty Nest Scenario

EU AI Act and C2PA: What Article 50 Requires

I’m a very slow thinker (2016)

The continuing "Q collar" scandal

Contiguous US breaks its record for hottest month ever, NOAA says

Scalable watermarking for identifying large language model outputs

NHS bans pagers due to lack of encryption

Openring: A webring for static site generators

Show HN: OpenComplAI – open-source EU AI Act compliance checks in CI/CD

Show HN: Fail the Build on Direct Service Calls

Mistral is serving GLM 5.2

New DeepSeek Pricing Published (Peak and Off-Peak)

The Importance of Whimsy

Let's not call it "tech debt," it's just "mess"

Drift Anchor -quick access to your proven AI prompts

The Reason Data Center Gas Power Plants Are So Dirty

Building a practical path to post-quantum cryptography

There Is Still No Silver Bullet