Ask HN: How do you send large sets of data to an LLM

2•obayesshelton•10mo ago

So, I am hitting limits with the amount of data I am sending to Claude via the API.

I am trying to send about 5000 comments but I would love to send more but I am hitting limits of the message size.

What are some good design patterns when sending large sets of data to an LLM?

I ideally need to send all the data together at it gives context to the overall prompt.

Comments

curious_curios•10mo ago

Some approaches we’ve used:

- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.

- RAG where only relevant parts are included in the context.

- Use an LLM with a larger context window (like Gemini pro)

obayesshelton•10mo ago

Yeah, I think I need to use Gemini

Question, how if possible could you query rows in a table?

Surely the better approach would be to have some sort of connection to table rows?

M5 Max MacBook Pro Review: Preeminent Power in the Same Old Shell

North Korea Was Right About Nuclear Weapons

Compass CNC was taken down. Probably by Shaper Tools

Sandboxing Agents

Codeown – A platform for developers to document their building journey

Apologies for earlier submissions, still learning the rules

Open-source DCF engine based on Damodaran's datasets with LLM narratives

OLAP Is All You Need: How We Built Reddit's Logging Platform

Sensational news. Fintech has published banking secrets for public access

Too much color: how many decimal places do you need?

Don't worry, Valve still plans to launch the Steam Machine "this year"

Permission denied:Help stop Google's attack on free and open Android development

Spectrogram Text Art with MiniDSP

AI unlocking new treatments for 'incurable' diseases

Ask HN: What are some good AI usage policies?

Miguel: An AI agent that modifies its own source code, sandboxed in Docker

If the differentiation is domain and GTM?

TLA+ as a Design Accelerator: Lessons from the Industry

Tells your next sick day ('Sick Clock') [video]

Clock – Variable Font

Trion: A Behavioral Oracle That Derived Truth from On-Chain History Not Price

Show HN: Rampart – Open-source firewall for AI agents (v0.8)

Markdown Files Won't Make You an Engineer

Build to Capture, Not to Last

Testing Nvidia's FP4: Running 70B LLMs on a Single RTX 5090 with Real Benchmarks

U.S. DOJ Attorney: I used AI to try and replicate my prior [deleted] work

Is Spotify Enabling Impersonation of Famous Jazz Musicians?

Tell HN: Beware of Mac Studio Scams on eBay

What's My ΔE(OK) JND?

Punching, Slamming, Screaming: A Chef's Past Abuse Haunts Noma