Ask HN: How do you send large sets of data to an LLM

2•obayesshelton•10mo ago

So, I am hitting limits with the amount of data I am sending to Claude via the API.

I am trying to send about 5000 comments but I would love to send more but I am hitting limits of the message size.

What are some good design patterns when sending large sets of data to an LLM?

I ideally need to send all the data together at it gives context to the overall prompt.

Comments

curious_curios•10mo ago

Some approaches we’ve used:

- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.

- RAG where only relevant parts are included in the context.

- Use an LLM with a larger context window (like Gemini pro)

obayesshelton•10mo ago

Yeah, I think I need to use Gemini

Question, how if possible could you query rows in a table?

Surely the better approach would be to have some sort of connection to table rows?

The Internet's Top Tech Publications Lost 58% of Their Google Traffic Since 2024

WorkOS now supports Fine-Grained Authorization

DevSwarm – Virtualize Git branches into concurrent development for AI agents

The halting problem in AI coding

Show HN: I made a little voice note recorder

Understanding UUIDs: From Basics to Generation in Linux, Python, and C#

Elevated errors on Claude Opus 4.6

Show HN: Kiln – WebGPU-native out-of-core volume rendering for multi-GB datasets

I'm losing the SEO battle for my own open source project

LLM needs a grandmother to prevent knowledge collapse

Bell Kiosk makes websites by hand for humans

Show HN: I built a 3D engine that turns PDFs into playable study worlds

Show HN: Oath – prove a human authorized each action before your AI agent acts

Too Use: The Bridge Between Software Engineering and Agentic AI

Ask HN: How many of you hold an amateur radio license in your country?

Show HN: Persistent Agent Framework – Self-Correcting AI Agents on Claude Code

Four months of Ruby Central moving Ruby backward

Show HN: FetchPrompt – Manage LLM prompts outside your code with a REST API

Show HN: SignalKit: Real-time audio DSP in pure Swift, zero dependencies

OpenAI amending contract with pentagon amid backlash

Show HN: Open-sourced AI Agent runtime (YAML-first)

Show HN: Mark your city and see where other builders are

Why mathematicians hate Good Will Hunting

Show HN: I built a proxy that cuts LLM costs 40-60% – no AI involved

Gibberlink aims to make phone calls more efficient (2025)

The Gram Editor

Hacking Involved in Khamenei Assassination

Show HN: Self-Protecting Files for the Agentic Era

Show HN: PrivacyShield – Mask your PII before it reaches ChatGPT/Claude

IT.System.Updates