Ask HN: How do you send large sets of data to an LLM

2•obayesshelton•6mo ago

So, I am hitting limits with the amount of data I am sending to Claude via the API.

I am trying to send about 5000 comments but I would love to send more but I am hitting limits of the message size.

What are some good design patterns when sending large sets of data to an LLM?

I ideally need to send all the data together at it gives context to the overall prompt.

Comments

curious_curios•6mo ago

Some approaches we’ve used:

- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.

- RAG where only relevant parts are included in the context.

- Use an LLM with a larger context window (like Gemini pro)

obayesshelton•6mo ago

Yeah, I think I need to use Gemini

Question, how if possible could you query rows in a table?

Surely the better approach would be to have some sort of connection to table rows?

Show HN: Discussion of ICT Model – Linking Information, Consciousness and Time

The first-ever protocol for websites and AI browsers to cooperate

Exposing and Exploiting Incomplete Branch Predictor Isolation in Cloud

Minimal Periodic Task Runner in Elixir

Ask HN: What insight or habit has led to a breakthrough in your mental health?

Selection and transmission of gut microbiome alone can shift mammalian behavior

My Professional X Account Was Hacked and X Support Won't Help Me

DoorDash Says Personal Information Stolen in Data Breach

Europol takes down more than 1k malicious servers in Operation Endgame

Amazon finds 150K NPM packages linked to token-farming campaign

Apple to Change Designs and Release Schedule

How We Built and Launched an MVP During Techstars

Linus Pauling

Building a Crowd-Feeding platform. Donors fund meals, Restaurants serve them

Show HN: I built and AI phone system and wrote a step by step instructions

Soccer, emeralds and cocaine: The 'new' Colombian drug lords with ties to Spain

U.N. Security Council Adopts U.S. Peace Plan for Gaza

'Ugly' Technicals Put the US Stock Rally at Risk of Correction

Randomized Banner Icons with JavaScript and Astro Framework

Lower Than London

Show HN: I developed an IDE tailored for Python developers

Valar Atomics Says It's the First Nuclear Startup to Achieve Criticality

Growth of global GDP per head has been remarkably steady over the past 3 decades

Eurofiber admits crooks swiped data from French unit after cyberattack

Another Designer Leaves Apple

Iframe with Hot Reload for Code Agents

Epstein files: Larry Summers steps back from commitments over email fallout

Parasitic ant tricks workers into killing their queen, then takes the throne

Legendary game designer, programmer Rebecca Heineman has died

Physical Intelligence: A VLA That Learns From Experience