Ask HN: How do you send large sets of data to an LLM

2•obayesshelton•1y ago

So, I am hitting limits with the amount of data I am sending to Claude via the API.

I am trying to send about 5000 comments but I would love to send more but I am hitting limits of the message size.

What are some good design patterns when sending large sets of data to an LLM?

I ideally need to send all the data together at it gives context to the overall prompt.

Comments

curious_curios•1y ago

Some approaches we’ve used:

- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.

- RAG where only relevant parts are included in the context.

- Use an LLM with a larger context window (like Gemini pro)

obayesshelton•1y ago

Yeah, I think I need to use Gemini

Question, how if possible could you query rows in a table?

Surely the better approach would be to have some sort of connection to table rows?

Zugzwang

If Claude writes the code, what makes me still a developer?

Santa Cruz restaurant changes logo after flurry of negative reviews for AI art

LLMs consistently pick resumes they generate over ones by humans or other models

Domination: A contrarian view of AI risk (2024)

I moved my blog from Jekyll to Emacs Lisp

The History of Lipstick

Alberta allows windfall oil and gas payments to select ranchers – on public land

US blockade costs Iran $4.8B, US Navy acting 'sort of like pirates,' Trump says

A preliminary model to establish a digital twin for coffee roasting

Show HN: RegularMonk – a web app that helps me use my phone less

Apple Faces Lawsuits over AirTag Stalking After Class Action Denied

Make Common Sense Common Again

Stackless coroutines for gamedev in ~200 lines of C++

Proudly Pathetic

NASA to increase CLPS contract to support surge of lunar lander missions

America's Expanding Domestic Surveillance

The Fake Hawaii CTO Who Fooled Everyone

Apple Stores Targeted in $16.2M Counterfeit Device Scheme

Docker vs. Podman: Which Containerization Tool Is Right for You – DataCamp

Ask HN:Do people configure Claude Code to use other models

LibreLocal 2026 – Global Meetups Across Six Continents

We Forgot How to Write

Sebastian Proactive: a local‑first AI companion that initiates conversations

Chinese AI models are ~8 months behind and falling further behind

Path to Vibe Engineering

Zig's issue tracker got 3k spam issues in 20 minutes

B.C. researcher taps magic of Dungeons and Dragons to help kids

Tim Cook, the interview: Running Apple 'is sort of a lonely job' (2016)

Here's Looking at Euclid: 3D Paper Models of Oliver Byrne's Euclid's Elements