frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Open in hackernews

Ask HN: How do you send large sets of data to an LLM

2•obayesshelton•1y ago
So, I am hitting limits with the amount of data I am sending to Claude via the API.

I am trying to send about 5000 comments but I would love to send more but I am hitting limits of the message size.

What are some good design patterns when sending large sets of data to an LLM?

I ideally need to send all the data together at it gives context to the overall prompt.

Comments

curious_curios•1y ago
Some approaches we’ve used:

- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.

- RAG where only relevant parts are included in the context.

- Use an LLM with a larger context window (like Gemini pro)

obayesshelton•1y ago
Yeah, I think I need to use Gemini

Question, how if possible could you query rows in a table?

Surely the better approach would be to have some sort of connection to table rows?

Climate Change Tracker

https://endtime-instruments.org/climate-tracker/
1•janoelze•17s ago•0 comments

Assistant Inside AirPods

https://www.airass.wtf/
1•josharsh•1m ago•0 comments

YC built software to run our internship expo – and an 8-bit SIM to show it off

https://www.ycombinator.com/software/blog/yc-unbroke-the-career-fair
1•ryankicks•2m ago•1 comments

Microsoft, the FAA, and Our Soviet Indifference to System Collapse

https://www.thebignewsletter.com/p/monopoly-round-up-microsoft-the-faa
1•PaulHoule•3m ago•0 comments

Adding Fortran Support to LLDB (GSoC 2026)

https://blog.llvm.org/posts/2026-09-07-gsoc-add-fortran-support-to-lldb/
1•JDevlieghere•4m ago•0 comments

Show HN: Cppgm compiles C++ to WASM 4x faster than Clang

https://incpption.com/
1•vishvananda•5m ago•0 comments

Show HN: One cloud computer for all your agents

https://box.simular.ai/
1•taro666•6m ago•1 comments

Jeremy Schneider: Postgres 18.7 Debian and RedHat Packagers Protect You

https://ardentperf.com/2026/11/13/postgres-18-7-debian-and-redhat-packagers-protect-you/
1•bashhq_r•6m ago•0 comments

Chase Bank is now also having a meltdown

https://twitter.com/downdetector/status/2122345174290374924
2•samk3nny•7m ago•1 comments

Open-sourced 100 dev tools(MIT). Host locally instead of pasting secrets online

https://github.com/redbison-dev/redbison-tools
1•redbisondev•7m ago•0 comments

Tailcat

https://tailscale.com/tailcat
1•bigwheels•9m ago•0 comments

Muse Charm – Personal AI Agent

https://www.meta.com/muse-charm/
1•qainsights•9m ago•0 comments

Introducing Solaris

https://runway.com/news/research/introducing-solaris
2•gmays•10m ago•1 comments

Ask HN: Gemini.Google.Com Changing Effort Level

1•yipinwong•11m ago•0 comments

Fable 5.2 creates an underwater world in a browser in only 96 KB

https://www.tomshardware.com/tech-industry/artificial-intelligence/fable-5-2-creates-an-underwate...
1•MC995•11m ago•1 comments

Superlite-cloud: open-source software factory

https://contextfirst.blog/superlite-cloud-a-code-factory/
1•iheatuchriswogu•12m ago•1 comments

The race to build autonomous war robots faces a problem

https://www.businessinsider.com/making-autonomous-war-robots-challenges-self-driving-cars-dont-uk...
1•cjaackie•13m ago•0 comments

OpenAI

1•commoner_•14m ago•0 comments

Tailscale Bash Prompt

https://feeding.cloud.geek.nz/posts/tailscale-bash-prompt/
1•speckx•15m ago•0 comments

Oracle Critical Security Patch Update Pre-Release Announcement – November 2026

https://www.oracle.com/security-alerts/cspunov2026.html
2•choult•15m ago•0 comments

Commerce Department moves to curb remote access to AI chips

https://www.cbsnews.com/news/nvidia-jensen-huang-commerce-department-limit-remote-access-ai-chips/
1•ijidak•16m ago•0 comments

Rakazo: Open-source Grok bot alternative

https://github.com/elie222/rakazo
1•cobri•16m ago•0 comments

Farenheit 451 [pdf]

https://dn790000.ca.archive.org/0/items/fahrenheit451_202004/Fahrenheit%20451.pdf
1•srirach•16m ago•1 comments

Artificial

https://thuo.org/artificial.html
1•thuo•16m ago•0 comments

Show HN: View – Build native Mac Mini apps with your own coding agent

https://useview.app/
1•deofoo•16m ago•0 comments

Research as a Hobby

https://andrewsarafa.ghost.io/research-as-a-hobby/
1•Frankie1862•17m ago•0 comments

Show HN: Dope Wars, rebuilt as a fake 1998 desktop in the browser

https://dopefront.com/
1•kyleclouthier•17m ago•0 comments

Databricks AI Index

https://developers.databricks.com/ai-index
1•pwendell•19m ago•1 comments

The reports of Stack Overflow's death are greatly exaggerated

https://stackoverflow.blog/2026/10/29/the-reports-of-stack-overflow-s-death-are-greatly-exaggerated/
2•ktosobcy•19m ago•1 comments

New decision model from Liquid AI top of AA index

https://www.liquid.ai/blog/d1-2
2•armcat•19m ago•0 comments