frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

Watch How the Office Became the Worst Place to Do Work [video]

https://www.wsj.com/tech/personal-tech/watch-how-the-office-became-the-worst-place-to-actually-do...
2•erickhill•3m ago•1 comments

Anatomia Di Tor – The Tor Protocol, Byte by Byte

https://github.com/aleff-github/onion-routing-anatomy
1•aleff•4m ago•0 comments

XiangShan Tapeout History

https://docs.xiangshan.cc/zh-cn/latest/tapeout/
1•camel-cdr•4m ago•0 comments

A New Shape for Work

https://www.notion.com/a-new-shape-for-work
1•pikdum•8m ago•0 comments

Making torch_remat work in TorchTitan

https://docs.pytorch.org/devlogs/distributed/2026-11-19-torch-remat-in-torchtitan/
1•matt_d•12m ago•0 comments

Forensic dissection of Roland J-6's 64 presets: measuring the hidden settings

https://github.com/liotier/RolandStuff/blob/main/J-6_presets_measurement/README.md
1•liotier•17m ago•0 comments

Is Ssense Pivoting to AI Slop?

https://www.thecut.com/article/is-ssense-pivoting-to-ai-slop.html
1•randycupertino•18m ago•1 comments

Your target market isn't demographic (2025)

https://longform.asmartbear.com/target-market/
2•mooreds•19m ago•0 comments

How to generate an accessible color palette from a single color

https://taisho.design/en/blog/accessible-color-palette-from-one-color
2•PabloDiFIlippo•21m ago•0 comments

Scaling Postgres to 1M durable workflows per second

https://www.dbos.dev/blog/one-million-workflows
3•KraftyOne•21m ago•0 comments

Show HN: Primeward – Exploring a stateful recurrence for the next prime

1•alexhr•29m ago•0 comments

Vulcan Street Plant

https://en.wikipedia.org/wiki/Vulcan_Street_Plant
1•_doctor_love•31m ago•0 comments

Catching Crumbs from the Table [pdf]

https://gwern.net/doc/fiction/science-fiction/2000-chiang.pdf
2•gchamonlive•31m ago•1 comments

Show HN: Jam – A music making game where you play gigs to earn studio gear

https://jam.resonantdsp.com
1•garrinm•33m ago•0 comments

Athanor (furnace)

https://en.wikipedia.org/wiki/Athanor
1•_doctor_love•39m ago•0 comments

Show HN: Park – save and recall work context across repos and machines

https://svandragt.github.io/park/
1•pacifika•41m ago•3 comments

Ask HN: How do you keep code review skills when agents write most of the code?

1•robinmin•41m ago•0 comments

Re: Riemann

https://borretti.me/article/re-riemann
10•_dain_•42m ago•1 comments

Petrucci Music Library

https://imslp.org
1•yetanotheruser•48m ago•0 comments

Help github just deleted me

https://nate.mecca1.net/posts/2026-11-20_help/
42•01nate•49m ago•20 comments

AI models change their answers when they are monitored

https://www.jordannews.jo/Section-129/Technology/AI-models-change-their-answers-when-they-are-mon...
2•nreece•51m ago•0 comments

Show HN: SaturnSQL Context, telling AI tools what the database means

https://saturnsql.com/context-layer
2•infr88•52m ago•0 comments

Real-Time Video on Embedded Linux Cameras with WebRTC

https://interrupt.memfault.com/blog/real-time-video-webrtc
2•hasheddan•52m ago•0 comments

Uncontacted Indigenous people emerge from Amazon forest to ask for food

https://www.washingtonpost.com/world/2026/11/19/uncontacted-indigenous-people-emerge-amazon-fores...
13•Teever•53m ago•0 comments

A human liver has been kept alive outside the body for a record seven weeks

https://www.technologyreview.com/2026/11/19/1148934/a-human-liver-has-been-kept-alive-outside-the...
9•bookofjoe•54m ago•1 comments

Officials approved the sale of 580k Nvidia chips to Chinese companies

https://www.washingtonpost.com/technology/2026/11/20/officials-approved-sale-580000-nvidia-chips-...
7•cdrnsf•54m ago•3 comments

Serious cyberattack thought backed by wealthy operators

https://www.ruv.is/english/2026-11-20-serious-cyberattack-thought-backed-by-wealthy-operators-493411
4•Bender•55m ago•1 comments

White House removes cyber-security chief after series of tech outages

https://www.bbc.com/news/articles/cwz0k3nn5p5mo
4•Lyngbakr•58m ago•0 comments

How to Be a 10x Engineer in 2027 and Beyond

https://serce.me/posts/2026-11-19-how-to-become-a-10x-engineer-in-2027-and-beyond
2•SerCe•59m ago•0 comments

ICE details Princeton neuroscientist claiming asylum

https://www.theguardian.com/us-news/2026/nov/20/princeton-doctoral-student-reportedly-detained-ice
7•angry_octet•1h ago•2 comments
Open in hackernews

Ask HN: How do you send large sets of data to an LLM

2•obayesshelton•1y ago
So, I am hitting limits with the amount of data I am sending to Claude via the API.

I am trying to send about 5000 comments but I would love to send more but I am hitting limits of the message size.

What are some good design patterns when sending large sets of data to an LLM?

I ideally need to send all the data together at it gives context to the overall prompt.

Comments

curious_curios•1y ago
Some approaches we’ve used:

- Group the comments by theme, then pass groups to the LLM to summarize/deduplicate then pass the outputs of that as context.

- RAG where only relevant parts are included in the context.

- Use an LLM with a larger context window (like Gemini pro)

obayesshelton•1y ago
Yeah, I think I need to use Gemini

Question, how if possible could you query rows in a table?

Surely the better approach would be to have some sort of connection to table rows?