frontpage.
newsnewestaskshowjobs

Open Source @Github

fp.

My Dog Ate a Pad or Tampon – What to Do Now – PetToxCheck

https://pettoxcheck.com/dogs/my-dog-ate-menstrual-pad/
1•adrian_pell•58s ago•0 comments

A Review of Alfred North Whitehead's "Introduction to Mathematics"

https://arxiv.org/abs/2403.19675
1•Alien1Being•1m ago•0 comments

Protein and amino acid restriction in aging and longevity

https://www.cell.com/cell-press-blue/fulltext/S3051-3839(26)00077-0
1•Alien1Being•4m ago•1 comments

Crocker's Land Expedition

https://en.wikipedia.org/wiki/Crocker_Land_Expedition
1•silver92bullet•5m ago•0 comments

Show HN: Hacker Series on AWS in zines way

https://securityzines.com/aws/
1•r0hi7•5m ago•0 comments

Cover Your Tracks See how trackers view the browser

https://coveryourtracks.eff.org/
1•colinprince•9m ago•0 comments

A typing idler game about fast takeoff

https://mbuffett.com/takeoff/
1•marcusbuffett•11m ago•1 comments

Show HN: WalletFeed, Apple Card Transactions to Webhooks, Sheets and S3

https://walletfeed.app/
1•phlhr•13m ago•0 comments

LeetCode adds vibe coding challenges now

https://leetcode.com/discuss/post/8614473/project-challenge-can-you-build-a-produc-27kz/
2•keyle•14m ago•1 comments

Show HN: AgentShield Zero-dep secret redactor and shell firewall for Claude

https://github.com/RitualDev-Lab/AgentShield
1•RitualDev•21m ago•0 comments

California state AG sues OpenAI over rogue agent incidents

https://techcrunch.com/2026/11/16/california-state-ag-sues-openai-over-rogue-agent-incidents/
1•gmays•22m ago•0 comments

AI-assisted code at scale: provenance, quality, centrality and review time

https://donsbot.com/2026/11/17/ai-assisted-code-at-scale-provenance-quality-centrality-and-review...
1•gbacon•26m ago•0 comments

Hex: Voice Dictation

https://anoma.ly/hex/
2•handfuloflight•30m ago•0 comments

AV1 vs. AV2: Which Video Codec Should You Use in 2026?

https://www.red5.net/blog/av1-vs-av2/
3•mondainx•34m ago•0 comments

How are large companies not ripshit about the frontier labs?

4•siraris•36m ago•0 comments

Skill Studio

https://verified-skill.com/desktop
1•handfuloflight•37m ago•0 comments

Skills Desktop

https://skills-desktop.vercel.app/
1•handfuloflight•39m ago•0 comments

Show HN: Motif, a tracker thin enough to be a sticker

https://motif.blog
2•prashaant•39m ago•0 comments

The Part About the Machines

https://thepointmag.com/examined-life/the-part-about-the-machines/
2•_delirium•40m ago•0 comments

Java4Shell (CVE-2026-114938): RCE in the OpenJDK Base64 decoder

https://mikiri.ai/attack-scenarios/java4shell/
1•srodionov•41m ago•1 comments

Attackers Used Optimizely to A/B Test Malware on Top Websites

https://krebsonsecurity.com/2026/11/attackers-used-optimizely-to-a-b-test-malware-on-top-websites/
1•chmaynard•45m ago•0 comments

Why is Gemini 4 Carbon taking so long?

https://kernel.dev/blog/why-is-gemini-4-carbon-taking-so-long/
4•deenadz•47m ago•0 comments

Building Lego Machines to Destroy Tall Lego Towers (2024)

https://kottke.org/24/07/building-lego-machines-to-destroy-tall-lego-towers
2•sammatilda•50m ago•0 comments

Measuring Alignment Eval Tells

https://metr.org/notes/2026-11-16-measuring-alignment-eval-tells/
1•gmays•52m ago•0 comments

A.I.'S People-Pleasing Problem

https://www.nytimes.com/2026/11/17/climate/climate-chatbots-people-pleasers.html
2•gumby•53m ago•3 comments

How "Independent" AI Safety Groups Are Pumping Anthropic IPO – Internet of Bugs

https://www.youtube.com/watch?v=pyRG_5dCrfg
3•agnosticmantis•56m ago•0 comments

Show HN: Recycle old hw HP Laserjet 1005 driver for Windows 11 x64 with Codex

https://github.com/hernandp/OpenHPZJS1005-x64-drv
2•hernandipietro•56m ago•0 comments

Provisioning Networks for AI Supercomputers: A Trace-Driven Study of Performance

https://arxiv.org/abs/2610.41700
2•matt_d•57m ago•0 comments

Show HN: Project badges to show LLM preferences

https://agentsp.lease/
3•jmhobbs•58m ago•1 comments

The Median Isn't the Message [pdf]

https://people.umass.edu/biep540w/pdf/Stephen%20Jay%20Gould.pdf
3•hiohio•1h ago•0 comments
Open in hackernews

Show HN: Fast and Quality Code Chunking with Chonkie

1•snyy•1y ago
Hi HN,

We’re Chonkie (https://github.com/chonkie-inc/chonkie) — we build open source tools that help split documents into meaningful chunks for use with AI models.

When you use LLMs over large documents or codebases, you often need to break them into smaller parts to fit the model’s context window. Our chunkers do this in a smart way: they preserve structure and meaning, so only the most relevant pieces are passed into the model. This reduces hallucinations, avoids confusion, and improves performance and accuracy.

Today we’re launching our Code Chunker — a fast, structure-aware way to break down source code into high-quality, token-aware chunks.

How it works:

(See the code: https://github.com/chonkie-inc/chonkie/blob/main/src/chonkie...)

Code Chunker uses tree-sitter (https://tree-sitter.github.io/tree-sitter/) to parse your code into an abstract syntax tree (AST). It then recursively merges and groups nodes in a way that respects both code structure and token limits.

It supports all languages that tree-sitter supports, and is designed to preserve formatting and semantics. Large functions or class definitions won’t be split in the middle of a block — instead, we dive recursively into the AST to produce clean, coherent chunks that fit your configured token budget.

What it’s useful for:

  - Embedding-based code search

  - RAG (retrieval-augmented generation) over codebases

  - Long-context analysis of code

  - Preparing repos for fine-tuning or pretraining
Try it out:

  - Open source package: https://docs.chonkie.ai/chunkers/code-chunker

  - Hosted playground (free with account): https://cloud.chonkie.ai
Happy Chonking!